-- Logs begin at Sat 2022-06-25 20:01:14 UTC, end at Sat 2022-06-25 22:30:27 UTC. -- Jun 25 20:40:41.644797 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 25 20:40:41.654117 ncdv-master-1 devstack@n-api.service[121559]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 20:40:41 2022] *** Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: nodename: ncdv-master-1 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: machine: x86_64 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: clock source: unix Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: pcre jit disabled Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: detected number of CPU cores: 4 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: current working directory: / Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: detected binary path: /usr/bin/uwsgi-core Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: your processes number limit is 47680 Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: your memory page size is 4096 bytes Jun 25 20:40:41.655858 ncdv-master-1 devstack@n-api.service[121559]: detected max file descriptor number: 2048 Jun 25 20:40:41.656805 ncdv-master-1 devstack@n-api.service[121559]: lock engine: pthread robust mutexes Jun 25 20:40:41.656805 ncdv-master-1 devstack@n-api.service[121559]: thunder lock: enabled Jun 25 20:40:41.656805 ncdv-master-1 devstack@n-api.service[121559]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 25 20:40:41.656805 ncdv-master-1 devstack@n-api.service[121559]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 20:40:41.704939 ncdv-master-1 devstack@n-api.service[121559]: Python main interpreter initialized at 0x55f8ccddf9c0 Jun 25 20:40:41.704939 ncdv-master-1 devstack@n-api.service[121559]: python threads support enabled Jun 25 20:40:41.704939 ncdv-master-1 devstack@n-api.service[121559]: your server socket listen backlog is limited to 100 connections Jun 25 20:40:41.704939 ncdv-master-1 devstack@n-api.service[121559]: your mercy for graceful operations on workers is 90 seconds Jun 25 20:40:41.705358 ncdv-master-1 devstack@n-api.service[121559]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 20:40:41.705358 ncdv-master-1 devstack@n-api.service[121559]: *** Operational MODE: preforking *** Jun 25 20:40:41.705619 ncdv-master-1 devstack@n-api.service[121559]: *** uWSGI is running in multiple interpreter mode *** Jun 25 20:40:41.705619 ncdv-master-1 devstack@n-api.service[121559]: spawned uWSGI master process (pid: 121559) Jun 25 20:40:41.705844 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 25 20:40:41.709780 ncdv-master-1 devstack@n-api.service[121559]: spawned uWSGI worker 1 (pid: 121560, cores: 1) Jun 25 20:40:41.709780 ncdv-master-1 devstack@n-api.service[121559]: spawned uWSGI worker 2 (pid: 121561, cores: 1) Jun 25 20:40:41.709780 ncdv-master-1 devstack@n-api.service[121559]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 20:40:43.008596 ncdv-master-1 devstack@n-api.service[121561]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 20:40:43.010953 ncdv-master-1 devstack@n-api.service[121560]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 20:40:43.681994 ncdv-master-1 devstack@n-api.service[121561]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:40:43.681994 ncdv-master-1 devstack@n-api.service[121561]: from cryptography.utils import int_from_bytes Jun 25 20:40:43.682338 ncdv-master-1 devstack@n-api.service[121561]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:40:43.682338 ncdv-master-1 devstack@n-api.service[121561]: from cryptography.utils import int_from_bytes Jun 25 20:40:43.702586 ncdv-master-1 devstack@n-api.service[121560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:40:43.702586 ncdv-master-1 devstack@n-api.service[121560]: from cryptography.utils import int_from_bytes Jun 25 20:40:43.702893 ncdv-master-1 devstack@n-api.service[121560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:40:43.702893 ncdv-master-1 devstack@n-api.service[121560]: from cryptography.utils import int_from_bytes Jun 25 20:40:46.234427 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:40:46.234999 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:40:46.235177 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:40:46.235536 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:40:46.235763 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:40:46.236164 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.236528 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.236847 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.237161 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.237490 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.237794 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.238108 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.238404 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.238725 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.238978 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.239280 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.239595 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.239907 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.240208 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.240534 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.240833 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.241131 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.241465 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.241747 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.241959 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:40:46.243542 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:40:46.243680 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.243680 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.243946 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:40:46.244057 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.244175 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:40:46.244304 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.244465 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:40:46.244605 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.244733 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.244848 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.244973 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245096 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245226 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245374 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245494 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245611 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245736 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245860 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.245991 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246119 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246243 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246361 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246488 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246612 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246777 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.246891 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247016 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247142 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247271 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247396 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247516 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247643 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247759 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.247963 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248092 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248221 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248346 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248478 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248609 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248741 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248861 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.248986 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249110 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249239 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249363 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249492 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249704 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.249906 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250038 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250158 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250290 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250421 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250548 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250690 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250861 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.250992 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251153 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251282 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251473 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251649 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251801 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.251932 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252059 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252213 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252342 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252503 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252632 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252757 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.252876 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253135 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253321 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253464 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253597 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253723 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253844 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.253975 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254102 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254220 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254446 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254623 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254766 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.254890 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255018 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255144 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255331 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255474 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255648 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255751 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.255948 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256051 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256246 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256348 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256587 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256693 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256896 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.256984 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257211 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257303 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257513 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257599 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257821 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.257914 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258126 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258224 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258439 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258537 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258737 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.258840 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259040 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259145 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259290 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259377 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259597 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259690 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.259923 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260021 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260236 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260327 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260557 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260647 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260824 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.260921 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261126 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261226 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261446 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261538 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261770 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.261958 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262099 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262223 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262350 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262485 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262606 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262724 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.262915 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263046 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263171 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263304 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263423 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263541 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263716 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.263840 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264013 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264154 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264305 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264449 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264626 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264762 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.264924 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265056 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265224 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265359 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265521 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265643 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.265819 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266025 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266150 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266275 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266402 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266571 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266703 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.266914 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267038 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267234 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267356 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267544 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267676 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267840 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.267962 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268137 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268266 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268473 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268614 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268744 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.268863 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269052 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269183 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269352 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269483 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269650 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269772 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.269962 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270086 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270211 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270341 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270497 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270626 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270800 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.270928 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271118 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271256 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271414 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271535 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271716 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.271843 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272049 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272173 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272293 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272450 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272620 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272751 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.272915 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273037 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273214 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273344 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273508 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273630 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273803 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.273933 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274096 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274229 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274392 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274520 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274685 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274816 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.274978 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275100 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275268 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275392 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275578 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275708 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.275887 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276007 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276221 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276351 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276499 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276650 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.276818 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.277128 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.277249 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.277455 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.277581 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.277777 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.277905 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.278085 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.278207 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.278407 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.278547 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.278712 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.278835 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.279018 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.279251 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.279382 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.279625 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.279787 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.279916 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.280241 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.280362 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.280566 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.280844 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.280966 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.281176 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.281303 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.281482 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.281736 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.281860 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.282075 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.282292 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.282414 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.282669 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.282798 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.282974 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.283274 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.283394 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.283577 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.283789 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.283913 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.284135 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.284257 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.284486 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.284612 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.284807 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.285041 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.285172 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.285404 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.285551 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.285721 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:40:46.286056 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.286175 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.286391 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.286513 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.286735 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.286869 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287052 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287179 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287368 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287487 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287703 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.287840 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288019 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288140 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288331 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288487 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288678 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288810 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.288997 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289119 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289309 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289431 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289618 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289749 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.289925 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290049 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290242 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290363 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290559 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290692 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290868 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.290996 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291183 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291315 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291491 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291621 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291795 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.291917 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.292180 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.292402 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.292570 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.292761 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.292883 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293098 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293220 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293425 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293555 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293741 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.293862 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294082 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294203 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294398 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294528 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294710 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.294839 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295018 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295140 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295369 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295492 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295610 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295744 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.295898 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296022 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296198 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296322 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296531 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296673 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296834 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.296963 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297150 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297274 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297471 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297594 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297773 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.297903 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298097 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298219 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298395 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298523 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298699 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.298821 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299003 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299134 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299307 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299429 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299607 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299747 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.299913 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300044 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300215 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300337 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300540 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300681 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300858 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.300987 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301164 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301293 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301468 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301600 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301773 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.301895 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302075 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302195 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302377 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302509 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302684 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302807 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.302985 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303104 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303289 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303410 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303594 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303726 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.303900 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304024 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304217 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304341 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304549 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304671 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304856 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.304977 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305163 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305286 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305473 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305595 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305779 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.305903 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306090 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306212 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306400 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306517 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306706 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.306843 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307003 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307124 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307307 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307436 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307609 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307745 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.307936 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308058 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308234 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308358 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308563 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308707 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308863 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.308986 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309161 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309294 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309457 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309588 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309756 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.309878 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310054 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310175 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310369 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310498 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310672 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310793 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.310969 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311092 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311269 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311392 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311568 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311701 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.311906 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312027 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312207 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312337 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312564 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312687 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.312889 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313007 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313195 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313295 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313506 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313617 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313810 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.313919 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314113 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314198 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314416 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314509 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314720 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.314815 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315020 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315112 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315321 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315418 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315622 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315721 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.315925 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316020 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316227 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316319 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316566 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316714 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316874 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.316995 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317176 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317307 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317478 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317600 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317775 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.317896 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318083 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318251 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318404 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318527 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318729 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.318850 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319040 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319162 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319356 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319481 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319660 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319783 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.319966 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320089 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320270 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320393 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320603 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320726 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.320909 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321044 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321216 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321347 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321527 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321647 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321829 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.321959 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322140 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322267 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322444 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322575 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322749 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.322883 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323053 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323174 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323365 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323662 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323800 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.323997 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324119 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324237 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324355 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324506 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324674 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.324804 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325010 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325132 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325327 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325448 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325650 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.325872 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.326003 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.326260 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.326415 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.326568 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.326878 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327000 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327187 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327318 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327497 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327801 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.327939 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.328111 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.328348 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.328541 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.328747 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.328873 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.329069 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.329379 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.329508 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.329698 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.329827 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330002 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330147 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330320 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330465 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330647 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.330982 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.331120 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.331288 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.331563 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.331774 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.331897 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332016 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332205 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332336 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332548 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332670 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.332878 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333006 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333189 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333311 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333496 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333618 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333803 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.333934 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334115 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334237 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334422 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334544 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334729 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.334858 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335037 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335168 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335342 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335470 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335645 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335777 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.335946 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336068 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336249 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336377 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336587 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336720 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.336910 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337032 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337222 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337345 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337538 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337669 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337857 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.337976 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338161 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338285 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338469 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338592 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338791 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.338913 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339124 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339248 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339430 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339565 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339734 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.339855 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340038 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340158 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340345 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340499 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340680 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340804 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.340989 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341111 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341302 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341425 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341604 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341732 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.341912 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342044 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342220 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342351 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342521 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342644 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342828 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.342959 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.343141 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.343272 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.343454 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.343709 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.343846 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344038 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344169 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344350 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344489 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344682 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344803 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.344996 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345127 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345309 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345429 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345613 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345745 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.345924 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.346046 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.346233 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.346355 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.346859 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.346996 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.347168 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.347290 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.347466 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.347587 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.347769 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348038 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348170 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348362 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348501 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348690 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348814 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.348989 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349120 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349296 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349418 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349597 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349720 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.349897 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350028 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350197 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350320 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350497 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350619 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350823 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.350959 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351090 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351211 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351387 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351511 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351685 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.351807 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352005 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352128 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352312 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352469 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352636 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352778 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.352935 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353067 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353237 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353360 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353537 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353667 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353846 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.353968 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354151 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354272 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354459 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354602 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354820 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.354950 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355127 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355261 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355436 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355569 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355741 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.355863 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356065 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356188 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356370 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356545 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356694 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356817 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.356997 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357117 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357298 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357431 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357596 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357726 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.357903 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358037 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358206 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358330 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358510 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358632 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358815 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.358947 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359114 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359239 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359418 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359541 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359716 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.359852 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360026 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360149 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360329 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360475 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360663 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360805 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.360961 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361083 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361267 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361401 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361571 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361703 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361868 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.361991 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362168 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362291 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362463 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362586 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362775 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.362900 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363073 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363199 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363360 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363490 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363657 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363799 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.363959 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364081 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364260 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364390 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364589 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364711 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364878 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.364998 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365180 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365310 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365477 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365607 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365773 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.365903 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366074 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366197 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366375 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366503 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366670 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366800 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.366972 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367094 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367276 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367396 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367582 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367713 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367877 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.367997 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368181 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368304 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368502 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368637 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368800 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.368920 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369096 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369225 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369398 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369532 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369693 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369816 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.369989 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370110 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370303 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370437 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370601 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370725 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.370897 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371018 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371211 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371335 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371512 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371642 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371809 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.371932 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372106 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372229 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372401 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372547 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372727 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.372860 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373033 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373155 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373343 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373464 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373646 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373776 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.373950 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374073 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374253 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374369 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374555 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374685 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374858 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.374980 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375163 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375283 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375459 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375590 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375764 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.375884 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376070 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376188 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376385 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376515 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376696 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376782 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.376993 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377088 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377310 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377445 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377616 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377747 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.377921 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378051 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378236 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378360 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378550 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378672 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378858 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.378985 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379153 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379283 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379454 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379577 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379759 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.379880 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380061 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380186 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380365 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380503 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380693 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.380826 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381002 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381124 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381307 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381428 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381611 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381744 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.381917 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382046 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382221 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382355 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382521 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382653 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382822 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.382946 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383124 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383246 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383422 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383553 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383729 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.383849 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384029 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384159 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384328 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384492 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384657 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384780 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.384956 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385078 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385262 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385385 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385560 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385683 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.385869 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386067 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386230 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386368 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386541 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386671 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386852 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.386974 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387163 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387287 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387470 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387600 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387794 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.387929 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388105 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388228 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388410 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388552 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388738 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.388872 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389048 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389178 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389359 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389480 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389664 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.389796 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390013 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390133 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390311 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390442 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390617 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390748 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.390934 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391057 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391232 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391354 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391529 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391652 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391826 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.391948 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392139 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392261 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392458 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392565 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392779 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.392877 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393186 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393323 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393488 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393607 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393789 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.393912 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394095 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394216 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394400 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394523 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394710 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.394831 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395035 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395166 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395343 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395464 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395647 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395768 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.395950 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396081 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396252 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396373 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396582 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396715 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.396898 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397029 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397214 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397335 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397518 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397648 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397826 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.397957 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398125 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398303 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398435 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398615 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398738 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.398926 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399055 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399249 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399373 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399572 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399719 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.399896 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400031 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400208 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400338 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400544 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400667 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400856 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.400995 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401182 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401306 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401526 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401656 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401839 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.401970 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402136 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402274 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402434 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402558 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402749 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.402881 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403048 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403178 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403353 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403476 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403660 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403784 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.403962 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.404093 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.404260 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.404818 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.404938 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405045 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405165 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405294 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405425 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405546 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405673 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405802 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.405923 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406041 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406159 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406286 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406414 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406535 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406653 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406772 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.406953 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407088 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407254 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407377 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407554 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407670 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407853 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.407998 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408149 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408272 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408507 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408634 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408810 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.408951 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409124 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409247 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409449 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409573 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409774 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.409906 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410079 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410203 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410407 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410528 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410723 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.410845 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411029 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411150 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411339 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411468 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411649 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411779 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.411947 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412068 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412246 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412377 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412571 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412694 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.412869 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413046 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413170 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413290 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413456 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413579 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413758 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.413889 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414055 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414190 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414354 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414477 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414651 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414782 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.414968 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415095 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415268 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415390 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415583 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415706 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.415888 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416062 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416185 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416304 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416504 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416643 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416804 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.416944 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417157 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417313 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417513 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417636 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417835 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.417959 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418142 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418299 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418444 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418565 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418748 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.418871 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419052 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419175 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419366 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419488 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419670 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419792 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.419979 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420101 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420288 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420411 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420617 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420740 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.420925 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421055 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421231 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421363 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421537 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421659 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421840 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.421963 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422150 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422282 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422459 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422582 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422767 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.422935 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423103 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423303 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423426 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423587 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423719 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.423896 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424018 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424205 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424330 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424600 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424725 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.424912 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425047 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425221 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425346 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425526 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425649 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425830 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.425962 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426136 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426260 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426444 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426576 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426762 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.426892 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427076 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427192 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427394 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427597 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427719 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.427930 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428053 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428250 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428375 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428593 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428728 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.428906 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429027 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429212 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429334 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429528 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429661 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429845 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.429966 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430152 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430281 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430540 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430666 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430786 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.430903 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431047 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431177 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431352 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431475 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431659 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431781 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.431964 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432087 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432267 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432391 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432598 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432722 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.432935 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.433142 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.433345 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.433555 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.433745 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.433906 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434062 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434237 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434403 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434567 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434741 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.434910 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435091 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435273 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435399 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435518 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435518 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435742 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435871 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.435998 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436125 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436245 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436364 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436546 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436690 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.436844 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437000 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437155 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437318 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437454 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437632 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437783 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.437958 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438082 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438294 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438427 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438617 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438740 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.438932 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439057 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439250 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439381 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439568 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439690 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.439900 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440095 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440230 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440414 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440559 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440769 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.440893 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441096 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441326 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441450 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441667 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441790 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.441977 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442100 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442295 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442427 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442611 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442735 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.442921 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443044 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443226 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443350 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443531 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443652 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443830 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.443951 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444132 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444264 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444459 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444597 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444767 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.444900 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445071 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445194 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445373 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445503 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445678 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.445903 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446026 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446253 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446376 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446562 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446684 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446847 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.446976 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447166 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447296 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447464 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447586 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447763 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.447886 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448058 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448180 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448362 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448556 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448755 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.448876 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449056 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449184 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449355 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449488 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449653 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449776 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.449956 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450076 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450251 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450380 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450551 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450673 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450851 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.450973 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451157 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451292 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451464 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451595 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451775 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.451896 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452084 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452213 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452392 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452544 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452717 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.452857 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453028 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453151 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453332 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453453 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453633 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453755 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.453936 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454058 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454240 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454370 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454541 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454664 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454844 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.454967 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.455151 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.455274 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.455456 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.455689 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.455814 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456019 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456149 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456333 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456508 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456686 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.456812 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457011 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457134 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457310 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457442 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457613 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457743 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.457908 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458043 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458224 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458346 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458526 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458650 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458828 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.458951 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459130 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459332 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459461 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459581 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459721 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.459843 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460022 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460304 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460476 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460621 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460742 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.460928 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461052 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461230 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461354 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461532 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461654 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461834 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.461966 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462136 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462258 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462443 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462575 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462775 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.462906 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463132 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463262 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463381 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463500 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463695 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.463827 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464003 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464144 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464330 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464473 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464663 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464794 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.464964 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465085 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465269 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465391 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465578 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465700 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.465887 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466010 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466200 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466324 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466505 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466636 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466813 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.466933 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467128 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467251 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467471 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467588 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467792 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.467914 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468103 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468233 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468462 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468586 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468762 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.468885 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469070 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469203 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469382 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469502 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469684 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469804 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.469999 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470141 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470318 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470441 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470640 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470770 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.470955 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.471077 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.471253 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.471375 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.471877 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.471999 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472179 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472303 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472507 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472632 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472824 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.472947 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473130 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473255 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473428 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473552 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473726 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.473857 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474029 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474153 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474327 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474443 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474627 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474759 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.474923 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475076 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475206 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475422 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475550 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475756 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.475879 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476083 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476208 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476371 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476517 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476700 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476822 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.476995 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477116 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477292 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477424 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477593 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477717 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.477890 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478013 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478187 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478318 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478484 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478607 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478782 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.478914 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479079 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479210 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479384 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479505 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479734 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.479864 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480050 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480175 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480359 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480538 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480691 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480815 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.480997 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481129 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481300 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481430 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481606 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481735 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.481912 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482036 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482216 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482348 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482516 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482647 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482821 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.482943 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483128 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483250 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483430 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483561 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483733 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.483855 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484032 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484154 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484334 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484535 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484668 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484788 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.484966 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485099 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485288 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485425 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485587 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485710 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.485904 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486027 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486216 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486346 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486535 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486663 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486843 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.486965 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487146 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487278 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487453 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487574 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487760 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.487882 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488078 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488201 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488357 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488577 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488702 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488821 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.488979 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489105 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489287 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489410 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489594 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489724 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.489912 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490041 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490234 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490357 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490538 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490667 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490855 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.490977 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491169 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491297 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491488 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491619 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491804 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.491926 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492111 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492233 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492455 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492594 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492772 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.492893 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493079 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493200 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493376 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493520 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493651 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121561) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:40:46.493772 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.493986 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.494303 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.494617 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.494946 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.495290 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.495604 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.495932 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.496261 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.496648 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.496965 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.497311 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.497645 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.497960 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.498274 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.498582 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:40:46.498825 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121560) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:40:46.559290 ncdv-master-1 devstack@n-api.service[121561]: INFO dbcounter [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Registered counter for database nova_api Jun 25 20:40:46.564885 ncdv-master-1 devstack@n-api.service[121560]: INFO dbcounter [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Registered counter for database nova_api Jun 25 20:40:46.579161 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_db.sqlalchemy.engines [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.584550 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_db.sqlalchemy.engines [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.585892 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writer thread running {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.591441 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writer thread running {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.640918 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.context [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=121561) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 20:40:46.645076 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:40:46.646604 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:40:46.647287 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.context [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=121560) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 20:40:46.647421 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:40:46.649333 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:40:46.651286 ncdv-master-1 devstack@n-api.service[121561]: INFO dbcounter [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Registered counter for database nova_cell0 Jun 25 20:40:46.651430 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_concurrency.lockutils [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:40:46.653036 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_concurrency.lockutils [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:40:46.653915 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_concurrency.lockutils [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:40:46.655371 ncdv-master-1 devstack@n-api.service[121561]: INFO dbcounter [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Registered counter for database nova_cell1 Jun 25 20:40:46.655899 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_concurrency.lockutils [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121560) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:40:46.658170 ncdv-master-1 devstack@n-api.service[121560]: INFO dbcounter [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Registered counter for database nova_cell0 Jun 25 20:40:46.662866 ncdv-master-1 devstack@n-api.service[121560]: INFO dbcounter [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Registered counter for database nova_cell1 Jun 25 20:40:46.663069 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_db.sqlalchemy.engines [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.664092 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_db.sqlalchemy.engines [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.669986 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_db.sqlalchemy.engines [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.671424 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writer thread running {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.673012 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_db.sqlalchemy.engines [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.674533 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writer thread running {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.679671 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writer thread running {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.683996 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writer thread running {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.821524 ncdv-master-1 devstack@n-api.service[121561]: INFO dbcounter [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Registered counter for database nova_cell0 Jun 25 20:40:46.825498 ncdv-master-1 devstack@n-api.service[121560]: INFO dbcounter [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Registered counter for database nova_cell0 Jun 25 20:40:46.830795 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_db.sqlalchemy.engines [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121561) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.834442 ncdv-master-1 devstack@n-api.service[121560]: DEBUG oslo_db.sqlalchemy.engines [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121560) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:40:46.835879 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writer thread running {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:46.838964 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writer thread running {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:40:47.286712 ncdv-master-1 devstack@n-api.service[121561]: WARNING keystonemiddleware.auth_token [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:40:47.294119 ncdv-master-1 devstack@n-api.service[121561]: WARNING keystonemiddleware.auth_token [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:40:47.306810 ncdv-master-1 devstack@n-api.service[121560]: WARNING keystonemiddleware.auth_token [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:40:47.314154 ncdv-master-1 devstack@n-api.service[121560]: WARNING keystonemiddleware.auth_token [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:40:47.513508 ncdv-master-1 devstack@n-api.service[121561]: WARNING keystonemiddleware.auth_token [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:40:47.519544 ncdv-master-1 devstack@n-api.service[121561]: WARNING keystonemiddleware.auth_token [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:40:47.524637 ncdv-master-1 devstack@n-api.service[121561]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8ccddf9c0 pid: 121561 (default app) Jun 25 20:40:47.527050 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:40:47.528281 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002134 Jun 25 20:40:47.528716 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Sat Jun 25 20:40:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:40:47.541070 ncdv-master-1 devstack@n-api.service[121560]: WARNING keystonemiddleware.auth_token [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:40:47.546997 ncdv-master-1 devstack@n-api.service[121560]: WARNING keystonemiddleware.auth_token [None req-8663d514-8a31-480b-81bd-2e868e628423 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:40:47.552041 ncdv-master-1 devstack@n-api.service[121560]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f8ccddf9c0 pid: 121560 (default app) Jun 25 20:42:07.472783 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:07.473844 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Jun 25 20:42:07.474197 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:07.486214 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_api:SELECT=3 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:07.487155 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_cell0:SELECT=3 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:07.488143 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_cell1:SELECT=3 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:07.488888 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:07.928124 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-529aa613-c29f-49f6-ad27-4d91ebd74186 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:07.957739 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-529aa613-c29f-49f6-ad27-4d91ebd74186 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476565 Jun 25 20:42:07.958614 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 20:42:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:10.300627 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:10.302390 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-15eacc2d-c527-4ca8-af5d-4ec9bb0b1028 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002039 Jun 25 20:42:10.302800 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:10.361296 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-d4ac851d-92d2-416a-8a35-193ca033a57e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "swap": 0, "rxtx_factor": 1.0}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:10.379260 ncdv-master-1 devstack@n-api.service[121560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:42:10.379260 ncdv-master-1 devstack@n-api.service[121560]: warnings.warn(msg) Jun 25 20:42:10.410313 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-d4ac851d-92d2-416a-8a35-193ca033a57e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101044 Jun 25 20:42:10.418217 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:10.641722 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-6c608913-965b-4e39-8432-c27fafc904fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:10.644209 ncdv-master-1 devstack@n-api.service[121561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:42:10.644209 ncdv-master-1 devstack@n-api.service[121561]: warnings.warn(msg) Jun 25 20:42:10.646937 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_api:SELECT=3 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:10.647890 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_cell0:SELECT=3 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:10.648978 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_cell1:SELECT=3 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:10.649674 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:10.709775 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-6c608913-965b-4e39-8432-c27fafc904fd admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289647 Jun 25 20:42:10.710369 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 25 20:42:10 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:13.074009 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-d4ac851d-92d2-416a-8a35-193ca033a57e admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:13.075698 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-d4ac851d-92d2-416a-8a35-193ca033a57e admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Jun 25 20:42:13.076480 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:13.184733 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-66b47a3d-ff32-4bf9-ae23-5d66892800c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:13.202033 ncdv-master-1 devstack@n-api.service[121561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:42:13.202033 ncdv-master-1 devstack@n-api.service[121561]: warnings.warn(msg) Jun 25 20:42:13.221665 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-66b47a3d-ff32-4bf9-ae23-5d66892800c6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139115 Jun 25 20:42:13.222539 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:13.234696 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-ffcb9cf1-c5b3-4a7c-992d-a62e2f6fda7f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:13.236194 ncdv-master-1 devstack@n-api.service[121560]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:42:13.236194 ncdv-master-1 devstack@n-api.service[121560]: warnings.warn(msg) Jun 25 20:42:13.267933 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-ffcb9cf1-c5b3-4a7c-992d-a62e2f6fda7f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036889 Jun 25 20:42:13.268527 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 25 20:42:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:15.637363 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-66b47a3d-ff32-4bf9-ae23-5d66892800c6 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:15.639001 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-66b47a3d-ff32-4bf9-ae23-5d66892800c6 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Jun 25 20:42:15.639587 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:15.714528 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-749ca5de-a926-4023-9282-50eea4cd163c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:15.737336 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-749ca5de-a926-4023-9282-50eea4cd163c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091255 Jun 25 20:42:15.744759 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:15.752215 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-033753b1-4eb2-415e-91f2-b7fd30ae9cec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:15.790633 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-033753b1-4eb2-415e-91f2-b7fd30ae9cec admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042025 Jun 25 20:42:15.791522 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 25 20:42:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:18.420914 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-749ca5de-a926-4023-9282-50eea4cd163c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:18.422685 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-749ca5de-a926-4023-9282-50eea4cd163c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002249 Jun 25 20:42:18.423548 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:18.485207 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-2acd39a5-e67c-44d6-8f71-94be679792a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "disk": 10, "ram": 2048, "rxtx_factor": 1.0, "swap": 0}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:18.509550 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-2acd39a5-e67c-44d6-8f71-94be679792a2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079983 Jun 25 20:42:18.522748 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-99a4e2ca-5168-480b-9845-9798450c0025 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:18.529550 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:18.547979 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-99a4e2ca-5168-480b-9845-9798450c0025 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029029 Jun 25 20:42:18.559254 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 25 20:42:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:21.138880 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-2acd39a5-e67c-44d6-8f71-94be679792a2 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:21.140897 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-2acd39a5-e67c-44d6-8f71-94be679792a2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002422 Jun 25 20:42:21.141321 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:21.205165 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:21.226546 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079352 Jun 25 20:42:21.227315 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:21.239523 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-c8bb6a2e-dd87-4095-9d87-8f43a6236773 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:21.264128 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-c8bb6a2e-dd87-4095-9d87-8f43a6236773 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028109 Jun 25 20:42:21.264664 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1335 bytes} [Sat Jun 25 20:42:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:23.758367 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:23.759392 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 25 20:42:23.759788 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:23.825627 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-98b8eeaa-6a9a-475f-bf63-325512f50f53 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:23.849501 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-98b8eeaa-6a9a-475f-bf63-325512f50f53 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083602 Jun 25 20:42:23.850035 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 20:42:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:42:26.353725 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:26.354745 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-a229340c-55f8-4a77-90b7-3aa1268373b5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 25 20:42:26.355177 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:26.421990 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-77464dc4-99d3-4dba-a146-fc67f31b594b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "name": "m1.tiny"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:26.446209 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-77464dc4-99d3-4dba-a146-fc67f31b594b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084921 Jun 25 20:42:26.447027 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:26.459153 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-ff5087b4-dc90-4998-9f11-2e90231b755d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:26.484621 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-ff5087b4-dc90-4998-9f11-2e90231b755d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029039 Jun 25 20:42:26.485930 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 25 20:42:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:28.917303 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-77464dc4-99d3-4dba-a146-fc67f31b594b admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:28.918309 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-77464dc4-99d3-4dba-a146-fc67f31b594b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jun 25 20:42:28.919974 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:28.994795 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-e9b296c4-ef8d-43fb-abb1-0190358b401a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:29.021648 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-e9b296c4-ef8d-43fb-abb1-0190358b401a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095650 Jun 25 20:42:29.022480 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:29.034088 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-ec409334-2909-4c82-96e2-79a4b1a21bff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:29.057217 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-ec409334-2909-4c82-96e2-79a4b1a21bff admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026682 Jun 25 20:42:29.058058 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 25 20:42:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:31.412767 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-e9b296c4-ef8d-43fb-abb1-0190358b401a admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:31.414161 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-e9b296c4-ef8d-43fb-abb1-0190358b401a admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Jun 25 20:42:31.414801 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:31.488116 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-c38d733d-ded3-4675-bf60-a10de70456da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "ram": 4096, "id": "3", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:31.513323 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-c38d733d-ded3-4675-bf60-a10de70456da admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092323 Jun 25 20:42:31.513935 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:31.530390 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-44ff55fb-1db5-4a64-9d27-89990a4618d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:31.557349 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-44ff55fb-1db5-4a64-9d27-89990a4618d8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031679 Jun 25 20:42:31.558120 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 25 20:42:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:34.498395 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-c38d733d-ded3-4675-bf60-a10de70456da admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:34.499536 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-c38d733d-ded3-4675-bf60-a10de70456da admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001628 Jun 25 20:42:34.499916 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:34.570030 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-a60a343c-0de9-4d09-a2bb-8f8b5f150fdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:34.589271 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-a60a343c-0de9-4d09-a2bb-8f8b5f150fdc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083015 Jun 25 20:42:34.589790 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 20:42:34.602144 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-6aa69ffb-fe71-4aad-92a7-5ee75c5ebd68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:34.626112 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-6aa69ffb-fe71-4aad-92a7-5ee75c5ebd68 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027572 Jun 25 20:42:34.626688 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 25 20:42:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:42:36.982687 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-a60a343c-0de9-4d09-a2bb-8f8b5f150fdc admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:42:36.984241 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-a60a343c-0de9-4d09-a2bb-8f8b5f150fdc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002364 Jun 25 20:42:36.984872 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:42:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:42:37.047098 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:37.071231 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077786 Jun 25 20:42:37.071793 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1282 bytes} [Sat Jun 25 20:42:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:42:37.084616 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-5237e318-4266-4f96-a156-c28851c27a22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:42:37.108529 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-5237e318-4266-4f96-a156-c28851c27a22 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027572 Jun 25 20:42:37.109117 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1332 bytes} [Sat Jun 25 20:42:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:43:04.542894 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:04.543907 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 25 20:43:04.544338 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:04.555584 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:04.627870 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-380a0aa8-9e05-4eff-b6e3-bac883fad688 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:04.653220 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-380a0aa8-9e05-4eff-b6e3-bac883fad688 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.102261 Jun 25 20:43:04.653756 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 20:43:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:05.684336 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:05.685646 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-dbc3f81e-d0ad-411c-9635-3f293e1fc2b4 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Jun 25 20:43:05.686145 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:05.995578 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-0588019d-320c-4f79-8295-7f5f82e1770d admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:06.001457 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.wsgi [None req-0588019d-320c-4f79-8295-7f5f82e1770d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-0588019d-320c-4f79-8295-7f5f82e1770d admin admin] Request method failure captured: Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Accept: application/json Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Accept-Encoding: gzip, deflate Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Connection: keep-alive Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Content-Length: 0 Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Host: 10.222.0.39 Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: Openstack-System-Scope: None Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: User-Agent: python-novaclient Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Auth-Token: gAAAAABit3NZZX0fVFvriEblnAAGzKWf9UuaWZxb7tU3R-VUd4Y1J57gZ8Cz5W_SBDKIv6okHCXn4bLUW0ptgz5bIjRO7p02Vq3gLYWMVrifoVGXMxAmiomg_7HFUEoG2jJfnXQ0vQbhiL8H7DwQzB_imY7Y0GRSQMEFdWMjBCci4bYtFQGiiwk Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Id: None Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Name: None Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Identity-Status: Confirmed Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Is-Admin-Project: True Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Id: default Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Name: Default Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Name: admin Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Role: member,admin,reader Jun 25 20:43:06.014128 ncdv-master-1 devstack@n-api.service[121560]: X-Roles: member,admin,reader Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant: admin Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Name: admin Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-User: admin Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Id: default Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Name: Default Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: X-User-Name: admin Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: method: > Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: exception: Flavor 42 could not be found. Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: action_args: {'id': '42'} Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:06.015834 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:06.016786 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.018037 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-0588019d-320c-4f79-8295-7f5f82e1770d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:06.019328 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-0588019d-320c-4f79-8295-7f5f82e1770d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074883 Jun 25 20:43:06.019328 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:43:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:06.025426 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-4ed624db-ba96-4db7-b4f7-f8233815f14f admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:06.028360 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:43:06.047761 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-4ed624db-ba96-4db7-b4f7-f8233815f14f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026010 Jun 25 20:43:06.048312 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:06.064838 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-319c008c-7d6e-4dcf-9a33-1f909be0e9f2 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:06.098846 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-319c008c-7d6e-4dcf-9a33-1f909be0e9f2 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.039361 Jun 25 20:43:06.099427 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:06.109116 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-f6f3a111-ab7b-4313-bdf5-a03c756d0bac admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:06.115577 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.wsgi [None req-f6f3a111-ab7b-4313-bdf5-a03c756d0bac admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-f6f3a111-ab7b-4313-bdf5-a03c756d0bac admin admin] Request method failure captured: Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Accept: application/json Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Accept-Encoding: gzip, deflate Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Connection: keep-alive Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Content-Length: 0 Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Host: 10.222.0.39 Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: Openstack-System-Scope: None Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: User-Agent: python-novaclient Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Auth-Token: gAAAAABit3NZZX0fVFvriEblnAAGzKWf9UuaWZxb7tU3R-VUd4Y1J57gZ8Cz5W_SBDKIv6okHCXn4bLUW0ptgz5bIjRO7p02Vq3gLYWMVrifoVGXMxAmiomg_7HFUEoG2jJfnXQ0vQbhiL8H7DwQzB_imY7Y0GRSQMEFdWMjBCci4bYtFQGiiwk Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Id: None Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Name: None Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Identity-Status: Confirmed Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Is-Admin-Project: True Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Id: default Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Name: Default Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Name: admin Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Role: member,admin,reader Jun 25 20:43:06.118844 ncdv-master-1 devstack@n-api.service[121561]: X-Roles: member,admin,reader Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant: admin Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Name: admin Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-User: admin Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Id: default Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Name: Default Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: X-User-Name: admin Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: method: > Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: exception: Flavor 42 could not be found. Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: action_args: {'id': '42'} Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:06.120374 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:06.122334 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:06.123383 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-f6f3a111-ab7b-4313-bdf5-a03c756d0bac admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:06.124381 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-f6f3a111-ab7b-4313-bdf5-a03c756d0bac admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014808 Jun 25 20:43:06.124381 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:43:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 25 20:43:06.959101 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-319c008c-7d6e-4dcf-9a33-1f909be0e9f2 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:06.960120 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-319c008c-7d6e-4dcf-9a33-1f909be0e9f2 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 25 20:43:06.960508 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:07.174071 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-46e75bfe-b1e1-4b29-a3f7-7ace6329e867 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:07.182001 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.wsgi [None req-46e75bfe-b1e1-4b29-a3f7-7ace6329e867 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-46e75bfe-b1e1-4b29-a3f7-7ace6329e867 admin admin] Request method failure captured: Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Accept: application/json Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Accept-Encoding: gzip, deflate Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Connection: keep-alive Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Content-Length: 0 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Host: 10.222.0.39 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: Openstack-System-Scope: None Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: User-Agent: python-novaclient Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Auth-Token: gAAAAABit3Nav0zNQc49pzumFFCa_7Rb7gryOtST0IBAXxY1bqvnOQzfNMArBYzLqWDIaTGMAuV7ztmN5BxpfU3YRHAlHlGUDv9GIQJ0SnMPo5RLgsG_Wmpg6HTLt9mRMdL07gGtNKDkUkmp-0xXtdBerlxy8eEztr-dbU_7o-1q9cd9Q10b0N4 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Id: None Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Name: None Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Identity-Status: Confirmed Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Is-Admin-Project: True Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Id: default Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Name: Default Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Name: admin Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Role: member,admin,reader Jun 25 20:43:07.183500 ncdv-master-1 devstack@n-api.service[121561]: X-Roles: member,admin,reader Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant: admin Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Name: admin Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-User: admin Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Id: default Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Name: Default Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: X-User-Name: admin Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: method: > Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: exception: Flavor 84 could not be found. Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: action_args: {'id': '84'} Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:07.184845 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:07.185649 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.186742 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-46e75bfe-b1e1-4b29-a3f7-7ace6329e867 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:07.187978 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-46e75bfe-b1e1-4b29-a3f7-7ace6329e867 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.074710 Jun 25 20:43:07.187978 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:43:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:07.194672 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-40302b9e-a922-409f-bec9-27fe76d689e1 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:07.215930 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-40302b9e-a922-409f-bec9-27fe76d689e1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024565 Jun 25 20:43:07.216787 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:07.231267 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-e332a62b-89e9-46eb-9669-0f6817589751 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:07.244809 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-e332a62b-89e9-46eb-9669-0f6817589751 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018250 Jun 25 20:43:07.245325 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:07.254532 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-ea060383-cd0b-45b5-8f2c-37830f5c083d admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:07.259883 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.wsgi [None req-ea060383-cd0b-45b5-8f2c-37830f5c083d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-ea060383-cd0b-45b5-8f2c-37830f5c083d admin admin] Request method failure captured: Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Accept: application/json Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Accept-Encoding: gzip, deflate Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Connection: keep-alive Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Content-Length: 0 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Host: 10.222.0.39 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: Openstack-System-Scope: None Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: User-Agent: python-novaclient Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Auth-Token: gAAAAABit3Nav0zNQc49pzumFFCa_7Rb7gryOtST0IBAXxY1bqvnOQzfNMArBYzLqWDIaTGMAuV7ztmN5BxpfU3YRHAlHlGUDv9GIQJ0SnMPo5RLgsG_Wmpg6HTLt9mRMdL07gGtNKDkUkmp-0xXtdBerlxy8eEztr-dbU_7o-1q9cd9Q10b0N4 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Id: None Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Name: None Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Identity-Status: Confirmed Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Is-Admin-Project: True Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Id: default Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Name: Default Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Name: admin Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Role: member,admin,reader Jun 25 20:43:07.261570 ncdv-master-1 devstack@n-api.service[121560]: X-Roles: member,admin,reader Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant: admin Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Name: admin Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-User: admin Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Id: default Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Name: Default Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: X-User-Name: admin Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: method: > Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: exception: Flavor 84 could not be found. Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: action_args: {'id': '84'} Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:07.262930 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:07.263727 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:07.264830 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-ea060383-cd0b-45b5-8f2c-37830f5c083d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:07.265844 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-ea060383-cd0b-45b5-8f2c-37830f5c083d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011903 Jun 25 20:43:07.265844 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:43:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:08.082701 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-e332a62b-89e9-46eb-9669-0f6817589751 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:08.083723 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-e332a62b-89e9-46eb-9669-0f6817589751 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 25 20:43:08.084260 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:08.300204 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-fb3597c5-e935-45b0-8f37-e7c81e2280c3 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:08.306078 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.wsgi [None req-fb3597c5-e935-45b0-8f37-e7c81e2280c3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-fb3597c5-e935-45b0-8f37-e7c81e2280c3 admin admin] Request method failure captured: Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Accept: application/json Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Accept-Encoding: gzip, deflate Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Connection: keep-alive Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Content-Length: 0 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Host: 10.222.0.39 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: Openstack-System-Scope: None Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: User-Agent: python-novaclient Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Auth-Token: gAAAAABit3NcQQ4iI9tq_nsghZHJ55ktv9ld2I8Xi5mvKNlGoNtKBXN-Vb62Et5eS8rzWWd2g8Uf9htYVOFFw5bBrX4Ku8V73oKIJoVdejb5jsPPZHUG94MzH7xoBaw_20ebIfYYuTUUqfabJHbhFrIQ7mml4YgIuUCdRUVUhFAJDjIHHvPXp78 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Id: None Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Domain-Name: None Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Identity-Status: Confirmed Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Is-Admin-Project: True Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Id: default Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Domain-Name: Default Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Project-Name: admin Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Role: member,admin,reader Jun 25 20:43:08.307655 ncdv-master-1 devstack@n-api.service[121560]: X-Roles: member,admin,reader Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant: admin Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-Tenant-Name: admin Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-User: admin Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Id: default Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-User-Domain-Name: Default Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: X-User-Name: admin Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: method: > Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: exception: Flavor 451 could not be found. Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: action_args: {'id': '451'} Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:08.308996 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:08.309916 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.311110 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-fb3597c5-e935-45b0-8f37-e7c81e2280c3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121560) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:08.312313 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-fb3597c5-e935-45b0-8f37-e7c81e2280c3 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.079074 Jun 25 20:43:08.312313 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:43:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:08.321447 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-89a3573c-0ff4-44ef-a1d0-97b4d92787f5 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:08.341664 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-89a3573c-0ff4-44ef-a1d0-97b4d92787f5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025806 Jun 25 20:43:08.342116 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:08.352150 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:08.365847 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017298 Jun 25 20:43:08.366365 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:43:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:43:08.378302 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-eefc6ce2-0430-4ad4-941c-8efcbef2cbb7 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:08.385822 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.wsgi [None req-eefc6ce2-0430-4ad4-941c-8efcbef2cbb7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-eefc6ce2-0430-4ad4-941c-8efcbef2cbb7 admin admin] Request method failure captured: Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Accept: application/json Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Accept-Encoding: gzip, deflate Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Connection: keep-alive Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Content-Length: 0 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Host: 10.222.0.39 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Openstack-Api-Version: compute 2.90 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: Openstack-System-Scope: None Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: User-Agent: python-novaclient Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Auth-Token: gAAAAABit3NcQQ4iI9tq_nsghZHJ55ktv9ld2I8Xi5mvKNlGoNtKBXN-Vb62Et5eS8rzWWd2g8Uf9htYVOFFw5bBrX4Ku8V73oKIJoVdejb5jsPPZHUG94MzH7xoBaw_20ebIfYYuTUUqfabJHbhFrIQ7mml4YgIuUCdRUVUhFAJDjIHHvPXp78 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Id: None Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Domain-Name: None Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Identity-Status: Confirmed Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Is-Admin-Project: True Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Id: default Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Domain-Name: Default Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Project-Name: admin Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Role: member,admin,reader Jun 25 20:43:08.387991 ncdv-master-1 devstack@n-api.service[121561]: X-Roles: member,admin,reader Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7d98522b7634403f83ff66fd72edfd9e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7d98522b7634403f83ff66fd72edfd9e"}]}] Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant: admin Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Id: 7d98522b7634403f83ff66fd72edfd9e Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-Tenant-Name: admin Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-User: admin Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Id: default Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-User-Domain-Name: Default Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-User-Id: 152e93db3c4b47f4a0815a7df2a050f8 Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: X-User-Name: admin Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: method: > Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: exception: Flavor 451 could not be found. Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: action_args: {'id': '451'} Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:43:08.389404 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:08.390212 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: ERROR nova.api.openstack.wsgi Jun 25 20:43:08.391389 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-eefc6ce2-0430-4ad4-941c-8efcbef2cbb7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121561) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:43:08.392389 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-eefc6ce2-0430-4ad4-941c-8efcbef2cbb7 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.016918 Jun 25 20:43:08.392389 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:43:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:43:09.234388 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:09.235400 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 25 20:43:09.235787 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:09.447700 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-e4a8a5f5-c480-41d9-83f7-af02bb8c8ebf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:43:09.468067 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-e4a8a5f5-c480-41d9-83f7-af02bb8c8ebf admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083177 Jun 25 20:43:09.468639 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 25 20:43:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:43:10.315849 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:10.316895 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 25 20:43:10.317298 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:10.523624 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-447a5b02-f92a-4158-b596-a3b661021b03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:43:10.542745 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-447a5b02-f92a-4158-b596-a3b661021b03 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080627 Jun 25 20:43:10.543279 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 25 20:43:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:43:11.390161 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:11.391183 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 25 20:43:11.391609 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:11.588757 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-25df30da-db55-42fb-99b6-d7dc8d9f0c17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:43:11.609142 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-25df30da-db55-42fb-99b6-d7dc8d9f0c17 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071745 Jun 25 20:43:11.609668 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 25 20:43:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:43:12.452827 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:12.453823 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 25 20:43:12.454200 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:12.666427 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-c79ea4a7-7f64-47c0-bd8b-8d4e6e6ada94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:43:12.687194 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-c79ea4a7-7f64-47c0-bd8b-8d4e6e6ada94 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.086878 Jun 25 20:43:12.687783 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Sat Jun 25 20:43:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:43:13.527424 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:13.528513 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 25 20:43:13.528875 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:43:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:43:13.734502 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-5d2affd8-9e11-4a4b-83a3-2d156b8f08c1 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:43:13.754135 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-5d2affd8-9e11-4a4b-83a3-2d156b8f08c1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081753 Jun 25 20:43:13.754665 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Sat Jun 25 20:43:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:44:21.375794 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.376843 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-2802f007-4fff-477e-9323-9c155acc4a1c admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 25 20:44:21.377229 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 930 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:44:21.385234 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:21.442102 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-599a65b0-976b-4708-bf4f-b408069ecacd admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.462599 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-599a65b0-976b-4708-bf4f-b408069ecacd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079071 Jun 25 20:44:21.463125 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:44:21.488535 ncdv-master-1 devstack@n-api.service[121560]: DEBUG dbcounter [-] [121560] Writing DB stats nova_api:SELECT=14 {{(pid=121560) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:21.492619 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-c07d23a3-3319-4789-85d3-7eb1153fd699 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.500857 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-c07d23a3-3319-4789-85d3-7eb1153fd699 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013700 Jun 25 20:44:21.501374 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1282 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:44:21.513472 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-9584dc15-d205-4861-accf-370c5b5be363 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.521442 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-9584dc15-d205-4861-accf-370c5b5be363 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011564 Jun 25 20:44:21.521955 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1285 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:44:21.533980 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.542353 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Jun 25 20:44:21.542888 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1285 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:44:21.557732 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-ff6a4dc5-4094-43f3-b24a-0a4f13e54d03 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:44:21.569795 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-ff6a4dc5-4094-43f3-b24a-0a4f13e54d03 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017651 Jun 25 20:44:21.570661 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1282 bytes} [Sat Jun 25 20:44:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:50:03.016730 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:50:03.017801 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Jun 25 20:50:03.018193 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:50:03.167993 ncdv-master-1 devstack@n-api.service[121561]: DEBUG dbcounter [-] [121561] Writing DB stats nova_api:SELECT=6 {{(pid=121561) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:03.296852 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:50:03.298476 ncdv-master-1 devstack@n-api.service[121561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:50:03.298476 ncdv-master-1 devstack@n-api.service[121561]: warnings.warn(msg) Jun 25 20:50:03.300180 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:03.300865 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:03.302068 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:03.302679 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:03.347362 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-a7aaddd5-a770-4994-a98c-1890bb5118d6 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.182041 Jun 25 20:50:03.348199 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:50:03 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:50:04.193619 ncdv-master-1 devstack@n-api.service[121560]: DEBUG nova.api.openstack.wsgi [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] Calling method '>' {{(pid=121560) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:50:04.194622 ncdv-master-1 devstack@n-api.service[121560]: INFO nova.api.openstack.requestlog [None req-4cfd3a02-a0af-460c-9c3a-b999472b7413 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 25 20:50:04.195014 ncdv-master-1 devstack@n-api.service[121560]: [pid: 121560|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Sat Jun 25 20:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:50:04.402496 ncdv-master-1 devstack@n-api.service[121561]: DEBUG nova.api.openstack.wsgi [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] Calling method '>' {{(pid=121561) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:50:04.403588 ncdv-master-1 devstack@n-api.service[121561]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:50:04.403588 ncdv-master-1 devstack@n-api.service[121561]: warnings.warn(msg) Jun 25 20:50:04.404818 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:04.405263 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:04.406050 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:04.406482 ncdv-master-1 devstack@n-api.service[121561]: DEBUG oslo_concurrency.lockutils [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121561) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:04.429327 ncdv-master-1 devstack@n-api.service[121561]: INFO nova.api.openstack.requestlog [None req-a53c438a-5f25-4668-9264-706a4ab3d584 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.087615 Jun 25 20:50:04.429883 ncdv-master-1 devstack@n-api.service[121561]: [pid: 121561|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:50:04 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:50:52.040341 ncdv-master-1 devstack@n-api.service[121559]: Sat Jun 25 20:50:52 2022 - graceful shutdown triggered... Jun 25 20:50:52.040507 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Jun 25 20:50:52.041547 ncdv-master-1 devstack@n-api.service[121560]: Gracefully killing worker 1 (pid: 121560)... Jun 25 20:50:52.041996 ncdv-master-1 devstack@n-api.service[121561]: Gracefully killing worker 2 (pid: 121561)... Jun 25 20:50:53.041678 ncdv-master-1 devstack@n-api.service[121559]: worker 1 buried after 1 seconds Jun 25 20:50:53.041678 ncdv-master-1 devstack@n-api.service[121559]: worker 2 buried after 1 seconds Jun 25 20:50:53.041678 ncdv-master-1 devstack@n-api.service[121559]: goodbye to uWSGI. Jun 25 20:50:53.043428 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Jun 25 20:50:53.044034 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Jun 25 20:50:53.046950 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Jun 25 20:50:53.116187 ncdv-master-1 devstack@n-api.service[137447]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 20:50:53 2022] *** Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: nodename: ncdv-master-1 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: machine: x86_64 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: clock source: unix Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: pcre jit disabled Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: detected number of CPU cores: 4 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: current working directory: / Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: detected binary path: /usr/bin/uwsgi-core Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: your processes number limit is 47680 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: your memory page size is 4096 bytes Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: detected max file descriptor number: 2048 Jun 25 20:50:53.118106 ncdv-master-1 devstack@n-api.service[137447]: lock engine: pthread robust mutexes Jun 25 20:50:53.119100 ncdv-master-1 devstack@n-api.service[137447]: thunder lock: enabled Jun 25 20:50:53.119100 ncdv-master-1 devstack@n-api.service[137447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 25 20:50:53.119100 ncdv-master-1 devstack@n-api.service[137447]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 20:50:53.167580 ncdv-master-1 devstack@n-api.service[137447]: Python main interpreter initialized at 0x555c0aa819c0 Jun 25 20:50:53.167580 ncdv-master-1 devstack@n-api.service[137447]: python threads support enabled Jun 25 20:50:53.167580 ncdv-master-1 devstack@n-api.service[137447]: your server socket listen backlog is limited to 100 connections Jun 25 20:50:53.167580 ncdv-master-1 devstack@n-api.service[137447]: your mercy for graceful operations on workers is 90 seconds Jun 25 20:50:53.167991 ncdv-master-1 devstack@n-api.service[137447]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 20:50:53.167991 ncdv-master-1 devstack@n-api.service[137447]: *** Operational MODE: preforking *** Jun 25 20:50:53.168257 ncdv-master-1 devstack@n-api.service[137447]: *** uWSGI is running in multiple interpreter mode *** Jun 25 20:50:53.168257 ncdv-master-1 devstack@n-api.service[137447]: spawned uWSGI master process (pid: 137447) Jun 25 20:50:53.168512 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Jun 25 20:50:53.169346 ncdv-master-1 devstack@n-api.service[137447]: spawned uWSGI worker 1 (pid: 137461, cores: 1) Jun 25 20:50:53.169461 ncdv-master-1 devstack@n-api.service[137447]: spawned uWSGI worker 2 (pid: 137462, cores: 1) Jun 25 20:50:53.172444 ncdv-master-1 devstack@n-api.service[137447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 20:50:54.507455 ncdv-master-1 devstack@n-api.service[137462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 20:50:54.526082 ncdv-master-1 devstack@n-api.service[137461]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 20:50:55.260037 ncdv-master-1 devstack@n-api.service[137462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:50:55.260037 ncdv-master-1 devstack@n-api.service[137462]: from cryptography.utils import int_from_bytes Jun 25 20:50:55.260764 ncdv-master-1 devstack@n-api.service[137462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:50:55.260764 ncdv-master-1 devstack@n-api.service[137462]: from cryptography.utils import int_from_bytes Jun 25 20:50:55.269605 ncdv-master-1 devstack@n-api.service[137461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:50:55.269605 ncdv-master-1 devstack@n-api.service[137461]: from cryptography.utils import int_from_bytes Jun 25 20:50:55.269959 ncdv-master-1 devstack@n-api.service[137461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:50:55.269959 ncdv-master-1 devstack@n-api.service[137461]: from cryptography.utils import int_from_bytes Jun 25 20:50:57.699274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:50:57.700141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:50:57.700141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:50:57.700597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:50:57.700773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:50:57.700871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:50:57.701238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.701326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:50:57.701409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.701596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:50:57.701707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.701975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:50:57.702082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.702235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:50:57.702354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.702661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.702810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.702956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.703953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.704972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.705829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.706921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.707063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.707192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.708511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.708678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.708819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.708965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.709909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.710999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.711964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.712945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.713970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.714874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.715124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.715260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.715419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.715557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.716924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.717886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.718978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.719888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.720870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.721949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.722854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.723031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.723145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.723333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.723502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.723646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.724999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.725954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.726863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.727071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.727263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.727394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.727527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.728971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.729982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.730970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.731937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.732849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.733981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.734089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.734323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.734455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.734648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.734755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.735929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.736874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.737943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.738945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.739843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.740827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.741883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.742380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.742562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.742717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.742717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.743936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.744211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.744372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.744551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.744718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.744872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.745018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.745178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.745324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.745469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.745620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.745772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.745927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.746083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:50:57.746230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.746384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.746562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.746726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.746886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.747959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.748903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.749847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.750942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.751990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.752166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.752758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.752943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.753936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.754790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.755988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.756913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.757819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.758909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.759118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.759291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.759493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.759662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.759812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.760110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.760510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.760761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.761026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.761265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.761522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.761737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.761960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.762224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.763094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.763341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.763341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.763793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.764031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.764263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.764671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.764916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.765150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.765448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.765663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.765663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.766987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.767877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.768861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.769930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.770998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.771910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.772064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.772226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.772382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.772561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.772892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.773295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.773462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.773624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.773779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.773925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.774959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.775860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.776957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.777863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.778940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.779880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.780976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.781978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.782137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.782283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.782436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.782600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.785895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.786083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.786258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.786679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.786851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.787856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.788958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.789886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.790961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.791106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.791251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.791397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.791550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.791705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.792313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.792513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.792678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.792824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.792987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.793932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.794079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.794231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.794388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.794545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.795936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.796869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.797979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.798916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.799977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.800929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.801861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.802007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.802159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.802305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.802477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.809761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.809970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.810937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.811858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.812853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.813917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.814994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.815147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.821900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.822705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.822868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.823963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.824912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.825998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.826788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.827909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.828195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.828341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.828561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.828730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.828993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.829147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.829300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.829471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.829791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.829955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.830112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.830257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.830411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.830558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.830790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.831096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.831250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.831599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.831920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.832979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.833895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.834998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.835953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.836895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.837971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.838883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.839946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.840116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.840278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.840484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.841034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.841195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.841361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.841595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.841838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.842130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.842394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.842559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.842717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.842863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.843802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.844906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.845863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.846930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.847865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.848854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.849783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.850862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.851022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.851178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.851332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.851492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.851654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.852661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.852840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.852997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.853981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.854969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.855910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.856986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.857948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.858904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.859926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.860253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.860447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.860609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.860763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.860915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.861891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.862053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.862205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.862376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.862774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.863870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.864944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.865900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.866987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.867969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.868944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.869906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.870066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.870381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.870549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.870710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.870869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.871969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.872134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.872372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.872612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.872968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.873256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.873416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.873577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.873737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.873899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.874850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.875926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.876978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.877130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.877426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.877593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.877780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.877932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.878950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.879863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.880891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.881950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.882682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.883998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.884938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.885995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.886974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.887920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.888979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.889930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.890924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.891913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.892924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.893339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.893480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.893602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.893730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.893854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.894934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.895866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.896797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.897860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.898923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.899870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.900158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.900313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.900495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.900665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.900883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.901911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.902685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.903645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.903803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.903950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.904936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.905892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.906872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.907948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.908925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.909920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.910880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.911930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.912958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.913297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.913738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.913899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.914996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.915974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.916952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.917903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.918859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.919973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.920989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.921226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.921392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.921555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.921790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.921953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.922936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.923102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.923267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.923429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.923882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.923882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.924200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.924362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.924548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.924702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.924868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.925988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.926957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.927929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.928928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.929891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.930194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.930356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.930515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.930515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.931164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.931419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.931588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.931753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.932802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.932968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.933131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.933305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.933481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.933635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.934899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.935862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.936971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.937975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.938945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.939907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.940898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.941965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.942891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.943887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.944343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.944536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.944699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.945943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.946932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.947933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.948954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.949906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.950951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.951965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.952983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.953919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.954940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.955939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.956940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.957034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.957127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.957215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.957312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.957398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.991439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.991771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.991950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.992103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.992245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.996761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.996958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.996958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.998149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.998307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.998656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.998948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.999118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.999293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.999452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.999610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:57.999765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.000992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.001135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.001457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.001705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.001867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.002993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.003153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.003444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.003642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.003807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.004080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.004356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.004630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.004907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.005161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.005425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.005595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.006175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.006335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.006511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.006687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.007111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.007393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.007646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.007906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.008480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.009432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.009572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.009715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.009896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.010875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.011984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.012897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.013975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.014962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.015953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.016886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.017898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.018130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.019908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.020738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:50:58.020738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:50:58.030691 ncdv-master-1 devstack@n-api.service[137461]: INFO dbcounter [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Registered counter for database nova_api Jun 25 20:50:58.036756 ncdv-master-1 devstack@n-api.service[137462]: INFO dbcounter [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Registered counter for database nova_api Jun 25 20:50:58.051110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_db.sqlalchemy.engines [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.057006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_db.sqlalchemy.engines [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.058704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writer thread running {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.064072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writer thread running {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.117747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.context [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137461) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 20:50:58.121262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.context [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137462) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 20:50:58.121680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:58.123271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:58.124080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:58.125420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:58.126223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:58.127013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:58.127801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:50:58.128287 ncdv-master-1 devstack@n-api.service[137461]: INFO dbcounter [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Registered counter for database nova_cell0 Jun 25 20:50:58.129810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:50:58.131827 ncdv-master-1 devstack@n-api.service[137462]: INFO dbcounter [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Registered counter for database nova_cell0 Jun 25 20:50:58.132539 ncdv-master-1 devstack@n-api.service[137461]: INFO dbcounter [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Registered counter for database nova_cell1 Jun 25 20:50:58.135841 ncdv-master-1 devstack@n-api.service[137462]: INFO dbcounter [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Registered counter for database nova_cell1 Jun 25 20:50:58.142116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_db.sqlalchemy.engines [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.144105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_db.sqlalchemy.engines [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.145607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_db.sqlalchemy.engines [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.148274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_db.sqlalchemy.engines [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.151933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writer thread running {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.153500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writer thread running {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.155631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writer thread running {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.157966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writer thread running {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.304458 ncdv-master-1 devstack@n-api.service[137462]: INFO dbcounter [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Registered counter for database nova_cell0 Jun 25 20:50:58.304646 ncdv-master-1 devstack@n-api.service[137461]: INFO dbcounter [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Registered counter for database nova_cell0 Jun 25 20:50:58.311098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_db.sqlalchemy.engines [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.314704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_db.sqlalchemy.engines [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:50:58.317064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writer thread running {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.320216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writer thread running {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:50:58.756724 ncdv-master-1 devstack@n-api.service[137461]: WARNING keystonemiddleware.auth_token [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:50:58.760318 ncdv-master-1 devstack@n-api.service[137462]: WARNING keystonemiddleware.auth_token [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:50:58.764227 ncdv-master-1 devstack@n-api.service[137461]: WARNING keystonemiddleware.auth_token [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:50:58.770107 ncdv-master-1 devstack@n-api.service[137462]: WARNING keystonemiddleware.auth_token [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:50:58.984469 ncdv-master-1 devstack@n-api.service[137461]: WARNING keystonemiddleware.auth_token [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:50:58.990530 ncdv-master-1 devstack@n-api.service[137461]: WARNING keystonemiddleware.auth_token [None req-4356aaa6-9ef9-4dfd-bdbc-317bd08da18e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:50:58.995619 ncdv-master-1 devstack@n-api.service[137461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555c0aa819c0 pid: 137461 (default app) Jun 25 20:50:59.002666 ncdv-master-1 devstack@n-api.service[137462]: WARNING keystonemiddleware.auth_token [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 20:50:59.010243 ncdv-master-1 devstack@n-api.service[137462]: WARNING keystonemiddleware.auth_token [None req-9c16ec4b-5645-4dcd-a74a-d610c409f1b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 20:50:59.015553 ncdv-master-1 devstack@n-api.service[137462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c0aa819c0 pid: 137462 (default app) Jun 25 20:51:46.682919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.684082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.685117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:46.685905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.007890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.009030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.010263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.010921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:47.953613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:47.955431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:47.956028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:47.956986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:47.957589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.001245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca14dd83-67fd-4cfa-a1f5-e3db082778f3 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.328756 Jun 25 20:51:48.001838 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1/1] 10.222.0.39 () {58 vars in 1163 bytes} [Sat Jun 25 20:51:46 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:48.052388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '.version_select at 0x7f985f03a0d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:48.054436 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.054436 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:48.060392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137462) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 25 20:51:48.061263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.061732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.087998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.088514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.102812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.103268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.109563 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fbf9026-6786-42bd-9cfc-0130ccff87f2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.109105 Jun 25 20:51:48.110147 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 20:51:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:48.198076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11f52895-fbcc-4712-bf0a-28cceb023663 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1074327532", "id": 1997275338, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:48.217542 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.217542 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.236170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1506050360", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:48.253855 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11f52895-fbcc-4712-bf0a-28cceb023663 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.250727 Jun 25 20:51:48.254431 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2/3] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:51:48 2022] POST /compute/v2.1/flavors => generated 471 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:51:48.427102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Calling method '.version_select at 0x7f985ef19550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:48.428393 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.428393 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.435408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137461) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jun 25 20:51:48.436204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.436713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.464488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.465487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.483933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.484625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.491816 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6af1632d-d651-430c-a66c-d42a4b861b7c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.236266 Jun 25 20:51:48.492437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3/4] 10.222.0.39 () {60 vars in 1207 bytes} [Sat Jun 25 20:51:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:51:48.661857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:51:48.682742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cea08382-cef7-46fa-82ba-3ac5191cb604 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1717111408", "ram": 512, "vcpus": 1, "disk": 10, "id": 1261366404, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:48.684388 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.684388 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.707362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cea08382-cef7-46fa-82ba-3ac5191cb604 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.213039 Jun 25 20:51:48.707984 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 4/5] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:51:48 2022] POST /compute/v2.1/flavors => generated 416 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:48.822550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:48.823812 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.823812 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.825084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.825533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.826328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.826769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.852662 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04411364-a6f9-4415-aa62-6ac288049008 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.143534 Jun 25 20:51:48.853274 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 5/6] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:51:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:48.858214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:48.858706 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.858706 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.859888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.860570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.861558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:48.862390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:48.887698 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e56dc95-63ab-4148-a96d-a08c6c580b29 tempest-AZAdminV2TestJSON-843345057 tempest-AZAdminV2TestJSON-843345057-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.033388 Jun 25 20:51:48.888300 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 6/7] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 20:51:48 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:48.898778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8f64503-9ec8-4bac-bdf7-a3b4a3d33764 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1961411476", "name": "tempest-test_aggregate-1864454152"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:48.916675 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:48.916675 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:48.917995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-d8f64503-9ec8-4bac-bdf7-a3b4a3d33764 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 29ef9e74-0fe1-40f3-ad64-a80ae79f32c3 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:51:48.988113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:51:48.988890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:51:48.989361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:51:48.989975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:51:48.992467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:51:49.000733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8f64503-9ec8-4bac-bdf7-a3b4a3d33764 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.110037 Jun 25 20:51:49.007427 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 7/8] 10.222.0.39 () {60 vars in 1164 bytes} [Sat Jun 25 20:51:48 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:49.012593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c586bf5-a36a-41cc-b570-22f523d8f4f6 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.014687 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.014687 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:49.017185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:49.017964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:49.019455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:49.020050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:49.062083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Getting quotas for project fb34595547bf4acc9abbb87c043554ca. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:51:49.074351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Getting quotas for user 259e4c3f5ff24d5b955ec36009319598 and project fb34595547bf4acc9abbb87c043554ca. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:51:49.093897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:51:49.098390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:51:49.186763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f3c61fa-8e9b-41f8-91c8-5284d80ecf3e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075291 Jun 25 20:51:49.187416 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2/9] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:51:49.192807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6685fc13-6942-4379-862e-94efb6f40084 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.195103 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.195103 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:49.230721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c586bf5-a36a-41cc-b570-22f523d8f4f6 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1997275338/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.213599 Jun 25 20:51:49.230721 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 8/10] 10.222.0.39 () {62 vars in 1264 bytes} [Sat Jun 25 20:51:49 2022] POST /compute/v2.1/flavors/1997275338/os-extra_specs => generated 62 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:49.244687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7d92c95-32d2-46a4-953c-1f93fbfe78d5 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.245660 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.245660 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:49.267232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7d92c95-32d2-46a4-953c-1f93fbfe78d5 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.035760 Jun 25 20:51:49.268091 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 9/11] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:49.268797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6685fc13-6942-4379-862e-94efb6f40084 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.079894 Jun 25 20:51:49.273601 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3/12] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:51:49 2022] POST /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:49.275919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60f9afeb-fc82-4143-a005-7a0e57811adc tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.276753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-60f9afeb-fc82-4143-a005-7a0e57811adc tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:49.368134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-60f9afeb-fc82-4143-a005-7a0e57811adc tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:49.387106 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60f9afeb-fc82-4143-a005-7a0e57811adc tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1220 microversion: 2.1 time: 0.116296 Jun 25 20:51:49.387959 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 4/13] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:49.393289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e04bfec-8a18-480d-972c-b078a05528bc tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.394049 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.394049 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:49.426658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e04bfec-8a18-480d-972c-b078a05528bc tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1997275338" status: 202 len: 0 microversion: 2.86 time: 0.037555 Jun 25 20:51:49.427252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 5/14] 10.222.0.39 () {60 vars in 1201 bytes} [Sat Jun 25 20:51:49 2022] DELETE /compute/v2.1/flavors/1997275338 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:51:49.545152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bcee184-a389-472b-b3ac-a91d8f9dcd82 tempest-AZAdminNegativeTestJSON-902923658 tempest-AZAdminNegativeTestJSON-902923658-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.547806 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.547806 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:49.550347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6bcee184-a389-472b-b3ac-a91d8f9dcd82 tempest-AZAdminNegativeTestJSON-902923658 tempest-AZAdminNegativeTestJSON-902923658-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b343199db9a64f2c952199dee2e6eabd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e2ed54264470db5b531662c5a7dc8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bcee184-a389-472b-b3ac-a91d8f9dcd82 tempest-AZAdminNegativeTestJSON-902923658 tempest-AZAdminNegativeTestJSON-902923658-project] Request method failure captured: Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Vkw0ECSHs8ISkndLehYvF1Bo9CwuHoalZaNUUvpfknTfwCl2QWBPElexX5vpWOuOuzLKaBp8O7tf_9dHZ2uIiotW_8G12cYhGam2-qso_DmKPac2ZkbrRNLppaSQtpQ9ySGapd27jwy0rAhQrgd5vRZnPXr6TASf-M1hrFLFSTTOc Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 225e2ed54264470db5b531662c5a7dc8 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AZAdminNegativeTestJSON-902923658 Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:51:49.564120 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/225e2ed54264470db5b531662c5a7dc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/225e2ed54264470db5b531662c5a7dc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_225e2ed54264470db5b531662c5a7dc8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/225e2ed54264470db5b531662c5a7dc8"}]}] Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AZAdminNegativeTestJSON-902923658 Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 225e2ed54264470db5b531662c5a7dc8 Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-902923658 Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AZAdminNegativeTestJSON-902923658-project Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b343199db9a64f2c952199dee2e6eabd Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AZAdminNegativeTestJSON-902923658-project Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 25 20:51:49.565516 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:51:49.566708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:51:49.567872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bcee184-a389-472b-b3ac-a91d8f9dcd82 tempest-AZAdminNegativeTestJSON-902923658 tempest-AZAdminNegativeTestJSON-902923658-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:51:49.569470 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6bcee184-a389-472b-b3ac-a91d8f9dcd82 tempest-AZAdminNegativeTestJSON-902923658 tempest-AZAdminNegativeTestJSON-902923658-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.293732 Jun 25 20:51:49.570376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 10/15] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:51:49.579214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ead65fc3-40e9-4979-8f2c-b8bca66d7a07 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.599585 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.599585 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:51:49.616396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ead65fc3-40e9-4979-8f2c-b8bca66d7a07 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:49.616991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ead65fc3-40e9-4979-8f2c-b8bca66d7a07 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:49.683293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8a1d4db-1317-4952-801b-c75e70b03ff6 tempest-FlavorsExtraSpecsTestJSON-2095374438 tempest-FlavorsExtraSpecsTestJSON-2095374438-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.697499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8a1d4db-1317-4952-801b-c75e70b03ff6 tempest-FlavorsExtraSpecsTestJSON-2095374438 tempest-FlavorsExtraSpecsTestJSON-2095374438-project] 10.222.0.39 "GET /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.268818 Jun 25 20:51:49.704405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 6/16] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:49.708828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-df1c872b-c3c6-4de8-b0ae-1f1d3f15e2d4 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.740985 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-df1c872b-c3c6-4de8-b0ae-1f1d3f15e2d4 tempest-FlavorMetadataValidation-1982502741 tempest-FlavorMetadataValidation-1982502741-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6270 microversion: 2.86 time: 0.040731 Jun 25 20:51:49.754816 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 7/17] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/flavors/detail => generated 6270 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:51:49.759892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22360244-fbea-42d1-80a8-03b2169f4d7f tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.761298 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.761298 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:49.786017 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22360244-fbea-42d1-80a8-03b2169f4d7f tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029340 Jun 25 20:51:49.786957 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 8/18] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:51:49 2022] POST /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:49.807140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd16e363-de54-4587-bbf4-3f7de5489ca5 tempest-FlavorsExtraSpecsTestJSON-2095374438 tempest-FlavorsExtraSpecsTestJSON-2095374438-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.832676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd16e363-de54-4587-bbf4-3f7de5489ca5 tempest-FlavorsExtraSpecsTestJSON-2095374438 tempest-FlavorsExtraSpecsTestJSON-2095374438-project] 10.222.0.39 "GET /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040608 Jun 25 20:51:49.833335 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 9/19] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 20:51:49.843495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a1961b8-a299-47f6-b32d-5293eb083a4e tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.892525 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a1961b8-a299-47f6-b32d-5293eb083a4e tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053403 Jun 25 20:51:49.893143 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 10/20] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:51:49 2022] POST /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:49.903112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f0a0bb6-c720-4708-bd8b-b238a89dde04 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:49.924903 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f0a0bb6-c720-4708-bd8b-b238a89dde04 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025344 Jun 25 20:51:49.930028 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:49.937684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7012da3d-688c-4a3c-831a-9212be57a4b8 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:49.939481 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:49.939481 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:49.977786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7012da3d-688c-4a3c-831a-9212be57a4b8 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.046229 Jun 25 20:51:49.986398 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 12/22] 10.222.0.39 () {60 vars in 1264 bytes} [Sat Jun 25 20:51:49 2022] PUT /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes => generated 22 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 20:51:49.994505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7061c863-2e11-449a-a586-23f4c6f3a528 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.005046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7061c863-2e11-449a-a586-23f4c6f3a528 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015467 Jun 25 20:51:50.010613 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 13/23] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 20:51:49 2022] GET /compute/v2.1/flavors/1261366404/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:50.016628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd970ac1-dadd-45c7-956d-586491c26677 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.017494 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:50.017494 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:50.073863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd970ac1-dadd-45c7-956d-586491c26677 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.061589 Jun 25 20:51:50.074517 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 14/24] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 20:51:50 2022] DELETE /compute/v2.1/flavors/1261366404/os-extra_specs/hw:numa_nodes => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:51:50.086113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9571478-bc63-43d2-853c-b040939eccc3 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.110836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=5,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:50.132143 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9571478-bc63-43d2-853c-b040939eccc3 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1261366404/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.052856 Jun 25 20:51:50.133138 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 15/25] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 20:51:50 2022] DELETE /compute/v2.1/flavors/1261366404/os-extra_specs/hw:cpu_policy => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 25 20:51:50.142769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-792f8a38-51a0-4f35-8e5e-93def44fce1c tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.169364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-792f8a38-51a0-4f35-8e5e-93def44fce1c tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1261366404/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031388 Jun 25 20:51:50.174380 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 16/26] 10.222.0.39 () {58 vars in 1202 bytes} [Sat Jun 25 20:51:50 2022] GET /compute/v2.1/flavors/1261366404/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:51:50.181016 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ead65fc3-40e9-4979-8f2c-b8bca66d7a07 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.1 time: 0.601068 Jun 25 20:51:50.184381 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 11/27] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:51:49 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:50.189851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61f6b55e-5686-4495-b468-cb58af6a873a tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.222893 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61f6b55e-5686-4495-b468-cb58af6a873a tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1261366404" status: 202 len: 0 microversion: 2.1 time: 0.042223 Jun 25 20:51:50.223486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 17/28] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:51:50 2022] DELETE /compute/v2.1/flavors/1261366404 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:51:50.233884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-756d7918-0d51-4308-bcba-252c9d597505 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.281494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-756d7918-0d51-4308-bcba-252c9d597505 tempest-FlavorsExtraSpecsTestJSON-485340055 tempest-FlavorsExtraSpecsTestJSON-485340055-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052983 Jun 25 20:51:50.282587 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 12/29] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:51:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:50.408631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-965632a9-305f-45e4-b9fb-b7265bdf56fd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:50.409818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-965632a9-305f-45e4-b9fb-b7265bdf56fd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:51.137498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1828318991", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "availability_zone": "tempest-test_az-1961411476"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:51.149490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:51.149933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:51.150727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:51.151155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:51.234619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:51:51.561126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:51:51.561506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:51:51.562171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:51:51.562678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:51:51.563111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:51:51.581532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:51.582346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:51.584508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:51.585288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:51.616367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-965632a9-305f-45e4-b9fb-b7265bdf56fd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:51.627229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Getting quotas for project 9b9e4621cb39462ba663e92f2e38a0b5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:51:51.635716 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-965632a9-305f-45e4-b9fb-b7265bdf56fd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1220 microversion: 2.1 time: 1.234092 Jun 25 20:51:51.636101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Getting quotas for user de7f658e8ff74ef2bc3a90c74b0013eb and project 9b9e4621cb39462ba663e92f2e38a0b5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:51:51.642572 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 13/30] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:50 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1220 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:51:51.672695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:51:51.679697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:51:51.769970 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a9e97f8-95cd-4404-ae5a-c73d48c78301 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423313 Jun 25 20:51:51.773294 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 18/31] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:51:51.782259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee677d4d-c072-4e93-aec4-9d0dd254a5ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:51.783033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee677d4d-c072-4e93-aec4-9d0dd254a5ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:51.876072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee677d4d-c072-4e93-aec4-9d0dd254a5ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:51.886276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee677d4d-c072-4e93-aec4-9d0dd254a5ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1243 microversion: 2.1 time: 0.108351 Jun 25 20:51:51.888923 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 14/32] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:51 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1243 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:52.656752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:52.657765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:52.689558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:52.692598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:52.695780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:52.697247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:52.906555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7780ccd3-492d-41a1-94a4-9d4ab7219ec1 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:52.907454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7780ccd3-492d-41a1-94a4-9d4ab7219ec1 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:53.031818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:53.061029 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e3f6fdd-accc-4f8f-abc1-7e43ad330d64 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1278 microversion: 2.1 time: 0.412163 Jun 25 20:51:53.073062 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 19/33] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:52 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1278 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:53.281430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7780ccd3-492d-41a1-94a4-9d4ab7219ec1 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:53.295583 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7780ccd3-492d-41a1-94a4-9d4ab7219ec1 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1243 microversion: 2.1 time: 0.394686 Jun 25 20:51:53.306583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 15/34] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:52 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1243 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:54.085005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:54.086925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:54.121831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:54.124851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:54.130913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:54.133348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:54.317341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:54.318213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:54.339011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:54.341349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:54.343364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:54.345130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:54.570496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:54.580558 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dce7eb59-080f-4a6c-8295-f6040ce334a6 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.504248 Jun 25 20:51:54.586482 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 20/35] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:54 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:54.764211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:54.784272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73fd9594-69eb-4264-b45a-a9d5ae994194 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1309 microversion: 2.1 time: 0.471025 Jun 25 20:51:54.787211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 16/36] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:54 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:55.607156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:55.608272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:55.633950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:55.636025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:55.637739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:55.638564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:55.807862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:55.809317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:55.827086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:55.827855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:55.829326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:55.832797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:56.025320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:56.041839 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-468fe3e3-f02b-421d-9c12-9e01d4f215f4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1297 microversion: 2.1 time: 0.239015 Jun 25 20:51:56.051819 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 17/37] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:55 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1297 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:56.799158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:56.816089 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab1934ff-96ba-4e91-b14b-dbe0d4c34afa tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 1.214649 Jun 25 20:51:56.829974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 21/38] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:55 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:57.060179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:57.060935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:57.074468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:57.081311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:57.086381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:57.090393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:57.835234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:57.835853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:57.852592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:57.853057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:57.853852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:57.854292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:57.887721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:57.896123 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-776719d8-fa8a-4c6c-b451-cdb5f769766d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.840230 Jun 25 20:51:57.900159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 18/39] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:57 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:58.307226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:58.321698 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-886ceb44-e156-498f-a028-3af9c25b7442 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.485626 Jun 25 20:51:58.322349 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 22/40] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:57 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:51:58.761612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fda98a58-a215-4bd4-9170-8d42562da672 req-f1ec683d-de5a-429e-8048-d9529d2850af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38a07d3-7458-4d71-90df-cd47e528ba35", "tag": "653bf2de-114e-4e35-b5da-7331195ff869"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:58.782742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fda98a58-a215-4bd4-9170-8d42562da672 req-f1ec683d-de5a-429e-8048-d9529d2850af service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:58.783556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fda98a58-a215-4bd4-9170-8d42562da672 req-f1ec683d-de5a-429e-8048-d9529d2850af service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:58.826474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fda98a58-a215-4bd4-9170-8d42562da672 req-f1ec683d-de5a-429e-8048-d9529d2850af service nova] Creating event network-changed:653bf2de-114e-4e35-b5da-7331195ff869 for instance e38a07d3-7458-4d71-90df-cd47e528ba35 on nch2-master-1 Jun 25 20:51:58.827200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fda98a58-a215-4bd4-9170-8d42562da672 req-f1ec683d-de5a-429e-8048-d9529d2850af service nova] Acquired lock "compute-rpcapi-router" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:51:58.828739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:58.829288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:58.830181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:58.830714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:58.845141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.compute.rpcapi [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 25 20:51:58.846547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] Releasing lock "compute-rpcapi-router" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:51:58.882288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58e3e5bc-c094-41be-b1f4-511e7ecb1ec2 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377854 Jun 25 20:51:58.883660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 19/41] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:58.916730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:58.918221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:58.928518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:58.929408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:58.930408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:58.931289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:59.144332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:51:59.157248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc073d91-ecc3-474d-8441-c18318b49615 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.245493 Jun 25 20:51:59.171285 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:58 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:51:59.345141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:51:59.345846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:51:59.361427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:59.361921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:59.362734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:51:59.364915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:51:59.479046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53bbe3f6-b880-4a9a-8744-560bd8104ba3 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1902158836", "id": 78960155, "os-flavor-access:is_public": "False"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:59.480861 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:59.480861 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:51:59.511371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53bbe3f6-b880-4a9a-8744-560bd8104ba3 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.719161 Jun 25 20:51:59.512592 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 23/43] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:51:58 2022] POST /compute/v2.1/flavors => generated 425 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:51:59.532792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-182bb56d-493c-4ad3-ae53-643cec0eb0ca tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e6bafd21c6734b378874ebf67e23b231"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:51:59.535220 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:51:59.535220 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:00.133810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:00.145674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f4e153ae-b56e-4d76-8c63-dd870ae50bd2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.807282 Jun 25 20:52:00.147177 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 21/44] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:51:59 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:00.177487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:00.178944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:00.189901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.190370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.193497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.195095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.448361 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-182bb56d-493c-4ad3-ae53-643cec0eb0ca tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/78960155/action" status: 200 len: 95 microversion: 2.1 time: 0.926694 Jun 25 20:52:00.450771 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 24/45] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:51:59 2022] POST /compute/v2.1/flavors/78960155/action => generated 95 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:00.569791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:00.587954 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c60d563b-17a1-4940-9a20-4150fe30430a tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.415607 Jun 25 20:52:00.588833 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 22/46] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:00 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:00.643447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Calling method '.version_select at 0x7f985dcbb700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:00.645195 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:00.645195 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:00.646999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.647598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.668040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.668827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.683801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.684501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.694850 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c7c4c7b-050c-4541-afa2-f3d23f060d65 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.242686 Jun 25 20:52:00.696327 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 25/47] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:52:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:00.730378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Calling method '.version_select at 0x7f985d485ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:00.731439 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:00.731439 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:00.732847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.733493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.762822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.764530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.794394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:00.795780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:00.820195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-831b679e-b9ab-4104-8f70-9942dcc44080 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.218828 Jun 25 20:52:00.822135 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:00.937206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9bf1358-e147-451b-abcd-fa94d40f2b80 tempest-FlavorsAccessTestJSON-627293134 tempest-FlavorsAccessTestJSON-627293134-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:00.995257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8110fc8-2e0a-4953-8e99-8c7329f6e0e4 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1898157526", "ram": 512, "vcpus": 1, "disk": 10, "id": 1350864900, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:01.023365 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9bf1358-e147-451b-abcd-fa94d40f2b80 tempest-FlavorsAccessTestJSON-627293134 tempest-FlavorsAccessTestJSON-627293134-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.325360 Jun 25 20:52:01.027386 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 26/49] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:00 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:01.032778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Calling method '.version_select at 0x7f985dd4e160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:01.035276 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:01.035276 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:01.040121 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:01.040121 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:01.046249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.047833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.074754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8110fc8-2e0a-4953-8e99-8c7329f6e0e4 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.235758 Jun 25 20:52:01.076149 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 24/50] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:00 2022] POST /compute/v2.1/flavors => generated 416 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:01.089037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Calling method '.version_select at 0x7f985d54b670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:01.093581 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:01.093581 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:01.095223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.096666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.145828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.149895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.238666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.240196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.263335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da5e27b3-8f4a-4a47-a99c-d5dca563e707 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.185478 Jun 25 20:52:01.264521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 25/51] 10.222.0.39 () {58 vars in 1211 bytes} [Sat Jun 25 20:52:01 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 196 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:01.277001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e41834b4-3b72-4789-9693-78b5697c099c tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e6bafd21c6734b378874ebf67e23b231"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:01.278945 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:01.278945 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:01.389631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:01.430410 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e41834b4-3b72-4789-9693-78b5697c099c tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/78960155/action" status: 200 len: 21 microversion: 2.1 time: 0.162374 Jun 25 20:52:01.432567 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 26/52] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:01 2022] POST /compute/v2.1/flavors/78960155/action => generated 21 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:01.476655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.477632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.486136 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86dd28b7-2c01-41cd-8081-6dd7137a1e77 tempest-HypervisorAdminV228Test-1960958067 tempest-HypervisorAdminV228Test-1960958067-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.457339 Jun 25 20:52:01.496985 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 27/53] 10.222.0.39 () {60 vars in 1192 bytes} [Sat Jun 25 20:52:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:01.504018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:01.505788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:01.514517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.515285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.516667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:01.517356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:01.605614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:01.660527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:01.911630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-151ce1b1-81d6-4730-8263-1536f293f9be tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:01.956006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:01.976040 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4777449a-9507-4ed3-b588-65f41fea2920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.476815 Jun 25 20:52:01.976714 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 28/54] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:01 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:02.007446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Calling method '.version_select at 0x7f985dd4e5e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.009224 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-151ce1b1-81d6-4730-8263-1536f293f9be tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] HTTP exception thrown: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:02.013136 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.013136 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-151ce1b1-81d6-4730-8263-1536f293f9be tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Request method failure captured: Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Vt9L2BjpOCRDFRaVE3ndmgks9-vaG5V1_VuS7CaBEVrHqVcSYQSohw-6XOJRza66AmTV57A-YRgxRrqv9OVrC3ItiwOeMb9KZY8i07Ocbot2zahZOGktKace5dO3E9PnICs-tJVK4cK7n-mMX03xtyoA7Nq63ldw7-R_ndDwyzqnI Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:02.016439 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}] Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 68692a535dd0447a9e68c00644194480 Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:02.018121 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'flavor_id': '1350864900', 'id': 'hw:cpu_thread_policy'} Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:02.018743 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:02.020704 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.021783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-151ce1b1-81d6-4730-8263-1536f293f9be tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Returning 404 to user: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:02.026355 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-151ce1b1-81d6-4730-8263-1536f293f9be tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] 10.222.0.39 "GET /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.592482 Jun 25 20:52:02.027648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.029223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.030872 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 27/55] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 20:52:01 2022] GET /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 597 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:02.047897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4c1f1e7-9621-4095-b2ed-2c6ef7222aec tempest-FlavorsAccessTestJSON-627293134 tempest-FlavorsAccessTestJSON-627293134-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.072838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.073305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.089199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.090918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.099629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c05b40af-5365-4d87-93df-444e44e7ad42 tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.121811 Jun 25 20:52:02.100959 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:02.106502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.107687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:02.115472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.115847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.118944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.119564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.186687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4c1f1e7-9621-4095-b2ed-2c6ef7222aec tempest-FlavorsAccessTestJSON-627293134 tempest-FlavorsAccessTestJSON-627293134-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.148445 Jun 25 20:52:02.193930 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 28/57] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:02.210881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-035f497a-6ec1-4ce6-bf46-2a017d80f500 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:02.220196 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.220196 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.221894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-035f497a-6ec1-4ce6-bf46-2a017d80f500 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '68692a535dd0447a9e68c00644194480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af62bf0347fa45a19dd2b9091ac99623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-035f497a-6ec1-4ce6-bf46-2a017d80f500 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Request method failure captured: Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/flavors/1350864900/os-extra_specs HTTP/1.1 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 66 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Vt9L2BjpOCRDFRaVE3ndmgks9-vaG5V1_VuS7CaBEVrHqVcSYQSohw-6XOJRza66AmTV57A-YRgxRrqv9OVrC3ItiwOeMb9KZY8i07Ocbot2zahZOGktKace5dO3E9PnICs-tJVK4cK7n-mMX03xtyoA7Nq63ldw7-R_ndDwyzqnI Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:02.233708 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}] Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 68692a535dd0447a9e68c00644194480 Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jun 25 20:52:02.235194 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'flavor_id': '1350864900', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:02.235994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jun 25 20:52:02.237114 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.243625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-035f497a-6ec1-4ce6-bf46-2a017d80f500 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:02.245657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-035f497a-6ec1-4ce6-bf46-2a017d80f500 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] 10.222.0.39 "POST /compute/v2.1/flavors/1350864900/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.050440 Jun 25 20:52:02.250365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 29/58] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:52:02 2022] POST /compute/v2.1/flavors/1350864900/os-extra_specs => generated 124 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:02.255802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Calling method '.version_select at 0x7f985f8c71f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.274047 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.274047 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.277990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.290472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.336881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:02.338451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:02.362934 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fca7749a-857d-4a15-9f0f-506efbd2050b tempest-HypervisorAdminUnderV252Test-700913148 tempest-HypervisorAdminUnderV252Test-700913148-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.108843 Jun 25 20:52:02.371260 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 20:52:02 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:02.384860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d07e249-8cad-459d-a98d-ebd4f3f4fb0a tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.390753 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.390753 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.484689 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d07e249-8cad-459d-a98d-ebd4f3f4fb0a tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/78960155" status: 202 len: 0 microversion: 2.1 time: 0.111252 Jun 25 20:52:02.487024 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 31/60] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:02 2022] DELETE /compute/v2.1/flavors/78960155 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:02.529650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b27fbb0-b1f1-46e8-8db6-728f0c3e2eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:02.534732 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.534732 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.625360 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b27fbb0-b1f1-46e8-8db6-728f0c3e2eb9 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1350864900/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.130296 Jun 25 20:52:02.632372 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:52:02 2022] POST /compute/v2.1/flavors/1350864900/os-extra_specs => generated 66 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:02.641692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d633ad3-6d04-457b-8375-256964417162 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.698392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d633ad3-6d04-457b-8375-256964417162 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.064020 Jun 25 20:52:02.704479 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 33/62] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:02 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:02.704800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fb31534-7902-4393-9a12-813c8ec577cb tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.705324 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.705324 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.706339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fb31534-7902-4393-9a12-813c8ec577cb tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '68692a535dd0447a9e68c00644194480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af62bf0347fa45a19dd2b9091ac99623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fb31534-7902-4393-9a12-813c8ec577cb tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Request method failure captured: Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Vt9L2BjpOCRDFRaVE3ndmgks9-vaG5V1_VuS7CaBEVrHqVcSYQSohw-6XOJRza66AmTV57A-YRgxRrqv9OVrC3ItiwOeMb9KZY8i07Ocbot2zahZOGktKace5dO3E9PnICs-tJVK4cK7n-mMX03xtyoA7Nq63ldw7-R_ndDwyzqnI Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:02.708365 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}] Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 68692a535dd0447a9e68c00644194480 Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:02.709499 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'flavor_id': '1350864900', 'id': 'hw:numa_nodes'} Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:02.710053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.711010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fb31534-7902-4393-9a12-813c8ec577cb tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:02.712045 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fb31534-7902-4393-9a12-813c8ec577cb tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] 10.222.0.39 "DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009289 Jun 25 20:52:02.717014 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 34/63] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 20:52:02 2022] DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes => generated 124 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:02.723510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43085d2f-ebf2-4bc2-8be9-0acb855bb0a9 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1144376547", "id": 1814003647, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:02.727156 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.727156 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.760784 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43085d2f-ebf2-4bc2-8be9-0acb855bb0a9 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.040493 Jun 25 20:52:02.764460 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 35/64] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:02 2022] POST /compute/v2.1/flavors => generated 431 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:02.777708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-324a20da-ee74-4f53-8bc5-6102889bdca8 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:02.880629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-324a20da-ee74-4f53-8bc5-6102889bdca8 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1350864900/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.114788 Jun 25 20:52:02.881850 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 36/65] 10.222.0.39 () {60 vars in 1223 bytes} [Sat Jun 25 20:52:02 2022] POST /compute/v2.1/flavors/1350864900/os-extra_specs => generated 66 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:02.898840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c6053a1-b326-496b-a494-79e4fb69f63e tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:02.902818 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.902818 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.926195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c6053a1-b326-496b-a494-79e4fb69f63e tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/1814003647/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.042932 Jun 25 20:52:02.927493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 37/66] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 20:52:02 2022] GET /compute/v2.1/flavors/1814003647/os-flavor-access => generated 21 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:02.934030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ead1f044-8e81-4288-9ef6-a73639a8a936 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:02.935807 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:02.935807 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:02.937499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ead1f044-8e81-4288-9ef6-a73639a8a936 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '68692a535dd0447a9e68c00644194480', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af62bf0347fa45a19dd2b9091ac99623', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ead1f044-8e81-4288-9ef6-a73639a8a936 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Request method failure captured: Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 22 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Vt9L2BjpOCRDFRaVE3ndmgks9-vaG5V1_VuS7CaBEVrHqVcSYQSohw-6XOJRza66AmTV57A-YRgxRrqv9OVrC3ItiwOeMb9KZY8i07Ocbot2zahZOGktKace5dO3E9PnICs-tJVK4cK7n-mMX03xtyoA7Nq63ldw7-R_ndDwyzqnI Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:02.939960 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af62bf0347fa45a19dd2b9091ac99623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af62bf0347fa45a19dd2b9091ac99623"}]}] Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af62bf0347fa45a19dd2b9091ac99623 Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 68692a535dd0447a9e68c00644194480 Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: {"hw:numa_nodes": "1"} Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:02.941159 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'flavor_id': '1350864900', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:02.941835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jun 25 20:52:02.943099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:02.945636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ead1f044-8e81-4288-9ef6-a73639a8a936 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:02.946744 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ead1f044-8e81-4288-9ef6-a73639a8a936 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619 tempest-FlavorsExtraSpecsNegativeTestJSON-1472115619-project] 10.222.0.39 "PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017664 Jun 25 20:52:02.948019 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 38/67] 10.222.0.39 () {60 vars in 1264 bytes} [Sat Jun 25 20:52:02 2022] PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes => generated 124 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:02.954754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ec1bfd9-c173-4827-bfe3-ee64e88616a5 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.028262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ec1bfd9-c173-4827-bfe3-ee64e88616a5 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1814003647" status: 202 len: 0 microversion: 2.1 time: 0.078528 Jun 25 20:52:03.035316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 39/68] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:52:02 2022] DELETE /compute/v2.1/flavors/1814003647 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:03.048373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-295d4ac2-caeb-4d41-a6e3-6b9cea44fe3d tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.059515 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-295d4ac2-caeb-4d41-a6e3-6b9cea44fe3d tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] HTTP exception thrown: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-295d4ac2-caeb-4d41-a6e3-6b9cea44fe3d tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Request method failure captured: Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VwmlMUGqTSMvghnsIko2P5qQ-imo2e_XI-i0g7_K5vH3z_8xkSBbR9grla_vZWLV5PAHQXuQx4QR2MKLUSoQPI0Qt8LprvyLhwVPOc6wMKETpoQvmcGBFZ0IV3lKdCmtKLdv0NeW1EmiJx9WYwOSdk_VC2LAjf_auzJvMsTIrsUkg Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:03.061977 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}] Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 4e33144a84224668ae91b62a7438a010 Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:03.063124 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'flavor_id': '1350864900', 'id': 'hw:cpu_thread_policy'} Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:03.063737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. Jun 25 20:52:03.065658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.067655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-295d4ac2-caeb-4d41-a6e3-6b9cea44fe3d tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Returning 404 to user: Flavor 1350864900 has no extra specs with key hw:cpu_thread_policy. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:03.068872 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-295d4ac2-caeb-4d41-a6e3-6b9cea44fe3d tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.032175 Jun 25 20:52:03.070077 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 40/69] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 20:52:03 2022] DELETE /compute/v2.1/flavors/1350864900/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:03.075584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.076620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:03.115544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:03.117719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:03.124197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:03.125544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:03.294667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:03.406520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:03.418925 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43c2a612-3dba-4f9b-b2ce-e376a7c7de43 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 1.313881 Jun 25 20:52:03.421857 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 30/70] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:02 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:03.436045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba7f3272-2336-4fc1-b330-566d9f4a2241 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.504314 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba7f3272-2336-4fc1-b330-566d9f4a2241 tempest-FlavorsAccessTestJSON-1459361770 tempest-FlavorsAccessTestJSON-1459361770-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.079327 Jun 25 20:52:03.518489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 31/71] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:03.551742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0a1193f-0269-4f58-9631-3a4b581a1093 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:03.556456 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:03.556456 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:03.566961 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f0a1193f-0269-4f58-9631-3a4b581a1093 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] HTTP exception thrown: Request body and URI mismatch Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0a1193f-0269-4f58-9631-3a4b581a1093 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Request method failure captured: Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 27 Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3VwmlMUGqTSMvghnsIko2P5qQ-imo2e_XI-i0g7_K5vH3z_8xkSBbR9grla_vZWLV5PAHQXuQx4QR2MKLUSoQPI0Qt8LprvyLhwVPOc6wMKETpoQvmcGBFZ0IV3lKdCmtKLdv0NeW1EmiJx9WYwOSdk_VC2LAjf_auzJvMsTIrsUkg Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:03.569771 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}] Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 4e33144a84224668ae91b62a7438a010 Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: {"hw:cpu_policy": "shared"} Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:03.570959 ncdv-master-1 devstack@n-api.service[137462]: exception: Request body and URI mismatch Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'flavor_id': '1350864900', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.571659 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0a1193f-0269-4f58-9631-3a4b581a1093 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:03.572774 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0a1193f-0269-4f58-9631-3a4b581a1093 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.034605 Jun 25 20:52:03.579603 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 32/72] 10.222.0.39 () {60 vars in 1264 bytes} [Sat Jun 25 20:52:03 2022] PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes => generated 73 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:03.584751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61cf6dcf-cec4-4a37-be90-175c0cef337e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:03.770672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:03.770672 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3207c34-ccfc-43c4-9522-4d6597c36a57 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.679780 Jun 25 20:52:03.770672 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 41/73] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:03 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61cf6dcf-cec4-4a37-be90-175c0cef337e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Request method failure captured: Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes HTTP/1.1 Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 49 Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3VwmlMUGqTSMvghnsIko2P5qQ-imo2e_XI-i0g7_K5vH3z_8xkSBbR9grla_vZWLV5PAHQXuQx4QR2MKLUSoQPI0Qt8LprvyLhwVPOc6wMKETpoQvmcGBFZ0IV3lKdCmtKLdv0NeW1EmiJx9WYwOSdk_VC2LAjf_auzJvMsTIrsUkg Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:03.785711 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e21d9dfe4f9e43419319585b02f6d6cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e21d9dfe4f9e43419319585b02f6d6cc"}]}] Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e21d9dfe4f9e43419319585b02f6d6cc Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 4e33144a84224668ae91b62a7438a010 Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jun 25 20:52:03.788033 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'flavor_id': '1350864900', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': ['string', Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'number']}}, Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance: Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jun 25 20:52:03.789351 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.791254 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jun 25 20:52:03.793340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:03.798313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61cf6dcf-cec4-4a37-be90-175c0cef337e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:03.801188 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61cf6dcf-cec4-4a37-be90-175c0cef337e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.220062 Jun 25 20:52:03.803990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 33/74] 10.222.0.39 () {60 vars in 1264 bytes} [Sat Jun 25 20:52:03 2022] PUT /compute/v2.1/flavors/1350864900/os-extra_specs/hw:numa_nodes => generated 117 bytes in 223 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:03.841774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1747bf23-6cf8-4b9b-90a6-f0d6919e594e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.843476 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:03.843476 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:03.865111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e220a03b-ddc7-408e-83ef-8272649e6312 req-f71d7cde-c518-4d09-8658-f5a52cb6ed34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4648d0-de74-4b1a-81dd-ea74faf0588b", "tag": "e59ab662-e460-4883-81b2-26899ad0987d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:03.881358 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1747bf23-6cf8-4b9b-90a6-f0d6919e594e tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1350864900" status: 202 len: 0 microversion: 2.1 time: 0.070267 Jun 25 20:52:03.885132 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 34/75] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:52:03 2022] DELETE /compute/v2.1/flavors/1350864900 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:52:03.886137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e220a03b-ddc7-408e-83ef-8272649e6312 req-f71d7cde-c518-4d09-8658-f5a52cb6ed34 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:03.886735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e220a03b-ddc7-408e-83ef-8272649e6312 req-f71d7cde-c518-4d09-8658-f5a52cb6ed34 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:03.904957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f92d864-ea37-479d-8da0-893316d99b7c tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:03.907892 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e220a03b-ddc7-408e-83ef-8272649e6312 req-f71d7cde-c518-4d09-8658-f5a52cb6ed34 service nova] Creating event network-changed:e59ab662-e460-4883-81b2-26899ad0987d for instance ae4648d0-de74-4b1a-81dd-ea74faf0588b on nch1-master-1 Jun 25 20:52:03.921188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e220a03b-ddc7-408e-83ef-8272649e6312 req-f71d7cde-c518-4d09-8658-f5a52cb6ed34 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166000 Jun 25 20:52:03.922116 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 42/76] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:03.973432 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f92d864-ea37-479d-8da0-893316d99b7c tempest-FlavorsExtraSpecsNegativeTestJSON-134807209 tempest-FlavorsExtraSpecsNegativeTestJSON-134807209-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082679 Jun 25 20:52:03.974498 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 35/77] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:04.441712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:04.442503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:04.467033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:04.469497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:04.476222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:04.476748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:04.790692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:04.793065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:04.843184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:04.844839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:04.850110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:04.851775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:04.906128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:04.919193 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f557613a-2894-4685-8605-27be95cad93f tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.483879 Jun 25 20:52:04.930165 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 43/78] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:04 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:05.288619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:05.304976 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-37b569db-8921-4a7f-8c42-f2d44deb50ce tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.518075 Jun 25 20:52:05.313987 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 36/79] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:04 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:05.942123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:05.945363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:05.959734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:05.961132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:05.964136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:05.967533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:06.331458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:06.334191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:06.355142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:06.355858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:06.356984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:06.357567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:06.630029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:06.652850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1f8f830d-f86e-4ed6-91a6-2cf8a7a735ce tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.713253 Jun 25 20:52:06.658426 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 44/80] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:05 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:06.747243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:06.756951 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5df1d5d-0a3c-4388-a7d2-d558ac8087e9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.434286 Jun 25 20:52:06.779274 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 37/81] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:06 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:07.676069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:07.676876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:07.690373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:07.693722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:07.698032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:07.698953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:07.787133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:07.788446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:07.798195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:07.801058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:07.809290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:07.812067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:07.882361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:07.889313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:07.898245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ba675de-b028-4333-8298-e1aa15a96882 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.226423 Jun 25 20:52:07.899200 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 45/82] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:07 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:08.044215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:08.057275 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c635f0e-946c-4779-879a-73772a5b635f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.274661 Jun 25 20:52:08.058567 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 38/83] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:07 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:08.918650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:08.919290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:08.922684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:08.930156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:08.930614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:08.931398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:08.931822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:09.075526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:09.076221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:09.077585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:09.083573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:09.084584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:09.085534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:09.086397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:09.086735 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-972fc740-5d66-404f-9d48-0aa31ca70741 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.175478 Jun 25 20:52:09.097366 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 46/84] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:08 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:09.243410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:09.253066 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9a115b0-32c0-4e38-9eeb-b336e22ca99b tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.181937 Jun 25 20:52:09.254279 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 39/85] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:09 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:10.105816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.107053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:10.109043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-70e26297-d1c5-4c83-9886-8d94ad0be3d0 tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] Calling method '.version_select at 0x7f985cb55310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.117047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.117743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.118541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.121635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.245808 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-70e26297-d1c5-4c83-9886-8d94ad0be3d0 tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.388128 Jun 25 20:52:10.247723 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 47/86] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:09 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:10.255570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfc7b63b-05f3-4f81-aa9e-158e2b9ffdaf tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] Calling method '.version_select at 0x7f985cb559d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.294163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:10.303366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a78ae1a6-510f-4612-bc19-ee2c3156cf2c tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.201731 Jun 25 20:52:10.304793 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 40/87] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:10.310150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.310992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:10.318021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.318632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.319549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.320122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.372119 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dfc7b63b-05f3-4f81-aa9e-158e2b9ffdaf tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks/44774a18-2ab5-4f45-acd8-0f01387b275f" status: 200 len: 652 microversion: 2.1 time: 0.120090 Jun 25 20:52:10.372815 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 48/88] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/os-networks/44774a18-2ab5-4f45-acd8-0f01387b275f => generated 652 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:10.382002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92d3a100-2079-4709-a396-c91bb05a795a tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] Calling method '.version_select at 0x7f985d49a9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.507549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:10.512980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:10.519366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1cbfb376-5b23-45ed-961d-be20ac4bb248 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.213065 Jun 25 20:52:10.519991 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 41/89] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:10.529039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92d3a100-2079-4709-a396-c91bb05a795a tempest-NetworksTest-1540780786 tempest-NetworksTest-1540780786-project-admin] 10.222.0.39 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.145055 Jun 25 20:52:10.529039 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 49/90] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:10.827499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Calling method '.version_select at 0x7f985d405af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:10.828413 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:10.828413 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:10.830654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.831099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.848416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.848959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.864662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:10.865160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:10.871501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2904b906-ee53-49d6-8058-c82b6c4c45a5 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.346152 Jun 25 20:52:10.872224 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 50/91] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:11.205606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30614dcf-3d29-4e03-894b-c0e3dc5b3898 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.207234 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.207234 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:11.211027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-30614dcf-3d29-4e03-894b-c0e3dc5b3898 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jun 25 20:52:11.217761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c54a70b6-cc29-4d0e-9310-c250f4574237 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Calling method '.version_select at 0x7f985dcbbdc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.219201 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.219201 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:11.220677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c54a70b6-cc29-4d0e-9310-c250f4574237 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '1636417dff5a4857a2eaf9acd150e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed6752b2897473cbdd87c1ea50fdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c54a70b6-cc29-4d0e-9310-c250f4574237 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Request method failure captured: Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V5WNGwdMK7u3nVq5LiLl8k62CA_zewDLGmThqfQ5aUd5db1wO0ndKMHBq3nhYlb6Eio0sWsgujKbSonN-Z63lOzyuRjPfqed6M2hmURlgppBK83RUYi8F8lWFPP-R1nyZkqpYiTHDsYfVQvx8jofMkhUbr1AqnclCP7gn3WmHIEDA Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4ed6752b2897473cbdd87c1ea50fdc6c Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:11.226056 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ed6752b2897473cbdd87c1ea50fdc6c"}]}] Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4ed6752b2897473cbdd87c1ea50fdc6c Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-398870814-project Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1636417dff5a4857a2eaf9acd150e5fe Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814-project Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 25 20:52:11.227247 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'nch1-master-1'} Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:11.227912 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jun 25 20:52:11.228925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.231355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c54a70b6-cc29-4d0e-9310-c250f4574237 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.232915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c54a70b6-cc29-4d0e-9310-c250f4574237 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.353734 Jun 25 20:52:11.233923 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 42/92] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 356 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30614dcf-3d29-4e03-894b-c0e3dc5b3898 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin] Request method failure captured: Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3V6qTpTXLfoXHB8_7iS1z8MIxyTUOydWiHO8uKoWA4KVuOPIZb_57x4Jy6t3fFxfvV4NqluIAhxeHEvZE1oX9Ht8QvRbQIHuTKx-XrA0UWlMF9nbDG0EwreFIHnA_nA32ZfYUOecUk4kNGmoypX7cgt_0qjRXQKBYYF_vlBN0zmXAU Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 9043b81c9654478c9a0a4c21b74044e1 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:11.236848 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9043b81c9654478c9a0a4c21b74044e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9043b81c9654478c9a0a4c21b74044e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9043b81c9654478c9a0a4c21b74044e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9043b81c9654478c9a0a4c21b74044e1"}]}] Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 9043b81c9654478c9a0a4c21b74044e1 Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ced6cbaa77664e5799b7a66e1a7d4a6a Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:11.237957 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid timestamp for date invalid_time Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'invalid_time'} Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.238558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jun 25 20:52:11.239642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.241375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30614dcf-3d29-4e03-894b-c0e3dc5b3898 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.242545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30614dcf-3d29-4e03-894b-c0e3dc5b3898 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372 tempest-InstanceUsageAuditLogNegativeTestJSON-1827305372-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.279593 Jun 25 20:52:11.243106 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 51/93] 10.222.0.39 () {58 vars in 1223 bytes} [Sat Jun 25 20:52:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 25 20:52:11.249732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Calling method '.version_select at 0x7f985dc838b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.252892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.253734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.269633 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Request method failure captured: Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V6VqUbB4FkGH1wNG6mqEi5V81bUGvnLNOUh8rC1RDKjgnLMjKXlhbBvogHyuW_BF-QzyZ4mEm-UMcSfv5E91qWflImz_dD9ArhVpkc23pF3MkqGU7Or1FQU2qVMHyPV1nE0PZHdbZeITOYdTdCH8C87j3cVOsfBqfMkC_84KJ0dNU Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9b57aea414a84712bfa37be5ff1691c8 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:11.276798 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b57aea414a84712bfa37be5ff1691c8"}]}] Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9b57aea414a84712bfa37be5ff1691c8 Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dc4144db571c464c9cdb446852bcd876 Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 25 20:52:11.277932 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'nonexistent_hypervisor_name'} Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.278593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9541949f-007c-4f58-ba16-ddd1f1d4b80a tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.034324 Jun 25 20:52:11.279628 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 43/94] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.289468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Calling method '.version_select at 0x7f985dc83c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.290939 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.290939 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:11.292511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.293095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.310187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.310522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.321831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.322392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.328634 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e9234ec4-7edc-4670-8801-9f0d5f962827 tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043415 Jun 25 20:52:11.329554 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 44/95] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:11.334606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.335459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:11.341818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.342358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.343118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.343598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.398125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4e7b257-b178-411a-808b-2f8bcc4e135c tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.398817 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.398817 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:11.399956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4e7b257-b178-411a-808b-2f8bcc4e135c tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'afe855a61c584a728633d50d240d53f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d29d01f1a45a09a0a8d1a2da1e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4e7b257-b178-411a-808b-2f8bcc4e135c tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Request method failure captured: Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3V5E0Kd8vXE54pBDx99R2egPCaLi0807-LtjO8YhTGsumzAyI9MZSEnJS0-efJTIdVBDh2Sm7RCo26vQ_WGkSsUC8Ufl_1BK8kWwjePG9n_PLM8M0kVAxtfVfZDfd9gUm-7VZRMavl_FQI2kBd2XO10OGZuup7-ItGuX7Y9OIUNQmM Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 912d29d01f1a45a09a0a8d1a2da1e3a0 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:11.401738 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}] Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 912d29d01f1a45a09a0a8d1a2da1e3a0 Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: afe855a61c584a728633d50d240d53f1 Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:11.402939 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:11.403520 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.404651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4e7b257-b178-411a-808b-2f8bcc4e135c tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.405493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4e7b257-b178-411a-808b-2f8bcc4e135c tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.153592 Jun 25 20:52:11.405493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 52/96] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 155 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.409362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-840cc3e8-a4ce-4407-a6aa-98745d8b4195 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Calling method '.version_select at 0x7f985cb555e0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.410290 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.410290 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:11.411415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-840cc3e8-a4ce-4407-a6aa-98745d8b4195 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '1636417dff5a4857a2eaf9acd150e5fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ed6752b2897473cbdd87c1ea50fdc6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-840cc3e8-a4ce-4407-a6aa-98745d8b4195 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Request method failure captured: Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3V5WNGwdMK7u3nVq5LiLl8k62CA_zewDLGmThqfQ5aUd5db1wO0ndKMHBq3nhYlb6Eio0sWsgujKbSonN-Z63lOzyuRjPfqed6M2hmURlgppBK83RUYi8F8lWFPP-R1nyZkqpYiTHDsYfVQvx8jofMkhUbr1AqnclCP7gn3WmHIEDA Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4ed6752b2897473cbdd87c1ea50fdc6c Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:11.413634 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4ed6752b2897473cbdd87c1ea50fdc6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4ed6752b2897473cbdd87c1ea50fdc6c"}]}] Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4ed6752b2897473cbdd87c1ea50fdc6c Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814 Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-398870814-project Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1636417dff5a4857a2eaf9acd150e5fe Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-398870814-project Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1'} Jun 25 20:52:11.414739 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:11.415478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jun 25 20:52:11.416773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.417673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-840cc3e8-a4ce-4407-a6aa-98745d8b4195 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.417673 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-840cc3e8-a4ce-4407-a6aa-98745d8b4195 tempest-HypervisorAdminNegativeUnderV252Test-398870814 tempest-HypervisorAdminNegativeUnderV252Test-398870814-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.009531 Jun 25 20:52:11.417673 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 53/97] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.511773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.521731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-595688bf-fae9-441f-b231-4adb27f1efbe tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.190979 Jun 25 20:52:11.522497 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 45/98] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:11.527314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-484eb65c-5db0-47fa-8f88-12f9496aa162 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.528103 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.528103 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:11.529241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-484eb65c-5db0-47fa-8f88-12f9496aa162 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'afe855a61c584a728633d50d240d53f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912d29d01f1a45a09a0a8d1a2da1e3a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-484eb65c-5db0-47fa-8f88-12f9496aa162 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Request method failure captured: Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-06-25%2020:52:11 HTTP/1.1 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V5E0Kd8vXE54pBDx99R2egPCaLi0807-LtjO8YhTGsumzAyI9MZSEnJS0-efJTIdVBDh2Sm7RCo26vQ_WGkSsUC8Ufl_1BK8kWwjePG9n_PLM8M0kVAxtfVfZDfd9gUm-7VZRMavl_FQI2kBd2XO10OGZuup7-ItGuX7Y9OIUNQmM Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 912d29d01f1a45a09a0a8d1a2da1e3a0 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:11.531416 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_912d29d01f1a45a09a0a8d1a2da1e3a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/912d29d01f1a45a09a0a8d1a2da1e3a0"}]}] Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 912d29d01f1a45a09a0a8d1a2da1e3a0 Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: afe855a61c584a728633d50d240d53f1 Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:11.532853 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '2022-06-25 20:52:11'} Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:11.533617 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.534925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-484eb65c-5db0-47fa-8f88-12f9496aa162 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.535967 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-484eb65c-5db0-47fa-8f88-12f9496aa162 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220 tempest-InstanceUsageAuditLogNegativeTestJSON-17849220-project] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-25 20:52:11" status: 403 len: 128 microversion: 2.1 time: 0.009209 Jun 25 20:52:11.535967 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 46/99] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-25%2020%3A52%3A11 => generated 128 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.541262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Calling method '.version_select at 0x7f985dc23af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.542144 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.542144 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:11.543363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.543884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.551928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] HTTP exception thrown: No hypervisor matching '738cfe2b-fb65-4a62-b8d6-3987ef5b4488' could be found. Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Request method failure captured: Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/738cfe2b-fb65-4a62-b8d6-3987ef5b4488/servers HTTP/1.1 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V6VqUbB4FkGH1wNG6mqEi5V81bUGvnLNOUh8rC1RDKjgnLMjKXlhbBvogHyuW_BF-QzyZ4mEm-UMcSfv5E91qWflImz_dD9ArhVpkc23pF3MkqGU7Or1FQU2qVMHyPV1nE0PZHdbZeITOYdTdCH8C87j3cVOsfBqfMkC_84KJ0dNU Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9b57aea414a84712bfa37be5ff1691c8 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:11.553579 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b57aea414a84712bfa37be5ff1691c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b57aea414a84712bfa37be5ff1691c8"}]}] Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9b57aea414a84712bfa37be5ff1691c8 Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951 Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dc4144db571c464c9cdb446852bcd876 Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: exception: No hypervisor matching '738cfe2b-fb65-4a62-b8d6-3987ef5b4488' could be found. Jun 25 20:52:11.554740 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '738cfe2b-fb65-4a62-b8d6-3987ef5b4488'} Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '738cfe2b-fb65-4a62-b8d6-3987ef5b4488' could be found. Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.555481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '738cfe2b-fb65-4a62-b8d6-3987ef5b4488' could be found. Jun 25 20:52:11.557051 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:11.558192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] Returning 404 to user: No hypervisor matching '738cfe2b-fb65-4a62-b8d6-3987ef5b4488' could be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:11.559231 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3522e767-748a-4f3b-ad78-54a14a2618ee tempest-HypervisorAdminNegativeUnderV252Test-474024951 tempest-HypervisorAdminNegativeUnderV252Test-474024951-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/738cfe2b-fb65-4a62-b8d6-3987ef5b4488/servers" status: 404 len: 123 microversion: 2.1 time: 0.024749 Jun 25 20:52:11.560274 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 47/100] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/os-hypervisors/738cfe2b-fb65-4a62-b8d6-3987ef5b4488/servers => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:11.568398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:11.569235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:11.571579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85cd36a1-273f-452b-b782-3e9ed80c1d5f tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-284542911", "id": 1585273054, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:11.573295 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.573295 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:11.576185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.576899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.577818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:11.578395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:11.595132 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85cd36a1-273f-452b-b782-3e9ed80c1d5f tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.178206 Jun 25 20:52:11.596475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 54/101] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:11 2022] POST /compute/v2.1/flavors => generated 438 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:11.613911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ced7681-5365-43c9-af51-ef71b157e29e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:11.615643 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:11.615643 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:11.731029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:11.742490 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0562479-4d83-4c7d-8d8e-9de54e85b66c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.180805 Jun 25 20:52:11.743077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 48/102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:11 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:12.189406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ced7681-5365-43c9-af51-ef71b157e29e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1585273054/action" status: 200 len: 97 microversion: 2.1 time: 0.586206 Jun 25 20:52:12.190047 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 55/103] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:11 2022] POST /compute/v2.1/flavors/1585273054/action => generated 97 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:12.200317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d17d09bf-b2ad-4366-b6c1-cca46d56ab6c tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:12.201747 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:12.201747 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:12.504181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:12.510587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d17d09bf-b2ad-4366-b6c1-cca46d56ab6c tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] HTTP exception thrown: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. Jun 25 20:52:12.539436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:12.540086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:12.546653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:12.547110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:12.547947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:12.548388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d17d09bf-b2ad-4366-b6c1-cca46d56ab6c tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Request method failure captured: Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/flavors/1585273054/action HTTP/1.1 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 67 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V6EMDyc9OwOPlH5jalAQeg_b365oc2c5zBTtxlMJ2aiQmhYn9OT7jDS4PpTlrObrfe0jacVto7NyrCtFCNizVG8ekSHG2UneOwX0cpSZuGDIzFalj9FniBb2pOuRN1yAQA0-FnXCljVY0cAagC8syhG_V53Z_G3SvGYCS1G9QN_0c Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:12.624837 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f77fec7e28f1495b8207391a39352008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f77fec7e28f1495b8207391a39352008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}] Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 43ecdca15957494abb92bfe30a030fe0 Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} Jun 25 20:52:12.626032 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: exception: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1585273054', 'body': {'addTenantAccess': {'tenant': '1f39dd45affa48fa836488de7e0f501b'}}} Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:52:12.626680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '20-1f39dd45affa48fa836488de7e0f501b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi project.save(context.session) Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi session.flush() Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:52:12.627771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:52:12.628854 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:52:12.630014 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '20-1f39dd45affa48fa836488de7e0f501b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 25, 20, 52, 12, 503486), 'updated_at': None, 'flavor_id': 20, 'project_id': '1f39dd45affa48fa836488de7e0f501b'}] Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:12.630929 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:12.631788 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:12.632790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:12.634197 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. Jun 25 20:52:12.634197 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:12.634197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d17d09bf-b2ad-4366-b6c1-cca46d56ab6c tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Returning 409 to user: Flavor access already exists for flavor 20 and project 1f39dd45affa48fa836488de7e0f501b combination. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:12.634197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d17d09bf-b2ad-4366-b6c1-cca46d56ab6c tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1585273054/action" status: 409 len: 152 microversion: 2.1 time: 0.430363 Jun 25 20:52:12.634197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 49/104] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:12 2022] POST /compute/v2.1/flavors/1585273054/action => generated 152 bytes in 432 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 25 20:52:12.638636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-56dbeb3c-ac10-4411-8011-b83f24ab717e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:12.639972 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:12.639972 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:12.799979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:12.822029 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14cde5ee-3a47-43be-b6df-4984aa8d21b9 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.286746 Jun 25 20:52:12.822646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 56/105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:12 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:12.837092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:12.837727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:12.854588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:12.855033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:12.855794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:12.857163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:12.974591 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-56dbeb3c-ac10-4411-8011-b83f24ab717e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1585273054/action" status: 200 len: 21 microversion: 2.1 time: 0.342925 Jun 25 20:52:12.983319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 50/106] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:12 2022] POST /compute/v2.1/flavors/1585273054/action => generated 21 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 20:52:12.990752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78a34672-a1e3-4d0f-8716-a317c209c180 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:12.991593 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:12.991593 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:13.035422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78a34672-a1e3-4d0f-8716-a317c209c180 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1585273054" status: 202 len: 0 microversion: 2.1 time: 0.050822 Jun 25 20:52:13.036082 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 51/107] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:52:12 2022] DELETE /compute/v2.1/flavors/1585273054 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:13.049237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae59baa6-4d42-45aa-be39-64eeca8436bf tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.063122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:13.072343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-824dda57-f0da-4d5f-b062-eae4ce55d2b8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.246687 Jun 25 20:52:13.083483 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 57/108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:12 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:13.085587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae59baa6-4d42-45aa-be39-64eeca8436bf tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043853 Jun 25 20:52:13.087622 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 52/109] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:13.105933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b33f3d19-86d2-4583-ae0e-33a629b59ed0 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-488617310", "id": 194624271, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:13.108398 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:13.108398 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:13.128054 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b33f3d19-86d2-4583-ae0e-33a629b59ed0 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.028606 Jun 25 20:52:13.129279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 58/110] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:13 2022] POST /compute/v2.1/flavors => generated 434 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:13.141540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03e740af-00cc-44b6-b333-a639cb062996 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.142652 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:13.142652 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:13.151787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-03e740af-00cc-44b6-b333-a639cb062996 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] HTTP exception thrown: Access list not available for public flavors. Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03e740af-00cc-44b6-b333-a639cb062996 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Request method failure captured: Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/flavors/194624271/os-flavor-access HTTP/1.1 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V6EMDyc9OwOPlH5jalAQeg_b365oc2c5zBTtxlMJ2aiQmhYn9OT7jDS4PpTlrObrfe0jacVto7NyrCtFCNizVG8ekSHG2UneOwX0cpSZuGDIzFalj9FniBb2pOuRN1yAQA0-FnXCljVY0cAagC8syhG_V53Z_G3SvGYCS1G9QN_0c Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:13.153263 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f77fec7e28f1495b8207391a39352008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f77fec7e28f1495b8207391a39352008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}] Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 43ecdca15957494abb92bfe30a030fe0 Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: exception: Access list not available for public flavors. Jun 25 20:52:13.154709 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'flavor_id': '194624271'} Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jun 25 20:52:13.155465 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.156562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03e740af-00cc-44b6-b333-a639cb062996 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:13.156562 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03e740af-00cc-44b6-b333-a639cb062996 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/194624271/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.018241 Jun 25 20:52:13.156562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 53/111] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 20:52:13 2022] GET /compute/v2.1/flavors/194624271/os-flavor-access => generated 91 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 25 20:52:13.164517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c838aa0-795d-4f76-b422-130bee9779fe tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.165367 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:13.165367 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:13.176945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=10,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:13.185998 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c838aa0-795d-4f76-b422-130bee9779fe tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/194624271" status: 202 len: 0 microversion: 2.1 time: 0.025302 Jun 25 20:52:13.189041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 59/112] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:52:13 2022] DELETE /compute/v2.1/flavors/194624271 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:13.196704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7dde135-a290-4bd7-aadc-82a46e4ec187 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.217545 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7dde135-a290-4bd7-aadc-82a46e4ec187 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025573 Jun 25 20:52:13.230012 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 54/113] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:13.241374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db9ecf48-ddac-4d85-94cc-eb02f76e4b15 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2042387372", "id": 401889395, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:13.275711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db9ecf48-ddac-4d85-94cc-eb02f76e4b15 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.044768 Jun 25 20:52:13.277072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 60/114] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:13 2022] POST /compute/v2.1/flavors => generated 436 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:13.568447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-180c083f-b001-463d-8758-30fb7aaf0bc4 tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:13.570571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-180c083f-b001-463d-8758-30fb7aaf0bc4 tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '09de5e17cfef4914ad400fade6819a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39dd45affa48fa836488de7e0f501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-180c083f-b001-463d-8758-30fb7aaf0bc4 tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Request method failure captured: Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/flavors/401889395/action HTTP/1.1 Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 67 Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V4zlXLz-_pLl6koPWtAYX1dnB_BR3e7UERrcrjmrE4yvJgBVfFP06auTOXM-ZU8iWrlBcZYIYG3D1c25jfW8-053C40xJz5edYWedWeBsK-lb9zbXNfQY4kzUG0OFSqUg0XkugHlWx9xDU25Ks-tKpgAENSFsOKmjAngfPERFzcZk Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1f39dd45affa48fa836488de7e0f501b Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:13.572183 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f39dd45affa48fa836488de7e0f501b"}]}] Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1f39dd45affa48fa836488de7e0f501b Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsAccessNegativeTestJSON-1095887393-project Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 09de5e17cfef4914ad400fade6819a73 Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393-project Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} Jun 25 20:52:13.573432 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '401889395', 'body': {'addTenantAccess': {'tenant': '1f39dd45affa48fa836488de7e0f501b'}}} Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:13.574088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jun 25 20:52:13.575005 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:13.577805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-180c083f-b001-463d-8758-30fb7aaf0bc4 tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:13.578856 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-180c083f-b001-463d-8758-30fb7aaf0bc4 tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] 10.222.0.39 "POST /compute/v2.1/flavors/401889395/action" status: 403 len: 130 microversion: 2.1 time: 0.294811 Jun 25 20:52:13.584125 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 55/115] 10.222.0.39 () {60 vars in 1196 bytes} [Sat Jun 25 20:52:13 2022] POST /compute/v2.1/flavors/401889395/action => generated 130 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:13.591295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-653ac853-1b93-44cc-ab79-ed039b3327b8 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.614048 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-653ac853-1b93-44cc-ab79-ed039b3327b8 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/401889395" status: 202 len: 0 microversion: 2.1 time: 0.028351 Jun 25 20:52:13.618141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 61/116] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:52:13 2022] DELETE /compute/v2.1/flavors/401889395 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:13.630024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-159f5332-fc68-4dda-9222-9f19f632d002 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.667901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-159f5332-fc68-4dda-9222-9f19f632d002 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046434 Jun 25 20:52:13.681005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 56/117] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:13.686816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e272e47e-89c6-4629-a8b3-267bbf677bfd tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1379702577", "id": 1302131753, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:13.709302 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e272e47e-89c6-4629-a8b3-267bbf677bfd tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.026202 Jun 25 20:52:13.711280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 62/118] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:13.723234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-de9eef97-7a2a-4104-9c66-0ab1869d8a7d tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:13.839728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:13.840373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:13.850546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:13.851092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:13.851908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:13.852359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:14.028217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-de9eef97-7a2a-4104-9c66-0ab1869d8a7d tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1302131753/action" status: 200 len: 97 microversion: 2.1 time: 0.309747 Jun 25 20:52:14.034955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 57/119] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:13 2022] POST /compute/v2.1/flavors/1302131753/action => generated 97 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:14.040276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9bfdcab-a2ad-4741-9479-97907127288b tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:14.046281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f9bfdcab-a2ad-4741-9479-97907127288b tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '09de5e17cfef4914ad400fade6819a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f39dd45affa48fa836488de7e0f501b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9bfdcab-a2ad-4741-9479-97907127288b tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Request method failure captured: Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/flavors/1302131753/action HTTP/1.1 Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 70 Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V4zlXLz-_pLl6koPWtAYX1dnB_BR3e7UERrcrjmrE4yvJgBVfFP06auTOXM-ZU8iWrlBcZYIYG3D1c25jfW8-053C40xJz5edYWedWeBsK-lb9zbXNfQY4kzUG0OFSqUg0XkugHlWx9xDU25Ks-tKpgAENSFsOKmjAngfPERFzcZk Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1f39dd45affa48fa836488de7e0f501b Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:14.051381 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1f39dd45affa48fa836488de7e0f501b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1f39dd45affa48fa836488de7e0f501b"}]}] Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1f39dd45affa48fa836488de7e0f501b Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393 Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsAccessNegativeTestJSON-1095887393-project Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 09de5e17cfef4914ad400fade6819a73 Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1095887393-project Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: {"removeTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} Jun 25 20:52:14.053328 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1302131753', 'body': {'removeTenantAccess': {'tenant': '1f39dd45affa48fa836488de7e0f501b'}}} Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can( Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:14.054238 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jun 25 20:52:14.055767 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:14.057251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9bfdcab-a2ad-4741-9479-97907127288b tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:14.057251 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f9bfdcab-a2ad-4741-9479-97907127288b tempest-FlavorsAccessNegativeTestJSON-1095887393 tempest-FlavorsAccessNegativeTestJSON-1095887393-project] 10.222.0.39 "POST /compute/v2.1/flavors/1302131753/action" status: 403 len: 133 microversion: 2.1 time: 0.019408 Jun 25 20:52:14.059098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:14.062409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 58/120] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:14 2022] POST /compute/v2.1/flavors/1302131753/action => generated 133 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:52:14.071081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-10a488c3-de9b-4ef8-b8b6-a3e112d283f3 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1f39dd45affa48fa836488de7e0f501b"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:14.072190 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a9c8f3c-e3f0-45eb-94a7-57b5fe7554cc tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.236602 Jun 25 20:52:14.072661 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 63/121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:13 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:14.091099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:14.091714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:14.097978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:14.098571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:14.099451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:14.100018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:14.265702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:14.273300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab785256-dc6e-435d-a075-178de55b7dc7 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.186867 Jun 25 20:52:14.274480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 64/122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:14 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:14.584201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-10a488c3-de9b-4ef8-b8b6-a3e112d283f3 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/1302131753/action" status: 200 len: 21 microversion: 2.1 time: 0.520150 Jun 25 20:52:14.589628 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 59/123] 10.222.0.39 () {60 vars in 1199 bytes} [Sat Jun 25 20:52:14 2022] POST /compute/v2.1/flavors/1302131753/action => generated 21 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:14.595904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b5247812-30ca-4b70-be50-735b2138dc4a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:14.596710 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:14.596710 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:14.621347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b5247812-30ca-4b70-be50-735b2138dc4a tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1302131753" status: 202 len: 0 microversion: 2.1 time: 0.030275 Jun 25 20:52:14.622593 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 65/124] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:52:14 2022] DELETE /compute/v2.1/flavors/1302131753 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:52:14.632061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-81f9e09a-b7db-4fed-ad2e-8a80aa85ffd6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:14.670330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-81f9e09a-b7db-4fed-ad2e-8a80aa85ffd6 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043314 Jun 25 20:52:14.671761 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 60/125] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:14.689044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9e52b4f-d73e-425f-a3b3-b5d001ca6d7e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2067283837", "id": 291064690, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:14.690856 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:14.690856 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:14.711092 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9e52b4f-d73e-425f-a3b3-b5d001ca6d7e tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.025885 Jun 25 20:52:14.712305 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 66/126] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:14 2022] POST /compute/v2.1/flavors => generated 436 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:14.726573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e6d2625-668f-434a-b212-469b8d6cc605 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1694d79cb0c646a39fa29b96aaa15507"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:15.090075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.090923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:15.099537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.100090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.100956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.101591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.132906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8e6d2625-668f-434a-b212-469b8d6cc605 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] HTTP exception thrown: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e6d2625-668f-434a-b212-469b8d6cc605 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Request method failure captured: Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/flavors/291064690/action HTTP/1.1 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 70 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V6EMDyc9OwOPlH5jalAQeg_b365oc2c5zBTtxlMJ2aiQmhYn9OT7jDS4PpTlrObrfe0jacVto7NyrCtFCNizVG8ekSHG2UneOwX0cpSZuGDIzFalj9FniBb2pOuRN1yAQA0-FnXCljVY0cAagC8syhG_V53Z_G3SvGYCS1G9QN_0c Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:15.135528 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f77fec7e28f1495b8207391a39352008"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f77fec7e28f1495b8207391a39352008"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f77fec7e28f1495b8207391a39352008"}]}] Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f77fec7e28f1495b8207391a39352008 Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-368984573 Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 43ecdca15957494abb92bfe30a030fe0 Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: {"removeTenantAccess": {"tenant": "1694d79cb0c646a39fa29b96aaa15507"}} Jun 25 20:52:15.137011 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: exception: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '291064690', 'body': {'removeTenantAccess': {'tenant': '1694d79cb0c646a39fa29b96aaa15507'}}} Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jun 25 20:52:15.137946 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:15.139133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e6d2625-668f-434a-b212-469b8d6cc605 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Returning 404 to user: Flavor access not found for 24 / 1694d79cb0c646a39fa29b96aaa15507 combination. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e6d2625-668f-434a-b212-469b8d6cc605 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors/291064690/action" status: 404 len: 124 microversion: 2.1 time: 0.417433 Jun 25 20:52:15.140355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 61/127] 10.222.0.39 () {60 vars in 1196 bytes} [Sat Jun 25 20:52:14 2022] POST /compute/v2.1/flavors/291064690/action => generated 124 bytes in 419 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:52:15.151111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1b40622-9889-4ea3-a11d-f575612df9df tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.181364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d1b40622-9889-4ea3-a11d-f575612df9df tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/291064690" status: 202 len: 0 microversion: 2.1 time: 0.037654 Jun 25 20:52:15.182109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 62/128] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:52:15 2022] DELETE /compute/v2.1/flavors/291064690 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:52:15.191548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95149a77-244b-44ca-b0e6-a7f1bd4bb1b9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.212765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95149a77-244b-44ca-b0e6-a7f1bd4bb1b9 tempest-FlavorsAccessNegativeTestJSON-368984573 tempest-FlavorsAccessNegativeTestJSON-368984573-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026145 Jun 25 20:52:15.213559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 63/129] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:15.264014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:15.272855 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63398ce2-d1a9-4c62-a96a-7a3d9d4dc0bb tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.186846 Jun 25 20:52:15.282519 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 67/130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:15.290605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.291262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:15.297885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.298332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.299110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.299544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.436993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:15.449524 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5120c3b0-19ab-405f-9f94-26028c683599 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.162921 Jun 25 20:52:15.450518 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 68/131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:15.609335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.610786 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.610786 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:15.611977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.612659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.613463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.613921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.637817 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-563aa8a8-4ff4-4e75-95c0-17224e04419b tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.361432 Jun 25 20:52:15.638404 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 64/132] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services => generated 969 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:15.649691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.650917 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.650917 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:15.652116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.652596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.653386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.653819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.663988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-bf823207-3d87-4e45-9a3a-518d69c3c23f req-768caa8f-04cf-458f-85e7-641315f81ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4648d0-de74-4b1a-81dd-ea74faf0588b", "name": "network-vif-plugged", "status": "completed", "tag": "e59ab662-e460-4883-81b2-26899ad0987d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:15.676352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf823207-3d87-4e45-9a3a-518d69c3c23f req-768caa8f-04cf-458f-85e7-641315f81ead service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.677020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf823207-3d87-4e45-9a3a-518d69c3c23f req-768caa8f-04cf-458f-85e7-641315f81ead service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.677812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-414b9fd5-8a71-4b9e-a9f7-6281f371c251 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.031883 Jun 25 20:52:15.685594 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 65/133] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 969 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:15.690680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.692108 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.692108 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:15.693588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.694242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.695236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.695719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-bf823207-3d87-4e45-9a3a-518d69c3c23f req-768caa8f-04cf-458f-85e7-641315f81ead service nova] Creating event network-vif-plugged:e59ab662-e460-4883-81b2-26899ad0987d for instance ae4648d0-de74-4b1a-81dd-ea74faf0588b on nch1-master-1 Jun 25 20:52:15.696092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.707297 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-bf823207-3d87-4e45-9a3a-518d69c3c23f req-768caa8f-04cf-458f-85e7-641315f81ead service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254462 Jun 25 20:52:15.713936 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 69/134] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:15.722241 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c0df911-f7e8-4887-8208-be90d7a9a11e tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.035185 Jun 25 20:52:15.728841 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 66/135] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services => generated 969 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:15.740947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.740947 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.740947 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:15.740947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.740947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.741287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.741287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.768135 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8730b4f7-c6f9-4b45-a596-7a86dc8dbfeb tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.037983 Jun 25 20:52:15.769699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 70/136] 10.222.0.39 () {58 vars in 1195 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:15.782578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.785453 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.785453 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:15.787511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.788270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.789793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.790743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.837096 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1a6015e-e2f6-49c4-821f-7793bc90b086 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 969 microversion: 2.1 time: 0.060577 Jun 25 20:52:15.838290 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 67/137] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services => generated 969 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:15.852675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:15.856567 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:15.856567 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:15.858919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.859947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.861041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:15.861685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:15.898929 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3f80662-e714-42c5-9136-8cdb438cd7e8 tempest-ServicesAdminNegativeTestJSON-115913250 tempest-ServicesAdminNegativeTestJSON-115913250-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.052465 Jun 25 20:52:15.907341 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 71/138] 10.222.0.39 () {58 vars in 1197 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:52:16.218627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fa6993f-ddaa-4842-9d61-6e8ce9facef3 tempest-ServicesAdminNegativeTestJSON-1363844607 tempest-ServicesAdminNegativeTestJSON-1363844607-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:16.219828 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:16.219828 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:16.221075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8fa6993f-ddaa-4842-9d61-6e8ce9facef3 tempest-ServicesAdminNegativeTestJSON-1363844607 tempest-ServicesAdminNegativeTestJSON-1363844607-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '64cc8bb214134a639e032c2f3b90b525', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e70855762d488086f9750692f43408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fa6993f-ddaa-4842-9d61-6e8ce9facef3 tempest-ServicesAdminNegativeTestJSON-1363844607 tempest-ServicesAdminNegativeTestJSON-1363844607-project] Request method failure captured: Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3V9YoFsfMNEbHXJKb_u81W9JuC30OFazmWYuTWm75IXGmzeWNJylUKFPV_LfILXVe_JTAf9khSO4vw4OeInNE95ymyU2NZqsja8H7rTXIjXygNQxXQf-SyCEXSiNzSOLydNS8HkYZMbX6ShTTzFLWcMKMEh3XNdNzQ4RxKVsrKnLuk Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 06e70855762d488086f9750692f43408 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1363844607 Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:16.225071 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/06e70855762d488086f9750692f43408"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06e70855762d488086f9750692f43408"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_06e70855762d488086f9750692f43408"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/06e70855762d488086f9750692f43408"}]}] Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1363844607 Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 06e70855762d488086f9750692f43408 Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1363844607 Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServicesAdminNegativeTestJSON-1363844607-project Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 64cc8bb214134a639e032c2f3b90b525 Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1363844607-project Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:16.226461 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:16.227240 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:16.228737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:16.231257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fa6993f-ddaa-4842-9d61-6e8ce9facef3 tempest-ServicesAdminNegativeTestJSON-1363844607 tempest-ServicesAdminNegativeTestJSON-1363844607-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:16.233760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fa6993f-ddaa-4842-9d61-6e8ce9facef3 tempest-ServicesAdminNegativeTestJSON-1363844607 tempest-ServicesAdminNegativeTestJSON-1363844607-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.325426 Jun 25 20:52:16.236297 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 68/139] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:52:15 2022] GET /compute/v2.1/os-services => generated 112 bytes in 329 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:52:16.292549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:16.293278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:16.300821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:16.301447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:16.302551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:16.303242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:16.454342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:16.462538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d93d50c3-fc75-46eb-bfcb-9d27234613b7 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.174778 Jun 25 20:52:16.463391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 72/140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:16 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:16.470579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:16.472996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:16.481624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:16.482103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:16.482913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:16.483344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:16.633501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:16.641152 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2587b3c2-596e-4ab8-9984-5bdc92058aa1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.177574 Jun 25 20:52:16.641723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 69/141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:16 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:17.465476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-70741dff-7cbb-4815-b531-a84f0324c903 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Action: 'create', calling method: .version_select at 0x7f985d4055e0>, body: {"keypair": {"name": "tempest-keypair-887803727", "type": "ssh", "user_id": "aa7e2c4cd4bd4d739d7a9bdd541ebe1f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDiYTbccY9n8DDrLOF7JjOXieXNzWhMEZPLmtaSOzHglWuJj47O61K1vXJ+fGfr/Fl+2vlO6waNWVZvYM4BXNG+HTz80wPHXsxuwoo2icQYoyLbM0YZI5a6U8gU9K7Amlg=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:17.479255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:17.479915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:17.486378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.491191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.492068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.492690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.510631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-70741dff-7cbb-4815-b531-a84f0324c903 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:17.518798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-70741dff-7cbb-4815-b531-a84f0324c903 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for user 3602791be0094112874d1c16cca92da8 and project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:17.553098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-70741dff-7cbb-4815-b531-a84f0324c903 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.447828 Jun 25 20:52:17.553864 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 73/142] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 20:52:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 451 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 20:52:17.567976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02425129-0783-4617-bf19-e841098e7554 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Action: 'create', calling method: .version_select at 0x7f985cb62a60>, body: {"keypair": {"name": "tempest-keypair-553886791", "type": "ssh", "user_id": "aa7e2c4cd4bd4d739d7a9bdd541ebe1f", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHMTv4P5sbk9qWKU9tGf4sTx7mjQPE3MgO3Onn9nvsLjoQRRx2JwTmCg9HcDDzUdxLaF0zAgH/710nd/FjUs3Q2wYMJqfXmy3GvKSBrXR3XNpZLSq8857K+93b7kMV8Lw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:17.589360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-02425129-0783-4617-bf19-e841098e7554 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:17.601286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-02425129-0783-4617-bf19-e841098e7554 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for user 3602791be0094112874d1c16cca92da8 and project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:17.639695 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02425129-0783-4617-bf19-e841098e7554 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.076936 Jun 25 20:52:17.642201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 74/143] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 20:52:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 25 20:52:17.651240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5309d877-26b5-4e7f-8eb8-c01827101992 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Calling method '.version_select at 0x7f985d405af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:17.669480 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5309d877-26b5-4e7f-8eb8-c01827101992 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-887803727?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f" status: 200 len: 511 microversion: 2.10 time: 0.022147 Jun 25 20:52:17.670778 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 75/144] 10.222.0.39 () {60 vars in 1336 bytes} [Sat Jun 25 20:52:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-887803727?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f => generated 511 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:17.683370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:17.684489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:17.692051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.692814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.693929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.694540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.699098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:17.709253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a4bb944e-9096-48fa-bbd4-8f5404966b23 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1339 microversion: 2.1 time: 0.233842 Jun 25 20:52:17.720600 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 70/145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:17 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:17.725221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3c72bb5-052d-4f79-8669-3b873f127f86 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Action: 'create', calling method: .version_select at 0x7f985d978ee0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-536687189", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHy4C1u9zuQ2sz+7aSWhNuqXOS6qrm1yL9lhJSsv0MzDAydze58I44r4+5zcVspeTI5c/6ctN5/7wATR1yY7/PEYP6+rIJlN5v6t3rXcgZglHcZS6PGmslPqR2JFuD1HYg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:17.750074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f3c72bb5-052d-4f79-8669-3b873f127f86 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:17.754614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f3c72bb5-052d-4f79-8669-3b873f127f86 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Getting quotas for user 3602791be0094112874d1c16cca92da8 and project 29931cdc2f2e48c891453c79d2fceb56. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:17.816364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3c72bb5-052d-4f79-8669-3b873f127f86 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.094543 Jun 25 20:52:17.818353 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 71/146] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 20:52:17 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 20:52:17.826707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0842ea63-c025-4a13-b738-82165fd0f084 req-0a1062b5-96d8-4cf8-b7e8-fba6acf6508e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38a07d3-7458-4d71-90df-cd47e528ba35", "name": "network-vif-plugged", "status": "completed", "tag": "653bf2de-114e-4e35-b5da-7331195ff869"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:17.847206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0842ea63-c025-4a13-b738-82165fd0f084 req-0a1062b5-96d8-4cf8-b7e8-fba6acf6508e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.847952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0842ea63-c025-4a13-b738-82165fd0f084 req-0a1062b5-96d8-4cf8-b7e8-fba6acf6508e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.871849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0842ea63-c025-4a13-b738-82165fd0f084 req-0a1062b5-96d8-4cf8-b7e8-fba6acf6508e service nova] Creating event network-vif-plugged:653bf2de-114e-4e35-b5da-7331195ff869 for instance e38a07d3-7458-4d71-90df-cd47e528ba35 on nch2-master-1 Jun 25 20:52:17.872674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0842ea63-c025-4a13-b738-82165fd0f084 req-0a1062b5-96d8-4cf8-b7e8-fba6acf6508e service nova] Acquired lock "compute-rpcapi-router" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:52:17.874116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.874957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.875897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:17.876627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:17.886109 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.rpcapi [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 25 20:52:17.887377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4435996-7b12-4359-96da-e2158596c68c None None] Releasing lock "compute-rpcapi-router" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:52:17.914733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:17.923471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ff00d83-80aa-452c-a4b7-a3f0f12d520a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.250817 Jun 25 20:52:17.923836 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4435996-7b12-4359-96da-e2158596c68c None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103487 Jun 25 20:52:17.925478 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 72/147] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:17.939983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 76/148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:17 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:17.962351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-481a40c1-dd09-42f4-af82-190e91f58bb6 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Calling method '.version_select at 0x7f985dc17550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:17.972548 ncdv-master-1 devstack@n-api.service[137462]: WARNING oslo_db.sqlalchemy.utils [None req-481a40c1-dd09-42f4-af82-190e91f58bb6 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 20:52:17.995466 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-481a40c1-dd09-42f4-af82-190e91f58bb6 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "GET /compute/v2.1/os-keypairs?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f" status: 200 len: 724 microversion: 2.10 time: 0.068476 Jun 25 20:52:17.996771 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 73/149] 10.222.0.39 () {60 vars in 1258 bytes} [Sat Jun 25 20:52:17 2022] GET /compute/v2.1/os-keypairs?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f => generated 724 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:18.007355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d1dab39b-0b87-46fc-b2bc-971c33054bf9 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Calling method '.version_select at 0x7f985ca69160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.057560 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d1dab39b-0b87-46fc-b2bc-971c33054bf9 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-536687189" status: 204 len: 0 microversion: 2.10 time: 0.053251 Jun 25 20:52:18.058952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 77/150] 10.222.0.39 () {60 vars in 1321 bytes} [Sat Jun 25 20:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-536687189 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:52:18.076582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79d8f66e-151d-4819-b713-d1aa73845a27 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Calling method '.version_select at 0x7f985ca69790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.106439 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79d8f66e-151d-4819-b713-d1aa73845a27 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553886791?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f" status: 204 len: 0 microversion: 2.10 time: 0.042749 Jun 25 20:52:18.114180 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 78/151] 10.222.0.39 () {60 vars in 1339 bytes} [Sat Jun 25 20:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553886791?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:52:18.120923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29fc8194-e118-45ac-9d84-93eb1f447391 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] Calling method '.version_select at 0x7f985ca6de50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.146375 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29fc8194-e118-45ac-9d84-93eb1f447391 tempest-KeyPairsV210TestJSON-2040127777 tempest-KeyPairsV210TestJSON-2040127777-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-887803727?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f" status: 204 len: 0 microversion: 2.10 time: 0.028260 Jun 25 20:52:18.148470 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 79/152] 10.222.0.39 () {60 vars in 1339 bytes} [Sat Jun 25 20:52:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-887803727?user_id=aa7e2c4cd4bd4d739d7a9bdd541ebe1f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:52:18.414112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Action: 'update', calling method: .version_select at 0x7f985d978160>, body: {"quota_set": {"ram": "5120"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:18.726666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.727683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:18.733958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.734411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:18.735165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.735785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:18.747794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.748362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:18.749899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.750471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:18.834526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03d41cf0-2249-463b-87f9-127b983d24d0 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97" status: 200 len: 148 microversion: 2.57 time: 0.816306 Jun 25 20:52:18.836478 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 74/153] 10.222.0.39 () {62 vars in 1302 bytes} [Sat Jun 25 20:52:18 2022] PUT /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97 => generated 148 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:18.846083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Calling method '.version_select at 0x7f985d978e50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.894756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:18.903002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f2dbbc6-15e1-4c85-8929-02393b06224e tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1488 microversion: 2.1 time: 0.180219 Jun 25 20:52:18.903660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 80/154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:18 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1488 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:18.920209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:18.921106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:18.927721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.928572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:18.929539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:18.930267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.252672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=9,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:19.260489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.261394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.262455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.263333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.308362 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52e20da6-0174-4da7-ba73-5c7bc4c4a506 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97/detail" status: 200 len: 463 microversion: 2.57 time: 0.465256 Jun 25 20:52:19.309508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 75/155] 10.222.0.39 () {60 vars in 1303 bytes} [Sat Jun 25 20:52:18 2022] GET /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97/detail => generated 463 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 20:52:19.318284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:19.323951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:19.340826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.341288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.342146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.342583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.351394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9b1b262-9d04-4eeb-83b9-0e955b416412 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1639 microversion: 2.1 time: 0.434641 Jun 25 20:52:19.352001 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 81/156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:18 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1639 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:19.368960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:19.370742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:19.378654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.379106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.379887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.380326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.425441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:52:19.557458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:19.567407 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-997ed9bd-3033-4e63-b726-59e1ee911fff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1320 microversion: 2.1 time: 0.254960 Jun 25 20:52:19.568553 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 76/157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:19 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:19.602743 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-716d1253-f1b2-4979-94b6-a26e395ab6ae tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 204 len: 0 microversion: 2.1 time: 0.237527 Jun 25 20:52:19.603418 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 82/158] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:52:19 2022] DELETE /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:52:19.612671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:19.613294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:19.620132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.620621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.621514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:19.622100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:19.764104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:19.774308 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd2c6f90-7acc-45ce-9295-0395beb0f4d4 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1494 microversion: 2.1 time: 0.166277 Jun 25 20:52:19.775081 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 77/159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:19 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1494 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:20.057526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Action: 'update', calling method: .version_select at 0x7f985cac8f70>, body: {"quota_set": {"ram": "2048"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:20.503116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=9,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.512315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.512995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.513906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.514504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.572067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.572793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.573871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.574459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.585109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:20.585955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:20.593244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.593955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.594946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.595621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.657628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1bafc045-54a3-48b2-9dd9-e013f6812662 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97?user_id=c8b24bdf086246e8b2a359bfd2f004b2" status: 200 len: 148 microversion: 2.57 time: 0.606348 Jun 25 20:52:20.663556 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 83/160] 10.222.0.39 () {62 vars in 1383 bytes} [Sat Jun 25 20:52:20 2022] PUT /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97?user_id=c8b24bdf086246e8b2a359bfd2f004b2 => generated 148 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:20.743033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:20.751466 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4bac9fb0-ad03-45a0-b162-b2ab072a5ff4 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1470 microversion: 2.1 time: 0.170502 Jun 25 20:52:20.752058 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 78/161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:20 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1470 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:20.757057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-881cb490-f3b3-4408-a612-63a153b0c924 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] Calling method '.version_select at 0x7f985d0e9940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:20.887511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Action: 'update', calling method: .version_select at 0x7f985c96a940>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:20.889231 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:20.889231 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:20.890548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.891086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.902914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:20.903621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:20.910273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:20.913784 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] HTTP exception thrown: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Request method failure captured: Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 HTTP/1.1 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 56 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WEvQq-PgK4hb-6uNGCkbBI8v4aTgLcs_asmW7VHaDbtOdjtoqGGRo5zBYUYSsYt89fgI7ZdN04mdPbt4ib0E9PsnCk4lyOJwEtIvTRJf0q6vt0Eo5v0B1dCQkmqdieWK_8QFc3zTsGoFFbk8UwT0Jsp3xTdptrXuOHd3h4zK_AqAg Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.53 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:20.918956 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}] Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 77f4ea9b80454b439c0fc86e192982f3 Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: {"status": "disabled", "disabled_reason": "maintenance"} Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:20.920504 ncdv-master-1 devstack@n-api.service[137461]: exception: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '834f34f3-4ab7-4e59-9fcd-417f112a2a53', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.921594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:20.922903 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:20.924153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:20.924153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:20.924153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:20.924153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Returning 404 to user: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:20.925472 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b4a7fdd-617d-4971-ab65-0de704d2509f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53" status: 404 len: 110 microversion: 2.53 time: 0.260574 Jun 25 20:52:20.930870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 84/162] 10.222.0.39 () {62 vars in 1308 bytes} [Sat Jun 25 20:52:20 2022] PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 => generated 110 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:21.029436 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-881cb490-f3b3-4408-a612-63a153b0c924 tempest-QuotasAdminTestV257-1432424499 tempest-QuotasAdminTestV257-1432424499-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97?user_id=c8b24bdf086246e8b2a359bfd2f004b2" status: 200 len: 190 microversion: 2.57 time: 0.275893 Jun 25 20:52:21.036838 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 79/163] 10.222.0.39 () {60 vars in 1363 bytes} [Sat Jun 25 20:52:20 2022] GET /compute/v2.1/os-quota-sets/270bbdc5d9264af796c0c5e4dd999d97?user_id=c8b24bdf086246e8b2a359bfd2f004b2 => generated 190 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:21.042436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.043118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:21.050521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.051138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.052076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.052803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.123358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.124537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:21.139460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.140162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.141115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.141686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.215799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:52:21.261698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:21.280611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af2519c6-43a1-45ee-ab64-fe02c4cc0a96 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1494 microversion: 2.1 time: 0.242498 Jun 25 20:52:21.281503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 80/164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:21.291166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Action: 'update', calling method: .version_select at 0x7f985d93dca0>, body: {"status": "disabled"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:21.293144 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.293144 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.294592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.296865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.309707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.310397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.335363 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] HTTP exception thrown: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Request method failure captured: Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 HTTP/1.1 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 22 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WEvQq-PgK4hb-6uNGCkbBI8v4aTgLcs_asmW7VHaDbtOdjtoqGGRo5zBYUYSsYt89fgI7ZdN04mdPbt4ib0E9PsnCk4lyOJwEtIvTRJf0q6vt0Eo5v0B1dCQkmqdieWK_8QFc3zTsGoFFbk8UwT0Jsp3xTdptrXuOHd3h4zK_AqAg Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.53 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:21.341545 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}] Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 77f4ea9b80454b439c0fc86e192982f3 Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: {"status": "disabled"} Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: exception: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.342989 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '834f34f3-4ab7-4e59-9fcd-417f112a2a53', 'body': {'status': 'disabled'}} Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.343836 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:21.345103 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:21.346331 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.346331 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.349516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Returning 404 to user: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:21.350882 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c707f063-75d2-42ab-99bc-1a581c2f798f tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53" status: 404 len: 110 microversion: 2.53 time: 0.068182 Jun 25 20:52:21.355660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 81/165] 10.222.0.39 () {62 vars in 1308 bytes} [Sat Jun 25 20:52:21 2022] PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 => generated 110 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:21.391339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Action: 'update', calling method: .version_select at 0x7f985d0a48b0>, body: {"status": "enabled"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:21.401177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.401675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.413400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.413851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.425222 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] HTTP exception thrown: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.430462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db0cf378-0d97-46f0-a0a9-7823c4dc1bc7 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 204 len: 0 microversion: 2.1 time: 0.497923 Jun 25 20:52:21.436726 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 85/166] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:52:20 2022] DELETE /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Request method failure captured: Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 HTTP/1.1 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 21 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WEvQq-PgK4hb-6uNGCkbBI8v4aTgLcs_asmW7VHaDbtOdjtoqGGRo5zBYUYSsYt89fgI7ZdN04mdPbt4ib0E9PsnCk4lyOJwEtIvTRJf0q6vt0Eo5v0B1dCQkmqdieWK_8QFc3zTsGoFFbk8UwT0Jsp3xTdptrXuOHd3h4zK_AqAg Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.53 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:21.442219 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_674e8e36cac34029a6970552d1fbfb44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/674e8e36cac34029a6970552d1fbfb44"}]}] Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 674e8e36cac34029a6970552d1fbfb44 Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464 Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 77f4ea9b80454b439c0fc86e192982f3 Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: {"status": "enabled"} Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: exception: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.443580 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '834f34f3-4ab7-4e59-9fcd-417f112a2a53', 'body': {'status': 'enabled'}} Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.444560 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:21.445833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:21.447001 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. Jun 25 20:52:21.447001 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:21.447131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.449076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:21.450180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Returning 404 to user: Service 834f34f3-4ab7-4e59-9fcd-417f112a2a53 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:21.451133 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4707ca08-a1b3-4f3a-8a10-e9e462753868 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53" status: 404 len: 110 microversion: 2.53 time: 0.090786 Jun 25 20:52:21.457220 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 82/167] 10.222.0.39 () {62 vars in 1308 bytes} [Sat Jun 25 20:52:21 2022] PUT /compute/v2.1/os-services/834f34f3-4ab7-4e59-9fcd-417f112a2a53 => generated 110 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:21.457494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.458338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.459766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.460838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.463776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.468858 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.468858 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.475083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.476307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.478745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.480350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.533627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb85dc56-bcc9-418c-af0d-7f963796f559 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1264 microversion: 2.53 time: 0.074805 Jun 25 20:52:21.534797 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 83/168] 10.222.0.39 () {60 vars in 1177 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services => generated 1264 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:21.545783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.548611 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.548611 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.554631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.555403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.556301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.556667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.612764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c71ff80-6221-4964-84b9-ac4445117e1d tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1264 microversion: 2.53 time: 0.070824 Jun 25 20:52:21.615307 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 84/169] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1264 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:21.633752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.635258 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.635258 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.637945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.638451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.640264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.643281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.695345 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c1a7bbd-1d7d-4c0c-aedd-57c3f74dc430 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1264 microversion: 2.53 time: 0.071776 Jun 25 20:52:21.698535 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 85/170] 10.222.0.39 () {60 vars in 1177 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services => generated 1264 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:21.716335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.722492 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.722492 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.725220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.726970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.731311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.732079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.783526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1aca002d-b613-409d-a714-c38420ad2014 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.078185 Jun 25 20:52:21.788559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 86/171] 10.222.0.39 () {60 vars in 1236 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:21.802547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.805936 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.805936 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:21.809637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.811769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.814476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.815336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.826822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:21.837131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c80db297-83d8-4979-8d9c-b716f26f83ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1476 microversion: 2.1 time: 0.397085 Jun 25 20:52:21.847019 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 86/172] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1476 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:21.870082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2dc571f1-6d0a-43ba-91e4-73e964b55297 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1264 microversion: 2.53 time: 0.072798 Jun 25 20:52:21.872017 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 87/173] 10.222.0.39 () {60 vars in 1177 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services => generated 1264 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:21.882886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:21.884338 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:21.884338 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:21.885587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.886096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.887144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:21.887363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:21.925842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2736c460-67b3-4bdf-b5a3-d13102aec392 tempest-ServicesAdminNegativeV253TestJSON-270825464 tempest-ServicesAdminNegativeV253TestJSON-270825464-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.046555 Jun 25 20:52:21.930384 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 87/174] 10.222.0.39 () {60 vars in 1238 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:22.161228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-60df6844-4f6a-4203-9212-e5fbfecae7e0 req-a5b8574d-bae1-4ae6-a370-536b57388433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4648d0-de74-4b1a-81dd-ea74faf0588b", "name": "network-vif-deleted", "tag": "e59ab662-e460-4883-81b2-26899ad0987d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:22.178951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-60df6844-4f6a-4203-9212-e5fbfecae7e0 req-a5b8574d-bae1-4ae6-a370-536b57388433 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:22.179946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-60df6844-4f6a-4203-9212-e5fbfecae7e0 req-a5b8574d-bae1-4ae6-a370-536b57388433 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:22.204110 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-60df6844-4f6a-4203-9212-e5fbfecae7e0 req-a5b8574d-bae1-4ae6-a370-536b57388433 service nova] Creating event network-vif-deleted:e59ab662-e460-4883-81b2-26899ad0987d for instance ae4648d0-de74-4b1a-81dd-ea74faf0588b on nch1-master-1 Jun 25 20:52:22.210738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-60df6844-4f6a-4203-9212-e5fbfecae7e0 req-a5b8574d-bae1-4ae6-a370-536b57388433 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053990 Jun 25 20:52:22.216000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 88/175] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:22.299798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:22.300702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:22.310699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:22.311158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:22.311951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:22.312381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:22.462523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de7f658e8ff74ef2bc3a90c74b0013eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9e4621cb39462ba663e92f2e38a0b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:22.480313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3e9816f-667f-49a4-ba0c-56d8c3202f60 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 200 len: 1324 microversion: 2.1 time: 0.185550 Jun 25 20:52:22.491648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 89/176] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:22 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 1324 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:22.521868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0dc40e6-d58d-46e2-b681-db404b54a789 tempest-ServicesAdminNegativeV253TestJSON-527992663 tempest-ServicesAdminNegativeV253TestJSON-527992663-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:22.524399 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:22.524399 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:22.526492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0dc40e6-d58d-46e2-b681-db404b54a789 tempest-ServicesAdminNegativeV253TestJSON-527992663 tempest-ServicesAdminNegativeV253TestJSON-527992663-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ced78e43dd604b00bc99b64ebfbbffa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cf1f66dab46465daf6c81a57afd7da5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0dc40e6-d58d-46e2-b681-db404b54a789 tempest-ServicesAdminNegativeV253TestJSON-527992663 tempest-ServicesAdminNegativeV253TestJSON-527992663-project] Request method failure captured: Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-services HTTP/1.1 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WDYqoKIApANbuRGsuTpWFK_WxfOhl5RBedXTn0bvyRgaGZ0vmKM3hU_E2bDEVYPuyTqADJFXdfRfG8VcAaRAvpJ6EMmujbcFxeCy-MT-zbpyvvxbGDk3Amc2OjIRq1DeNH33vUfky7eMo1BoVkJ2FTYbY0TYByNrybVy6KMZFqhvY Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.53 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4cf1f66dab46465daf6c81a57afd7da5 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-527992663 Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:22.528794 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4cf1f66dab46465daf6c81a57afd7da5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cf1f66dab46465daf6c81a57afd7da5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4cf1f66dab46465daf6c81a57afd7da5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4cf1f66dab46465daf6c81a57afd7da5"}]}] Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-527992663 Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4cf1f66dab46465daf6c81a57afd7da5 Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-527992663 Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServicesAdminNegativeV253TestJSON-527992663-project Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ced78e43dd604b00bc99b64ebfbbffa0 Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-527992663-project Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:22.530349 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:22.531101 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jun 25 20:52:22.532291 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:22.534706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0dc40e6-d58d-46e2-b681-db404b54a789 tempest-ServicesAdminNegativeV253TestJSON-527992663 tempest-ServicesAdminNegativeV253TestJSON-527992663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:22.536355 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0dc40e6-d58d-46e2-b681-db404b54a789 tempest-ServicesAdminNegativeV253TestJSON-527992663 tempest-ServicesAdminNegativeV253TestJSON-527992663-project] 10.222.0.39 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.598214 Jun 25 20:52:22.537486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 88/177] 10.222.0.39 () {60 vars in 1177 bytes} [Sat Jun 25 20:52:21 2022] GET /compute/v2.1/os-services => generated 112 bytes in 600 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:22.860908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:22.861858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:22.871901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:22.873839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:22.874912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:22.876062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:23.135408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:23.154210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-48b0d0b4-9194-42fc-8e71-188db3d75238 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1476 microversion: 2.1 time: 0.302781 Jun 25 20:52:23.163745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 90/178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:22 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:23.504746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:23.505420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:23.553922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:23.559617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:23.560505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:23.562128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:23.605907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] HTTP exception thrown: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Request method failure captured: Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b HTTP/1.1 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vg2vPJXJyz2ruRGwhL49mIVZdUCZ3fmBzJjgc8Cef6Xgj24PdfV4GsUSzFdOvvFnGKJBmchTPKr7LFfM699dyt4-iKvErZAPV85Do8YvO5-jev3PBwB5ptXMI6rpWzzgdVyA--LwfQaISEvM4hGVteadrKq6hLRBogkvAfm1YEKjg Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:23.610286 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}] Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: de7f658e8ff74ef2bc3a90c74b0013eb Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:23.611438 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ae4648d0-de74-4b1a-81dd-ea74faf0588b'} Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:23.612085 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:23.613138 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:23.615560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Returning 404 to user: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:23.619170 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6310b030-0f3c-4c45-bdf2-f8758bad567d tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 404 len: 111 microversion: 2.1 time: 0.123664 Jun 25 20:52:23.628996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcbc1091-f1c1-49fc-aac8-acae48692a4c tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:23.630451 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:23.630451 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:23.632451 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 89/179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:23 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:23.658274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbc1091-f1c1-49fc-aac8-acae48692a4c tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:23.658737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbc1091-f1c1-49fc-aac8-acae48692a4c tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:23.821981 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcbc1091-f1c1-49fc-aac8-acae48692a4c tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 300 microversion: 2.1 time: 0.197047 Jun 25 20:52:23.823888 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 91/180] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:23 2022] POST /compute/v2.1/os-aggregates/1/action => generated 300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:23.834300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a8520a9-e667-4d2c-9070-c14936c8c572 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:23.835342 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:23.835342 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:23.892229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a8520a9-e667-4d2c-9070-c14936c8c572 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.061856 Jun 25 20:52:23.895206 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 90/181] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:23 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:23.912907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e853df64-f9e6-4925-9d41-c323f3252f27 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-817738321"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:23.914278 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:23.914278 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:23.915146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-e853df64-f9e6-4925-9d41-c323f3252f27 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 26ed3987-392a-4888-b98d-9f9eb8af2763 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:23.952869 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e853df64-f9e6-4925-9d41-c323f3252f27 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042923 Jun 25 20:52:23.954365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 92/182] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:23.967699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd24b547-c2fa-4684-af6a-b92e3a02f671 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:23.970430 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:23.970430 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:23.982259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd24b547-c2fa-4684-af6a-b92e3a02f671 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:23.983968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd24b547-c2fa-4684-af6a-b92e3a02f671 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:24.173864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:24.175250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:24.184780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:24.185447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:24.187421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:24.187421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:24.579505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:24.591563 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e107887c-8bd5-46e4-a4b3-81a0e9570e4e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1434 microversion: 2.1 time: 0.423647 Jun 25 20:52:24.600505 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd24b547-c2fa-4684-af6a-b92e3a02f671 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 241 microversion: 2.1 time: 0.631493 Jun 25 20:52:24.600505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 91/183] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:23 2022] POST /compute/v2.1/os-aggregates/2/action => generated 241 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:24.601106 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 93/184] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:24 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1434 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:24.606246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60179ab8-6509-4854-a5ae-95c92ae3dd7b tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:24.607229 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:24.607229 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:24.624973 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60179ab8-6509-4854-a5ae-95c92ae3dd7b tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 241 microversion: 2.1 time: 0.020956 Jun 25 20:52:24.625947 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 92/185] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:52:24 2022] GET /compute/v2.1/os-aggregates/2 => generated 241 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:24.638572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1eb3a939-1f9d-45bb-8263-0000fa7ee05a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:24.640036 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:24.640036 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:24.657079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eb3a939-1f9d-45bb-8263-0000fa7ee05a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:24.657643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eb3a939-1f9d-45bb-8263-0000fa7ee05a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:24.848580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1eb3a939-1f9d-45bb-8263-0000fa7ee05a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.212005 Jun 25 20:52:24.849774 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 94/186] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:24 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:24.861283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aceb1d51-ddbf-4037-84c4-25cab993dad9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:24.870520 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:24.870520 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:24.908504 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aceb1d51-ddbf-4037-84c4-25cab993dad9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.051832 Jun 25 20:52:24.910846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 93/187] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:24 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:24.926691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bca7d663-bb2d-4772-90b7-250af68c2028 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1966656880"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:24.928298 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:24.928298 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:24.930864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-bca7d663-bb2d-4772-90b7-250af68c2028 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 089e67b0-a17b-4ef8-8a21-d85c4e800f8e for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:24.951817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e10c5ff3-0801-4bf3-9dc2-c1508cbc2fb0 req-d6c2a532-362a-4330-b055-9862d37c7e29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38a07d3-7458-4d71-90df-cd47e528ba35", "name": "network-vif-deleted", "tag": "653bf2de-114e-4e35-b5da-7331195ff869"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:24.982088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e10c5ff3-0801-4bf3-9dc2-c1508cbc2fb0 req-d6c2a532-362a-4330-b055-9862d37c7e29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:24.984202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e10c5ff3-0801-4bf3-9dc2-c1508cbc2fb0 req-d6c2a532-362a-4330-b055-9862d37c7e29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:24.991945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bca7d663-bb2d-4772-90b7-250af68c2028 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074083 Jun 25 20:52:24.997621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 95/188] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:25.021138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0439f6e1-c268-4826-9d23-250654daa111 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:25.022553 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.022553 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:25.031189 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e10c5ff3-0801-4bf3-9dc2-c1508cbc2fb0 req-d6c2a532-362a-4330-b055-9862d37c7e29 service nova] Creating event network-vif-deleted:653bf2de-114e-4e35-b5da-7331195ff869 for instance e38a07d3-7458-4d71-90df-cd47e528ba35 on nch2-master-1 Jun 25 20:52:25.052879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e10c5ff3-0801-4bf3-9dc2-c1508cbc2fb0 req-d6c2a532-362a-4330-b055-9862d37c7e29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105418 Jun 25 20:52:25.055280 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 94/189] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:25.055928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0439f6e1-c268-4826-9d23-250654daa111 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.056684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0439f6e1-c268-4826-9d23-250654daa111 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.277033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0439f6e1-c268-4826-9d23-250654daa111 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.272003 Jun 25 20:52:25.278041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 96/190] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:25 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:25.291696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dee345d0-2c7a-4fc6-952b-7d65c0d21254 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:25.292635 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.292635 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:25.318922 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dee345d0-2c7a-4fc6-952b-7d65c0d21254 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.032955 Jun 25 20:52:25.319518 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 95/191] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:52:25 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:25.331167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0b25ddb-0714-4533-a5d7-0af7dc0a0082 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:25.333638 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.333638 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:25.357532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b25ddb-0714-4533-a5d7-0af7dc0a0082 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.357957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b25ddb-0714-4533-a5d7-0af7dc0a0082 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.545502 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b0b25ddb-0714-4533-a5d7-0af7dc0a0082 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.218873 Jun 25 20:52:25.548565 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 97/192] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:25 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:25.561734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca391515-268f-4b76-b691-848f427066d9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:25.562749 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.562749 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:25.610293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:25.610926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:25.623747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.624194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.627706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.628294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.652674 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca391515-268f-4b76-b691-848f427066d9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.096066 Jun 25 20:52:25.654525 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 96/193] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:25 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:25.670804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-982c31d0-fd97-4f45-b4ec-31aa7679df7a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2095669280"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:25.675759 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.675759 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:25.681408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-982c31d0-fd97-4f45-b4ec-31aa7679df7a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid b0e2093c-eda5-4767-b47b-1df18ad72fbc for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:25.736602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.737040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.745065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lazy-loading 'fault' on Instance uuid e38a07d3-7458-4d71-90df-cd47e528ba35 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:52:25.764248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-982c31d0-fd97-4f45-b4ec-31aa7679df7a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.101529 Jun 25 20:52:25.767660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 97/194] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:25.781822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-667748ed-d233-47c2-82f4-01254d990480 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:25.785695 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:25.785695 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:25.804771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667748ed-d233-47c2-82f4-01254d990480 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:25.805820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667748ed-d233-47c2-82f4-01254d990480 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:25.928981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:26.068516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:26.103421 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9e82f42-8e18-4e53-8a1f-1ce464013f5a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 200 len: 1310 microversion: 2.1 time: 0.497930 Jun 25 20:52:26.110376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-667748ed-d233-47c2-82f4-01254d990480 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.336625 Jun 25 20:52:26.111380 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 98/195] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:25 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:26.111724 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 98/196] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:25 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 1310 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:26.122996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f588379b-5381-4403-8e1c-9aa401f0bae9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.126018 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.126018 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.135989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f588379b-5381-4403-8e1c-9aa401f0bae9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:26.136570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f588379b-5381-4403-8e1c-9aa401f0bae9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:26.296944 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f588379b-5381-4403-8e1c-9aa401f0bae9 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.179390 Jun 25 20:52:26.298187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 99/197] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:26.308948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13c56957-75ca-421e-87cf-13a79b44da83 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.309733 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.309733 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:26.345223 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13c56957-75ca-421e-87cf-13a79b44da83 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.039844 Jun 25 20:52:26.348446 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 99/198] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:26 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:26.358436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b131c23-60b7-49ea-8513-b4082ad81fb2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1459598070"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.359777 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.359777 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.360769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-5b131c23-60b7-49ea-8513-b4082ad81fb2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 7c5977b7-1a0d-4a2d-9e00-058866f300d5 for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:26.403402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-719df9aa-2ef6-4681-ad8e-787dbc3e294d tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-224398926"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.405707 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.405707 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:26.407485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-719df9aa-2ef6-4681-ad8e-787dbc3e294d tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid 31c7191f-72df-4dc9-b818-610e024f3c8a for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:26.413097 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b131c23-60b7-49ea-8513-b4082ad81fb2 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.060450 Jun 25 20:52:26.419396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 100/199] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:26.432344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee274684-07cf-4db3-810c-94ed40e04bf3 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.433950 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.433950 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.455409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-719df9aa-2ef6-4681-ad8e-787dbc3e294d tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.055702 Jun 25 20:52:26.457892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 100/200] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:26.472877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-afba9fac-db97-4d22-ac7b-adb355fc6836 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.477747 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.477747 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:26.489185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afba9fac-db97-4d22-ac7b-adb355fc6836 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:26.490342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afba9fac-db97-4d22-ac7b-adb355fc6836 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:26.493846 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee274684-07cf-4db3-810c-94ed40e04bf3 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.072122 Jun 25 20:52:26.494110 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 101/201] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:26 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:26.514055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0582015-1f75-4a23-b29f-db40c506ad5a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.514895 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.514895 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.517054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=5 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:26.531714 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d0582015-1f75-4a23-b29f-db40c506ad5a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0582015-1f75-4a23-b29f-db40c506ad5a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Request method failure captured: Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ViF4P0Wq0aobUSnT5i429uxNrL4iYocgTOdLrtS8SxeIdCaRn_pelN4uo86xr3tqyRcpyBvWCxkAFEizZ9lwk6BIUV2vA8krPThoTtEfLohO3-6b_ys6-p-kY_tm0bH3bAs_FJyQ4IyPM0hTf4KdaGgUK3iXVznccAQzWBn5GbiDo Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:26.541882 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}] Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d7abe5e437a9421682db3fb6f26cebfd Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: exception: Aggregate 5 could not be found. Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '5'} Jun 25 20:52:26.543247 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.544098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.545189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0582015-1f75-4a23-b29f-db40c506ad5a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:26.546159 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0582015-1f75-4a23-b29f-db40c506ad5a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.041688 Jun 25 20:52:26.547554 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 102/202] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:52:26 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:26.552643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43ec4b42-4a67-4c10-9dd3-bf7880b51e6d tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.553101 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.553101 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.584755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:26.631816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-43ec4b42-4a67-4c10-9dd3-bf7880b51e6d tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43ec4b42-4a67-4c10-9dd3-bf7880b51e6d tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Request method failure captured: Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ViF4P0Wq0aobUSnT5i429uxNrL4iYocgTOdLrtS8SxeIdCaRn_pelN4uo86xr3tqyRcpyBvWCxkAFEizZ9lwk6BIUV2vA8krPThoTtEfLohO3-6b_ys6-p-kY_tm0bH3bAs_FJyQ4IyPM0hTf4KdaGgUK3iXVznccAQzWBn5GbiDo Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:26.644039 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}] Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d7abe5e437a9421682db3fb6f26cebfd Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: exception: Aggregate 5 could not be found. Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '5'} Jun 25 20:52:26.645599 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:26.646262 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:26.647308 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43ec4b42-4a67-4c10-9dd3-bf7880b51e6d tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43ec4b42-4a67-4c10-9dd3-bf7880b51e6d tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.097163 Jun 25 20:52:26.648403 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 103/203] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:26 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:26.656916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5ff38ea-22e1-436d-8bde-f3f450ede074 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-965888978", "name": "tempest-test_aggregate-1363448020"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.693336 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.693336 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.696675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-b5ff38ea-22e1-436d-8bde-f3f450ede074 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 9ffadb27-497a-4580-8313-72313337a5b7 for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:26.840293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-afba9fac-db97-4d22-ac7b-adb355fc6836 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 241 microversion: 2.1 time: 0.375036 Jun 25 20:52:26.843364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 101/204] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates/6/action => generated 241 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:26.868073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:26.869556 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.869556 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:26.875301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5ff38ea-22e1-436d-8bde-f3f450ede074 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.222512 Jun 25 20:52:26.875936 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 104/205] 10.222.0.39 () {60 vars in 1164 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:26.889184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d00cb7df-81c9-44d6-af8c-768d5b7ef2c3 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.890282 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.890282 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.910873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:26.913299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:26.936965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d00cb7df-81c9-44d6-af8c-768d5b7ef2c3 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.048842 Jun 25 20:52:26.937485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 105/206] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:26 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:26.961678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8457201d-2ecb-46fc-9bdf-81ebe1f94071 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:26.962985 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:26.962985 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:26.985757 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Aggregate 6 already has host nch1-master-1. Jun 25 20:52:26.996228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8457201d-2ecb-46fc-9bdf-81ebe1f94071 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8457201d-2ecb-46fc-9bdf-81ebe1f94071 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Request method failure captured: Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ViF4P0Wq0aobUSnT5i429uxNrL4iYocgTOdLrtS8SxeIdCaRn_pelN4uo86xr3tqyRcpyBvWCxkAFEizZ9lwk6BIUV2vA8krPThoTtEfLohO3-6b_ys6-p-kY_tm0bH3bAs_FJyQ4IyPM0hTf4KdaGgUK3iXVznccAQzWBn5GbiDo Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:26.999193 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}] Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d7abe5e437a9421682db3fb6f26cebfd Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: exception: Aggregate 7 could not be found. Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '7'} Jun 25 20:52:27.000343 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.002139 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.003110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8457201d-2ecb-46fc-9bdf-81ebe1f94071 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:27.006545 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8457201d-2ecb-46fc-9bdf-81ebe1f94071 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.047323 Jun 25 20:52:27.006545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 106/207] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:52:26 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 39 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:27.019297 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: {"add_host": {"host": "nch1-master-1"}} Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:27.020573 ncdv-master-1 devstack@n-api.service[137461]: exception: Aggregate 6 already has host nch1-master-1. Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6', 'body': {'add_host': {'host': 'nch1-master-1'}}} Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:52:27.021275 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi session.flush() Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:52:27.023021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:52:27.024306 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:52:27.025508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 25, 20, 52, 26, 964120), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 6}] Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.026625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host nch1-master-1. Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.027753 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host nch1-master-1. Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:27.030549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:27.031710 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host nch1-master-1. Jun 25 20:52:27.031710 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.031839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd3ee6c2-5a63-44e7-875e-6b87d8e2812a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.031839 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.031839 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.034003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 409 to user: Aggregate 6 already has host nch1-master-1. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:27.035416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c2a55eb-7399-4055-94e7-b74a218eeca3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 95 microversion: 2.1 time: 0.184607 Jun 25 20:52:27.037131 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 102/208] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:26 2022] POST /compute/v2.1/os-aggregates/6/action => generated 95 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jun 25 20:52:27.047330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e40a8ee-7608-4b03-976f-602450b3e528 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.054221 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.054221 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:27.066134 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-dd3ee6c2-5a63-44e7-875e-6b87d8e2812a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd3ee6c2-5a63-44e7-875e-6b87d8e2812a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Request method failure captured: Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ViF4P0Wq0aobUSnT5i429uxNrL4iYocgTOdLrtS8SxeIdCaRn_pelN4uo86xr3tqyRcpyBvWCxkAFEizZ9lwk6BIUV2vA8krPThoTtEfLohO3-6b_ys6-p-kY_tm0bH3bAs_FJyQ4IyPM0hTf4KdaGgUK3iXVznccAQzWBn5GbiDo Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:27.067871 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6df32fdb9d9d4277bd36a129adaddc20"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6df32fdb9d9d4277bd36a129adaddc20"}]}] Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 6df32fdb9d9d4277bd36a129adaddc20 Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-871800690 Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d7abe5e437a9421682db3fb6f26cebfd Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-871800690-project-admin Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: exception: Aggregate 7 could not be found. Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '7'} Jun 25 20:52:27.069140 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:27.069798 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.071097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd3ee6c2-5a63-44e7-875e-6b87d8e2812a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:27.072493 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd3ee6c2-5a63-44e7-875e-6b87d8e2812a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.061426 Jun 25 20:52:27.075762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e40a8ee-7608-4b03-976f-602450b3e528 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:27.076383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e40a8ee-7608-4b03-976f-602450b3e528 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:27.084831 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 107/209] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:27 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:27.094785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48cb3abd-417a-4c8d-b706-725043d222a1 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1057627568"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.096111 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.096111 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.097667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-48cb3abd-417a-4c8d-b706-725043d222a1 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid f0c3ad1a-00b9-4fba-bff8-0676815e55fb for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:27.173434 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48cb3abd-417a-4c8d-b706-725043d222a1 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087314 Jun 25 20:52:27.175962 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 108/210] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.203647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.221512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:27.249761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:27.250456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:27.251947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:27.253291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:27.277372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 HTTP/1.1 Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:27.279502 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:52:27.280972 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e38a07d3-7458-4d71-90df-cd47e528ba35'} Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:27.281785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:52:27.283920 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.293408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:27.295511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-048f46b9-5873-42bc-8c51-7761319b4aa5 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 404 len: 111 microversion: 2.1 time: 0.112567 Jun 25 20:52:27.298856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 109/211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:27 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:27.333356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f929a86d-5cd1-413b-be4c-e036bde7597e tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.338142 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.338142 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.347981 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e40a8ee-7608-4b03-976f-602450b3e528 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 226 microversion: 2.1 time: 0.306184 Jun 25 20:52:27.348621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 103/212] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates/6/action => generated 226 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.359872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2806dfb0-4c0e-48da-bd07-8e696e08939d tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.360955 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.360955 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:27.367219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f929a86d-5cd1-413b-be4c-e036bde7597e tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.066487 Jun 25 20:52:27.371194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 110/213] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:52:27 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.385568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49ea0e3e-daa4-4787-8598-8e4568268a26 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.389635 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.389635 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.412528 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2806dfb0-4c0e-48da-bd07-8e696e08939d tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.056365 Jun 25 20:52:27.418420 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 104/214] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:27 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 25 20:52:27.423032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8eff5995-4583-4f90-967b-5826b75628c4 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-269708534"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.424699 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.424699 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:27.425582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-8eff5995-4583-4f90-967b-5826b75628c4 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid d02819b7-0631-45f3-8da3-97d1e83becba for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:27.454516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49ea0e3e-daa4-4787-8598-8e4568268a26 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.075630 Jun 25 20:52:27.457712 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 111/215] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.477536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8eff5995-4583-4f90-967b-5826b75628c4 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.057358 Jun 25 20:52:27.479422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e46657d7-b2d1-43db-b363-c1f97ba484f2 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-619677793"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.485830 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 105/216] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.490272 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.490272 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.493081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-e46657d7-b2d1-43db-b363-c1f97ba484f2 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Generated uuid 8b27a860-1309-40ff-b68e-2d0151fc2716 for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:27.503004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-930bc992-6e85-48be-be34-f3811ea7c320 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.503898 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.503898 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:27.524399 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-930bc992-6e85-48be-be34-f3811ea7c320 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.037264 Jun 25 20:52:27.528481 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 106/217] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:52:27 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:27.556294 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e46657d7-b2d1-43db-b363-c1f97ba484f2 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.097650 Jun 25 20:52:27.562782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 112/218] 10.222.0.39 () {62 vars in 1204 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:27.586997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12fbada9-cbd1-4eb9-a6b0-8b7d7419ee30 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:27.590501 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.590501 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:27.666130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12fbada9-cbd1-4eb9-a6b0-8b7d7419ee30 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.099303 Jun 25 20:52:27.669973 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 113/219] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:27 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:27.686277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2089002889", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.754161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:52:27.938337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bed2ea7-300d-449b-96a0-d22615123cb7 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:27.941339 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:27.941339 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:27.942566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bed2ea7-300d-449b-96a0-d22615123cb7 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bed2ea7-300d-449b-96a0-d22615123cb7 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 39 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:27.944440 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: {"add_host": {"host": "nch1-master-1"}} Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:27.945704 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '9', 'body': {'add_host': {'host': 'nch1-master-1'}}} Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:27.946508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jun 25 20:52:27.947767 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:27.954661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bed2ea7-300d-449b-96a0-d22615123cb7 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:27.959033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bed2ea7-300d-449b-96a0-d22615123cb7 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 118 microversion: 2.1 time: 0.428915 Jun 25 20:52:27.959623 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 107/220] 10.222.0.39 () {60 vars in 1190 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/os-aggregates/9/action => generated 118 bytes in 430 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:27.967402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab45fa9a-8213-431d-aa3c-28a02ba92eb5 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812976277"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.133953 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.133953 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.205706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab45fa9a-8213-431d-aa3c-28a02ba92eb5 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.243960 Jun 25 20:52:28.206744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 108/221] 10.222.0.39 () {62 vars in 1212 bytes} [Sat Jun 25 20:52:27 2022] PUT /compute/v2.1/os-aggregates/10 => generated 299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:28.216651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efee13de-f3e1-489f-a0fe-e38d2b810701 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2118015486", "availability_zone": "tempest-test_az-1234330210"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.240781 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.240781 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.241871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-efee13de-f3e1-489f-a0fe-e38d2b810701 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid fa4a68a3-91cb-4560-890b-6da2bb20b5ff for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:28.293608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-efee13de-f3e1-489f-a0fe-e38d2b810701 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.085520 Jun 25 20:52:28.294750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 109/222] 10.222.0.39 () {60 vars in 1164 bytes} [Sat Jun 25 20:52:28 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:28.306574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a947c03-8e71-4ccf-92c1-6ea4f932aee0 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:28.311163 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.311163 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.359844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a947c03-8e71-4ccf-92c1-6ea4f932aee0 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.062686 Jun 25 20:52:28.360862 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 110/223] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:28 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:28.372358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dcaad66-b006-4f0b-a373-5e1f0e2f60b5 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:28.373604 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.373604 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.393604 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dcaad66-b006-4f0b-a373-5e1f0e2f60b5 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 299 microversion: 2.41 time: 0.030408 Jun 25 20:52:28.394369 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 111/224] 10.222.0.39 () {60 vars in 1192 bytes} [Sat Jun 25 20:52:28 2022] GET /compute/v2.1/os-aggregates/10 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:28.404758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-493b305b-4dc5-4aa6-8efa-605694a4d34a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2118015486_new", "availability_zone": "tempest-test_az-1234330210_new"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.406292 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.406292 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.477470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493b305b-4dc5-4aa6-8efa-605694a4d34a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:28.479661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493b305b-4dc5-4aa6-8efa-605694a4d34a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:28.544024 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-493b305b-4dc5-4aa6-8efa-605694a4d34a tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 337 microversion: 2.1 time: 0.148539 Jun 25 20:52:28.544708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 112/225] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 20:52:28 2022] PUT /compute/v2.1/os-aggregates/11 => generated 337 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:28.560102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e36747a5-0439-457c-8b29-05eb14078a71 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-303748374"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.561441 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.561441 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.562331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-e36747a5-0439-457c-8b29-05eb14078a71 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid 79637ab0-0d5d-45dc-8146-9d972feff546 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:28.622456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e36747a5-0439-457c-8b29-05eb14078a71 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072628 Jun 25 20:52:28.625995 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 113/226] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:28 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:28.633668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2653e3ab-8bcb-487b-b98f-0a6eb5f7ea2c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.635392 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.635392 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.657600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2653e3ab-8bcb-487b-b98f-0a6eb5f7ea2c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:28.658050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2653e3ab-8bcb-487b-b98f-0a6eb5f7ea2c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:28.711366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:52:28.711945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:52:28.712759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:52:28.713354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:52:28.714289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:52:28.737855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:28.741832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:28.742733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:28.743196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:28.800104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Getting quotas for project fb34595547bf4acc9abbb87c043554ca. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:28.836690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Getting quotas for user 259e4c3f5ff24d5b955ec36009319598 and project fb34595547bf4acc9abbb87c043554ca. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:28.863112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:52:28.869046 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2653e3ab-8bcb-487b-b98f-0a6eb5f7ea2c tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 314 microversion: 2.41 time: 0.241793 Jun 25 20:52:28.869801 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 114/227] 10.222.0.39 () {62 vars in 1234 bytes} [Sat Jun 25 20:52:28 2022] POST /compute/v2.1/os-aggregates/10/action => generated 314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:28.874629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32c579c9-8ebe-49f9-b6f0-e1b11690c76e tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:28.876739 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.876739 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.879694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:52:28.893246 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32c579c9-8ebe-49f9-b6f0-e1b11690c76e tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 807 microversion: 2.1 time: 0.022151 Jun 25 20:52:28.898726 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 115/228] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:52:28 2022] GET /compute/v2.1/os-aggregates => generated 807 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:28.919221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-797568916"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:28.924961 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:28.924961 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:28.955597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:28.962900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:28.991744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.000259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.030120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-797568916 could not be found. Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 57 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:29.038875 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: {"add_host": {"host": "tempest-nonexist_host-797568916"}} Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:29.040356 ncdv-master-1 devstack@n-api.service[137461]: exception: Compute host tempest-nonexist_host-797568916 could not be found. Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-797568916'}}} Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-797568916' is not mapped to any cell Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.041341 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jun 25 20:52:29.042593 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-797568916 could not be found. Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-797568916 could not be found. Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.044187 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-797568916 could not be found. Jun 25 20:52:29.045412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.054945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-797568916 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.056101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9e253a6-e50b-4bd2-81a6-7e2947294609 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.156035 Jun 25 20:52:29.064474 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 116/229] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:28 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:29.094998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b68bc6da-81e4-4235-901a-37bf245946d6 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.099109 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5bdf0e82-e27d-4223-bce4-3cbfada038ba tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.421369 Jun 25 20:52:29.102093 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 114/230] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:52:29.108980 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.108980 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:29.128728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c51158cd-052d-43d5-8a55-8b624bfacee7 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.133156 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.133156 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:29.150258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b68bc6da-81e4-4235-901a-37bf245946d6 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.156191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b68bc6da-81e4-4235-901a-37bf245946d6 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.202041 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c51158cd-052d-43d5-8a55-8b624bfacee7 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.098521 Jun 25 20:52:29.203324 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 115/231] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:29.224303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2caca632-7e1b-4d40-847e-987baee7cd90 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.226971 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.226971 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:29.278356 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2caca632-7e1b-4d40-847e-987baee7cd90 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.072483 Jun 25 20:52:29.279512 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 116/232] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:29.295873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-485d8836-23eb-4aa9-b83e-1649a296ba4a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.312683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-485d8836-23eb-4aa9-b83e-1649a296ba4a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:29.473830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b68bc6da-81e4-4235-901a-37bf245946d6 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 299 microversion: 2.41 time: 0.406113 Jun 25 20:52:29.477485 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 117/233] 10.222.0.39 () {62 vars in 1234 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates/10/action => generated 299 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:29.497360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-74b829be-1aba-4310-b108-a4dce8c04df4 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-257960930"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.501982 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.501982 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:29.504104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-74b829be-1aba-4310-b108-a4dce8c04df4 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Generated uuid 309ce4de-d387-4b6d-84b0-cc2471993696 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:29.522199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-485d8836-23eb-4aa9-b83e-1649a296ba4a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:29.530972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-485d8836-23eb-4aa9-b83e-1649a296ba4a tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1220 microversion: 2.1 time: 0.250028 Jun 25 20:52:29.536251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:29 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:29.554989 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-74b829be-1aba-4310-b108-a4dce8c04df4 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.076021 Jun 25 20:52:29.564220 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 118/235] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:29.566401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-390d69fd-1eb2-46ee-a559-146bd5b80969 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.578508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9b5a4c0-281a-4267-b21e-b19a7157dfe0 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-390d69fd-1eb2-46ee-a559-146bd5b80969 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 283 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:29.579081 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:29.581062 ncdv-master-1 devstack@n-api.service[137462]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:52:29.581744 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:29.583350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:29.586154 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:29.587416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:52:29.587416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.587565 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.587565 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:29.587715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-390d69fd-1eb2-46ee-a559-146bd5b80969 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.596173 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-390d69fd-1eb2-46ee-a559-146bd5b80969 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.046557 Jun 25 20:52:29.598875 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 118/236] 10.222.0.39 () {60 vars in 1164 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:29.625575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-497c258c-25ba-4c8a-82f1-736782686095 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.626759 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.626759 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:29.646911 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9b5a4c0-281a-4267-b21e-b19a7157dfe0 tempest-AggregatesAdminTestV241-538659415 tempest-AggregatesAdminTestV241-538659415-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.41 time: 0.078923 Jun 25 20:52:29.655567 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 119/237] 10.222.0.39 () {60 vars in 1195 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:29.667630 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-497c258c-25ba-4c8a-82f1-736782686095 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.060001 Jun 25 20:52:29.669974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 119/238] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:52:29 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:29.679098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0d9d4bf-d6d1-425b-a5c8-9b71d492eef3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0d9d4bf-d6d1-425b-a5c8-9b71d492eef3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 27 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:29.695801 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: {"aggregate": {"name": ""}} Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:29.700404 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'aggregate': {'name': ''}}} Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi '' Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.701603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:52:29.703001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.704225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19b30b6e-7129-4755-a17c-b386ed25b734 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.708772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0d9d4bf-d6d1-425b-a5c8-9b71d492eef3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.708772 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0d9d4bf-d6d1-425b-a5c8-9b71d492eef3 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.043950 Jun 25 20:52:29.708772 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 120/239] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:29.709397 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.709397 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:29.721561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e03b37b-245e-422a-a48f-c87ac79be74f tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1548982049"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.722943 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.722943 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:29.732988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e03b37b-245e-422a-a48f-c87ac79be74f tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e03b37b-245e-422a-a48f-c87ac79be74f tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 60 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:29.737880 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: {"aggregate": {"name": "tempest-test_aggregate-1548982049"}} Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:29.739316 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1548982049'}}} Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:29.740074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:29.741339 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jun 25 20:52:29.742504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.748463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e03b37b-245e-422a-a48f-c87ac79be74f tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.754733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e03b37b-245e-422a-a48f-c87ac79be74f tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.040322 Jun 25 20:52:29.756975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 121/240] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:29.781330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a4e7285-fdee-4008-8c22-94d994e4a7cd tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2053973863"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.783089 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19b30b6e-7129-4755-a17c-b386ed25b734 tempest-AggregatesAdminTestJSON-871800690 tempest-AggregatesAdminTestJSON-871800690-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.102686 Jun 25 20:52:29.784699 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 120/241] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:29.791164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-2a4e7285-fdee-4008-8c22-94d994e4a7cd tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid f7add25e-2dc8-4a05-b04f-090a8343ea8c for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:29.801391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.812727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:29.846033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.848265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.853540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.854259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.860802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9,nova_api:DELETE=8,nova_api:UPDATE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:29.904360 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a4e7285-fdee-4008-8c22-94d994e4a7cd tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.141692 Jun 25 20:52:29.906648 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] HTTP exception thrown: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:29.907537 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 122/242] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Request method failure captured: Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b HTTP/1.1 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vg2vPJXJyz2ruRGwhL49mIVZdUCZ3fmBzJjgc8Cef6Xgj24PdfV4GsUSzFdOvvFnGKJBmchTPKr7LFfM699dyt4-iKvErZAPV85Do8YvO5-jev3PBwB5ptXMI6rpWzzgdVyA--LwfQaISEvM4hGVteadrKq6hLRBogkvAfm1YEKjg Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:29.914446 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}] Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: de7f658e8ff74ef2bc3a90c74b0013eb Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:29.915687 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ae4648d0-de74-4b1a-81dd-ea74faf0588b'} Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.916300 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:29.917346 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.922174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2053973863"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:29.922562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Returning 404 to user: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.925631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f7387715-be43-4dcf-a155-20e92acd58f2 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 404 len: 111 microversion: 2.1 time: 0.135419 Jun 25 20:52:29.926945 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.926945 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:29.930192 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 121/243] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:29.930775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid dba7239f-936b-4d4c-a16e-9d1fa0ae9678 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:29.954981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.957218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] [instance: ae4648d0-de74-4b1a-81dd-ea74faf0588b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:29.967098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2053973863 already exists. Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 60 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:29.968908 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: {"aggregate": {"name": "tempest-test_aggregate-2053973863"}} Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:29.970013 ncdv-master-1 devstack@n-api.service[137461]: exception: Aggregate tempest-test_aggregate-2053973863 already exists. Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2053973863'}}} Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate.create() Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jun 25 20:52:29.970680 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2053973863 already exists. Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:29.973511 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2053973863 already exists. Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2053973863 already exists. Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2053973863 already exists. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:29.975067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ea21131-d4f8-4317-a927-ee72d512bcea tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.057663 Jun 25 20:52:29.978690 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 123/244] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:29 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:29.987201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.987647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.988458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:29.993356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-38a853fc-1730-4be0-9e07-e9343f5dd745 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:29.995418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:29.999942 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:29.999942 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.038741 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] HTTP exception thrown: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Request method failure captured: Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b HTTP/1.1 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vg2vPJXJyz2ruRGwhL49mIVZdUCZ3fmBzJjgc8Cef6Xgj24PdfV4GsUSzFdOvvFnGKJBmchTPKr7LFfM699dyt4-iKvErZAPV85Do8YvO5-jev3PBwB5ptXMI6rpWzzgdVyA--LwfQaISEvM4hGVteadrKq6hLRBogkvAfm1YEKjg Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:30.041800 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9b9e4621cb39462ba663e92f2e38a0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9b9e4621cb39462ba663e92f2e38a0b5"}]}] Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9b9e4621cb39462ba663e92f2e38a0b5 Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1172786183 Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: de7f658e8ff74ef2bc3a90c74b0013eb Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminTestJSON-1172786183-project Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:30.043159 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ae4648d0-de74-4b1a-81dd-ea74faf0588b'} Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.043817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. Jun 25 20:52:30.045026 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.047616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] Returning 404 to user: Instance ae4648d0-de74-4b1a-81dd-ea74faf0588b could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.051596 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d1382222-d8c6-4eca-869f-41d57a615779 tempest-AggregatesAdminTestJSON-1172786183 tempest-AggregatesAdminTestJSON-1172786183-project] 10.222.0.39 "GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b" status: 404 len: 111 microversion: 2.1 time: 0.116759 Jun 25 20:52:30.057338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 122/245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:29 2022] GET /compute/v2.1/servers/ae4648d0-de74-4b1a-81dd-ea74faf0588b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:30.069222 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-38a853fc-1730-4be0-9e07-e9343f5dd745 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.089377 Jun 25 20:52:30.069814 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 124/246] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:30.085161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce80d72f-fa6e-4d55-99de-7466d49c54da tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2125574087"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:30.086941 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.086941 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:30.088357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-ce80d72f-fa6e-4d55-99de-7466d49c54da tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid e97e958a-cd43-45ab-a4ab-765567525304 for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:30.136408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce80d72f-fa6e-4d55-99de-7466d49c54da tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060988 Jun 25 20:52:30.139133 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 123/247] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:30.154132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-425a307e-fa1a-4b15-9142-626fe66e0e27 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.154991 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.154991 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.156983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-425a307e-fa1a-4b15-9142-626fe66e0e27 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-425a307e-fa1a-4b15-9142-626fe66e0e27 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:30.160081 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 25 20:52:30.161274 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '15'} Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:30.161887 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jun 25 20:52:30.162829 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.164815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-425a307e-fa1a-4b15-9142-626fe66e0e27 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.175544 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-425a307e-fa1a-4b15-9142-626fe66e0e27 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.024810 Jun 25 20:52:30.188404 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 125/248] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:30.194055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c8e03d7-c286-4776-9252-bd6fcb9aab7a tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.194833 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.194833 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:30.243478 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c8e03d7-c286-4776-9252-bd6fcb9aab7a tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.053741 Jun 25 20:52:30.245237 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 124/249] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:30 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:30.256158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-537b2e92-0c02-4c30-b50b-67c36b7a4bd5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.271049 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-537b2e92-0c02-4c30-b50b-67c36b7a4bd5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-537b2e92-0c02-4c30-b50b-67c36b7a4bd5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:30.274169 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: exception: Aggregate -1 could not be found. Jun 25 20:52:30.275599 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '-1'} Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:30.276379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.277577 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 25 20:52:30.278951 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.286200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-537b2e92-0c02-4c30-b50b-67c36b7a4bd5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.289850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-537b2e92-0c02-4c30-b50b-67c36b7a4bd5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.039172 Jun 25 20:52:30.295384 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 126/250] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:30 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:30.304129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd622ab-8a65-48dc-a100-e1bbfd9d9906 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-450600776"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:30.305614 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.305614 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:30.306652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-cfd622ab-8a65-48dc-a100-e1bbfd9d9906 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid ed4a80b5-1a12-40f7-b9be-8ecfb335691d for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:30.355792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfd622ab-8a65-48dc-a100-e1bbfd9d9906 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.056385 Jun 25 20:52:30.357528 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 125/251] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:30.368291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de4aa94e-4c77-4aa6-95ab-008d0b7d6c48 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.369797 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.369797 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.372203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de4aa94e-4c77-4aa6-95ab-008d0b7d6c48 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de4aa94e-4c77-4aa6-95ab-008d0b7d6c48 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:30.375608 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 25 20:52:30.376897 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '16'} Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:30.377668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jun 25 20:52:30.378624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.384805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de4aa94e-4c77-4aa6-95ab-008d0b7d6c48 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.387377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de4aa94e-4c77-4aa6-95ab-008d0b7d6c48 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.022979 Jun 25 20:52:30.395990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 127/252] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:30 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:30.405102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6cf9ae3-d20e-44a5-aedd-e18e3c9b2328 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.406158 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.406158 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:30.413254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=10,nova_api:DELETE=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:30.495083 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6cf9ae3-d20e-44a5-aedd-e18e3c9b2328 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.098523 Jun 25 20:52:30.495665 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 126/253] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:30.521610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22db4b71-c81c-4c39-b46f-97590b252b54 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.534609 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-22db4b71-c81c-4c39-b46f-97590b252b54 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22db4b71-c81c-4c39-b46f-97590b252b54 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:30.536694 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: exception: Aggregate -1 could not be found. Jun 25 20:52:30.537873 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '-1'} Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.538523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jun 25 20:52:30.539498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.553237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22db4b71-c81c-4c39-b46f-97590b252b54 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.556573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.557466 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22db4b71-c81c-4c39-b46f-97590b252b54 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.053405 Jun 25 20:52:30.557599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:30.559324 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 128/254] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:52:30 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:30.574076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:30.578763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:30.580787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:30.585957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:30.586922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57954656-031a-407f-bc3b-31ba9ee2f9b4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:30.596275 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.596275 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.599475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57954656-031a-407f-bc3b-31ba9ee2f9b4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57954656-031a-407f-bc3b-31ba9ee2f9b4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:30.608145 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 25 20:52:30.609374 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:30.610001 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jun 25 20:52:30.611033 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:30.616562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57954656-031a-407f-bc3b-31ba9ee2f9b4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:30.620414 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57954656-031a-407f-bc3b-31ba9ee2f9b4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.050832 Jun 25 20:52:30.622569 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 129/255] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:52:30 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:52:30.634790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5616ea34-1bef-49f8-b7ff-abde1780fe00 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1864156869"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:30.638851 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.638851 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.642323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-5616ea34-1bef-49f8-b7ff-abde1780fe00 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid 4822831e-cc61-45b4-8af3-4203a76ac28c for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:30.676533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=20 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:30.711685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5616ea34-1bef-49f8-b7ff-abde1780fe00 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.080776 Jun 25 20:52:30.717708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 130/256] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:52:30.745440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd91d051-6bc2-4afb-8f3a-0899182209e7 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:30.747513 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:30.747513 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:30.774124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd91d051-6bc2-4afb-8f3a-0899182209e7 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:30.775280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd91d051-6bc2-4afb-8f3a-0899182209e7 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:30.982619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:31.003450 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-779f135b-c38b-45ba-b224-7a09a67a76bd tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1224 microversion: 2.1 time: 0.450290 Jun 25 20:52:31.006716 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 127/257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:30 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1224 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:31.046208 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd91d051-6bc2-4afb-8f3a-0899182209e7 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.321588 Jun 25 20:52:31.046860 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 131/258] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:30 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:31.061669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac781359-ca11-4400-9565-595ca46082c4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:31.063435 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.063435 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:31.064729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ac781359-ca11-4400-9565-595ca46082c4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '432e697b89654407ab9d5d4ed54a9d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c120d28e8dbc44b6a0fd1c411b828e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac781359-ca11-4400-9565-595ca46082c4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Request method failure captured: Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 42 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3VhflOZzoS713rDEoSAi0Ax1SYQk7PLUOXYofNWEKWBNiWcziZm3irz1DSZft4bFXyFrR-R71qJLLtIVYbnWzI6gFPeJX40TMGGL4_m-olVN7lPH5JlbhaFyVOSFFv14g3VY6cix_FaRc-aGqoGYjWAyzDx-YGXEz1hfVEvthdFKtY Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:31.068349 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c120d28e8dbc44b6a0fd1c411b828e35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c120d28e8dbc44b6a0fd1c411b828e35"}]}] Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c120d28e8dbc44b6a0fd1c411b828e35 Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222 Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 432e697b89654407ab9d5d4ed54a9d81 Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2111329222-project Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: {"remove_host": {"host": "nch1-master-1"}} Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:31.069573 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch1-master-1'}}} Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:31.070263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jun 25 20:52:31.071228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.073939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac781359-ca11-4400-9565-595ca46082c4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:31.077210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac781359-ca11-4400-9565-595ca46082c4 tempest-AggregatesAdminNegativeTestJSON-2111329222 tempest-AggregatesAdminNegativeTestJSON-2111329222-project] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.021778 Jun 25 20:52:31.078780 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 128/259] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:31.089507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4328fc53-9903-457e-803d-c61fdcbb50a1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:31.091898 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.091898 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:31.112520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4328fc53-9903-457e-803d-c61fdcbb50a1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:31.117332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4328fc53-9903-457e-803d-c61fdcbb50a1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:31.335710 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4328fc53-9903-457e-803d-c61fdcbb50a1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.251810 Jun 25 20:52:31.340972 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 132/260] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:31.353399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-caeb7405-2c4b-46e0-a7d6-28c31355baf5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:31.354333 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.354333 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:31.417635 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-caeb7405-2c4b-46e0-a7d6-28c31355baf5 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.068664 Jun 25 20:52:31.418339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 129/261] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 20:52:31.431652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4f5d5c4-d0ce-4c17-b172-5dfd93c5e5f0 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1925833182"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:31.433241 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.433241 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:31.434416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.aggregate [None req-c4f5d5c4-d0ce-4c17-b172-5dfd93c5e5f0 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Generated uuid 79534090-5e40-41a0-ac0c-e4be42d01b82 for aggregate {{(pid=137461) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 20:52:31.487428 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4f5d5c4-d0ce-4c17-b172-5dfd93c5e5f0 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.061567 Jun 25 20:52:31.493674 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 133/262] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 20:52:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:31.503416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:31.505031 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.505031 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:31.522104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:31.522569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:31.547819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:31.549066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:31.579529 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.compute.aggregates [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 25 20:52:31.580394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Request method failure captured: Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 42 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3VjDLbWSiQtiZ105ptVGIGek1W3lH1ztb-iEahumWNwTttIFcEdV_XzKUER11wPG_SdrJKdqqaq6yrhbMmUQQgGOG15U_125VMD-Xy6ww-ELIE7VLQHqULOIGGYlqMhVXz16YY80cGdceYx3LpBdtHE397Qz9I26ivNpzG6uw0saQk Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:31.589846 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5ccc26c557b14392ab352f289a191271"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5ccc26c557b14392ab352f289a191271"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5ccc26c557b14392ab352f289a191271"}]}] Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5ccc26c557b14392ab352f289a191271 Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513 Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: f92c71346ae3442e9343399bba81031a Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: {"remove_host": {"host": "nonexist_host"}} Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:52:31.591373 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot remove host nonexist_host in aggregate 18 Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jun 25 20:52:31.592233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jun 25 20:52:31.593515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.594771 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Jun 25 20:52:31.596069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:31.598354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:31.599111 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-672cb690-1d23-4434-ab9d-7b3efddb93b1 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.101116 Jun 25 20:52:31.603487 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 130/263] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 20:52:31 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:31.608520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb188aaa-702e-46c4-8fbf-034a8be02a92 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:31.609361 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:31.609361 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:31.666941 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb188aaa-702e-46c4-8fbf-034a8be02a92 tempest-AggregatesAdminNegativeTestJSON-2075127513 tempest-AggregatesAdminNegativeTestJSON-2075127513-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.062376 Jun 25 20:52:31.674149 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 134/264] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jun 25 20:52:32.023788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:32.025278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:32.036296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:32.041041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:32.042158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:32.042723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:32.370969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:32.382337 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cacdaa6a-9324-4e31-ba03-6b6cb03cb135 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1278 microversion: 2.1 time: 0.363163 Jun 25 20:52:32.382933 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 131/265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:32 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1278 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:33.401996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:33.403369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:33.415538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:33.418748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:33.422318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:33.422992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:33.433723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:33.750947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:33.762163 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-49a06536-4a75-4202-846f-b96bbcaf9ea3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1278 microversion: 2.1 time: 0.366920 Jun 25 20:52:33.764988 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 135/266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:33 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1278 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:34.781161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:34.781783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:34.797776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:34.798235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:34.799019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:34.799458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:37.112621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:37.122283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c3e8347-6746-464f-adc6-b2c4159eb5c8 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 2.345187 Jun 25 20:52:37.126968 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 132/267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:34 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:38.141554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:38.143002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:38.157156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:38.164691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:38.166161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:38.166799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:38.312602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-daabbfce-b80e-4beb-a716-59bc954ef8bf req-2a982085-2c9f-49c1-bc34-a7b283c44315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a33a7fc0-694c-4123-9ce2-53a3203ce659", "tag": "8a939401-cb81-4567-8093-c66213382ced"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:38.352332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daabbfce-b80e-4beb-a716-59bc954ef8bf req-2a982085-2c9f-49c1-bc34-a7b283c44315 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:38.357977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daabbfce-b80e-4beb-a716-59bc954ef8bf req-2a982085-2c9f-49c1-bc34-a7b283c44315 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:38.384744 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-daabbfce-b80e-4beb-a716-59bc954ef8bf req-2a982085-2c9f-49c1-bc34-a7b283c44315 service nova] Creating event network-changed:8a939401-cb81-4567-8093-c66213382ced for instance a33a7fc0-694c-4123-9ce2-53a3203ce659 on nch2-master-1 Jun 25 20:52:38.416939 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-daabbfce-b80e-4beb-a716-59bc954ef8bf req-2a982085-2c9f-49c1-bc34-a7b283c44315 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108756 Jun 25 20:52:38.418240 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 133/268] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:38.992280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=15 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:39.132312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:39.144028 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a70d10fc-30a8-4c7f-a657-2fd2dfe2e322 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.006600 Jun 25 20:52:39.147317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 136/269] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:38 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:40.162753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:40.163469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:40.165960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=26 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:40.181054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:40.183327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:40.185406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:40.186898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:41.245728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-633905138", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:41.373864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:52:41.465759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:41.478509 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f2a8d12-853a-4c29-a9a8-94a15aaf9b36 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.320204 Jun 25 20:52:41.489595 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 134/270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:40 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:41.878689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:42.197571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30add789-3c4a-42fa-bb60-35788b05a318 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-707984146", "id": 532182665, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:42.201170 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:42.201170 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:42.223619 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30add789-3c4a-42fa-bb60-35788b05a318 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.350215 Jun 25 20:52:42.224966 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 135/271] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:52:41 2022] POST /compute/v2.1/flavors => generated 464 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:42.226366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30add789-3c4a-42fa-bb60-35788b05a318 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:42.227544 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30add789-3c4a-42fa-bb60-35788b05a318 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001492 Jun 25 20:52:42.228349 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 136/272] 10.222.0.39 () {56 vars in 885 bytes} [Sat Jun 25 20:52:42 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 25 20:52:42.371613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:52:42.372806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:52:42.373519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:52:42.374025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:52:42.374737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:52:42.394975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:42.395424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:42.399684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:42.400241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:42.459086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Getting quotas for project 16bcac6970c1483ab891f5d019ab5275. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:42.470096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Getting quotas for user 50a75def6fb349428da65572e0a55516 and project 16bcac6970c1483ab891f5d019ab5275. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:42.494787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:52:42.499692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:52:42.513194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d34437ea-029b-4f17-83c5-7ee2c2a6d849 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:42.532417 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d34437ea-029b-4f17-83c5-7ee2c2a6d849 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] 10.222.0.39 "GET /compute/v2.1/flavors/532182665" status: 200 len: 464 microversion: 2.61 time: 0.297309 Jun 25 20:52:42.533994 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 137/273] 10.222.0.39 () {60 vars in 1195 bytes} [Sat Jun 25 20:52:42 2022] GET /compute/v2.1/flavors/532182665 => generated 464 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:42.540010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:42.541082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:42.551062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:42.551708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:42.552932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:42.554335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:42.624515 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-46fb0a0d-7f70-4ddb-9ae2-ebe5a9d3ae69 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.613451 Jun 25 20:52:42.625758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 137/274] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:52:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:52:42.631095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-632078ec-08f9-4b36-afad-40b0c0401770 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] Action: 'update', calling method: .version_select at 0x7f98602f6f70>, body: {"flavor": {"description": "new"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:42.652641 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:42.652641 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:42.708102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-632078ec-08f9-4b36-afad-40b0c0401770 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/532182665" status: 200 len: 465 microversion: 2.61 time: 0.081012 Jun 25 20:52:42.712317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 138/275] 10.222.0.39 () {62 vars in 1215 bytes} [Sat Jun 25 20:52:42 2022] PUT /compute/v2.1/flavors/532182665 => generated 465 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:52:42.728561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcf2a9f3-8e44-44a7-862f-6b409f2a66d5 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:42.731979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dcf2a9f3-8e44-44a7-862f-6b409f2a66d5 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:43.103677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dcf2a9f3-8e44-44a7-862f-6b409f2a66d5 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:43.121214 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcf2a9f3-8e44-44a7-862f-6b409f2a66d5 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1222 microversion: 2.1 time: 0.405391 Jun 25 20:52:43.122235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 139/276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:42 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1222 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:43.138244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43848a67-ed35-4014-9991-8fe92b4e9d07 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:43.189826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43848a67-ed35-4014-9991-8fe92b4e9d07 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.060050 Jun 25 20:52:43.191525 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 140/277] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:52:43 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:43.210905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bdd3592b-ad44-41a1-bfb5-f1dd47461823 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:43.252060 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bdd3592b-ad44-41a1-bfb5-f1dd47461823 tempest-FlavorsV261TestJSON-942006850 tempest-FlavorsV261TestJSON-942006850-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.045276 Jun 25 20:52:43.253023 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 141/278] 10.222.0.39 () {60 vars in 1165 bytes} [Sat Jun 25 20:52:43 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:52:43.266930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa4534af-d592-4287-a9bd-027f89531b42 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:43.267968 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:43.267968 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:43.307230 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa4534af-d592-4287-a9bd-027f89531b42 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/532182665" status: 202 len: 0 microversion: 2.61 time: 0.044546 Jun 25 20:52:43.308614 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 142/279] 10.222.0.39 () {60 vars in 1198 bytes} [Sat Jun 25 20:52:43 2022] DELETE /compute/v2.1/flavors/532182665 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:52:43.318285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01b14bf6-d7c7-44db-9db5-acff15247427 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:43.381690 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01b14bf6-d7c7-44db-9db5-acff15247427 tempest-FlavorsV261TestJSON-1834694460 tempest-FlavorsV261TestJSON-1834694460-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.067839 Jun 25 20:52:43.382822 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 143/280] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:52:43 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:52:43.910211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:43.923082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-593e366f-4956-4895-b6c0-1fc7895ae856 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.387755 Jun 25 20:52:43.932684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 138/281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:42 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:44.140854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:44.141469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:44.154241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:44.154694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:44.160795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:44.161334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:44.547699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:44.562521 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c83b9a5c-00f9-431e-878b-93eb5da7a8d8 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1274 microversion: 2.1 time: 0.421824 Jun 25 20:52:44.583687 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 144/282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:44 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1274 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:44.952459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:44.953855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:44.972252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:44.973073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:44.974082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:44.978220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:45.581802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:45.582416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:45.595604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:45.598440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:45.599506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:45.600598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:45.837048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:45.846848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7e1f50d-aef0-41c9-bc2a-7af01ab2a3cb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1280 microversion: 2.1 time: 0.269397 Jun 25 20:52:45.859317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 145/283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:45 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:45.903591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:45.914064 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff4706cc-c1e3-4419-a3c5-f6f0df4aeec3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 0.975097 Jun 25 20:52:45.915534 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 139/284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:44 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:46.867270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:46.867955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:46.876634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:46.881074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:46.883096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:46.883548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:46.931460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:46.932797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:46.959103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:46.959883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:46.962348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:46.964804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:47.222619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:47.231512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76b6f425-8f81-4cae-860d-481f39cba029 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1280 microversion: 2.1 time: 0.369342 Jun 25 20:52:47.247876 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 146/285] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:46 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:48.025782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:48.041276 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49c98b35-7bcb-4a73-ab56-bbbd2b7644ff tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.114187 Jun 25 20:52:48.061249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 140/286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:46 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:48.249327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:48.250505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:48.260158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:48.272232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:48.273531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:48.277058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:49.067315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:49.067935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:49.080298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:49.083547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:49.084440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:49.084891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:49.147587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:49.156308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-70376bdc-7cbe-4fd9-b674-b961b9789620 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.910952 Jun 25 20:52:49.161580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 147/287] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:48 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:50.262669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-500528980", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "7ef2b2be-dae0-4c92-af7f-25bfe52fff3b"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:50.409156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] validate_networks() for [('7ef2b2be-dae0-4c92-af7f-25bfe52fff3b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:52:50.792118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:50.811808 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9cddde04-6a62-4291-9bb3-810ebadc6e4c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.748477 Jun 25 20:52:50.812491 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 141/288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:49 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:50.837130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:50.837130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:50.847739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:50.849290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:50.865460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:50.867290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:51.305942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:51.320963 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d52a5b49-3363-4234-bac8-2bda8a86755d tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.495314 Jun 25 20:52:51.339157 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 142/289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:50 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:51.474324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ead2c7fc-34a2-49dc-82c0-eb7abf8b7aa5 req-0463dc35-4d71-4d14-9312-9f49fb15f45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c888e23-419b-4eb0-9d17-248a8b977d20", "tag": "f468598c-8d4f-4173-8e57-3e4e6c8bdc01"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:51.500161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ead2c7fc-34a2-49dc-82c0-eb7abf8b7aa5 req-0463dc35-4d71-4d14-9312-9f49fb15f45c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:51.500654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ead2c7fc-34a2-49dc-82c0-eb7abf8b7aa5 req-0463dc35-4d71-4d14-9312-9f49fb15f45c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:51.562137 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ead2c7fc-34a2-49dc-82c0-eb7abf8b7aa5 req-0463dc35-4d71-4d14-9312-9f49fb15f45c service nova] Creating event network-changed:f468598c-8d4f-4173-8e57-3e4e6c8bdc01 for instance 4c888e23-419b-4eb0-9d17-248a8b977d20 on nch1-master-1 Jun 25 20:52:51.586488 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ead2c7fc-34a2-49dc-82c0-eb7abf8b7aa5 req-0463dc35-4d71-4d14-9312-9f49fb15f45c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115730 Jun 25 20:52:51.593211 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 143/290] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:51.831362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:51.831878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:51.843711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:51.844156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:51.850436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:51.850907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:52.431548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:52.532767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:52.543740 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6ec3b43b-1566-4976-a918-0e4cd8c3415c tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 0.717952 Jun 25 20:52:52.544322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 144/291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:51 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:52.561012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:52.561625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:52.593101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:52.593474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:52.598438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:52.598959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:53.112198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:53.473258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:52:53.473839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:52:53.474156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:52:53.474586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:52:53.475007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:52:53.485597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:53.486044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:53.505064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:53.505673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:53.603113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:52:53.620820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:53.623133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for user 39e82edaa30d418d96ea37f942d62755 and project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:52:53.670642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:52:53.677864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:52:53.749700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:53.764093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef318e8e-879e-448c-b72f-822d1b1b0e8a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 1.210280 Jun 25 20:52:53.770389 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 145/292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:52 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:53.808390 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3be6ba7-c6d1-40fb-8bb4-afd9675f6f52 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.860633 Jun 25 20:52:53.810989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 148/293] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3865 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 20:52:53.843898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:53.845925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:53.891312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:53.897324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:53.898575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:53.900026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.346047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cfb3f70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.347350 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:54.347350 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:54.348501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.349156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.350101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.350667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.431791 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b76ad3fb-6529-4a4e-8737-7874ec854333 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.660023 Jun 25 20:52:54.433648 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 146/294] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:52:53 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:54.445013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.454256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:54.519796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:54.537861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4edd34c8-1c7a-4011-a1c9-aea3453120ec tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 0.722796 Jun 25 20:52:54.554982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 149/295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:53 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:54.619907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:54.628506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:54.638896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:54.642006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d15a45d-3678-4724-91d8-a7957ed5ae82 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1261 microversion: 2.25 time: 0.203982 Jun 25 20:52:54.644859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 147/296] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:54.660764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cf9e4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.669193 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:54.669193 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:54.670682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.672920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.675151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.676300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.679621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Calling method '.version_select at 0x7f985c611670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.684406 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:54.684406 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:54.693311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.696507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.701906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.705376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.748736 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4421673c-2a4b-4e01-9a2d-6edb8b741b72 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.102472 Jun 25 20:52:54.754302 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 148/297] 10.222.0.39 () {58 vars in 1138 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:54.761238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cfa11f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.770039 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:54.770039 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:54.771673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.777210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.780929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.783057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.802400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3d1e503-f8e8-40e5-8122-a57e3a1fb22a tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.242281 Jun 25 20:52:54.809799 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 150/298] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:54.827144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:54.828171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:54.876409 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01106226-59b1-490c-8793-c5a024d7b2cd tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.118434 Jun 25 20:52:54.877673 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 149/299] 10.222.0.39 () {58 vars in 1144 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 20:52:54.890273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.890728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:54.903144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:54.906621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.131429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a51a5fea-387a-44a7-a3aa-a5055d17acdd tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Calling method '.version_select at 0x7f985cfa1c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.132653 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.132653 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.133742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a51a5fea-387a-44a7-a3aa-a5055d17acdd tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a51a5fea-387a-44a7-a3aa-a5055d17acdd tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:55.135732 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:52:55.137317 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.138350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jun 25 20:52:55.139762 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.141114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a51a5fea-387a-44a7-a3aa-a5055d17acdd tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.141114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a51a5fea-387a-44a7-a3aa-a5055d17acdd tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.258362 Jun 25 20:52:55.141114 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 150/300] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 260 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:55.142462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cf9ea60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.144809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.145252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.156381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.157031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.203208 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a842aa7d-e5ab-4ed0-accf-2b1ca5ed5f6a tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.063894 Jun 25 20:52:55.209335 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 151/301] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:55.214965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66fed09b-bac9-4f95-8c4c-b654596d28e2 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Calling method '.version_select at 0x7f985cf9e5e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.215844 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.215844 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.216983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66fed09b-bac9-4f95-8c4c-b654596d28e2 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66fed09b-bac9-4f95-8c4c-b654596d28e2 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:55.222994 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ncdv-master-1'} Jun 25 20:52:55.224497 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.225381 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jun 25 20:52:55.226616 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.228036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66fed09b-bac9-4f95-8c4c-b654596d28e2 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.228036 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66fed09b-bac9-4f95-8c4c-b654596d28e2 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018676 Jun 25 20:52:55.228036 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 152/302] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:55.238945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cfa1430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.241130 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.241130 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.243602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.244820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.245645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.248269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.307876 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-de705ec3-fdb0-43ec-8a92-a13992971dea tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.074179 Jun 25 20:52:55.314678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 153/303] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:55.317307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f85dd629-8f89-44b3-953a-7e1b831a5fac tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Calling method '.version_select at 0x7f985cfa10d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.320358 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.320358 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.341345 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f85dd629-8f89-44b3-953a-7e1b831a5fac tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f85dd629-8f89-44b3-953a-7e1b831a5fac tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:55.343691 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'nonexistent_hostname'} Jun 25 20:52:55.345101 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:55.345951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 25 20:52:55.347194 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.348359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.349846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f85dd629-8f89-44b3-953a-7e1b831a5fac tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.352865 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f85dd629-8f89-44b3-953a-7e1b831a5fac tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.041489 Jun 25 20:52:55.354256 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 154/304] 10.222.0.39 () {58 vars in 1211 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:55.368303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cfb3820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.369818 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.369818 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.371413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.377339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.378449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.379054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.430338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8986bcd4-bc0a-4812-bbcd-3df289fb02d8 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.072053 Jun 25 20:52:55.431545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 155/305] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:55.436681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a27ff26-a6f7-4639-873a-a5ed5c2cc128 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Calling method '.version_select at 0x7f985cfa1a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.437735 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.437735 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.439041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6a27ff26-a6f7-4639-873a-a5ed5c2cc128 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.439866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a27ff26-a6f7-4639-873a-a5ed5c2cc128 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:55.441026 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ncdv-master-1'} Jun 25 20:52:55.442426 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.443233 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jun 25 20:52:55.444392 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.447955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a27ff26-a6f7-4639-873a-a5ed5c2cc128 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.448133 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d47889e-8af3-40d6-8bab-cae131401f0e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.635342 Jun 25 20:52:55.449986 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a27ff26-a6f7-4639-873a-a5ed5c2cc128 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.017271 Jun 25 20:52:55.451667 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 156/306] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:55.465808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cfb3dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.467758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 151/307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:54 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:55.473506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ecae3fd-a9c8-4c4e-976c-c53ab33697f3 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Calling method '.version_select at 0x7f985c537700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.474324 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.474324 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:55.480660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.481101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.489407 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2ecae3fd-a9c8-4c4e-976c-c53ab33697f3 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ecae3fd-a9c8-4c4e-976c-c53ab33697f3 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:55.491300 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'nonexistent_hostname'} Jun 25 20:52:55.492605 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.493393 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.494934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.495851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ecae3fd-a9c8-4c4e-976c-c53ab33697f3 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.495851 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ecae3fd-a9c8-4c4e-976c-c53ab33697f3 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024051 Jun 25 20:52:55.495851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 152/308] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:55.504147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a72efc8-a58b-445a-bf98-c9922c2bbd92 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Calling method '.version_select at 0x7f985c4e7a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.506684 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.506684 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:55.510879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a72efc8-a58b-445a-bf98-c9922c2bbd92 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a72efc8-a58b-445a-bf98-c9922c2bbd92 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:55.517117 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ncdv-master-1'} Jun 25 20:52:55.518282 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.518981 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jun 25 20:52:55.520396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.523942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a72efc8-a58b-445a-bf98-c9922c2bbd92 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.526470 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a72efc8-a58b-445a-bf98-c9922c2bbd92 tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.026153 Jun 25 20:52:55.529335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 153/309] 10.222.0.39 () {58 vars in 1196 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:55.531347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.532002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.543400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0767929-42ee-45f1-897c-a6219d57c7bf tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Calling method '.version_select at 0x7f985c6111f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.564857 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d0767929-42ee-45f1-897c-a6219d57c7bf tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.568131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0767929-42ee-45f1-897c-a6219d57c7bf tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:55.568923 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'nonexistent_hostname'} Jun 25 20:52:55.570174 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:55.579332 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 25 20:52:55.580472 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0767929-42ee-45f1-897c-a6219d57c7bf tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0767929-42ee-45f1-897c-a6219d57c7bf tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.034045 Jun 25 20:52:55.582579 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 154/310] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:55.598248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.598876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:55.623096 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-693f3e19-8631-408a-b3e6-b00235f6651c tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.168766 Jun 25 20:52:55.624028 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 157/311] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:55.633182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.633663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.634796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1e8654f5-7a83-422d-85ec-19e8dae0c02d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Calling method '.version_select at 0x7f985cfa11f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.635706 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.635706 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.639552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1e8654f5-7a83-422d-85ec-19e8dae0c02d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1e8654f5-7a83-422d-85ec-19e8dae0c02d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:52:55.641249 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ncdv-master-1'} Jun 25 20:52:55.642394 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.643089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jun 25 20:52:55.644067 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.645022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1e8654f5-7a83-422d-85ec-19e8dae0c02d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.645122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.645218 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1e8654f5-7a83-422d-85ec-19e8dae0c02d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.017214 Jun 25 20:52:55.646858 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 158/312] 10.222.0.39 () {58 vars in 1193 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:55.651689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.665204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Calling method '.version_select at 0x7f985cf9e3a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.671327 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.671327 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.692692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.693528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.740401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.753107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.827894 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b44237f-7a2b-4a44-8667-1b2858ce2754 tempest-HostsAdminTestJSON-1774450886 tempest-HostsAdminTestJSON-1774450886-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 598 microversion: 2.1 time: 0.178609 Jun 25 20:52:55.839060 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 159/313] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 598 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:55.850688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af31ee0a-388b-4815-bba2-7290f68ad359 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Calling method '.version_select at 0x7f985cf9eee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.851549 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:55.851549 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:52:55.913775 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-af31ee0a-388b-4815-bba2-7290f68ad359 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af31ee0a-388b-4815-bba2-7290f68ad359 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:52:55.915517 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'nonexistent_hostname'} Jun 25 20:52:55.916909 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:55.917737 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jun 25 20:52:55.923089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:52:55.924273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af31ee0a-388b-4815-bba2-7290f68ad359 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:55.933799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af31ee0a-388b-4815-bba2-7290f68ad359 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.093266 Jun 25 20:52:55.939759 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 160/314] 10.222.0.39 () {58 vars in 1214 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:52:55.948147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:55.950631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:55.971110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.974031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:55.975540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:55.985828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:56.371176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:56.386956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:56.388595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:56.389917 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-059f12fc-c71f-467e-b38c-04298d196dd4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1321 microversion: 2.25 time: 0.448119 Jun 25 20:52:56.401524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 161/315] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:56.619987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:56.632297 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e5ceee16-0397-4068-83e4-d96dc94960c1 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 1.051615 Jun 25 20:52:56.652868 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 155/316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:55 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:56.661547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-670fa92e-62fb-4306-994d-fde455fa9390 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Action: 'update', calling method: .version_select at 0x7f985c5b23a0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-670fa92e-62fb-4306-994d-fde455fa9390 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 51 Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:56.664811 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: {"status": "enable", "maintenance_mode": "invalid"} Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:56.666024 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'disable', Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Enable', Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Disable', Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance: Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'invalid' Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:56.666773 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:56.668255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:56.669324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:56.669324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:56.669324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:56.669324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:56.669324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:56.671244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-670fa92e-62fb-4306-994d-fde455fa9390 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:56.672336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-670fa92e-62fb-4306-994d-fde455fa9390 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.017750 Jun 25 20:52:56.673469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 156/317] 10.222.0.39 () {60 vars in 1189 bytes} [Sat Jun 25 20:52:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:56.687365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-61e1541d-b8b1-4cae-b0a8-a02d95daee21 req-9c4f5013-9294-401d-aaa2-5689875db328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33a7fc0-694c-4123-9ce2-53a3203ce659", "name": "network-vif-plugged", "status": "completed", "tag": "8a939401-cb81-4567-8093-c66213382ced"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:56.698860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-61e1541d-b8b1-4cae-b0a8-a02d95daee21 req-9c4f5013-9294-401d-aaa2-5689875db328 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:56.710257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-61e1541d-b8b1-4cae-b0a8-a02d95daee21 req-9c4f5013-9294-401d-aaa2-5689875db328 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:56.737709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-61e1541d-b8b1-4cae-b0a8-a02d95daee21 req-9c4f5013-9294-401d-aaa2-5689875db328 service nova] Creating event network-vif-plugged:8a939401-cb81-4567-8093-c66213382ced for instance a33a7fc0-694c-4123-9ce2-53a3203ce659 on nch2-master-1 Jun 25 20:52:56.739683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4164840b-622c-4a8b-bca5-31e724ec28f2 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Action: 'create', calling method: .version_select at 0x7f985cfb3310>, body: {"pool": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:56.750132 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-61e1541d-b8b1-4cae-b0a8-a02d95daee21 req-9c4f5013-9294-401d-aaa2-5689875db328 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074260 Jun 25 20:52:56.751281 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 157/318] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:52:56.757614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:56.758632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:56.765724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:56.766672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:56.767932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:56.768704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:57.105466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:57.118343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-498c0722-ce61-4abc-8335-95a3c4c335ae tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.361388 Jun 25 20:52:57.119040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 158/319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:56 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:57.128279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2704273-1dc2-44a1-bf9f-b81d115ec937 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Action: 'update', calling method: .version_select at 0x7f985c623160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2704273-1dc2-44a1-bf9f-b81d115ec937 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 51 Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:57.136044 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: {"status": "invalid", "maintenance_mode": "enable"} Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:57.137374 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'disable', Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Enable', Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Disable', Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance: Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'invalid' Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.142198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.145553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2704273-1dc2-44a1-bf9f-b81d115ec937 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d2704273-1dc2-44a1-bf9f-b81d115ec937 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.017623 Jun 25 20:52:57.149548 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 159/320] 10.222.0.39 () {60 vars in 1189 bytes} [Sat Jun 25 20:52:57 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:52:57.161603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f6196da-c172-4c63-8601-4d2fcde11a0d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Action: 'update', calling method: .version_select at 0x7f985c514e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:57.163456 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:52:57.163456 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:52:57.165029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f6196da-c172-4c63-8601-4d2fcde11a0d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '604fb9a67a10427ea0df0c3b41ef9193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f83ac789f4d94dd1b4285443defab881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f6196da-c172-4c63-8601-4d2fcde11a0d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Request method failure captured: Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 50 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WkqNkztYULIjcaM7QjwLLc_oi5ZU-XO9RDJFwIyMEciIMlU8dpRpjYplCe1EKuHljdjw3ZIEgauZbRkSTJEtKl5WtbOqwMUUoYw6kBYW3nRcCvZVrOBIkDyYj0dfi6IMCQTIXK2-Qbx8pJ_EYusxE6CVOzKP4eOQ_hPfGCqKRkNuo Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:52:57.166988 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f83ac789f4d94dd1b4285443defab881"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f83ac789f4d94dd1b4285443defab881"}]}] Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f83ac789f4d94dd1b4285443defab881 Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1592188207 Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 604fb9a67a10427ea0df0c3b41ef9193 Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1592188207-project Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: {"status": "enable", "maintenance_mode": "enable"} Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 25 20:52:57.168278 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:57.169121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jun 25 20:52:57.170186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.172900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f6196da-c172-4c63-8601-4d2fcde11a0d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:57.173994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f6196da-c172-4c63-8601-4d2fcde11a0d tempest-HostsAdminNegativeTestJSON-1592188207 tempest-HostsAdminNegativeTestJSON-1592188207-project] 10.222.0.39 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.029877 Jun 25 20:52:57.175121 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 160/321] 10.222.0.39 () {60 vars in 1189 bytes} [Sat Jun 25 20:52:57 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:52:57.193254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37e543a4-b037-4989-b5a1-b9ca771bc1f8 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Action: 'update', calling method: .version_select at 0x7f985c537790>, body: {"status": null, "maintenance_mode": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37e543a4-b037-4989-b5a1-b9ca771bc1f8 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 42 Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:57.197701 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: {"status": null, "maintenance_mode": null} Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 25 20:52:57.198934 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'disable', Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Enable', Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'Disable', Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'ENABLE', Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance: Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi None Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.199740 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.201097 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37e543a4-b037-4989-b5a1-b9ca771bc1f8 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:57.202122 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37e543a4-b037-4989-b5a1-b9ca771bc1f8 tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.018890 Jun 25 20:52:57.203678 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 161/322] 10.222.0.39 () {60 vars in 1189 bytes} [Sat Jun 25 20:52:57 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 20:52:57.213717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Action: 'update', calling method: .version_select at 0x7f985c623f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:52:57.216990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.hosts [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Enabling host nonexistent_hostname. Jun 25 20:52:57.227243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Request method failure captured: Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 50 Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WlAhcUyM5BrjxBiywEoThmTlGWrB9wNrzOEvJKFL-m4rt3V0Ed0edSuH_q1uiCNW5q19JUqngLiBHihImukKMvcsT8y8ci1H2xmw9wUaRf8oOJPoDhQwZGIN_kU5UzFCelC6vFGj3hKwgLcdgbLGo2YQgN9W6qjwbjo931n9T3M5Q Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:52:57.229520 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5d350253901443f4b5f7cf70dd9edc4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5d350253901443f4b5f7cf70dd9edc4d"}]}] Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5d350253901443f4b5f7cf70dd9edc4d Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1307927171 Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ce697dfa33564f178f2cbe5c1000ff9b Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1307927171-project-admin Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: {"status": "enable", "maintenance_mode": "enable"} Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:57.230796 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jun 25 20:52:57.231620 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:52:57.233141 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jun 25 20:52:57.234172 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:52:57.235977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:52:57.236890 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b66356a9-3551-4f2c-9bd9-21ff1013679d tempest-HostsAdminNegativeTestJSON-1307927171 tempest-HostsAdminNegativeTestJSON-1307927171-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.028041 Jun 25 20:52:57.238508 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 162/323] 10.222.0.39 () {60 vars in 1210 bytes} [Sat Jun 25 20:52:57 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 25 20:52:57.410526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:57.412278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:57.426393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:57.428987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:57.430083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:57.430535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:57.581216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:57.593609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:57.598351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:57.599550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-87444980-e86c-4164-877d-f07c2ff98084 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1319 microversion: 2.25 time: 0.194800 Jun 25 20:52:57.610607 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 163/324] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:52:57 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:52:57.655562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:57.658776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:57.694135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:57.695980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:57.697772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:57.699682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:58.504116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:58.519717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-27069af0-ba29-4ccf-a426-c931ac2042ac tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1320 microversion: 2.1 time: 0.872427 Jun 25 20:52:58.520810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 164/325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:57 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1320 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:52:58.529554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:58.531648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:58.545235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:58.545595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:58.546379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:58.550705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:59.439852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:52:59.450331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22576090-a14a-432f-bc19-c53b1a709222 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.926216 Jun 25 20:52:59.461877 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 165/326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:52:58 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:52:59.483307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:52:59.484394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:52:59.501794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:59.503116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:52:59.504238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:52:59.505019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:00.189249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:00.207609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:00.211688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:00.216820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7a0b09a-f751-4597-8459-fa35f07773c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.753325 Jun 25 20:53:00.217611 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 166/327] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:52:59 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:00.233173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:00.234679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:00.254990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:00.257064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:00.260242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:00.262910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:00.476829 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4164840b-622c-4a8b-bca5-31e724ec28f2 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.072320 Jun 25 20:53:00.478295 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 162/328] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:52:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:00.487467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:00.494383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:00.512583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:00.526288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:00.527959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:00.532928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:00.534137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:01.044384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:01.061574 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fedcfe01-3d46-4881-b523-9ea4679e8a65 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1470 microversion: 2.1 time: 0.841742 Jun 25 20:53:01.064311 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 167/329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:00 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1470 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:01.085117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34f290a0-0281-411f-8de6-69dc0ce87a9a tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985c623160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:01.313883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:01.328776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2af92c16-e104-49ea-8891-c87bb22c28dd tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 0.849131 Jun 25 20:53:01.359103 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 163/330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:00 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:01.384048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:01.387322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:01.403523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:01.405174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:01.407435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:01.408198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:01.763066 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7052f6e2-e1ac-44b1-a2a1-3ca6a4bde596 tempest-DeleteServersAdminTestJSON-6217087 tempest-DeleteServersAdminTestJSON-6217087-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659/action" status: 202 len: 0 microversion: 2.1 time: 0.397474 Jun 25 20:53:01.765146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 164/331] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:53:01 2022] POST /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:01.795845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:01.803447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:01.846769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:01.847220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:01.848006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:01.858693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.199056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:02.214244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:02.216160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:02.217555 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aba4742c-6898-4f02-b095-dc0c4f094321 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.445984 Jun 25 20:53:02.220009 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 165/332] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:01 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:02.224894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:02.225686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:02.232171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.232910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.233852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.234432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.292310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.292786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.293334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lazy-loading 'fault' on Instance uuid a33a7fc0-694c-4123-9ce2-53a3203ce659 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:02.437331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34f290a0-0281-411f-8de6-69dc0ce87a9a tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/07bd0769-fe9f-4db6-ba26-6a997ec931d9" status: 200 len: 142 microversion: 2.1 time: 1.370403 Jun 25 20:53:02.444319 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 168/333] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 20:53:01 2022] GET /compute/v2.1/os-floating-ips/07bd0769-fe9f-4db6-ba26-6a997ec931d9 => generated 142 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:02.449323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-237e1b3d-fb07-45a2-942d-6da9bd758a16 req-be4c5077-dce6-403c-89f7-c177c91550c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:02.464187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-237e1b3d-fb07-45a2-942d-6da9bd758a16 req-be4c5077-dce6-403c-89f7-c177c91550c3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.464658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-237e1b3d-fb07-45a2-942d-6da9bd758a16 req-be4c5077-dce6-403c-89f7-c177c91550c3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.515500 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-237e1b3d-fb07-45a2-942d-6da9bd758a16 req-be4c5077-dce6-403c-89f7-c177c91550c3 service nova] Creating event network-changed:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch2-master-1 Jun 25 20:53:02.530678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-237e1b3d-fb07-45a2-942d-6da9bd758a16 req-be4c5077-dce6-403c-89f7-c177c91550c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084921 Jun 25 20:53:02.531306 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 169/334] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:02.545384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:02.546959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:02.566059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.566507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.568242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:02.568732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:02.575083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:02.716878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:02.728057 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fba97ae8-4421-4909-8272-fdd394d36920 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1453 microversion: 2.1 time: 0.504199 Jun 25 20:53:02.728865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 166/335] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:02 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1453 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:02.751771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95baa930-1e47-4041-abbc-e5e630ac3e69 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985cfa1160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:03.268186 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95baa930-1e47-4041-abbc-e5e630ac3e69 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.529492 Jun 25 20:53:03.270700 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 167/336] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:53:02 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:03.276712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dca84a09-da43-4939-9731-bdae83a7fec3 req-9dc396cb-e24e-4a37-89b6-59e5196cfa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c888e23-419b-4eb0-9d17-248a8b977d20", "name": "network-vif-plugged", "status": "completed", "tag": "f468598c-8d4f-4173-8e57-3e4e6c8bdc01"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:03.289011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dca84a09-da43-4939-9731-bdae83a7fec3 req-9dc396cb-e24e-4a37-89b6-59e5196cfa20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:03.289445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dca84a09-da43-4939-9731-bdae83a7fec3 req-9dc396cb-e24e-4a37-89b6-59e5196cfa20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:03.301719 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dca84a09-da43-4939-9731-bdae83a7fec3 req-9dc396cb-e24e-4a37-89b6-59e5196cfa20 service nova] Creating event network-vif-plugged:f468598c-8d4f-4173-8e57-3e4e6c8bdc01 for instance 4c888e23-419b-4eb0-9d17-248a8b977d20 on nch1-master-1 Jun 25 20:53:03.308380 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dca84a09-da43-4939-9731-bdae83a7fec3 req-9dc396cb-e24e-4a37-89b6-59e5196cfa20 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036317 Jun 25 20:53:03.309791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 168/337] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:03.323177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:03.324904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:03.336745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:03.343173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:03.344522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:03.345819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:03.382850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:53:03.579106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:03.602359 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-053f48c4-8bc0-4d64-a6d0-2c93e606adeb tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1322 microversion: 2.1 time: 1.068990 Jun 25 20:53:03.613869 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:02 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1322 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:03.618235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:03.620437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:03.643762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:03.644401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:03.646893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:03.649015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:03.664594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:03.709544 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c6caea19-393d-4e28-aaab-946af22e520d tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 204 len: 0 microversion: 2.1 time: 0.396238 Jun 25 20:53:03.711823 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 169/339] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:03 2022] DELETE /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:53:03.731219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0483951c-f003-48c0-b0a6-aa950ad3031f tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985dc23820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:04.199938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:04.241536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:04.245236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:04.249866 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f1c9547-4371-497f-9785-29872b387e3a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.642984 Jun 25 20:53:04.253052 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 171/340] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:03 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:04.268492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:04.269535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:04.293202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:04.298186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:04.316593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:04.318875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:04.413522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:04.414098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:04.414895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lazy-loading 'fault' on Instance uuid a33a7fc0-694c-4123-9ce2-53a3203ce659 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:04.627954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:04.735036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:04.960471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:04.976195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ad5c9fe-ee31-48ea-9249-9158c56a67d9 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1459 microversion: 2.1 time: 0.721434 Jun 25 20:53:04.976928 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 172/341] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:04 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1459 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:05.406047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:05.612989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Calling method '.version_select at 0x7f985c4b3ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:05.614513 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:05.614513 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:05.615700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.616135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.652241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.652777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.742946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.744405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.795706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.796155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.858333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.860666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.879118 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b92ee766-c210-4e56-823e-76ea337d179c tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.901033 Jun 25 20:53:05.881771 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 173/342] 10.222.0.39 () {60 vars in 1242 bytes} [Sat Jun 25 20:53:04 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:05.895297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:05.895953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:05.911107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.911559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:05.912360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:05.916606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.038564 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0483951c-f003-48c0-b0a6-aa950ad3031f tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/07bd0769-fe9f-4db6-ba26-6a997ec931d9" status: 202 len: 0 microversion: 2.1 time: 2.323847 Jun 25 20:53:06.039157 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 170/343] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:53:03 2022] DELETE /compute/v2.1/os-floating-ips/07bd0769-fe9f-4db6-ba26-6a997ec931d9 => generated 0 bytes in 2327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:06.061926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.068812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:06.077614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.078066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.078860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.079298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.351042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.366808 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29e8adb3-7e30-4be7-9181-2a6326674b2b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1471 microversion: 2.1 time: 0.481039 Jun 25 20:53:06.368900 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 174/344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:05 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:06.386819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Calling method '.version_select at 0x7f985c6111f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.391046 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:06.391046 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:06.393361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.395491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.435111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.445266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.447631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.450258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.450932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.454581 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb2ec15a-f34b-48b6-8dad-10be7c68e6ad tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.413879 Jun 25 20:53:06.456790 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 171/345] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:06 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:06.464709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.471264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:06.483436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.487049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.488052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.490004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.502714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.504027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.546766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.547228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.587844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.590612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.591840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lazy-loading 'fault' on Instance uuid a33a7fc0-694c-4123-9ce2-53a3203ce659 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:06.609632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.611921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.625785 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eaa1a379-d1f5-44ce-bd52-6603b8d28ace tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.255515 Jun 25 20:53:06.627178 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 175/346] 10.222.0.39 () {60 vars in 1221 bytes} [Sat Jun 25 20:53:06 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:06.636494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e4fa948-6d90-437c-b221-2901b454c64a tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Action: 'create', calling method: .version_select at 0x7f985c537f70>, body: {"pool": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:06.817370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.825966 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b43bd9e7-5788-4074-b967-9ee376b1d187 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1459 microversion: 2.1 time: 0.366193 Jun 25 20:53:06.826768 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 172/347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:06 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1459 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:06.831588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.832803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:06.866712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.867090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.869385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.873234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.905576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Request method failure captured: Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20/diagnostics HTTP/1.1 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WWf4cCGu7Ua29C6Q6NcizMurHYrxyGM5XM3yJiE7RX_5qqEkXk954Ys2m4OKppIcJt67IGDZLgo-EbEo2E7rVPI24TeExPZ-6SIjdvhzCrkprWTsuqANbZgoCbOcFYzcFwX3-Ps71YR59OX-2WfoAmqHnBFgHa5BOn_z8LXxzP75s Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 16bcac6970c1483ab891f5d019ab5275 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:06.907986 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16bcac6970c1483ab891f5d019ab5275"}]}] Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 16bcac6970c1483ab891f5d019ab5275 Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiagnosticsNegativeTest-1228050166-project Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 50a75def6fb349428da65572e0a55516 Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1228050166-project Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:06.909563 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '4c888e23-419b-4eb0-9d17-248a8b977d20'} Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:06.910317 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jun 25 20:53:06.911653 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:06.913622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:06.915046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce23ca3e-8f8a-4a40-9dda-f0e0c24d7206 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.086804 Jun 25 20:53:06.915833 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 173/348] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:53:06 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20/diagnostics => generated 117 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:06.921471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Calling method '.version_select at 0x7f985cf9eee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.923259 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:06.923259 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:06.925371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.926191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.951340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:06.951567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:06.960289 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-593fb4ca-4adf-4a0c-bc76-e7765062384a tempest-HypervisorAdminV253TestBase-1245973115 tempest-HypervisorAdminV253TestBase-1245973115-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/dcec21c8-4247-4015-ac50-a587284b0cec" status: 200 len: 792 microversion: 2.53 time: 0.043088 Jun 25 20:53:06.962296 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 174/349] 10.222.0.39 () {60 vars in 1297 bytes} [Sat Jun 25 20:53:06 2022] GET /compute/v2.1/os-hypervisors/dcec21c8-4247-4015-ac50-a587284b0cec => generated 792 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:06.970780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:06.971922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:06.997965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.000983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:07.004826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.005570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:07.040748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:53:07.083266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:07.159919 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee9e2186-09f9-4081-9b2b-d8c27c06afda tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 204 len: 0 microversion: 2.1 time: 0.193724 Jun 25 20:53:07.163524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 175/350] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:06 2022] DELETE /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:53:07.192849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:07.209458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:07.217753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.218485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:07.219770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.221001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:07.757111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:07.770261 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8d6edb9-69aa-47c0-a73c-2380a8ad65c4 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1477 microversion: 2.1 time: 0.600891 Jun 25 20:53:07.776382 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 176/351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:07 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1477 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:07.847014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:07.847965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:07.925984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.927335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:07.930976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:07.933797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.211632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:08.226949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:08.230370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:08.233798 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ccee122f-178d-4b7b-9870-92d301d09d6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.432791 Jun 25 20:53:08.258218 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 177/352] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:07 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:08.263988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:08.267984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:08.279992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.280831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.287297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.288273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.340110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.341821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.342848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lazy-loading 'fault' on Instance uuid a33a7fc0-694c-4123-9ce2-53a3203ce659 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:08.425285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259e4c3f5ff24d5b955ec36009319598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb34595547bf4acc9abbb87c043554ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:08.436960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfd0e040-df91-41d5-a63f-f1826d47538f tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 200 len: 1417 microversion: 2.1 time: 0.176836 Jun 25 20:53:08.447494 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 178/353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:08 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 1417 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:08.447494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0d054061-0206-4263-bb78-7f0480cfb290 req-abbdc1bf-9b10-45b9-b8df-90e0be788581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a33a7fc0-694c-4123-9ce2-53a3203ce659", "name": "network-vif-deleted", "tag": "8a939401-cb81-4567-8093-c66213382ced"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:08.454967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0d054061-0206-4263-bb78-7f0480cfb290 req-abbdc1bf-9b10-45b9-b8df-90e0be788581 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.455537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0d054061-0206-4263-bb78-7f0480cfb290 req-abbdc1bf-9b10-45b9-b8df-90e0be788581 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.480446 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0d054061-0206-4263-bb78-7f0480cfb290 req-abbdc1bf-9b10-45b9-b8df-90e0be788581 service nova] Creating event network-vif-deleted:8a939401-cb81-4567-8093-c66213382ced for instance a33a7fc0-694c-4123-9ce2-53a3203ce659 on nch2-master-1 Jun 25 20:53:08.505623 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0d054061-0206-4263-bb78-7f0480cfb290 req-abbdc1bf-9b10-45b9-b8df-90e0be788581 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065804 Jun 25 20:53:08.528495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 179/354] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:08.795987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:08.797350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:08.820862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.821734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:08.828099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:08.828924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:09.225152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:09.286778 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-09f76f0c-26fd-454f-b366-d2daace20c0b tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1477 microversion: 2.1 time: 0.493634 Jun 25 20:53:09.294194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 180/355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:08 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1477 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:09.321456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:09.324030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:09.353968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:09.356895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:09.360588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:09.362355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:09.847220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:09.860724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:09.870498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:09.875428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2eca6e2-f928-413f-8c57-ccdc9ae67f55 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.578732 Jun 25 20:53:09.877885 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 181/356] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:09 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:09.903673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:09.906610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:09.933957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:09.935878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:09.938213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:09.939057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:09.970816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 HTTP/1.1 Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:09.977440 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:09.978919 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a33a7fc0-694c-4123-9ce2-53a3203ce659'} Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:09.979761 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:09.981082 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:09.985248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:09.989364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e876b9fc-b14c-4e28-9235-c6315af6361e tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 404 len: 111 microversion: 2.1 time: 0.095395 Jun 25 20:53:09.989952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 182/357] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:09 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:10.010430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:10.010947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:10.025239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.025993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.027008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.038735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.074580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 HTTP/1.1 Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:10.076516 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.077812 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a33a7fc0-694c-4123-9ce2-53a3203ce659'} Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:10.078457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.079485 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.080583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:10.080583 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cad75dfc-37f7-4a9d-afb1-eb2d5d80bf08 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 404 len: 111 microversion: 2.1 time: 0.079122 Jun 25 20:53:10.082197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 183/358] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:09 2022] DELETE /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:10.087254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:10.088258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: a33a7fc0-694c-4123-9ce2-53a3203ce659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:10.096966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.097491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.098390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.098941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.131069 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 HTTP/1.1 Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:10.133871 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.135042 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a33a7fc0-694c-4123-9ce2-53a3203ce659'} Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:10.135694 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. Jun 25 20:53:10.136898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.137823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance a33a7fc0-694c-4123-9ce2-53a3203ce659 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:10.137823 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a902144-5f5d-4809-b3d0-c96d34a201c2 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659" status: 404 len: 111 microversion: 2.1 time: 0.053477 Jun 25 20:53:10.146489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 184/359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:10 2022] GET /compute/v2.1/servers/a33a7fc0-694c-4123-9ce2-53a3203ce659 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:10.154216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:10.154967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:10.169379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.170162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.174361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.174829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.206473 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 HTTP/1.1 Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:10.209712 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.210935 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e38a07d3-7458-4d71-90df-cd47e528ba35'} Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:10.211563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.212619 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.213980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:10.213980 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f53b18eb-378c-40cd-8e6a-9eda0e855cc3 tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 404 len: 111 microversion: 2.1 time: 0.064249 Jun 25 20:53:10.221386 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 185/360] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:10 2022] DELETE /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:10.234959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:10.235640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] [instance: e38a07d3-7458-4d71-90df-cd47e528ba35] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:10.245481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.251017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.253423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.254476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.297114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] HTTP exception thrown: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Request method failure captured: Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 HTTP/1.1 Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Vgr1NKeZCLZgwD5DexeF6vMZqR-39KAdFG4ahA10smfLxP38I4cHnPp19RoT9XkmDw5Lset-8fkq2x3yKgifeTtx1EF6Shy7E_KK5TCGUfQh1YLL0okFLXqO8g3_E_rHD1_b06zXKwEKdrylAZUmVSyKFH0ZbkRGq3XLxqcZitHDc Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:10.299255 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fb34595547bf4acc9abbb87c043554ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fb34595547bf4acc9abbb87c043554ca"}]}] Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fb34595547bf4acc9abbb87c043554ca Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1460497276 Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259e4c3f5ff24d5b955ec36009319598 Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersAdminTestJSON-1460497276-project Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.300536 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e38a07d3-7458-4d71-90df-cd47e528ba35'} Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:10.301181 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. Jun 25 20:53:10.302219 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:10.303153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] Returning 404 to user: Instance e38a07d3-7458-4d71-90df-cd47e528ba35 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:10.303153 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-616739dc-ab9b-4b67-a348-bd65679e70ca tempest-DeleteServersAdminTestJSON-1460497276 tempest-DeleteServersAdminTestJSON-1460497276-project] 10.222.0.39 "GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35" status: 404 len: 111 microversion: 2.1 time: 0.078331 Jun 25 20:53:10.309288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 186/361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:10 2022] GET /compute/v2.1/servers/e38a07d3-7458-4d71-90df-cd47e528ba35 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:10.324863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:10.326128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:10.336571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.339991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:10.341160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:10.341508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:11.015174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:11.041853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f263ed0-40b6-4238-acf7-6c7ae3837e9a tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1477 microversion: 2.1 time: 0.721459 Jun 25 20:53:11.043142 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 187/362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:10 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1477 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:11.062322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:11.062952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:11.081966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:11.082524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:11.085596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:11.086081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:11.404447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:11.433884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:11.439028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:11.440636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a727f603-f9cc-4229-85b3-1011285463b2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.395487 Jun 25 20:53:11.454180 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 188/363] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:11 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:11.674591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3f7d6335-e2d9-4a99-9ad1-7e71ab267212 req-ccc8644c-e0a4-495c-b78c-66eae119b43f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c888e23-419b-4eb0-9d17-248a8b977d20", "name": "network-vif-deleted", "tag": "f468598c-8d4f-4173-8e57-3e4e6c8bdc01"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:11.696211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f7d6335-e2d9-4a99-9ad1-7e71ab267212 req-ccc8644c-e0a4-495c-b78c-66eae119b43f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:11.697005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f7d6335-e2d9-4a99-9ad1-7e71ab267212 req-ccc8644c-e0a4-495c-b78c-66eae119b43f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:11.726760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3f7d6335-e2d9-4a99-9ad1-7e71ab267212 req-ccc8644c-e0a4-495c-b78c-66eae119b43f service nova] Creating event network-vif-deleted:f468598c-8d4f-4173-8e57-3e4e6c8bdc01 for instance 4c888e23-419b-4eb0-9d17-248a8b977d20 on nch1-master-1 Jun 25 20:53:11.737583 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3f7d6335-e2d9-4a99-9ad1-7e71ab267212 req-ccc8644c-e0a4-495c-b78c-66eae119b43f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070478 Jun 25 20:53:11.738737 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 189/364] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:12.060460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:12.061242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:12.074650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:12.075104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:12.075887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:12.076312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:12.199990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:12.200495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:12.201140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lazy-loading 'fault' on Instance uuid 4c888e23-419b-4eb0-9d17-248a8b977d20 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:12.291153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50a75def6fb349428da65572e0a55516', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16bcac6970c1483ab891f5d019ab5275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:12.304841 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d9ba04c-3a9c-45a6-bde1-0e6cfdb0674e tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 200 len: 1312 microversion: 2.1 time: 0.248942 Jun 25 20:53:12.314598 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 190/365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:12 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 1312 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:12.463656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:12.464870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:12.484052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:12.484802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:12.485747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:12.486370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:13.178711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:13.190525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:13.198025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:13.203558 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-096a914c-2cda-4e2b-abc6-cd18838faa5a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.745596 Jun 25 20:53:13.224672 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 191/366] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:12 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:13.232821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e85cfc65-79d7-44ad-a8c9-6f2823cfe0cd req-c1543ae9-e6a9-4f6c-8c34-3a4c97976d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "name": "network-vif-plugged", "status": "completed", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:13.244389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e85cfc65-79d7-44ad-a8c9-6f2823cfe0cd req-c1543ae9-e6a9-4f6c-8c34-3a4c97976d75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:13.245127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e85cfc65-79d7-44ad-a8c9-6f2823cfe0cd req-c1543ae9-e6a9-4f6c-8c34-3a4c97976d75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:13.261458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e85cfc65-79d7-44ad-a8c9-6f2823cfe0cd req-c1543ae9-e6a9-4f6c-8c34-3a4c97976d75 service nova] Creating event network-vif-plugged:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch2-master-1 Jun 25 20:53:13.271848 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e85cfc65-79d7-44ad-a8c9-6f2823cfe0cd req-c1543ae9-e6a9-4f6c-8c34-3a4c97976d75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045627 Jun 25 20:53:13.274301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 192/367] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:13.323002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:13.326324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] [instance: 4c888e23-419b-4eb0-9d17-248a8b977d20] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:13.343134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:13.344953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:13.347006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:13.349865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:13.385001 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] HTTP exception thrown: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Request method failure captured: Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 HTTP/1.1 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WWf4cCGu7Ua29C6Q6NcizMurHYrxyGM5XM3yJiE7RX_5qqEkXk954Ys2m4OKppIcJt67IGDZLgo-EbEo2E7rVPI24TeExPZ-6SIjdvhzCrkprWTsuqANbZgoCbOcFYzcFwX3-Ps71YR59OX-2WfoAmqHnBFgHa5BOn_z8LXxzP75s Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 16bcac6970c1483ab891f5d019ab5275 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:13.388693 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_16bcac6970c1483ab891f5d019ab5275"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/16bcac6970c1483ab891f5d019ab5275"}]}] Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 16bcac6970c1483ab891f5d019ab5275 Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1228050166 Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiagnosticsNegativeTest-1228050166-project Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 50a75def6fb349428da65572e0a55516 Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1228050166-project Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. Jun 25 20:53:13.389931 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4c888e23-419b-4eb0-9d17-248a8b977d20'} Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:13.390618 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. Jun 25 20:53:13.391673 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:13.395024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] Returning 404 to user: Instance 4c888e23-419b-4eb0-9d17-248a8b977d20 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:13.395024 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-62f1e9cc-b29b-41bf-bae6-37356985dbc6 tempest-ServerDiagnosticsNegativeTest-1228050166 tempest-ServerDiagnosticsNegativeTest-1228050166-project] 10.222.0.39 "GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20" status: 404 len: 111 microversion: 2.1 time: 0.071694 Jun 25 20:53:13.395024 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 193/368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:13 2022] GET /compute/v2.1/servers/4c888e23-419b-4eb0-9d17-248a8b977d20 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:53:14.223265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:14.224487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:14.236863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:14.237408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:14.239170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:14.241354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:14.564902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:14.587468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:14.610005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:14.611483 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0804c05e-5553-4974-9cbe-3c259c8e3a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1361 microversion: 2.25 time: 0.392415 Jun 25 20:53:14.625661 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 194/369] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:14 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1361 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:53:15.687867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8782dcc-762f-4e01-a4ed-033ce630d54a tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Calling method '.version_select at 0x7f985ce21af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:15.688980 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:15.688980 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:15.690085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c8782dcc-762f-4e01-a4ed-033ce630d54a tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '6addf702bb774eef8b543482b6ea1908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea2dec6873942569910686295de2392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8782dcc-762f-4e01-a4ed-033ce630d54a tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Request method failure captured: Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W564dkPOgvosldGqO0GddafqjBTuTDkBAqidLszA-lW_RYyTu10GaXgcr5HjhMLkyx8M1xz6n6ZeTrHmoJAXgrOMqupZ6DwNTwhQ-Q3torXVsw7JKFlrUPUxROsZPG38gjRvu1nd798BUmQ8Z_uTziA7D_YEyRyjOoeHX5BTRwFGI Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:15.694041 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ea2dec6873942569910686295de2392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ea2dec6873942569910686295de2392"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}] Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6addf702bb774eef8b543482b6ea1908 Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:53:15.695183 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._detail(req) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:15.695909 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jun 25 20:53:15.696960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.697917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8782dcc-762f-4e01-a4ed-033ce630d54a tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:15.697917 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8782dcc-762f-4e01-a4ed-033ce630d54a tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.346827 Jun 25 20:53:15.697917 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 195/370] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 20:53:15 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 348 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:53:15.702010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:15.702716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:15.727504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:15.731665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:15.732640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:15.733101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:15.861980 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e4fa948-6d90-437c-b221-2901b454c64a tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 9.233409 Jun 25 20:53:15.862649 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 176/371] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:53:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 9235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:15.867576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-459a1d58-15cf-4c5b-9c44-fc4902895771 tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Calling method '.version_select at 0x7f985c4b3ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:15.868718 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:15.868718 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:15.870119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-459a1d58-15cf-4c5b-9c44-fc4902895771 tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '6addf702bb774eef8b543482b6ea1908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea2dec6873942569910686295de2392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-459a1d58-15cf-4c5b-9c44-fc4902895771 tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Request method failure captured: Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W564dkPOgvosldGqO0GddafqjBTuTDkBAqidLszA-lW_RYyTu10GaXgcr5HjhMLkyx8M1xz6n6ZeTrHmoJAXgrOMqupZ6DwNTwhQ-Q3torXVsw7JKFlrUPUxROsZPG38gjRvu1nd798BUmQ8Z_uTziA7D_YEyRyjOoeHX5BTRwFGI Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:53:15.891423 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ea2dec6873942569910686295de2392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ea2dec6873942569910686295de2392"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}] Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6addf702bb774eef8b543482b6ea1908 Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:53:15.892984 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:15.893844 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jun 25 20:53:15.895201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:15.902266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-459a1d58-15cf-4c5b-9c44-fc4902895771 tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:15.904471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-459a1d58-15cf-4c5b-9c44-fc4902895771 tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.040899 Jun 25 20:53:15.908081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 177/372] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:15 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:15.924717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6983b139-bc55-41c1-b2a6-a3ebd491d359 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985c5b20d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:16.179129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:16.188705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:16.193466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:16.197098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71b69286-e9e9-4578-bf9b-e78de6f934c5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1558 microversion: 2.25 time: 0.499070 Jun 25 20:53:16.207109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 196/373] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:15 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1558 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:16.214890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de2bcc8-4194-49c3-8436-63d75ad37eed tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Calling method '.version_select at 0x7f985ce21550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:16.215914 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:16.215914 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:16.217217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6de2bcc8-4194-49c3-8436-63d75ad37eed tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '6addf702bb774eef8b543482b6ea1908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea2dec6873942569910686295de2392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de2bcc8-4194-49c3-8436-63d75ad37eed tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Request method failure captured: Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W564dkPOgvosldGqO0GddafqjBTuTDkBAqidLszA-lW_RYyTu10GaXgcr5HjhMLkyx8M1xz6n6ZeTrHmoJAXgrOMqupZ6DwNTwhQ-Q3torXVsw7JKFlrUPUxROsZPG38gjRvu1nd798BUmQ8Z_uTziA7D_YEyRyjOoeHX5BTRwFGI Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:16.218917 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ea2dec6873942569910686295de2392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ea2dec6873942569910686295de2392"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}] Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6addf702bb774eef8b543482b6ea1908 Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:53:16.220297 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:16.221182 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jun 25 20:53:16.222388 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:16.224132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de2bcc8-4194-49c3-8436-63d75ad37eed tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:16.225143 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6de2bcc8-4194-49c3-8436-63d75ad37eed tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016802 Jun 25 20:53:16.227793 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 197/374] 10.222.0.39 () {58 vars in 1178 bytes} [Sat Jun 25 20:53:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:16.608177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.619818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=53 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:16.983400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:16.984124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:17.007333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:17.009367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:17.010306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:17.011738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:17.384290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c74f7943-2aa3-4657-a9a3-3da9ad4fa189 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:17.432591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:17.477593 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2fb060e3-916c-4fd7-befa-bc5426739b5a tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 2050 microversion: 2.25 time: 1.248471 Jun 25 20:53:17.478870 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 198/375] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:16 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 2050 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:18.120913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Calling method '.version_select at 0x7f985ce39dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:18.121801 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:18.121801 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:18.123350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:18.123978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:18.159511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:18.160007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:18.205896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:18.206541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:18.213907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2a820b7-0c75-49ae-86b9-660b8946a93d tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.733454 Jun 25 20:53:18.214825 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 199/376] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:18.596126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6d208a0-33b5-4a84-b8cc-9224d261f6e8 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-216676280", "id": 541105244, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:18.598660 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:18.598660 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:18.638477 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6d208a0-33b5-4a84-b8cc-9224d261f6e8 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.421344 Jun 25 20:53:18.642181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 200/377] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:18 2022] POST /compute/v2.1/flavors => generated 426 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:18.654575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:18.655462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:18.674536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:18.674999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:18.676018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:18.676570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:18.927667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c74f7943-2aa3-4657-a9a3-3da9ad4fa189 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:18.947288 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04ac8e6a-227a-44e9-ac4a-fa16811f82c5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 2050 microversion: 2.25 time: 0.302784 Jun 25 20:53:18.948687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 201/378] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:18 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 2050 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:18.959018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acae00a3-41bb-44a3-9a26-fb58013e440d tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Calling method '.version_select at 0x7f985cf1ad30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:18.960231 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:18.960231 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:18.965011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-acae00a3-41bb-44a3-9a26-fb58013e440d tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '6addf702bb774eef8b543482b6ea1908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea2dec6873942569910686295de2392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acae00a3-41bb-44a3-9a26-fb58013e440d tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Request method failure captured: Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W564dkPOgvosldGqO0GddafqjBTuTDkBAqidLszA-lW_RYyTu10GaXgcr5HjhMLkyx8M1xz6n6ZeTrHmoJAXgrOMqupZ6DwNTwhQ-Q3torXVsw7JKFlrUPUxROsZPG38gjRvu1nd798BUmQ8Z_uTziA7D_YEyRyjOoeHX5BTRwFGI Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:53:18.967705 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ea2dec6873942569910686295de2392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ea2dec6873942569910686295de2392"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}] Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6addf702bb774eef8b543482b6ea1908 Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1'} Jun 25 20:53:18.970280 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:18.971162 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jun 25 20:53:18.972263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:18.976520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acae00a3-41bb-44a3-9a26-fb58013e440d tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:18.977593 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-acae00a3-41bb-44a3-9a26-fb58013e440d tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.027814 Jun 25 20:53:18.978309 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 202/379] 10.222.0.39 () {58 vars in 1172 bytes} [Sat Jun 25 20:53:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:18.983113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-588966b9-e8c5-4921-bdc5-02502064c597 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:18.984102 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:18.984102 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:19.012146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:19.028766 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-588966b9-e8c5-4921-bdc5-02502064c597 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/541105244" status: 202 len: 0 microversion: 2.1 time: 0.048816 Jun 25 20:53:19.033845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 203/380] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:53:18 2022] DELETE /compute/v2.1/flavors/541105244 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:19.045034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:19.049142 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:19.049142 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:19.054097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.055018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.058811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.059648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.103684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-abcf9983-4f56-41bb-8bb1-ffbdcb04bb4e tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.072169 Jun 25 20:53:19.110795 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 204/381] 10.222.0.39 () {60 vars in 1216 bytes} [Sat Jun 25 20:53:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:19.116624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4293dd6-6ff2-40a5-b7b3-6c7e02528f94 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Calling method '.version_select at 0x7f985ce6d670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:19.118450 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:19.118450 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:19.119421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e4293dd6-6ff2-40a5-b7b3-6c7e02528f94 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] HTTP exception thrown: Hypervisor with ID '91720f45-514f-45e0-a4d7-166025653603' could not be found. Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4293dd6-6ff2-40a5-b7b3-6c7e02528f94 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Request method failure captured: Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-hypervisors/91720f45-514f-45e0-a4d7-166025653603/uptime HTTP/1.1 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W7V_UeDghdn2MYYO1GdglMmpbIWdZjtNH5P1lh1Md6F_ghzjnNllAAn1hrJuW9eRQx9p0klbStkosjQGTJjXgcXayJ2O7m3xoGn-xsyBF1DFQ17rmdJIVxsRQQI2kOvlu8KW1aDn_CUHnzDpkA26QXjPEIpzCYJix21FSxA6HtuJc Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 31d62422053d49e1af356e08f5c2a0b7 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:53:19.126980 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31d62422053d49e1af356e08f5c2a0b7"}]}] Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 31d62422053d49e1af356e08f5c2a0b7 Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 22e5a738cf984400ad27b506b025e218 Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: exception: Hypervisor with ID '91720f45-514f-45e0-a4d7-166025653603' could not be found. Jun 25 20:53:19.128784 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '91720f45-514f-45e0-a4d7-166025653603'} Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '91720f45-514f-45e0-a4d7-166025653603' Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 25 20:53:19.129647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '91720f45-514f-45e0-a4d7-166025653603' could not be found. Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:19.130891 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '91720f45-514f-45e0-a4d7-166025653603' could not be found. Jun 25 20:53:19.132050 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:53:19.133628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4293dd6-6ff2-40a5-b7b3-6c7e02528f94 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Returning 404 to user: Hypervisor with ID '91720f45-514f-45e0-a4d7-166025653603' could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:19.134630 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e4293dd6-6ff2-40a5-b7b3-6c7e02528f94 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/91720f45-514f-45e0-a4d7-166025653603/uptime" status: 404 len: 123 microversion: 2.1 time: 0.022793 Jun 25 20:53:19.137085 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 205/382] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 20:53:19 2022] GET /compute/v2.1/os-hypervisors/91720f45-514f-45e0-a4d7-166025653603/uptime => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:19.147099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f37d066-f494-4eaa-9b45-317c0ce5939e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:19.206138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f37d066-f494-4eaa-9b45-317c0ce5939e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051371 Jun 25 20:53:19.207434 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 206/383] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:19.219191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:19.223599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:19.245449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.246915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.247730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.249808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.853933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6983b139-bc55-41c1-b2a6-a3ebd491d359 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9" status: 202 len: 0 microversion: 2.1 time: 3.942317 Jun 25 20:53:19.858737 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 178/384] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:53:15 2022] DELETE /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9 => generated 0 bytes in 3948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:19.859859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'flavor' on Instance uuid c74f7943-2aa3-4657-a9a3-3da9ad4fa189 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:19.863616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Calling method '.version_select at 0x7f985c514430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:19.865823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.869064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.905732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.906391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.933857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:19.935046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:19.952138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08577e1f-d616-401d-a3fc-f381d5e0b913 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.092226 Jun 25 20:53:19.954352 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 179/385] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:19 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:19.965335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f8f3194-e281-43b4-a38c-1d6600e73aa7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-850724589", "id": 1023753039, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:19.969576 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:19.969576 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:19.982667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Going to try to live migrate instance to nch1-master-1 {{(pid=137462) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:53:20.022344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f8f3194-e281-43b4-a38c-1d6600e73aa7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.066081 Jun 25 20:53:20.022961 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 180/386] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:19 2022] POST /compute/v2.1/flavors => generated 416 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:20.043874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985c537700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:20.617044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cc77e313-fad1-41e7-8495-8d19a2cdb4f9 could not be found", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 20:53:20.617907 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] HTTP exception thrown: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Request method failure captured: Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9 HTTP/1.1 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WnN1hGC-CG4Ohwcp2CE3ahoIDK5rglqf_6xKR4urtdc8_ommgxPnswRwihatNNYP6i8y-9v4zOM9i0wClqp5c1e2k_Z6ie5vbhNFbUS1MuU6zZy5_4ZG8B0mOw5oUviGlVniR6UruW-E741UUGkhVXwsPMGFzDFgTBsutd0YVJM_s Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4897232399d64121b7b31c749b09dd1f Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:53:20.636156 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4897232399d64121b7b31c749b09dd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4897232399d64121b7b31c749b09dd1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4897232399d64121b7b31c749b09dd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4897232399d64121b7b31c749b09dd1f"}]}] Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4897232399d64121b7b31c749b09dd1f Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsTestJSON-2117312307-project Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9dcea2fb80f64978af9a32780752008e Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsTestJSON-2117312307-project Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cc77e313-fad1-41e7-8495-8d19a2cdb4f9'} Jun 25 20:53:20.637691 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 20:53:20.638596 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cc77e313-fad1-41e7-8495-8d19a2cdb4f9 could not be found Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ff7a293-b5a9-4e58-86c7-96848c9fee08'] Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9. Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:20.639917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:20.641386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:20.643617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:20.643617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.643617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Returning 404 to user: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:20.643617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d2ce29e-ce43-40d3-8f0c-3d4a06b53d4c tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9" status: 404 len: 111 microversion: 2.1 time: 0.607625 Jun 25 20:53:20.643617 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 181/387] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 20:53:20 2022] GET /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9 => generated 111 bytes in 618 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:20.648219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34566784-69d2-443f-a7ae-c9598a1e422c tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Calling method '.version_select at 0x7f985c41c820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:20.660013 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:20.660013 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:20.661362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34566784-69d2-443f-a7ae-c9598a1e422c tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '6addf702bb774eef8b543482b6ea1908', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ea2dec6873942569910686295de2392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34566784-69d2-443f-a7ae-c9598a1e422c tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Request method failure captured: Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W564dkPOgvosldGqO0GddafqjBTuTDkBAqidLszA-lW_RYyTu10GaXgcr5HjhMLkyx8M1xz6n6ZeTrHmoJAXgrOMqupZ6DwNTwhQ-Q3torXVsw7JKFlrUPUxROsZPG38gjRvu1nd798BUmQ8Z_uTziA7D_YEyRyjOoeHX5BTRwFGI Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:53:20.663036 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ea2dec6873942569910686295de2392"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ea2dec6873942569910686295de2392"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ea2dec6873942569910686295de2392"}]}] Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ea2dec6873942569910686295de2392 Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-519647476 Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6addf702bb774eef8b543482b6ea1908 Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-519647476-project Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1'} Jun 25 20:53:20.664495 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:53:20.665457 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jun 25 20:53:20.666600 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:20.667709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34566784-69d2-443f-a7ae-c9598a1e422c tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:20.667709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34566784-69d2-443f-a7ae-c9598a1e422c tempest-HypervisorAdminNegativeTestJSON-519647476 tempest-HypervisorAdminNegativeTestJSON-519647476-project] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.021970 Jun 25 20:53:20.673736 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 182/388] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:53:20 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:20.681839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dbe5edb7-574c-4f3d-a7f4-50b9db2ed849 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:20.725202 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dbe5edb7-574c-4f3d-a7f4-50b9db2ed849 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.050337 Jun 25 20:53:20.736685 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 183/389] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:20 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:20.743323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Calling method '.version_select at 0x7f985c4b3c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:20.999213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cc77e313-fad1-41e7-8495-8d19a2cdb4f9 could not be found", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 20:53:21.000015 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] HTTP exception thrown: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Request method failure captured: Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9 HTTP/1.1 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WnN1hGC-CG4Ohwcp2CE3ahoIDK5rglqf_6xKR4urtdc8_ommgxPnswRwihatNNYP6i8y-9v4zOM9i0wClqp5c1e2k_Z6ie5vbhNFbUS1MuU6zZy5_4ZG8B0mOw5oUviGlVniR6UruW-E741UUGkhVXwsPMGFzDFgTBsutd0YVJM_s Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4897232399d64121b7b31c749b09dd1f Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:53:21.001936 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4897232399d64121b7b31c749b09dd1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4897232399d64121b7b31c749b09dd1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4897232399d64121b7b31c749b09dd1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4897232399d64121b7b31c749b09dd1f"}]}] Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4897232399d64121b7b31c749b09dd1f Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2117312307 Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsTestJSON-2117312307-project Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9dcea2fb80f64978af9a32780752008e Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsTestJSON-2117312307-project Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cc77e313-fad1-41e7-8495-8d19a2cdb4f9'} Jun 25 20:53:21.003329 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 20:53:21.004215 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cc77e313-fad1-41e7-8495-8d19a2cdb4f9 could not be found Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cad1cf44-b903-4826-af29-057c5c468c12'] Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9. Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.005518 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:21.006833 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:21.008113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 Jun 25 20:53:21.008113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.008113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] Returning 404 to user: Floating IP not found for ID cc77e313-fad1-41e7-8495-8d19a2cdb4f9 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:21.008113 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-031d2475-c19d-4b53-8677-02ad0733ea57 tempest-FloatingIPsTestJSON-2117312307 tempest-FloatingIPsTestJSON-2117312307-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9" status: 404 len: 111 microversion: 2.1 time: 0.264693 Jun 25 20:53:21.008113 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 184/390] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:53:20 2022] DELETE /compute/v2.1/os-floating-ips/cc77e313-fad1-41e7-8495-8d19a2cdb4f9 => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:21.016987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdc61e3-559a-4f86-93ac-0fbdf44933a3 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Calling method '.version_select at 0x7f985c514e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:21.018735 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7bdc61e3-559a-4f86-93ac-0fbdf44933a3 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] HTTP exception thrown: Hypervisor with ID 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' could not be found. Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdc61e3-559a-4f86-93ac-0fbdf44933a3 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Request method failure captured: Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-hypervisors/e4400fb9-46f2-419f-bc21-4dfd2e68114a HTTP/1.1 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W7V_UeDghdn2MYYO1GdglMmpbIWdZjtNH5P1lh1Md6F_ghzjnNllAAn1hrJuW9eRQx9p0klbStkosjQGTJjXgcXayJ2O7m3xoGn-xsyBF1DFQ17rmdJIVxsRQQI2kOvlu8KW1aDn_CUHnzDpkA26QXjPEIpzCYJix21FSxA6HtuJc Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 31d62422053d49e1af356e08f5c2a0b7 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 20:53:21.041813 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31d62422053d49e1af356e08f5c2a0b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31d62422053d49e1af356e08f5c2a0b7"}]}] Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 31d62422053d49e1af356e08f5c2a0b7 Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-369470220 Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 22e5a738cf984400ad27b506b025e218 Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: exception: Hypervisor with ID 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' could not be found. Jun 25 20:53:21.043186 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e4400fb9-46f2-419f-bc21-4dfd2e68114a'} Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jun 25 20:53:21.043875 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:53:21.045157 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' could not be found. Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' could not be found. Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdc61e3-559a-4f86-93ac-0fbdf44933a3 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] Returning 404 to user: Hypervisor with ID 'e4400fb9-46f2-419f-bc21-4dfd2e68114a' could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:21.046355 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bdc61e3-559a-4f86-93ac-0fbdf44933a3 tempest-HypervisorAdminNegativeTestJSON-369470220 tempest-HypervisorAdminNegativeTestJSON-369470220-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/e4400fb9-46f2-419f-bc21-4dfd2e68114a" status: 404 len: 123 microversion: 2.1 time: 0.038218 Jun 25 20:53:21.058672 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 185/391] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 20:53:21 2022] GET /compute/v2.1/os-hypervisors/e4400fb9-46f2-419f-bc21-4dfd2e68114a => generated 123 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:53:21.072940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af428928-123c-4b0e-9f87-9fc5d9463e9e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:21.073854 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:21.073854 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:21.131928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af428928-123c-4b0e-9f87-9fc5d9463e9e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1023753039" status: 202 len: 0 microversion: 2.1 time: 0.072009 Jun 25 20:53:21.132571 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 186/392] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:53:21 2022] DELETE /compute/v2.1/flavors/1023753039 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:21.370658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-578525516", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:21.482775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:22.151608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:22.152276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:22.152737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:22.153284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:22.154364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:22.173145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:22.176879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:22.178386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:22.179067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:22.229360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:22.241614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:22.275068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:22.281947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:22.364541 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86025ed4-6020-4901-b302-dcd88aed1e19 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230368 Jun 25 20:53:22.366187 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 187/393] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:53:22.374863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec31eaf6-9211-43bd-a39f-9828c79efe0e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:22.415441 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec31eaf6-9211-43bd-a39f-9828c79efe0e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045936 Jun 25 20:53:22.417694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 188/394] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:22.428052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-177f9b59-e4db-40e1-aad3-cb31cd3a77ca tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:22.431360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-177f9b59-e4db-40e1-aad3-cb31cd3a77ca tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:22.694716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-177f9b59-e4db-40e1-aad3-cb31cd3a77ca tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:22.706917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-177f9b59-e4db-40e1-aad3-cb31cd3a77ca tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1216 microversion: 2.1 time: 0.287167 Jun 25 20:53:22.707968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 189/395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:22 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1216 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:22.715983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-373e4ade-dfd5-4e69-9caf-dac4d0315d24 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1783126012", "id": 483572233, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:22.718862 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:22.718862 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:22.769908 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-373e4ade-dfd5-4e69-9caf-dac4d0315d24 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.059844 Jun 25 20:53:22.777953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 190/396] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:22 2022] POST /compute/v2.1/flavors => generated 426 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:22.792499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa069ebe-22ac-43b1-81f0-67055f68617c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:22.793604 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:22.793604 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:22.853971 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa069ebe-22ac-43b1-81f0-67055f68617c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/483572233" status: 202 len: 0 microversion: 2.1 time: 0.074507 Jun 25 20:53:22.858125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 191/397] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:53:22 2022] DELETE /compute/v2.1/flavors/483572233 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:22.863309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59323a57-7691-493b-aba2-6e28fdf08503 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:22.917178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59323a57-7691-493b-aba2-6e28fdf08503 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057300 Jun 25 20:53:22.918129 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 192/398] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:22.938312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3037a44-ad61-443c-ab69-5e9b53851182 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1165160029", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:23.000874 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3037a44-ad61-443c-ab69-5e9b53851182 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.066440 Jun 25 20:53:23.004451 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 193/399] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:22 2022] POST /compute/v2.1/flavors => generated 507 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:23.018115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-12ff5a44-daf3-4a5a-b2cc-7cb451544ae3 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.063914 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-12ff5a44-daf3-4a5a-b2cc-7cb451544ae3 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/fa31dab4-4e92-4fb4-875f-352af6322f9c" status: 202 len: 0 microversion: 2.1 time: 0.055255 Jun 25 20:53:23.065124 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 194/400] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:23 2022] DELETE /compute/v2.1/flavors/fa31dab4-4e92-4fb4-875f-352af6322f9c => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:23.075034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf210a6a-05d4-4229-b4b0-14707c0b4a6d tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.122983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf210a6a-05d4-4229-b4b0-14707c0b4a6d tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051136 Jun 25 20:53:23.137288 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 195/401] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:23.148820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec82586c-8a98-4f38-83ec-f7283872fc11 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2093366263", "id": "74d99afa-fc98-4b8b-8492-2ad0a5422610", "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:23.178239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec82586c-8a98-4f38-83ec-f7283872fc11 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.032261 Jun 25 20:53:23.186011 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 196/402] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:23 2022] POST /compute/v2.1/flavors => generated 507 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:23.198643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a99e9f0-79a1-4fdd-bef9-0dea40d70b2f tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.246236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a99e9f0-79a1-4fdd-bef9-0dea40d70b2f tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/74d99afa-fc98-4b8b-8492-2ad0a5422610" status: 202 len: 0 microversion: 2.1 time: 0.057956 Jun 25 20:53:23.247754 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 197/403] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:53:23 2022] DELETE /compute/v2.1/flavors/74d99afa-fc98-4b8b-8492-2ad0a5422610 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:23.261284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21eb33ea-15bc-483c-acc3-ac9635ca0c4f tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.306358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21eb33ea-15bc-483c-acc3-ac9635ca0c4f tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053563 Jun 25 20:53:23.330437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 198/404] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:23.335861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0941516f-ad40-413e-830e-7d767bf810ff tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-29587662", "id": 249993518, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:23.378051 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0941516f-ad40-413e-830e-7d767bf810ff tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.046033 Jun 25 20:53:23.378925 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 199/405] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:23.390621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec0700cd-7078-4089-b30f-ac215fe7d414 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.398569 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec0700cd-7078-4089-b30f-ac215fe7d414 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/249993518" status: 200 len: 409 microversion: 2.1 time: 0.012469 Jun 25 20:53:23.399716 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 200/406] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 20:53:23 2022] GET /compute/v2.1/flavors/249993518 => generated 409 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:23.676914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8c3c448e-7be5-4fc3-9b4b-dddce6029a04 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.739028 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8c3c448e-7be5-4fc3-9b4b-dddce6029a04 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5390 microversion: 2.1 time: 0.331979 Jun 25 20:53:23.750022 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 201/407] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:23 2022] GET /compute/v2.1/flavors/detail => generated 5390 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:23.763325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:23.763875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:23.788915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:23.789608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:23.791148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:23.791148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:24.101586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:24.147007 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86cd28f0-6821-4495-8f13-85a8ff4651dc tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1268 microversion: 2.1 time: 0.395684 Jun 25 20:53:24.149232 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 202/408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:23 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1268 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:24.159043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-757ecbeb-6025-4322-8cb9-6b58b0358077 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.161279 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:24.161279 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:24.217205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-757ecbeb-6025-4322-8cb9-6b58b0358077 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/249993518" status: 202 len: 0 microversion: 2.1 time: 0.065384 Jun 25 20:53:24.219069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 203/409] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:53:24 2022] DELETE /compute/v2.1/flavors/249993518 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:24.245588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-609f211e-fe43-4f95-975c-537a01cf32ff tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.287992 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-609f211e-fe43-4f95-975c-537a01cf32ff tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.063113 Jun 25 20:53:24.289376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 204/410] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:24.346922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9dc5fb41-f88f-4ba9-a840-67490fe5de0c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1583621592", "id": 1305596225, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:24.357139 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:24.357139 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:24.410473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9,nova_api:DELETE=15 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:24.419868 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9dc5fb41-f88f-4ba9-a840-67490fe5de0c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.092695 Jun 25 20:53:24.424938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 205/411] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:24 2022] POST /compute/v2.1/flavors => generated 430 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:24.432389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6fdd1e0-4fed-44c7-b9e2-1d70e620bfd1 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "1305596225"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:24.459131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c6fdd1e0-4fed-44c7-b9e2-1d70e620bfd1 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] HTTP exception thrown: Flavor 1305596225 could not be found. Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6fdd1e0-4fed-44c7-b9e2-1d70e620bfd1 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Request method failure captured: Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 107 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W75aMUd3r3XnkrNG-oX8MT4KfAECrLy2W7GBOyHTSLCwAb_tWma--HozPMmMD2M_KqhcbxHIM_p0HaHhqCHPJZZtrwl7PQQPHL5ChnNvOvfVHOBqsJAKDpACQN0pKqBs4pCE7WfAeVDevCAbw5DnMgMheEqKm3TiFwm0YeFKoVevA Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b520b7f3bb474c65be467a38d457a033 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsAdminTestJSON-1449291791 Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:53:24.470617 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b520b7f3bb474c65be467a38d457a033"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b520b7f3bb474c65be467a38d457a033"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b520b7f3bb474c65be467a38d457a033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b520b7f3bb474c65be467a38d457a033"}]}] Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsAdminTestJSON-1449291791 Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b520b7f3bb474c65be467a38d457a033 Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1449291791 Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsAdminTestJSON-1449291791-project Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 38af0fbf13e245428bd1e2953e3df701 Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsAdminTestJSON-1449291791-project Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "test", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "1305596225"}} Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:53:24.472238 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor 1305596225 could not be found. Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '1305596225'}}} Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1305596225 could not be found. Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:24.473128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1305596225 could not be found. Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:53:24.474386 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:53:24.475762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:53:24.475762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:53:24.475762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:53:24.475762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1305596225 could not be found. Jun 25 20:53:24.475762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:53:24.477863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6fdd1e0-4fed-44c7-b9e2-1d70e620bfd1 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Returning 400 to user: Flavor 1305596225 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:53:24.478899 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c6fdd1e0-4fed-44c7-b9e2-1d70e620bfd1 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.050996 Jun 25 20:53:24.479738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 206/412] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:24 2022] POST /compute/v2.1/servers => generated 81 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Jun 25 20:53:24.488518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-996a89c8-c5b0-475f-8d1d-81c5e578ffb0 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.546817 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-996a89c8-c5b0-475f-8d1d-81c5e578ffb0 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1305596225" status: 202 len: 0 microversion: 2.1 time: 0.062521 Jun 25 20:53:24.556788 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 207/413] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:53:24 2022] DELETE /compute/v2.1/flavors/1305596225 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:53:24.562059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2aa04308-c199-44e6-8040-7e68bbda9abf tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.640926 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2aa04308-c199-44e6-8040-7e68bbda9abf tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061876 Jun 25 20:53:24.641964 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 208/414] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:24.663681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09c3ebff-a480-48e0-ba04-7d64786519a2 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-899458434", "id": 1749981855, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:24.706826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09c3ebff-a480-48e0-ba04-7d64786519a2 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.053139 Jun 25 20:53:24.708492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 209/415] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:24 2022] POST /compute/v2.1/flavors => generated 414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:24.718068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eccd2eec-d953-4af1-a6aa-1437b1cac90e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-242535853", "id": 1700658758, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:24.762349 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eccd2eec-d953-4af1-a6aa-1437b1cac90e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.047896 Jun 25 20:53:24.770570 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 210/416] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:24 2022] POST /compute/v2.1/flavors => generated 413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:24.779805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04f76cbb-9923-4843-9834-06c14ba8b110 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.844327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04f76cbb-9923-4843-9834-06c14ba8b110 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.071471 Jun 25 20:53:24.850724 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 211/417] 10.222.0.39 () {58 vars in 1168 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:24.856748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c1d1fc6-eabe-4894-917e-9314ebf5b72c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.875636 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c1d1fc6-eabe-4894-917e-9314ebf5b72c tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.023351 Jun 25 20:53:24.881820 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 212/418] 10.222.0.39 () {58 vars in 1176 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:24.888020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b524698-2fbf-4002-b8e6-d5bfd9d67785 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.910981 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b524698-2fbf-4002-b8e6-d5bfd9d67785 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.021906 Jun 25 20:53:24.911953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 213/419] 10.222.0.39 () {58 vars in 1170 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:24.922861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8ebfa9ce-3427-49ea-b017-b1e7931d853e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:24.942941 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8ebfa9ce-3427-49ea-b017-b1e7931d853e tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.024030 Jun 25 20:53:24.950147 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 214/420] 10.222.0.39 () {58 vars in 1168 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:24.957949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8f03daa-9913-46a6-8959-af0aa5bfd786 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.008064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8f03daa-9913-46a6-8959-af0aa5bfd786 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.056639 Jun 25 20:53:25.024463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 215/421] 10.222.0.39 () {58 vars in 1168 bytes} [Sat Jun 25 20:53:24 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:25.045490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eaa6868a-1685-4d71-8776-2933dbaae340 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.125250 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eaa6868a-1685-4d71-8776-2933dbaae340 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.099756 Jun 25 20:53:25.129909 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 216/422] 10.222.0.39 () {58 vars in 1174 bytes} [Sat Jun 25 20:53:25 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:25.144294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d484be69-f049-49bf-9831-b354db063ed5 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.182053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d484be69-f049-49bf-9831-b354db063ed5 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.042846 Jun 25 20:53:25.183754 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 217/423] 10.222.0.39 () {58 vars in 1172 bytes} [Sat Jun 25 20:53:25 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:25.193933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.195121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:25.210899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:25.211748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:25.215219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:25.215980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:25.590189 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be91a362-230c-4449-a0df-5cb55f43bfda tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189/action" status: 202 len: 0 microversion: 2.25 time: 6.380482 Jun 25 20:53:25.595049 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 207/424] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:53:19 2022] POST /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189/action => generated 0 bytes in 6383 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:53:25.598496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f683e12-c109-4569-906e-7d9e66dac382 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.661734 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f683e12-c109-4569-906e-7d9e66dac382 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.069019 Jun 25 20:53:25.673189 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 208/425] 10.222.0.39 () {58 vars in 1168 bytes} [Sat Jun 25 20:53:25 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:25.691624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:25.696737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:25.709013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:25.709793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:25.712124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:25.713010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:26.083957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:26.107185 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1fbac49-6cdd-49ed-97e3-6a8bfed56f69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1274 microversion: 2.1 time: 0.920888 Jun 25 20:53:26.117800 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 218/426] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:25 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1274 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.125269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4688eddf-155c-47a3-8489-af22ae2b1ed3 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.129437 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:26.129437 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:26.165286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4688eddf-155c-47a3-8489-af22ae2b1ed3 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1700658758" status: 202 len: 0 microversion: 2.1 time: 0.053315 Jun 25 20:53:26.168154 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 219/427] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:53:26 2022] DELETE /compute/v2.1/flavors/1700658758 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:26.180235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d82d8ad-5ed1-48db-9de0-c3c04ca71722 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.229362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d82d8ad-5ed1-48db-9de0-c3c04ca71722 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056827 Jun 25 20:53:26.240920 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 220/428] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.250643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21ca4399-abb5-464e-93d5-3c0ad187f058 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.276033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21ca4399-abb5-464e-93d5-3c0ad187f058 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1749981855" status: 202 len: 0 microversion: 2.1 time: 0.032024 Jun 25 20:53:26.281999 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 221/429] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:53:26 2022] DELETE /compute/v2.1/flavors/1749981855 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:53:26.289161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9558b7a-0078-449f-8ccd-36b7bc96e462 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.312638 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9558b7a-0078-449f-8ccd-36b7bc96e462 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028040 Jun 25 20:53:26.329332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 222/430] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.334617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26a2ef6e-fd0d-413e-ba7c-100ba229d518 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-331528987", "id": 1565490416, "os-flavor-access:is_public": "False"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:26.336579 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:26.336579 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:26.359176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26a2ef6e-fd0d-413e-ba7c-100ba229d518 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.028162 Jun 25 20:53:26.367142 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 223/431] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:26 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:26.374067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f7d2a5a-8310-4ccc-8df1-273e7329eaf7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.397038 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f7d2a5a-8310-4ccc-8df1-273e7329eaf7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028049 Jun 25 20:53:26.408640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 224/432] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.415558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-898ca902-2525-4a26-a0d8-c13773b32f5f tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.440523 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-898ca902-2525-4a26-a0d8-c13773b32f5f tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030267 Jun 25 20:53:26.451527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 225/433] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.456659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd06b7c0-c7ba-42ae-8e45-19b83c8b89c7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.495245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd06b7c0-c7ba-42ae-8e45-19b83c8b89c7 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1565490416" status: 202 len: 0 microversion: 2.1 time: 0.042390 Jun 25 20:53:26.495826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 226/434] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:53:26 2022] DELETE /compute/v2.1/flavors/1565490416 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:53:26.517184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f4780cd-20cf-43c5-89cf-7dd3e6add678 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.537936 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f4780cd-20cf-43c5-89cf-7dd3e6add678 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030224 Jun 25 20:53:26.563924 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 227/435] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.572136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f0920fe-fbab-4cad-89ac-d00ffd6219a4 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-684513028", "id": 406246210, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:26.611852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f0920fe-fbab-4cad-89ac-d00ffd6219a4 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.056265 Jun 25 20:53:26.619069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 228/436] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:26 2022] POST /compute/v2.1/flavors => generated 410 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:26.625897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-776da5ed-e0a3-4ea5-88bf-086d82e611e3 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.648606 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-776da5ed-e0a3-4ea5-88bf-086d82e611e3 tempest-FlavorsAdminTestJSON-1449291791 tempest-FlavorsAdminTestJSON-1449291791-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.028115 Jun 25 20:53:26.656821 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 229/437] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:26.665090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1d1755e4-458b-470f-9155-c0cd7d1ed422 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.686951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1d1755e4-458b-470f-9155-c0cd7d1ed422 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/406246210" status: 202 len: 0 microversion: 2.1 time: 0.026053 Jun 25 20:53:26.687595 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 230/438] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:53:26 2022] DELETE /compute/v2.1/flavors/406246210 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:53:26.696388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b1d9c8f-a940-4ce9-a3bc-2e478903ca07 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:26.725921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b1d9c8f-a940-4ce9-a3bc-2e478903ca07 tempest-FlavorsAdminTestJSON-1242652432 tempest-FlavorsAdminTestJSON-1242652432-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033756 Jun 25 20:53:26.726855 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 231/439] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:27.129743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:27.132341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:27.153961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:27.155708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:27.175296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:27.175804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:27.338390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:27.347093 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4867b014-a22c-4bca-8852-29eb990b733a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1274 microversion: 2.1 time: 0.224643 Jun 25 20:53:27.351821 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 232/440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:27 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:27.410494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:27.423181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:27.428354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:27.431476 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f6ee767-6e5e-422c-b39f-b624065c7108 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 1.756241 Jun 25 20:53:27.435029 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 209/441] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:25 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:28.022425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7e2716e-f806-4130-b3f9-83c0d30d06d7 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:28.034156 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7e2716e-f806-4130-b3f9-83c0d30d06d7 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.313989 Jun 25 20:53:28.043883 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 233/442] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:53:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:28.138688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c2a811ce-533d-465f-ac40-6197fd8ce936 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-249351697", "id": 2022263478, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:28.141868 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:28.141868 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:28.170084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c2a811ce-533d-465f-ac40-6197fd8ce936 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.126351 Jun 25 20:53:28.172062 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 210/443] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:28 2022] POST /compute/v2.1/flavors => generated 424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:28.183169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7f19578-13a7-40ef-8b68-6a57a897ee1d tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:28.204713 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7f19578-13a7-40ef-8b68-6a57a897ee1d tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026184 Jun 25 20:53:28.207956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 234/444] 10.222.0.39 () {58 vars in 1181 bytes} [Sat Jun 25 20:53:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:53:28.218416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-649ceb8f-8a40-423a-a9e2-0ca09a310a14 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1571234687", "id": 619076461, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:28.261578 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-649ceb8f-8a40-423a-a9e2-0ca09a310a14 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.047018 Jun 25 20:53:28.262353 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 211/445] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:28 2022] POST /compute/v2.1/flavors => generated 422 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:28.276581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ce2e978-0d6b-447b-abd0-d21b64026691 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:28.325756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ce2e978-0d6b-447b-abd0-d21b64026691 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035087 Jun 25 20:53:28.329646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 235/446] 10.222.0.39 () {58 vars in 1181 bytes} [Sat Jun 25 20:53:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:53:28.343348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d823bd9c-514f-44e5-995f-175be9bc1ff6 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Action: 'create', calling method: .version_select at 0x7f985ccc3700>, body: {"keypair": {"name": "tempest-keypair-238536916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9QiTurXmwWpm+icwYFIDG9iHhImOVNQ12r11qH8CucV8cENpY2kxPCakGXcykcMpWbuYu3iQMRapoKa5N/tYCqMHLa6luP5APLf3AHxZzL+UmjpBr3wTAlQnSNzo3mfw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:28.360908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d823bd9c-514f-44e5-995f-175be9bc1ff6 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for project 2ce47feeb3ff411a8511889a370e746e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:28.366048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d823bd9c-514f-44e5-995f-175be9bc1ff6 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for user 33d0756150114bc7bd3f6f72b93cb56a and project 2ce47feeb3ff411a8511889a370e746e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:28.367549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:28.368137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:28.383584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:28.387414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:28.390481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:28.394965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d823bd9c-514f-44e5-995f-175be9bc1ff6 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057025 Jun 25 20:53:28.396223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:28.396405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 212/447] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:53:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:28.464782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:28.466979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:28.481877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:28.483655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:28.485423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:28.486976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:28.721696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:28.737486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18140518-908a-4c87-b019-5639006b1c02 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.369941 Jun 25 20:53:28.747751 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 236/448] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:28 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:29.083560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:29.231835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:29.244168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:29.246534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:29.252824 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b17a711-dc0c-44a4-9ae6-bbbc03c3e2a8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 0.798340 Jun 25 20:53:29.264334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 213/449] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:28 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:29.754682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:29.756041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:29.772690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:29.773200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:29.774039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:29.774546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:30.270665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:30.271354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:30.289258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:30.290030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:30.291012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:30.297192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:30.297419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:30.310467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-780523e7-826c-4673-bf0c-f9cecf1a6ac1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.556148 Jun 25 20:53:30.320603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 237/450] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:29 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:30.860327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b8fa8069-5031-49b9-92ad-cdcea800eab6 req-4f14ed7f-65a1-4485-b0f6-9a1d4f10b1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acaf208-7f08-43b0-a4cf-21cdcf91b5f8", "tag": "ef4735f1-38e8-43c9-a3ce-04d3807f0d03"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:30.865150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:30.883589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b8fa8069-5031-49b9-92ad-cdcea800eab6 req-4f14ed7f-65a1-4485-b0f6-9a1d4f10b1f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:30.884129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b8fa8069-5031-49b9-92ad-cdcea800eab6 req-4f14ed7f-65a1-4485-b0f6-9a1d4f10b1f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:30.943109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b8fa8069-5031-49b9-92ad-cdcea800eab6 req-4f14ed7f-65a1-4485-b0f6-9a1d4f10b1f2 service nova] Creating event network-changed:ef4735f1-38e8-43c9-a3ce-04d3807f0d03 for instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 on nch1-master-1 Jun 25 20:53:30.949540 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b8fa8069-5031-49b9-92ad-cdcea800eab6 req-4f14ed7f-65a1-4485-b0f6-9a1d4f10b1f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092768 Jun 25 20:53:30.951339 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 238/451] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:31.331812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:31.332674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:31.353350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:31.355325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:31.356210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:31.365338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:31.761757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:31.774173 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6db13bcd-1532-457b-97ab-fe1626ba22d6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.446875 Jun 25 20:53:31.776666 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 239/452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:31 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:32.025227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:32.043595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:32.045348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:32.046809 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5824b3b0-0e89-4024-a085-c16db92dd07a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 1.780219 Jun 25 20:53:32.049475 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 214/453] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:30 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:32.205534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.379546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Action: 'update', calling method: .version_select at 0x7f985c5b2790>, body: {"quota_set": {"ram": "5120"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:32.700477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:32.803723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:32.804450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:32.843214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:32.843952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:32.846676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:32.847689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:33.408689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:33.409090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:33.410000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:33.412837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:33.555545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b3692b6-35b0-46ec-8176-fedcb5a47e7b tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a" status: 200 len: 240 microversion: 2.36 time: 1.777415 Jun 25 20:53:33.556590 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 240/454] 10.222.0.39 () {62 vars in 1302 bytes} [Sat Jun 25 20:53:31 2022] PUT /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a => generated 240 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:33.573717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:33.574595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:33.591510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:33.591964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:33.597560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:33.598209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:33.961867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:33.995308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:34.000395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:34.006562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-48d64822-7efd-435c-8507-57a3772e157a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 0.446430 Jun 25 20:53:34.012171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:34.021041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 241/455] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:33 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:34.027866 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ed24f4d4-4510-4895-a277-029d1a6d36b5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 1.239780 Jun 25 20:53:34.046408 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 215/456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:32 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:34.046632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Calling method '.version_select at 0x7f985c41cee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:34.059908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8454c779-c161-4742-83c3-a6cbd5bc9df5 req-9ef80ad3-38e0-4ee6-bada-44805cf9101c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "name": "network-vif-unplugged", "status": "completed", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:34.077980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8454c779-c161-4742-83c3-a6cbd5bc9df5 req-9ef80ad3-38e0-4ee6-bada-44805cf9101c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:34.078490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8454c779-c161-4742-83c3-a6cbd5bc9df5 req-9ef80ad3-38e0-4ee6-bada-44805cf9101c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:34.123224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8454c779-c161-4742-83c3-a6cbd5bc9df5 req-9ef80ad3-38e0-4ee6-bada-44805cf9101c service nova] Creating event network-vif-unplugged:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch2-master-1 Jun 25 20:53:34.142434 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8454c779-c161-4742-83c3-a6cbd5bc9df5 req-9ef80ad3-38e0-4ee6-bada-44805cf9101c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103419 Jun 25 20:53:34.148999 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 216/457] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:34.480819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87730a9e-656b-4045-a3d8-76e071a53ff9 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1588765270", "id": 2136796022, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:34.486597 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:34.486597 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:34.535226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:34.536749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:34.539713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:34.539884 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87730a9e-656b-4045-a3d8-76e071a53ff9 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.388777 Jun 25 20:53:34.546877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:34.547120 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 217/458] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:53:34 2022] POST /compute/v2.1/flavors => generated 449 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:34.611871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-985b53fb-8567-4a3f-8ff2-c196a00debed tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a/detail" status: 200 len: 672 microversion: 2.36 time: 0.589260 Jun 25 20:53:34.620941 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 242/459] 10.222.0.39 () {60 vars in 1303 bytes} [Sat Jun 25 20:53:34 2022] GET /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a/detail => generated 672 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:34.876448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8522323b-f8ce-4b07-978f-f09450d02528 tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:34.909421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8522323b-f8ce-4b07-978f-f09450d02528 tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] 10.222.0.39 "GET /compute/v2.1/flavors/2136796022" status: 200 len: 449 microversion: 2.55 time: 0.342627 Jun 25 20:53:34.910910 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 218/460] 10.222.0.39 () {60 vars in 1198 bytes} [Sat Jun 25 20:53:34 2022] GET /compute/v2.1/flavors/2136796022 => generated 449 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:34.923616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-905cb685-45ac-43e0-9eeb-7a3c01bc8255 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:34.925547 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:34.925547 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:34.975719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-905cb685-45ac-43e0-9eeb-7a3c01bc8255 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] 10.222.0.39 "PUT /compute/v2.1/flavors/2136796022" status: 200 len: 450 microversion: 2.55 time: 0.057465 Jun 25 20:53:34.980612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 243/461] 10.222.0.39 () {62 vars in 1218 bytes} [Sat Jun 25 20:53:34 2022] PUT /compute/v2.1/flavors/2136796022 => generated 450 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:34.998732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f4327862-d097-4453-a1bc-8beddc5af78e tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:35.046161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:35.046946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:35.071587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:35.073818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:35.076344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:35.078369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:35.102631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4327862-d097-4453-a1bc-8beddc5af78e tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6593 microversion: 2.55 time: 0.090730 Jun 25 20:53:35.103335 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 219/462] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:53:34 2022] GET /compute/v2.1/flavors/detail => generated 6593 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:35.128417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:35.137224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:35.148799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:35.149262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:35.153148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:35.153637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:35.772957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:35.784376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:35.786513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:35.788103 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fce0afc8-b361-40d8-9f6e-7bcb102d47e6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 0.752673 Jun 25 20:53:35.788951 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 244/463] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:35 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:35.796610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-304e1926-05fe-479a-b508-fd88d6a882c8 tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:35.831751 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-304e1926-05fe-479a-b508-fd88d6a882c8 tempest-FlavorsV255TestJSON-2138681649 tempest-FlavorsV255TestJSON-2138681649-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.55 time: 0.041159 Jun 25 20:53:35.834456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 245/464] 10.222.0.39 () {60 vars in 1165 bytes} [Sat Jun 25 20:53:35 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:35.844475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Action: 'update', calling method: .version_select at 0x7f985c39df70>, body: {"quota_set": {"ram": "2048"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:35.985995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:36.004616 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c3807ac-14bf-4636-afaf-34bf0c9278dd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.896943 Jun 25 20:53:36.006288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 220/465] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:35 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:36.017587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-09c22eb6-aa12-4fe9-b507-3d513d0d1ae1 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:36.018665 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:36.018665 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:36.044477 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-09c22eb6-aa12-4fe9-b507-3d513d0d1ae1 tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2136796022" status: 202 len: 0 microversion: 2.55 time: 0.036434 Jun 25 20:53:36.057434 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 221/466] 10.222.0.39 () {60 vars in 1201 bytes} [Sat Jun 25 20:53:36 2022] DELETE /compute/v2.1/flavors/2136796022 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:53:36.073607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85eb6fc4-7f49-4ca0-8bcf-679a085614ac tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:36.113030 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85eb6fc4-7f49-4ca0-8bcf-679a085614ac tempest-FlavorsV255TestJSON-1853337461 tempest-FlavorsV255TestJSON-1853337461-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 6153 microversion: 2.55 time: 0.049368 Jun 25 20:53:36.126954 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 222/467] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 20:53:36 2022] GET /compute/v2.1/flavors/detail => generated 6153 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:36.133496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.134211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.135358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.136062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.198805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.199483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.201446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.202088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.237588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3d572483-74e5-496f-8a7e-d5b3ac20d0bf req-072c8082-d5b0-4d23-b822-65459909b8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:36.276016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3d572483-74e5-496f-8a7e-d5b3ac20d0bf req-072c8082-d5b0-4d23-b822-65459909b8ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.288255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3d572483-74e5-496f-8a7e-d5b3ac20d0bf req-072c8082-d5b0-4d23-b822-65459909b8ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.338697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3d572483-74e5-496f-8a7e-d5b3ac20d0bf req-072c8082-d5b0-4d23-b822-65459909b8ac service nova] Creating event network-changed:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch2-master-1 Jun 25 20:53:36.352193 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3d572483-74e5-496f-8a7e-d5b3ac20d0bf req-072c8082-d5b0-4d23-b822-65459909b8ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124252 Jun 25 20:53:36.360289 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 223/468] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:36.426002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b8f5ffb-f180-4778-91d9-49473f7df123 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a?user_id=5b6a4c5d5a9b42b08da76565c9f09128" status: 200 len: 240 microversion: 2.36 time: 0.589902 Jun 25 20:53:36.432827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 246/469] 10.222.0.39 () {62 vars in 1383 bytes} [Sat Jun 25 20:53:35 2022] PUT /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a?user_id=5b6a4c5d5a9b42b08da76565c9f09128 => generated 240 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:36.440535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c750207-83d2-430d-8af8-c55fdf6a2bf3 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] Calling method '.version_select at 0x7f985cbea280>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:36.835605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:36.836254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:36.864962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.868370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:36.870814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:36.873426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:37.389630 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c750207-83d2-430d-8af8-c55fdf6a2bf3 tempest-QuotasAdminTestV236-1515250215 tempest-QuotasAdminTestV236-1515250215-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a?user_id=5b6a4c5d5a9b42b08da76565c9f09128" status: 200 len: 282 microversion: 2.36 time: 0.954937 Jun 25 20:53:37.402593 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 224/470] 10.222.0.39 () {60 vars in 1363 bytes} [Sat Jun 25 20:53:36 2022] GET /compute/v2.1/os-quota-sets/13c0954c08a74ff58527e21d9ef5b00a?user_id=5b6a4c5d5a9b42b08da76565c9f09128 => generated 282 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:53:37.410369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:37.411182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:37.435598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:37.436068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:37.436914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:37.437349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:38.048829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:38.060923 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d63152de-91ee-4aae-9695-4c1d9232d42d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.657017 Jun 25 20:53:38.064177 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 225/471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:37 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:38.110816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:38.137925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:38.142125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:38.143491 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9115aec0-203d-47f5-8e02-e685abdf77cb tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 1.340453 Jun 25 20:53:38.152645 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 247/472] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:36 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:53:38.166318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1201454574", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "619076461", "adminPass": "***", "networks": [{"uuid": "865bd5da-70b8-4a43-99a3-edc759baf240"}], "security_groups": [{"name": "tempest-securitygroup--2008530787"}], "key_name": "tempest-keypair-238536916", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:38.444535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] validate_networks() for [('865bd5da-70b8-4a43-99a3-edc759baf240', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:38.723773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-175629687", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "df01ad33-2d1d-469d-8a83-fe93f2aaff22"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:38.851532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] validate_networks() for [('df01ad33-2d1d-469d-8a83-fe93f2aaff22', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:39.427138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:39.427590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:39.428096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:39.428794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:39.429787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:39.455072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:39.455547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:39.463770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:39.464406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:39.532892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for project 2ce47feeb3ff411a8511889a370e746e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:39.544563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for user 33d0756150114bc7bd3f6f72b93cb56a and project 2ce47feeb3ff411a8511889a370e746e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:39.585033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:39.613757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:39.699204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-778e6dec-f006-42ba-b12d-cce77909b083 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.545233 Jun 25 20:53:39.703703 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 248/473] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:53:39.726182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:39.727035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:39.738083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:39.738364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:39.739222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:39.739862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.080670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:40.081299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:40.081799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:40.082336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:40.082851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:40.103497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:40.111079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:40.114358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be163919-221b-4cf1-8c21-ac3a2187da9d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.407925 Jun 25 20:53:40.115451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.117580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 249/474] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:39 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:40.120757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:40.121759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.132898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:40.133670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:40.155507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:40.159871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.162986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:40.168093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.171556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:40.187007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for user e9c6e12528ea4760bed65f994df57783 and project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:40.229954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:40.232552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:40.357709 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29f78992-1bc3-41dc-9ab8-6d68bd6cd40c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.290935 Jun 25 20:53:40.358647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 226/475] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:53:40.364154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-66b05aea-23b3-4c24-9307-d0f000bcf97f req-7081150b-7340-4d77-a0c0-1f2b1bc59660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acaf208-7f08-43b0-a4cf-21cdcf91b5f8", "name": "network-vif-plugged", "status": "completed", "tag": "ef4735f1-38e8-43c9-a3ce-04d3807f0d03"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:40.378517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-66b05aea-23b3-4c24-9307-d0f000bcf97f req-7081150b-7340-4d77-a0c0-1f2b1bc59660 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:40.379175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-66b05aea-23b3-4c24-9307-d0f000bcf97f req-7081150b-7340-4d77-a0c0-1f2b1bc59660 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:40.391739 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-66b05aea-23b3-4c24-9307-d0f000bcf97f req-7081150b-7340-4d77-a0c0-1f2b1bc59660 service nova] Creating event network-vif-plugged:ef4735f1-38e8-43c9-a3ce-04d3807f0d03 for instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 on nch1-master-1 Jun 25 20:53:40.399962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-66b05aea-23b3-4c24-9307-d0f000bcf97f req-7081150b-7340-4d77-a0c0-1f2b1bc59660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039384 Jun 25 20:53:40.401452 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 227/476] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:40.407804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02aaf31e-b631-4409-b203-2cb6b7fa1d3e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:40.408990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02aaf31e-b631-4409-b203-2cb6b7fa1d3e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:40.600808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02aaf31e-b631-4409-b203-2cb6b7fa1d3e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:40.612171 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02aaf31e-b631-4409-b203-2cb6b7fa1d3e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1262 microversion: 2.1 time: 0.209126 Jun 25 20:53:40.622934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 228/477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:40 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1262 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:40.637806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1a6debce-ee32-4f72-a29f-154e92956c9b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:40.638457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a6debce-ee32-4f72-a29f-154e92956c9b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:41.014976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1a6debce-ee32-4f72-a29f-154e92956c9b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:41.023185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1a6debce-ee32-4f72-a29f-154e92956c9b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1210 microversion: 2.1 time: 0.399047 Jun 25 20:53:41.027986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 229/478] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:40 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1210 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:41.139817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:41.140532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:41.160276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:41.161825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:41.162683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:41.163184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:41.541661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:41.550350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-002e0241-dfcd-4758-94d7-c62d7c0a4352 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.418839 Jun 25 20:53:41.554334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 230/479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:41 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:41.601518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a5a74b4c-d4e3-4328-8995-1acd3d5a4d53 req-4e4c7b47-2024-4c78-9d99-c3d499df33c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "name": "network-vif-unplugged", "status": "completed", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:41.619721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:41.643001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5a74b4c-d4e3-4328-8995-1acd3d5a4d53 req-4e4c7b47-2024-4c78-9d99-c3d499df33c2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:41.661614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5a74b4c-d4e3-4328-8995-1acd3d5a4d53 req-4e4c7b47-2024-4c78-9d99-c3d499df33c2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:41.696148 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a5a74b4c-d4e3-4328-8995-1acd3d5a4d53 req-4e4c7b47-2024-4c78-9d99-c3d499df33c2 service nova] Creating event network-vif-unplugged:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch2-master-1 Jun 25 20:53:41.726778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:41.756816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a5a74b4c-d4e3-4328-8995-1acd3d5a4d53 req-4e4c7b47-2024-4c78-9d99-c3d499df33c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173202 Jun 25 20:53:41.756992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:41.758990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 231/480] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:41.761287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:41.763613 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-afd3c993-65fa-4ed1-8bb5-9efa0a667b4e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 1.644726 Jun 25 20:53:41.769096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 250/481] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:40 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:41.784476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:41.785266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:41.802284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:41.802730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:41.803517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:41.808476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.093246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:42.107164 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b80692b-6de6-4792-ae1e-ad944e455357 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1314 microversion: 2.1 time: 0.346317 Jun 25 20:53:42.109113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 232/482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:41 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:42.304498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-628101885", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:42.418646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:42.419080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:42.419837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:42.420293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:42.420753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:42.434225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.434934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.435883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.436361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.459423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Getting quotas for project 26b3a9ffdd5b4cf5b483c2a770e54a85. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:42.464178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Getting quotas for user 7001fd3982074ec9ac00f5acd8efd71d and project 26b3a9ffdd5b4cf5b483c2a770e54a85. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:42.477906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] Calling method '.version_select at 0x7f985cc65a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:42.496935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.497718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.498801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.499475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.506022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:42.508284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:42.524620 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40ce01ed-1d46-46c9-80a4-d1f896fbfa5f tempest-AbsoluteLimitsTestJSON-370667668 tempest-AbsoluteLimitsTestJSON-370667668-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.410894 Jun 25 20:53:42.525977 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 233/483] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:53:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:42.531325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:42.532179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:42.539217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.540000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.541287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.542084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.628751 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a4e58fdc-1c61-416f-a143-7bd82570a49e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.858397 Jun 25 20:53:42.629442 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 251/484] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:53:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 20:53:42.682433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:42.683069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:42.716470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:42.724799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.726525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.727475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:42.728021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:42.742399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:42.745520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:42.763428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-973a7a36-e732-4468-9f7a-c6c40874a970 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1270 microversion: 2.1 time: 0.236089 Jun 25 20:53:42.764411 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 234/485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:42 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:42.772747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:42.778920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:43.100577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.149129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.159195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.180236 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-28566ce4-88df-41aa-9404-504838e18fcb tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "PUT /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1358 microversion: 2.75 time: 0.414291 Jun 25 20:53:43.189364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 235/486] 10.222.0.39 () {62 vars in 1296 bytes} [Sat Jun 25 20:53:42 2022] PUT /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:43.204625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.205777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:43.206167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:43.220918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79b27875-3fa7-4e5d-a401-a147c9c4946c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1316 microversion: 2.1 time: 0.590050 Jun 25 20:53:43.222364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 252/487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:42 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1316 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:43.237452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:43.238046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.238488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.238837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:43.247244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.248140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.253251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.253699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.258091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.258819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.498228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.502069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:43.509364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-150a1a31-da07-4e86-b2d5-fe18c98d9f1d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1320 microversion: 2.1 time: 0.285630 Jun 25 20:53:43.522193 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 253/488] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:43 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:43.530993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:43.535707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:43.654956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.671490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.677886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.696300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d0faec0-15fe-49af-b09a-d4d9b5994e21 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1358 microversion: 2.75 time: 0.172565 Jun 25 20:53:43.698956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 254/489] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:43 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:43.783484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:43.784207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:43.795734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.798590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.800537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:43.801245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:43.820283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.840342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.861272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:43.864703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e49cc49f-6b1d-4bcc-99dc-c242dc3821ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1568 microversion: 2.25 time: 0.673868 Jun 25 20:53:43.867583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 236/490] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:43 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1568 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:44.010773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:44.019488 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cfb56731-9831-4658-80a2-dc445ec61641 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1268 microversion: 2.1 time: 0.240498 Jun 25 20:53:44.020253 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 255/491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:43 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1268 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:44.241003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:44.241650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:44.253572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.254319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:44.255634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.257308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:44.529892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:44.531508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:44.549784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.551951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:44.554419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.554895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:44.725125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:44.740065 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9ef555b-dfa1-4ffd-a218-1fbc32fa8fdc tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1320 microversion: 2.1 time: 0.214359 Jun 25 20:53:44.741026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 256/492] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:44 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1320 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:44.755572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:44.757276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:44.775322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.777077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:44.780740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:44.781685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.038674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.051223 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-58e07130-a749-4c61-843d-109c5f423fea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1466 microversion: 2.1 time: 0.813949 Jun 25 20:53:45.053283 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 237/493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:44 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1466 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:45.068196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.069078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:45.076988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.077786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.078752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.079470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.121412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.142542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.144522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.150985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07378731-901e-4431-a6db-7e73fc64f111 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1416 microversion: 2.75 time: 0.406494 Jun 25 20:53:45.152327 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 257/494] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:44 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1416 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:45.179452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.180515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:45.188547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.189320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.190277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.191313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.267860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.279645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-789427b6-f9ed-4961-bf12-03c373dd667a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1268 microversion: 2.1 time: 0.125838 Jun 25 20:53:45.281709 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 258/495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:45.382744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.403064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.408384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:45.412006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55a60038-f338-4a2f-b02d-6717d25da66e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1558 microversion: 2.25 time: 0.356425 Jun 25 20:53:45.413036 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 238/496] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1558 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:45.432798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0fb476d0-b922-46cd-8f24-774091f27f8d tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '.version_select at 0x7f985cbf9700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.436488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fb476d0-b922-46cd-8f24-774091f27f8d tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.438474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fb476d0-b922-46cd-8f24-774091f27f8d tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.465492 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0fb476d0-b922-46cd-8f24-774091f27f8d tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.038503 Jun 25 20:53:45.466261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 239/497] 10.222.0.39 () {60 vars in 1183 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 20:53:45.477868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.478615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:45.487200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.488278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.489503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.490137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.584533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.585323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:45.594451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.595670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.596481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.597104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.809370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c74f7943-2aa3-4657-a9a3-3da9ad4fa189 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:53:45.843371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39953b6e-94ff-481a-ba5a-1275138f3b81 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 2050 microversion: 2.25 time: 0.369194 Jun 25 20:53:45.849362 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 240/498] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 2050 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:53:45.859853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:45.860495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:45.886697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.887161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:45.887954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:45.888383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.056198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-806162db-a365-4860-901e-6faa57833914 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1617 microversion: 2.1 time: 0.772244 Jun 25 20:53:46.057002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 259/499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1617 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:46.430303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:46.446600 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0080e27f-8499-41da-8c4e-a89cf390f3b4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.592055 Jun 25 20:53:46.447281 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 241/500] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:45 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:46.452460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: .version_select at 0x7f985cc65ee0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-652416393", "policies": ["affinity"]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:46.473682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c5b2c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:46.474768 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:46.474768 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:46.476861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.477534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.478296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:46.482404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:46.497171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.498419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.512150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.512852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.521968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dfc3267-daab-48b5-ba0b-c9016b7b84f3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.463910 Jun 25 20:53:46.528493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 260/501] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:46 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:46.536886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-794192502", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "7ef2b2be-dae0-4c92-af7f-25bfe52fff3b"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:46.588467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:46.614918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:46.616611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] validate_networks() for [('7ef2b2be-dae0-4c92-af7f-25bfe52fff3b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:46.646665 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-532bf50e-b385-469c-a0bc-9bc3246ce85d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.197831 Jun 25 20:53:46.652097 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 242/502] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 20:53:46 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:46.662378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:46.666998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:46.680585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.681644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.682697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.683351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.924912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:46.935947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:46.938043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:46.945177 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd27d56c-6d5d-4ce2-8726-bd8c48635f40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1416 microversion: 2.75 time: 0.290571 Jun 25 20:53:46.957688 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 243/503] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:46 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1416 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:46.968719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:46.969921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:46.980251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.981059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:46.982106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:46.982736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.242555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:47.243374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:47.244111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:47.244568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:47.245138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:47.258146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.258793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.260233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.260869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.280052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:47.285286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for user 39e82edaa30d418d96ea37f942d62755 and project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:47.297266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:47.299713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:47.357095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11e284a9-0ff3-43b5-8c22-c85c736314f8 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.827006 Jun 25 20:53:47.358938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 261/504] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 20:53:47.377663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c514160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.379673 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:47.379673 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:47.382186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.383198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.408853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.411591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.413893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:47.426439 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01a2ca5f-6eb1-4caf-a0a2-f97ac01f1433 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.463918 Jun 25 20:53:47.427074 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 244/505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:46 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:47.439561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-489367914", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "525c24a0-e807-4c3f-820f-5e4f8a95c0c7"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:47.444183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.444183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.452979 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d0fb9d7-99b8-4ec6-8822-e801f3059e18 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.092292 Jun 25 20:53:47.454121 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 262/506] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:47.465299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.466282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:47.540874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:47.579623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:47.590492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:47.593623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:47.603029 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96d3f0d0-0d5c-4e95-b84c-fea08b4f6954 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1261 microversion: 2.25 time: 0.140640 Jun 25 20:53:47.604004 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 263/507] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:47.610272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.611527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:47.621811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.622382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.623367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.623951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.830631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:47.841629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-38ee069c-2b9e-4c44-adbd-e46891feaa12 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.235438 Jun 25 20:53:47.846461 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 264/508] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:47.860791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c537280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.862975 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:47.862975 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:47.864497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.866273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.881844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.882350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.894017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.894468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.905984 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-231e40c3-3817-49e6-937e-08beb4075833 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055626 Jun 25 20:53:47.906849 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 265/509] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:47.917106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c514b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.917946 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:47.917946 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:47.919529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.919982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.937146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.937587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.947273 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8723ef0f-f52e-4495-8dd4-4395af2de107 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033444 Jun 25 20:53:47.955929 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 266/510] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:47.960969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08f55642-525f-47e6-a805-3ca1b31a6253 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c3dcee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:47.961822 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:47.961822 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:47.964376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08f55642-525f-47e6-a805-3ca1b31a6253 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:47.965874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08f55642-525f-47e6-a805-3ca1b31a6253 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:47.989021 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08f55642-525f-47e6-a805-3ca1b31a6253 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.031360 Jun 25 20:53:47.992597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 267/511] 10.222.0.39 () {58 vars in 1178 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:48.001866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:48.002478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:48.011573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.012025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.012876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.013641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.137002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:48.153738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:48.157873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:48.166239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d703dd0-12e1-4fed-9894-7c5bce0f9735 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1437 microversion: 2.75 time: 0.171667 Jun 25 20:53:48.180464 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 268/512] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:47 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1437 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:48.186138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c38c1f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:48.187044 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:48.187044 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:48.189072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.189629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.215397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.215861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.230922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.231373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.238671 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16ad2cb7-d729-4be7-92b6-51bdda55e2f7 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.070596 Jun 25 20:53:48.239262 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 269/513] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:53:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:48.426110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2107192191", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:48.470110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:48.470776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:48.471156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:48.471533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:48.475284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:48.499313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:53:48.502701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.503149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.503936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:48.504367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:48.546704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:48.553568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:48.568108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 2 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:48.570783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:48.665790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137462) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jun 25 20:53:48.721247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:48.729399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:48.779702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:48.796363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:48.809260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:48.847852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:48.961766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:48.969361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:49.011894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:49.012616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:49.015239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:49.015860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:49.016541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:49.040061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.043626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.044861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:49.045329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.045880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.062732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:49.094181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Getting quotas for project ea50e527346c47a2b3c0f7362ff5449b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:53:49.104985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Getting quotas for user af65f7ab19604ee1841ce4ae7e65a994 and project ea50e527346c47a2b3c0f7362ff5449b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:53:49.119188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:53:49.120748 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fc85ecc-47c3-4166-9a72-4cd670b0ed79 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.687400 Jun 25 20:53:49.121706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:53:49.121977 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 245/514] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:47 2022] POST /compute/v2.1/servers => generated 32 bytes in 1689 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 25 20:53:49.131554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:49.133024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:49.160054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.160591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.161671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.162248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.188823 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee16b80d-cc10-40c1-8571-1d3b6b557ddf tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.948041 Jun 25 20:53:49.196488 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 270/515] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:53:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:53:49.200310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c41ca60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:49.201171 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:49.201171 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:49.207486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.208125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.236064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.236999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.246443 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-176d76e4-10d7-4275-926d-b27cec378e9b tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.053340 Jun 25 20:53:49.256407 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 271/516] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:53:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:49.262328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-def77776-709d-43e4-8d32-2047bec21ee6 req-216bf6d7-77e0-4da1-b3cb-e2710e8c685d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabdeb25-a01e-4754-813d-31771aad3b7a", "tag": "ddfb9b3f-76b0-41bb-b549-9c7accacfc1b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:49.276727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-def77776-709d-43e4-8d32-2047bec21ee6 req-216bf6d7-77e0-4da1-b3cb-e2710e8c685d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.277401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-def77776-709d-43e4-8d32-2047bec21ee6 req-216bf6d7-77e0-4da1-b3cb-e2710e8c685d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.294645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-def77776-709d-43e4-8d32-2047bec21ee6 req-216bf6d7-77e0-4da1-b3cb-e2710e8c685d service nova] Creating event network-changed:ddfb9b3f-76b0-41bb-b549-9c7accacfc1b for instance cabdeb25-a01e-4754-813d-31771aad3b7a on nch2-master-1 Jun 25 20:53:49.302563 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-def77776-709d-43e4-8d32-2047bec21ee6 req-216bf6d7-77e0-4da1-b3cb-e2710e8c685d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044371 Jun 25 20:53:49.303744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 272/517] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:49.310566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:49.311556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:49.320810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.321388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.323011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.323580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.327605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:53:49.332307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:53:49.336149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:53:49.336758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:53:49.337649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:53:49.456522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:49.468125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.468752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.470059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.470688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.641935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.650369 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa6bf45b-ea6f-4e78-8be3-34d1b7f913fc tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.345038 Jun 25 20:53:49.654192 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 273/518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:49 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:49.670509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:49.673380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:49.687522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.689238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.691632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.692384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.788462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.797335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.812759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.834496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52474b8e-af73-4e19-9cfb-3b7aae9b1b49 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "POST /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c/action" status: 202 len: 1494 microversion: 2.75 time: 0.711252 Jun 25 20:53:49.835648 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 246/519] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:53:49 2022] POST /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c/action => generated 1494 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 25 20:53:49.849075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:49.864209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:49.879316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.879782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.882673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:49.883160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:49.894959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.908701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.910326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.915278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebc36399-821b-421e-98b6-6579da87e194 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1319 microversion: 2.25 time: 0.258501 Jun 25 20:53:49.929388 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 274/520] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:49 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:49.943200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:49.946702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:49.947607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Searching by: {'deleted': False, 'project_id': '29037675b33a4f318e1fcafc33b6bed5'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:53:50.021525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.022233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.026383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.026842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.314896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:53:50.397671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:50.563825 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb8bb763-2c52-4863-a0f5-5be685e78bc5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1001 microversion: 2.1 time: 0.632096 Jun 25 20:53:50.565818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 275/521] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:53:49 2022] GET /compute/v2.1/servers => generated 1001 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:50.585098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:50.585935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:50.607471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.607964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.610495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.611409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.683312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:50.692048 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-caffd19d-0790-4856-8462-eaf5a9598bf5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.855061 Jun 25 20:53:50.706434 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 247/522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:49 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:50.721573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985cf1a790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:50.722932 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:50.722932 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:53:50.724349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.725002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.751501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.754144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.774577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61571db6-11eb-40f0-9d2a-be70724a746c tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.066492 Jun 25 20:53:50.775342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 248/523] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:53:50 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:50.787431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:50.791882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:50.807908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.808503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.809532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.810114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.819944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:50.836078 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4eea5de1-60b8-46f8-8140-0e2e41373c0f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1274 microversion: 2.1 time: 0.267503 Jun 25 20:53:50.837410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 276/524] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:50 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:50.854535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:50.859248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:50.872746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.873195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.873990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.874471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.922102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:50.935726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:50.937386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:50.953901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eca6d042-d424-4268-905f-a2e8ff9c1024 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.170260 Jun 25 20:53:50.957065 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 249/525] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:50 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:50.973086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:50.979955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:50.992724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.993598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:50.994680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:50.995944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.096394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:51.115597 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-469cffdf-1b07-4d0d-ae4e-2cd3f75c7ca4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1214 microversion: 2.1 time: 0.275074 Jun 25 20:53:51.116241 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 277/526] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:50 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1214 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:51.123525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Calling method '.version_select at 0x7f985c2951f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:51.124472 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:53:51.124472 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:53:51.125901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.132089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.147943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.148660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.161226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.161982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.281761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:51.285842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a97e2406-8c4e-426d-aeee-27f4eb9354e3 tempest-HypervisorAdminTestJSON-1051406894 tempest-HypervisorAdminTestJSON-1051406894-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.165819 Jun 25 20:53:51.286851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 278/527] 10.222.0.39 () {58 vars in 1172 bytes} [Sat Jun 25 20:53:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:51.303470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:51.304186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:51.311959 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92d5f3b3-06e4-40ed-831e-332d9d2581a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.351737 Jun 25 20:53:51.336660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 250/528] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:50 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:51.356377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:51.376412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.377775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.379433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.380952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.392742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b563f15c-345b-4b3d-9b5c-bd63e1e57052 req-09b8a0e2-3549-4a1e-9f4c-9e223e64b78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:51.409562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b563f15c-345b-4b3d-9b5c-bd63e1e57052 req-09b8a0e2-3549-4a1e-9f4c-9e223e64b78b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.412830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b563f15c-345b-4b3d-9b5c-bd63e1e57052 req-09b8a0e2-3549-4a1e-9f4c-9e223e64b78b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.445151 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b563f15c-345b-4b3d-9b5c-bd63e1e57052 req-09b8a0e2-3549-4a1e-9f4c-9e223e64b78b service nova] Creating event network-changed:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch2-master-1 Jun 25 20:53:51.459611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b563f15c-345b-4b3d-9b5c-bd63e1e57052 req-09b8a0e2-3549-4a1e-9f4c-9e223e64b78b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070457 Jun 25 20:53:51.460874 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 251/529] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:53:51.715159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:51.717824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:51.725499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.726047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:51.726927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:51.727433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.036595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.047455 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-97994025-0100-4236-82a6-27109ec3b0e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.337085 Jun 25 20:53:52.049045 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 252/530] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:51 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:52.055451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:52.056934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:52.067563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.069900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.072063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.073025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.081116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:52.218055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.252996 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab588e52-7ca1-4875-83b3-5dcf5ea05ddb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1280 microversion: 2.1 time: 0.201763 Jun 25 20:53:52.254415 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 253/531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:52 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1280 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:52.262266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:52.263223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:52.274705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.275445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.276528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.277678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.302388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.312820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.315033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.316816 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a8ef791-443c-4212-a096-de6c735aed05 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 1.028598 Jun 25 20:53:52.328577 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 279/532] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:51 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:52.334529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:52.335505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:52.344243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.344971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.346005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.346671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.465632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.482549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.487237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.496754 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ea812dd5-5238-4508-a9be-6573d15c89bc tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.240158 Jun 25 20:53:52.498042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 254/533] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:52 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:52.511886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:52.515733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5abc92ed-b59c-485e-8e70-1e7939a78244 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1276 microversion: 2.1 time: 0.184345 Jun 25 20:53:52.517139 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 280/534] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:52 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1276 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:52.521478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:52.522138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:52.530164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.531469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:52.532688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:52.533568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.064651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:53.065383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:53.076741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.088462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.089763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.092330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.449240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.456866 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bee1dad2-c514-4114-9a03-f0cfe08e96d4 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.396249 Jun 25 20:53:53.461340 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 281/535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:53 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:53.470832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:53.472483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:53.485423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.486293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.487520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.488239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.505105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.517318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-34ea73e9-b351-4be3-a531-3d8f8a255866 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 1.001740 Jun 25 20:53:53.518368 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 255/536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:52 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:53.536990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:53.538922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:53.547487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.548104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.549370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.550062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.595529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.603737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-530bcb16-815e-4344-9be4-f5f4d66712e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1280 microversion: 2.1 time: 0.141418 Jun 25 20:53:53.604488 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 282/537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:53 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1280 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:53.609417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:53.610356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:53.618580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.619196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.620762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.621397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.733491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.743046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.744744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:53.751008 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3cc8dfb6-4d63-4baa-9de2-6f4a632d345c tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.145258 Jun 25 20:53:53.751876 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 283/538] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:53 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:53.757974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:53.759765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:53.769188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.770191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:53.771504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:53.772248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:54.031662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:54.052125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:54.056706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:54.060007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef884419-768a-4b01-a811-8601b08e852f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 0.538851 Jun 25 20:53:54.061356 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 256/539] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:53 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:54.249368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:54.262303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d772257-3eab-4257-bc92-87340c89dd12 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1276 microversion: 2.1 time: 0.508260 Jun 25 20:53:54.263192 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 284/540] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:53 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:54.476485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:54.477166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:54.493293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:54.493964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:54.494769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:54.495998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:54.534151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:54.534929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:54.546804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:54.549474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:54.551297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:54.555175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:54.950687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:54.971621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c47b95ed-6d90-4d12-ac06-895eb9fe1574 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.439955 Jun 25 20:53:54.983679 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 285/541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:54 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:53:54.999977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:55.000703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:55.007585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.008036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.008838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.009266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.033148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.044951 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5940bca-863b-4443-be16-2931c171ca0a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.573187 Jun 25 20:53:55.047262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 257/542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:54 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:55.059412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:55.060299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:55.076027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.077603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.078948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.081044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.276367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.287465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.309370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.321093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14c42572-92d6-4a4c-b098-a9a2db06544b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.271185 Jun 25 20:53:55.331022 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 258/543] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:55 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:55.331022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:55.331022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:55.353710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.355109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.357853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.358982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.483311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.495039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccbd2474-4d0d-4cee-b920-e31f66ea2906 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.507746 Jun 25 20:53:55.506326 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 286/544] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:54 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:55.512379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:55.513314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:55.520652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.521385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.522321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.522907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.697818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:55.711457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c81e9d7-2211-48bc-b205-0fff77ce5a38 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1276 microversion: 2.1 time: 0.203504 Jun 25 20:53:55.714458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 287/545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:55 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:55.855716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ced9df6c-626e-4c81-88a4-791c34bc16a9 req-76358d10-35b6-4e79-8af4-58dd7d918566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:55.872071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ced9df6c-626e-4c81-88a4-791c34bc16a9 req-76358d10-35b6-4e79-8af4-58dd7d918566 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:55.872718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ced9df6c-626e-4c81-88a4-791c34bc16a9 req-76358d10-35b6-4e79-8af4-58dd7d918566 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:55.901439 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ced9df6c-626e-4c81-88a4-791c34bc16a9 req-76358d10-35b6-4e79-8af4-58dd7d918566 service nova] Creating event network-changed:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch2-master-1 Jun 25 20:53:55.911802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ced9df6c-626e-4c81-88a4-791c34bc16a9 req-76358d10-35b6-4e79-8af4-58dd7d918566 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056861 Jun 25 20:53:55.912987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 288/546] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:55.991855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:55.992829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:56.005731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:56.006394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:56.007334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:56.009922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:56.374736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:56.384216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1983fc4f-6cda-4931-9c0b-bab95cb94933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.397542 Jun 25 20:53:56.385758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 289/547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:55 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:56.391045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:56.391931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:56.405442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:56.407693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:56.415878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:56.416348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:56.878177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:56.902825 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2b81424-0cbf-4fa8-86a7-d864f2a68e08 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.515573 Jun 25 20:53:56.916293 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 290/548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:56 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:56.942023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:56.947887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:56.989107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:56.989812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:56.990769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:57.001580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:57.174027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.183500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.198766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.200132 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-840e9fb3-45a6-422e-9da3-2ea04f475163 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 1.876694 Jun 25 20:53:57.201463 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 259/549] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:55 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:57.207004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:57.211745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:57.219165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:57.219775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:57.220734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:57.221287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:57.234863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.251689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.257894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:57.285779 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8140bef5-55c2-4375-be3b-e6cef5fed6ac tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.354728 Jun 25 20:53:57.294032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 291/550] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:56 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:57.318300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:57.319183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:57.331473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:57.331949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:57.332769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:57.333405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.262972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:58.267978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:58.270649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:58.278971 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9ca2429-25bc-461a-8791-7c366771e26b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 1.074099 Jun 25 20:53:58.280338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 260/551] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:57 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:58.286564 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6800e73e-ab50-4b8c-b778-c493e2aa7fa4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.988007 Jun 25 20:53:58.287424 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 292/552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:57 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:58.295942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:58.303067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:58.304714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:58.305633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:58.319950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.320929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.321809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.323343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.325677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.327566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.328986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.332778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.528494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:58.709908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:58.720100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b512ae0d-25a2-40bb-b284-8c88f2e908a1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.429201 Jun 25 20:53:58.724458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 293/553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:58 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:58.751392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:58.751574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:58.752764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:58.760500 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be395b9f-0c3f-4859-8808-7f5dc8e3fc4b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.477647 Jun 25 20:53:58.760912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.761438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.762288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.762787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.772634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 261/554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:58 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:53:58.785775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:58.791870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:58.815987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.821136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:58.827740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:58.830159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:59.078805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=52 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:59.115998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=50 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:59.137643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.155459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.161151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.178127 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-816b4431-04da-446c-85e8-e74f042b776e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.403903 Jun 25 20:53:59.179062 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 262/555] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:58 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:59.189110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-daf4a9e3-9378-4afa-ae42-3c85414a4c00 req-ce83aa6b-6aa4-4b88-b2dc-4ce89f9baab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2a6b47f-92e4-4bda-aba5-3a732126f241", "tag": "a63c9fa3-9247-44ee-86e3-e653c20f9e19"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:53:59.211019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daf4a9e3-9378-4afa-ae42-3c85414a4c00 req-ce83aa6b-6aa4-4b88-b2dc-4ce89f9baab2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:59.212685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daf4a9e3-9378-4afa-ae42-3c85414a4c00 req-ce83aa6b-6aa4-4b88-b2dc-4ce89f9baab2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:59.277340 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-daf4a9e3-9378-4afa-ae42-3c85414a4c00 req-ce83aa6b-6aa4-4b88-b2dc-4ce89f9baab2 service nova] Creating event network-changed:a63c9fa3-9247-44ee-86e3-e653c20f9e19 for instance f2a6b47f-92e4-4bda-aba5-3a732126f241 on nch1-master-1 Jun 25 20:53:59.295531 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-daf4a9e3-9378-4afa-ae42-3c85414a4c00 req-ce83aa6b-6aa4-4b88-b2dc-4ce89f9baab2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114434 Jun 25 20:53:59.299696 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 263/556] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:53:59.316321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:59.320942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:59.341801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:59.342265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:59.344405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:59.346476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:59.346652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.368344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.374892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:53:59.378090 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-142dc3e2-f775-4d6c-a2d3-d0a887021b33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 0.652278 Jun 25 20:53:59.382010 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 294/557] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:53:58 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:53:59.394253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:53:59.406219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:53:59.431325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:59.431769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:53:59.438074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:53:59.438974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.153785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:00.171709 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-261b3522-2f2e-4ef8-acd9-746cfc8f57bb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.867304 Jun 25 20:54:00.174521 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 264/558] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:59 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:00.185115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=19 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:00.456861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:00.470044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ea1e7b5-f83e-41bc-b1d5-6139621e34ea tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 1.086689 Jun 25 20:54:00.470820 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 295/559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:53:59 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:00.481729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:00.483882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:00.496177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:00.499590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.502051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:00.505817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.533686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-259642870", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "6eeac77f-8801-43f4-8ac9-0cee52480fbe"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:00.626354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] validate_networks() for [('6eeac77f-8801-43f4-8ac9-0cee52480fbe', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:00.726539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:00.737097 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3572bfd-f763-449b-90d4-00899f9df772 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.263360 Jun 25 20:54:00.738733 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 296/560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:00 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:00.745440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-917edd36-a593-45fa-89b5-7c85b821b0c8 req-e634295c-110f-4c90-a095-6d1163c42b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabdeb25-a01e-4754-813d-31771aad3b7a", "name": "network-vif-plugged", "status": "completed", "tag": "ddfb9b3f-76b0-41bb-b549-9c7accacfc1b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:00.755496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-917edd36-a593-45fa-89b5-7c85b821b0c8 req-e634295c-110f-4c90-a095-6d1163c42b6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:00.756231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-917edd36-a593-45fa-89b5-7c85b821b0c8 req-e634295c-110f-4c90-a095-6d1163c42b6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.769813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-917edd36-a593-45fa-89b5-7c85b821b0c8 req-e634295c-110f-4c90-a095-6d1163c42b6c service nova] Creating event network-vif-plugged:ddfb9b3f-76b0-41bb-b549-9c7accacfc1b for instance cabdeb25-a01e-4754-813d-31771aad3b7a on nch2-master-1 Jun 25 20:54:00.775777 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-917edd36-a593-45fa-89b5-7c85b821b0c8 req-e634295c-110f-4c90-a095-6d1163c42b6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 Jun 25 20:54:00.776401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 297/561] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:00.789243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:00.790219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:00.798973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:00.799429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.800208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:00.800690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:00.982408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:00.993176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7181d9d2-7c81-4ef8-b8c2-80edaeb461b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.214824 Jun 25 20:54:00.994026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 298/562] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:00 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:01.001118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:01.002283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:01.012293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.012882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.013799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.014351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.099909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:01.109633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:01.111210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:01.116798 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c65bc51-80f9-4ab6-845c-44ed95d5d582 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.121082 Jun 25 20:54:01.117410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 299/563] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:00 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:01.125504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-761b1953-2835-4681-baf1-7a9e5488ce9a req-07c71e54-3c67-4610-8510-ee89baf06774 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f", "tag": "2e2edaa7-e682-4d9a-8daf-556fe88fa547"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:01.137855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-761b1953-2835-4681-baf1-7a9e5488ce9a req-07c71e54-3c67-4610-8510-ee89baf06774 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.138294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-761b1953-2835-4681-baf1-7a9e5488ce9a req-07c71e54-3c67-4610-8510-ee89baf06774 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.159180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-761b1953-2835-4681-baf1-7a9e5488ce9a req-07c71e54-3c67-4610-8510-ee89baf06774 service nova] Creating event network-changed:2e2edaa7-e682-4d9a-8daf-556fe88fa547 for instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f on nch1-master-1 Jun 25 20:54:01.166168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-761b1953-2835-4681-baf1-7a9e5488ce9a req-07c71e54-3c67-4610-8510-ee89baf06774 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044003 Jun 25 20:54:01.167260 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 300/564] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:01.217113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:01.217810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:01.218392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:01.218883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:01.219358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:01.230770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.231333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.232254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.233241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.256366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Getting quotas for project ecaaba0e553049e6a4da58c2c5081305. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:01.261502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Getting quotas for user 67284d616ad14540b8e798ce389b10a7 and project ecaaba0e553049e6a4da58c2c5081305. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:01.275778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:01.277619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:01.281150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:01.373898 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70a0a387-e372-4c6b-a877-a36bbe50fda0 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.189048 Jun 25 20:54:01.376511 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 265/565] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:01.392978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:01.394377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:01.417240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e5f3e1e-6881-4c2e-b614-f3b1d704ab31 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] Action: 'create', calling method: .version_select at 0x7f985c16baf0>, body: {"security_group": {"name": "tempest-securitygroup-1467954193", "description": "tempest-description-690308811"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:01.425738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.429123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:01.430374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:01.442131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.152616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e5f3e1e-6881-4c2e-b614-f3b1d704ab31 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.983848 Jun 25 20:54:02.153867 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 301/566] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 20:54:01 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:02.166555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.167590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.177160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.177630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.178402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.178841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.478681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.479713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.491079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77d7f07f-a8fd-4216-9ad6-be57f849972e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.335155 Jun 25 20:54:02.491912 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 302/567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:02.497068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.497884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.505234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.505899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.506043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.507262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.507994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.512240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.513463 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1b6cd0e-d01a-455c-97ff-d1bccccd1951 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 1.135384 Jun 25 20:54:02.515371 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 266/568] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:01 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:02.523827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.526304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.540630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.541622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.542581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.543173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.639012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.656397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d283ab8-3e32-4933-831c-23cdb9a1420a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1212 microversion: 2.1 time: 0.155481 Jun 25 20:54:02.657179 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 303/569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1212 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:02.670667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.671484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.683790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.690647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.691758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.692372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.847603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.856350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c8e9ac4-8be6-4db8-b317-9099ec042e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.339640 Jun 25 20:54:02.857493 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 267/570] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:02.862856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.863643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.871146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.871592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.872362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.872892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.892128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:02.915530 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88422e9c-2023-4750-a7bf-0aa80156b60e tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1388 microversion: 2.1 time: 0.255190 Jun 25 20:54:02.916241 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 304/571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1388 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:02.921227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:02.927941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:02.941828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.945239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:02.948191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:02.948962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.053706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:03.064283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:03.068794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:03.069389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:03.075385 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7ea672f-2a2e-42a9-a088-df30d4df521e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.157787 Jun 25 20:54:03.076245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 305/572] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:03.077723 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6bbed93b-2cdb-47cd-84f2-93e3c6b48932 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.218643 Jun 25 20:54:03.081460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1091f71e-d6d1-4253-b061-53a98402a47c tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] Action: 'create', calling method: .version_select at 0x7f985c198430>, body: {"security_group": {"name": "tempest-securitygroup-1874805531", "description": "tempest-description-1997113177"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:03.088057 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 268/573] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:02 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:03.093234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-470ba172-ef5a-4d92-b7be-d9ccb9b27bf9 req-4437d9a6-d368-4b62-86e7-919f2eed5b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "name": "network-vif-plugged", "status": "completed", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:03.107491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-470ba172-ef5a-4d92-b7be-d9ccb9b27bf9 req-4437d9a6-d368-4b62-86e7-919f2eed5b1d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.108264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-470ba172-ef5a-4d92-b7be-d9ccb9b27bf9 req-4437d9a6-d368-4b62-86e7-919f2eed5b1d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.125896 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-470ba172-ef5a-4d92-b7be-d9ccb9b27bf9 req-4437d9a6-d368-4b62-86e7-919f2eed5b1d service nova] Creating event network-vif-plugged:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch2-master-1 Jun 25 20:54:03.133553 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-470ba172-ef5a-4d92-b7be-d9ccb9b27bf9 req-4437d9a6-d368-4b62-86e7-919f2eed5b1d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043860 Jun 25 20:54:03.134572 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 269/574] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:03.221539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-532875d3-23e1-4bf4-9125-b47eb5eded4f req-15a4fa34-11c2-43ae-9f87-34d58146b05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16ab884a-b59d-442c-b1c2-3d43353e4a9e", "tag": "fa7c0560-1ab7-41bb-8da1-cb540138a79e"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:03.247700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-532875d3-23e1-4bf4-9125-b47eb5eded4f req-15a4fa34-11c2-43ae-9f87-34d58146b05d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.248696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-532875d3-23e1-4bf4-9125-b47eb5eded4f req-15a4fa34-11c2-43ae-9f87-34d58146b05d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.270461 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-532875d3-23e1-4bf4-9125-b47eb5eded4f req-15a4fa34-11c2-43ae-9f87-34d58146b05d service nova] Creating event network-changed:fa7c0560-1ab7-41bb-8da1-cb540138a79e for instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e on nch1-master-1 Jun 25 20:54:03.285343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1091f71e-d6d1-4253-b061-53a98402a47c tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.207226 Jun 25 20:54:03.285756 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 306/575] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 20:54:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:03.292330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-532875d3-23e1-4bf4-9125-b47eb5eded4f req-15a4fa34-11c2-43ae-9f87-34d58146b05d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080923 Jun 25 20:54:03.292986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 270/576] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:03.354420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d1b6e53-5627-45bf-be2e-4ac7ac9d5a2d tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] Action: 'create', calling method: .version_select at 0x7f985c16baf0>, body: {"security_group": {"name": "tempest-securitygroup-1745822408", "description": "tempest-description-1432435121"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:03.513938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:03.514644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:03.527851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.528595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.529395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.530163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.702248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d1b6e53-5627-45bf-be2e-4ac7ac9d5a2d tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.409664 Jun 25 20:54:03.704268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 307/577] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 20:54:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:03.713335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:03.714089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:03.749785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.754790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:03.758963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:03.759451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.010481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.019052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.019293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.020621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.021757 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c189f03e-64a5-4ad3-a5ef-3a49475a82f6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 0.316087 Jun 25 20:54:04.022323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 308/578] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:03 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:04.026936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.027746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.028154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99e20b89-1a32-427c-95a3-cae939c25790 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.521558 Jun 25 20:54:04.030497 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 271/579] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:03 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:04.034439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.034895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.035696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.036640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd7a0058-107e-4f3b-957d-67ac37fc9087 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] Action: 'create', calling method: .version_select at 0x7f985cb41280>, body: {"security_group": {"name": "tempest-securitygroup-351507176", "description": "tempest-description-693381975"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:04.036796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.099360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.107406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb75d7bc-507b-461a-8372-56c4b5753f55 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1274 microversion: 2.1 time: 0.083917 Jun 25 20:54:04.107956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 309/580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:04.121535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.122149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.128201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.128693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.129469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.129892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.182740 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd7a0058-107e-4f3b-957d-67ac37fc9087 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.152331 Jun 25 20:54:04.189956 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 272/581] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 20:54:04 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:04.189956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.189956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.195499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.195953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.196847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.197284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.212683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:04.259779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.267495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4da19a4-c616-42e6-b602-0478a1396ae2 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.149651 Jun 25 20:54:04.268093 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 310/582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:04.273474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.274061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.280209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.280762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.281459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.281890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.348172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.357443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.359065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.364210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23316c40-64ba-429c-807e-e6210d28b791 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.094816 Jun 25 20:54:04.376405 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 311/583] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:04.376405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.376405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.384512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.384962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.385732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.386170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.518197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.532809 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ef86991-6418-4541-ad6b-b79d9892e0f9 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1586 microversion: 2.1 time: 0.348284 Jun 25 20:54:04.536631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 273/584] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1586 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:04.543807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-57aa49de-0387-4f1a-9853-cc63cea05cbd tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] Calling method '.version_select at 0x7f985cbf93a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.774040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:04.781898 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25e14496-11ae-4cf3-a9c7-4f1ca242fb7e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1310 microversion: 2.1 time: 0.415667 Jun 25 20:54:04.782734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 312/585] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1310 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:04.787515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:04.788202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:04.794347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.795001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.795960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:04.796572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:04.929100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a3d8445-8fbb-4579-afdf-5ebbc739a135 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.145116 Jun 25 20:54:04.931792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 313/586] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:05.042801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:05.044539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:05.053277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.054013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:05.056672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.057428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:05.062358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:05.317847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:05.339070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:05.343490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:05.345424 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16cc588e-2c88-4d5c-9673-7c94f27ee06a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 0.309090 Jun 25 20:54:05.349066 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 314/587] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:05 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:05.355556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:05.356866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:05.373489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.379315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:05.381412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.382605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:05.719208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:05.734484 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ce64c7d-8bb7-41da-b5cc-e97cf1d94c73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.383331 Jun 25 20:54:05.746282 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 315/588] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:05 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:05.752376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:05.753109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:05.759913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.760451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:05.761284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:05.761781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.110716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.118590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40030eda-ae1c-4192-a776-1720e1dbf8f7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1274 microversion: 2.1 time: 0.370211 Jun 25 20:54:06.119176 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 316/589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:05 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:06.124061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3e602718-19b2-4d02-b2ca-3b0c3b5035a9 req-dda34e1f-6a91-4c6c-a4b9-d2754f66a986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "name": "network-vif-plugged", "status": "completed", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:06.132856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3e602718-19b2-4d02-b2ca-3b0c3b5035a9 req-dda34e1f-6a91-4c6c-a4b9-d2754f66a986 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.133282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3e602718-19b2-4d02-b2ca-3b0c3b5035a9 req-dda34e1f-6a91-4c6c-a4b9-d2754f66a986 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.145120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3e602718-19b2-4d02-b2ca-3b0c3b5035a9 req-dda34e1f-6a91-4c6c-a4b9-d2754f66a986 service nova] Creating event network-vif-plugged:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch2-master-1 Jun 25 20:54:06.150260 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3e602718-19b2-4d02-b2ca-3b0c3b5035a9 req-dda34e1f-6a91-4c6c-a4b9-d2754f66a986 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029635 Jun 25 20:54:06.151058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 317/590] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:06.155905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:06.156673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:06.163113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.163571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.164852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.165702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.423017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.435701 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-00f638c4-d70f-4b3c-87f7-c5b5e6092150 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.283598 Jun 25 20:54:06.436640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 318/591] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:06 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:06.441899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:06.442762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:06.449179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.449867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.450707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.451298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.560040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.576674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.578801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.602237 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb19f85d-9612-456a-9780-38ba8dd341ed tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.164038 Jun 25 20:54:06.614242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 319/592] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:06 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:06.614242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:06.614242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:06.618557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.619119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.619987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.620526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.860984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:06.878905 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e05eecb-f15e-4061-b975-87eb98a61fd2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1492 microversion: 2.1 time: 0.274937 Jun 25 20:54:06.879505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 320/593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:06 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1492 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:06.887630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:06.888631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:06.897043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.898182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:06.900369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:06.901121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.058282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:07.070364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:07.081728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:07.083807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c747482-8eab-4cd5-8147-9c422514a380 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1361 microversion: 2.25 time: 0.203320 Jun 25 20:54:07.084632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 321/594] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:06 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:07.091490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:07.093293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:07.106442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.107651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.109194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.109851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.277234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:07.285624 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-74e4cd65-5c46-481b-a33e-a46d3820f8e6 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.199601 Jun 25 20:54:07.286530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 322/595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:07 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:07.291004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:07.291700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:07.298098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.298619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.299462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.299978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.454649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:07.471441 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2be77e66-f8f5-411b-be18-1d9b48dc0272 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 200 len: 1586 microversion: 2.1 time: 0.183692 Jun 25 20:54:07.475297 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 323/596] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:07 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 1586 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:07.482086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3572bc95-9ab1-467e-9039-cbbe753bc09c req-41e28def-caea-46f5-bcf4-54628c3ade0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cabdeb25-a01e-4754-813d-31771aad3b7a", "tag": "ddfb9b3f-76b0-41bb-b549-9c7accacfc1b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:07.492821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3572bc95-9ab1-467e-9039-cbbe753bc09c req-41e28def-caea-46f5-bcf4-54628c3ade0d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.493488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3572bc95-9ab1-467e-9039-cbbe753bc09c req-41e28def-caea-46f5-bcf4-54628c3ade0d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.506895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3572bc95-9ab1-467e-9039-cbbe753bc09c req-41e28def-caea-46f5-bcf4-54628c3ade0d service nova] Creating event network-changed:ddfb9b3f-76b0-41bb-b549-9c7accacfc1b for instance cabdeb25-a01e-4754-813d-31771aad3b7a on nch2-master-1 Jun 25 20:54:07.513279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3572bc95-9ab1-467e-9039-cbbe753bc09c req-41e28def-caea-46f5-bcf4-54628c3ade0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036365 Jun 25 20:54:07.517892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 324/597] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:07.683869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:07.685212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:07.694218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.694828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.697243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.698211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.881501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b6c8fdef-1180-42a7-83ad-08184f55b929 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1643 microversion: 2.1 time: 0.362178 Jun 25 20:54:07.882409 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 325/598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:07 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1643 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:07.887285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:07.888139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:07.893894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:07.896055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.896766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:07.897881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:07.898386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.058342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.068081 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e96a221-fbce-4c0e-93e1-e6c9f1d52ff9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.184183 Jun 25 20:54:08.068721 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 326/599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:07 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:08.073942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b4914858-3b54-4587-9c24-f451dbf86cac req-f9a89574-4759-4617-935f-6b7294963a87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d", "tag": "5c076f17-0f48-48db-bda5-c57f1f6e994f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:08.083283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b4914858-3b54-4587-9c24-f451dbf86cac req-f9a89574-4759-4617-935f-6b7294963a87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.084125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b4914858-3b54-4587-9c24-f451dbf86cac req-f9a89574-4759-4617-935f-6b7294963a87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.099432 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b4914858-3b54-4587-9c24-f451dbf86cac req-f9a89574-4759-4617-935f-6b7294963a87 service nova] Creating event network-changed:5c076f17-0f48-48db-bda5-c57f1f6e994f for instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d on nch2-master-1 Jun 25 20:54:08.105121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b4914858-3b54-4587-9c24-f451dbf86cac req-f9a89574-4759-4617-935f-6b7294963a87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034767 Jun 25 20:54:08.106051 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 327/600] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:08.111686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:08.113530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:08.119982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.120159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.121074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.121576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.262401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.270395 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83886227-8e02-43e1-9878-6917d26e9454 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.163156 Jun 25 20:54:08.271710 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 328/601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:08 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:08.278172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:08.279255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:08.285827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.286276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.287320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.287446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.368794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.377894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.379398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.384973 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71586c57-3ac4-45c9-8880-f06f987c6082 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.112388 Jun 25 20:54:08.385874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 329/602] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:08 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:08.390793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:08.391453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:08.397421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.397860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.398617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.399045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.546226 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e9b0c27-4262-49d4-af0b-8c5e4ba7a190 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1643 microversion: 2.1 time: 0.159232 Jun 25 20:54:08.557913 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 330/603] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:08 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1643 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:08.561458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:08.561983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:08.569042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.569495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.570590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.571042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.731987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.740581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.742130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:08.743377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc56e163-5153-4c77-9c8f-95ae054c7faf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1557 microversion: 2.25 time: 0.190344 Jun 25 20:54:08.744192 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 331/604] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:08 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:08.748634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a6b47f-92e4-4bda-aba5-3a732126f241", "name": "network-vif-plugged", "status": "completed", "tag": "a63c9fa3-9247-44ee-86e3-e653c20f9e19"}, {"server_uuid": "9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f", "name": "network-vif-plugged", "status": "completed", "tag": "2e2edaa7-e682-4d9a-8daf-556fe88fa547"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:08.759310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.760384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.774270 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] Creating event network-vif-plugged:a63c9fa3-9247-44ee-86e3-e653c20f9e19 for instance f2a6b47f-92e4-4bda-aba5-3a732126f241 on nch1-master-1 Jun 25 20:54:08.774834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] Creating event network-vif-plugged:2e2edaa7-e682-4d9a-8daf-556fe88fa547 for instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f on nch1-master-1 Jun 25 20:54:08.781664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6441145b-eb34-485b-afee-2ccd37663e87 req-75a50702-0d8e-4a50-97bf-2958639db06a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036403 Jun 25 20:54:08.782498 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 332/605] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:08.788268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:08.789133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:08.795693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.796817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.797236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:08.797796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:08.845076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:09.001540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:09.011124 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59474c3f-2edb-49db-852b-c7bf6dd3cfbb tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.227498 Jun 25 20:54:09.014267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-57aa49de-0387-4f1a-9853-cc63cea05cbd tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11741 microversion: 2.1 time: 4.475707 Jun 25 20:54:09.021796 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 333/606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:08 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:09.028938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.031020 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:09.031020 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:54:09.032447 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 274/607] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 20:54:04 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11741 bytes in 4495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:54:09.033967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.035445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.036536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.037207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.037408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.038362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:09.049147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.049900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.051211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.054374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.066594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d980c268-a56b-4deb-b6fd-aa190801ba0f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043223 Jun 25 20:54:09.073239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 334/608] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:09.078676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d0b6733-15cd-4923-bcd6-c7beba51d435 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] Calling method '.version_select at 0x7f985c196c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.226105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:09.255860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3180dd03-d315-4976-ac1b-f6b14a5b9bd9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 2049 microversion: 2.25 time: 0.222198 Jun 25 20:54:09.257241 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 275/609] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 2049 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:09.265502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:09.268478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:09.276594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d0b6733-15cd-4923-bcd6-c7beba51d435 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.202002 Jun 25 20:54:09.276967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.277518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.278393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.278897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.288274 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 335/610] 10.222.0.39 () {58 vars in 1190 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:09.297873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.303705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:09.308448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lazy-loading 'flavor' on Instance uuid 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:09.315253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.315692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.316546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.316979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.322306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Going to try to live migrate instance to nch1-master-1 {{(pid=137462) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:54:09.488087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:09.496997 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da2710e2-d907-419e-954d-2fe553ed2f0e tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.207348 Jun 25 20:54:09.504591 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 336/611] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:09.504591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.504591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:09.509908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.510395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.511409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.511852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.651200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:09.711399 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cb2a384c-8322-45f7-a84b-6d35fd182e99 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 2049 microversion: 2.25 time: 0.212107 Jun 25 20:54:09.712387 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 337/612] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 2049 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:09.717230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:09.717923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:09.724493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.724885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.725675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:09.726110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:09.859615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:09.867739 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5f7c96a-88a7-4229-9f2d-ebeaa16d0c03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.154336 Jun 25 20:54:09.868376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 338/613] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:09 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:09.872873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db83c45f-fc92-4946-ac8e-daf01d26bf90 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] Calling method '.version_select at 0x7f985c5379d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.036912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db83c45f-fc92-4946-ac8e-daf01d26bf90 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/16016d6d-4d83-404c-8681-3181f46a0ab3" status: 202 len: 0 microversion: 2.1 time: 0.167304 Jun 25 20:54:10.037532 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 339/614] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:54:09 2022] DELETE /compute/v2.1/os-security-groups/16016d6d-4d83-404c-8681-3181f46a0ab3 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:10.044087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.044670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:10.051142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.051600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.052365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.052830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.117080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:10.125258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:10.126752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:10.131744 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79087784-d9fd-4e0a-9ec8-87f1f4f2250f tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.093223 Jun 25 20:54:10.132311 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 340/615] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:10 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:10.136598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.137923 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:10.137923 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:54:10.139103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.139548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.140335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.140795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.163462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54e5ff98-d67e-44a4-996c-3ec37d8419c4 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.030180 Jun 25 20:54:10.164065 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 341/616] 10.222.0.39 () {60 vars in 1216 bytes} [Sat Jun 25 20:54:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:54:10.168377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.169080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:10.174950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.175421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.176144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.176629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.311794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:10.320621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c5f1d36-62a2-4afc-ba93-e1aab646fb6e tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1322 microversion: 2.1 time: 0.155389 Jun 25 20:54:10.321183 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 342/617] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:10 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:10.325800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e402bf5d-cbf4-4df4-8284-af380ceba5c4 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] Calling method '.version_select at 0x7f985c295ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.493290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e402bf5d-cbf4-4df4-8284-af380ceba5c4 tempest-SecurityGroupsTestAdminJSON-1612691976 tempest-SecurityGroupsTestAdminJSON-1612691976-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/291f693b-35c1-46ab-b228-cff88fb66057" status: 202 len: 0 microversion: 2.1 time: 0.170796 Jun 25 20:54:10.498120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 343/618] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:54:10 2022] DELETE /compute/v2.1/os-security-groups/291f693b-35c1-46ab-b228-cff88fb66057 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:10.501719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:10.502954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:10.510394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.511102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.511965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.512383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.591316 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae8869f1-0ab7-4fac-9eda-97493a77158f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5/action" status: 202 len: 0 microversion: 2.25 time: 0.095825 Jun 25 20:54:10.592206 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 344/619] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:54:10 2022] POST /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:54:10.597898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fc4b4cf-618c-4ec3-9924-caa3cf8b1269 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] Calling method '.version_select at 0x7f985c295dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.813292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fc4b4cf-618c-4ec3-9924-caa3cf8b1269 tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/3d023cd5-a76d-45e6-8bb6-b62df60c04c3" status: 202 len: 0 microversion: 2.1 time: 0.219775 Jun 25 20:54:10.814534 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 345/620] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:54:10 2022] DELETE /compute/v2.1/os-security-groups/3d023cd5-a76d-45e6-8bb6-b62df60c04c3 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:10.827496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:10.828987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:10.836438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.837592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:10.838563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:10.839162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.016039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.024853 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a9ff4e8-5e43-43a3-87fc-10069b6e14e9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.208767 Jun 25 20:54:11.039552 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 346/621] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:10 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:11.047188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.047800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.054210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.054898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.055870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.056475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.247739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:11.262102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:11.272313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:11.282933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d58c9e8-721d-4956-8162-42d0132bee40 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 2034 microversion: 2.25 time: 0.240422 Jun 25 20:54:11.284042 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 347/622] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:11 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 2034 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:11.289725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-301dbd7f-1207-491d-9b01-f33a657eec45 req-06516c9c-c963-40be-8e19-3f4cc46ead4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ab884a-b59d-442c-b1c2-3d43353e4a9e", "name": "network-vif-plugged", "status": "completed", "tag": "fa7c0560-1ab7-41bb-8da1-cb540138a79e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:11.298341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-301dbd7f-1207-491d-9b01-f33a657eec45 req-06516c9c-c963-40be-8e19-3f4cc46ead4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.298874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-301dbd7f-1207-491d-9b01-f33a657eec45 req-06516c9c-c963-40be-8e19-3f4cc46ead4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.310512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-301dbd7f-1207-491d-9b01-f33a657eec45 req-06516c9c-c963-40be-8e19-3f4cc46ead4a service nova] Creating event network-vif-plugged:fa7c0560-1ab7-41bb-8da1-cb540138a79e for instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e on nch1-master-1 Jun 25 20:54:11.315712 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-301dbd7f-1207-491d-9b01-f33a657eec45 req-06516c9c-c963-40be-8e19-3f4cc46ead4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029928 Jun 25 20:54:11.316818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 348/623] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:11.322978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9845edc9-3ccb-4c8f-a820-ce3ddf07d4fb tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] Calling method '.version_select at 0x7f985c5b2af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.517092 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf3475ac-8220-490b-92b9-5eb6debf3f14 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0/action" status: 202 len: 0 microversion: 2.1 time: 2.258352 Jun 25 20:54:11.517951 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 276/624] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:09 2022] POST /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0/action => generated 0 bytes in 2260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:11.523309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.524121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.537451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.537906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.538794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.539700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.591882 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9845edc9-3ccb-4c8f-a820-ce3ddf07d4fb tempest-SecurityGroupsTestAdminJSON-804594286 tempest-SecurityGroupsTestAdminJSON-804594286-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/2a147fa6-d2a7-4b22-be87-8d68ace79a12" status: 202 len: 0 microversion: 2.1 time: 0.273863 Jun 25 20:54:11.593072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 349/625] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:54:11 2022] DELETE /compute/v2.1/os-security-groups/2a147fa6-d2a7-4b22-be87-8d68ace79a12 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:11.599554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.600757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.614741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.615431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.616402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.617904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.687896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.698176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.701073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.707687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6497dd45-53ac-4c01-8356-4114659ac4d0 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.113045 Jun 25 20:54:11.721012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 350/626] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:11 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:11.726443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:11.727847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.736014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.738336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.738795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.739640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.740080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.745281 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b0c007c3-f718-4f3a-a32f-4ed80a79c027 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1318 microversion: 2.1 time: 0.226024 Jun 25 20:54:11.755263 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 277/627] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:11 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:11.761009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.761770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.768770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.770970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.771952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.772694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.823302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'flavor' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:11.871309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Going to try to live migrate instance to nch1-master-1 {{(pid=137461) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:54:11.939369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:11.948198 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-196c26b5-cadd-4144-a5e1-3362c885c925 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1471 microversion: 2.1 time: 0.191706 Jun 25 20:54:11.948815 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 278/628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:11 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:11.965972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:11.966848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:11.973151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.973601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:11.974552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:11.974988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:12.128810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:12.137977 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e8695869-c34a-42ec-8732-99281e39c567 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.176236 Jun 25 20:54:12.148515 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 279/629] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:11 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:12.390754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:12.391831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: 78bad1d0-0979-40a1-bd68-fb53388ee3ee] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:12.398474 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] HTTP exception thrown: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Request method failure captured: Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/78bad1d0-0979-40a1-bd68-fb53388ee3ee/action HTTP/1.1 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 15 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3XbmZNgDob_l16gbocOQfEQpWWYBKjRYU3g4x346xcbVO_OCxZkzMnLU4A-gnGwlycaAfeVzEHjfmAdkdpIHjHb67SIltqMkXrYrljo-zVmgFzLxWWfWgJ8HZEfG0bAlx5yWBgHnuuprSdRXElF6s6vM1wtlrAYczNZ_0SquSCYSvM Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:12.400473 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20751ea751214751af64f3f053198949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20751ea751214751af64f3f053198949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}] Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 026230b7926140c1859a630ebe633242 Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: {"migrate": {}} Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:12.402246 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '78bad1d0-0979-40a1-bd68-fb53388ee3ee', 'body': {'migrate': {}}} Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:12.403436 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. Jun 25 20:54:12.405582 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:12.407445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Returning 404 to user: Instance 78bad1d0-0979-40a1-bd68-fb53388ee3ee could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:12.407445 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d5ec34c-9e05-456f-8ac8-707faa9cdeeb tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/78bad1d0-0979-40a1-bd68-fb53388ee3ee/action" status: 404 len: 111 microversion: 2.1 time: 0.261978 Jun 25 20:54:12.407445 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 280/630] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:12 2022] POST /compute/v2.1/servers/78bad1d0-0979-40a1-bd68-fb53388ee3ee/action => generated 111 bytes in 263 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:54:12.407778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:12.408292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:12.416408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:12.420880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:12.421901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:12.422350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:12.641362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:12.650006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-161d5116-5631-4e44-9df7-553e9d655693 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.246198 Jun 25 20:54:12.650952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 281/631] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:12 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:12.656454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1137341473", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:12.710758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:13.141984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:13.142473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:13.143375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:13.145034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:13.145586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:13.176603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.177228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.178690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.179127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.202564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Getting quotas for project ea50e527346c47a2b3c0f7362ff5449b. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:13.208314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Getting quotas for user af65f7ab19604ee1841ce4ae7e65a994 and project ea50e527346c47a2b3c0f7362ff5449b. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:13.242942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:13.245483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:13.316565 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d9d16d0-0a99-4fd6-a291-0efc1c14c422 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660286 Jun 25 20:54:13.323997 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 282/632] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:13.331901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:13.340633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:13.360961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.367901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.368946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.369385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.502811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:13.518394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:13.519902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:13.539026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff51b79f-4d40-41a8-a169-155fb52e4355 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.212515 Jun 25 20:54:13.544581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 283/633] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:13 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:13.551118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:13.552464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:13.560133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.561008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.562300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.562749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.859084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:13.873947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d416efca-6966-4b33-b927-5eb2d3d586d7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1468 microversion: 2.1 time: 0.326038 Jun 25 20:54:13.874716 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 284/634] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:13 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1468 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:13.894658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:13.895485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:13.916837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.917322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:13.918141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:13.918583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.144956 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbd86303-ebc7-47b6-b581-1c18fc3d7c61 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5/action" status: 202 len: 0 microversion: 2.25 time: 2.421716 Jun 25 20:54:14.146476 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 351/635] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:54:11 2022] POST /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5/action => generated 0 bytes in 2425 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:54:14.152206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.153261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:14.170001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.170459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.171239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.171679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.263129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.272947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d7adbcbc-e445-405a-b9db-540310ab84f1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1218 microversion: 2.1 time: 0.125268 Jun 25 20:54:14.274248 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 352/636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:14.279719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.280557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:14.287215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.287895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.289242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.289683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.321620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.328970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:14.334299 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c59c6d20-b852-49a1-a1b3-ea9ca7a4c910 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.457429 Jun 25 20:54:14.338217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 285/637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:13 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:14.355949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.357015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:14.386429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.389863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.390903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.391823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.503161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.523172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67de8fb2-48bd-4173-96d5-dd9eade688d2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.236590 Jun 25 20:54:14.523172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 353/638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:14.523172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e5c5127e-f2d6-446c-accb-5c843b0354e0 req-99c6d91e-ceae-49bf-b799-b320ec2addcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "name": "network-vif-unplugged", "status": "completed", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:14.539157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e5c5127e-f2d6-446c-accb-5c843b0354e0 req-99c6d91e-ceae-49bf-b799-b320ec2addcd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.539577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e5c5127e-f2d6-446c-accb-5c843b0354e0 req-99c6d91e-ceae-49bf-b799-b320ec2addcd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.568690 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e5c5127e-f2d6-446c-accb-5c843b0354e0 req-99c6d91e-ceae-49bf-b799-b320ec2addcd service nova] Creating event network-vif-unplugged:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch2-master-1 Jun 25 20:54:14.576138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e5c5127e-f2d6-446c-accb-5c843b0354e0 req-99c6d91e-ceae-49bf-b799-b320ec2addcd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061622 Jun 25 20:54:14.577404 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 354/639] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:14.583887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.584918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:14.594990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.595833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.596901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.597571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.702858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.727836 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3381e9bb-e33b-4a9a-8b72-f5b6a5c66dce tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 200 len: 1468 microversion: 2.1 time: 0.385408 Jun 25 20:54:14.728734 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 286/640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 1468 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:14.744451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.750601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:14.770818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.772133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.775910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.777552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.855218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.866617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.868194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.869402 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a48d71e-8b55-49a9-a300-66a5be9d2f30 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.290525 Jun 25 20:54:14.876593 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 355/641] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:14.883181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:14.889971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.897394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Searching by: {'reservation_id': 'r-j2brigs0', 'deleted': False, 'project_id': '29037675b33a4f318e1fcafc33b6bed5'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:54:14.905588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.906330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.907373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:14.908254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:14.922708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.942182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.945254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:14.954786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1057f73-82f5-4b97-afe4-3c5e4c27bb2d tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.224395 Jun 25 20:54:14.956203 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 287/642] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:15.104974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:54:15.168983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.170505 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:15.170505 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:54:15.171722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.172167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.173286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.174769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.207564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:15.208463 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ac05d08-3d49-403a-a0b4-c1f3a38223d2 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.186466 Jun 25 20:54:15.209645 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 288/643] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/os-services => generated 947 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:54:15.220158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.220946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.223530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.224672 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:15.224672 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:54:15.225911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.226717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.227636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.228637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.273661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d8887fe-e258-4785-9f42-fd552b0b251c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.055277 Jun 25 20:54:15.276881 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 289/644] 10.222.0.39 () {58 vars in 1173 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:15.290044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.292093 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:15.292093 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:54:15.293616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.294048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.294930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.295540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.322164 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d40cddc-8132-44ae-bb4a-2afcafaee233 tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037555 Jun 25 20:54:15.329335 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 290/645] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:54:15.333718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.334410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:15.344460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.344982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.345652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.346332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.389564 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e097cf7-56c4-444b-91be-759c56989a89 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-j2brigs0" status: 200 len: 2929 microversion: 2.1 time: 0.511090 Jun 25 20:54:15.390605 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 356/646] 10.222.0.39 () {58 vars in 1196 bytes} [Sat Jun 25 20:54:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-j2brigs0 => generated 2929 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:15.395278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.396651 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:54:15.396651 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:54:15.398377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.399059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.400092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.401045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.426646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f678601d-5baf-4e5e-ae30-e9393abfcb3c tempest-ServicesAdminTestJSON-1414565463 tempest-ServicesAdminTestJSON-1414565463-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034762 Jun 25 20:54:15.427279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 357/647] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/os-services => generated 947 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:15.432055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6d619d55-af97-4bfb-b093-634fe618d41b req-08166f38-a896-4d74-bd57-664582a5d5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d", "name": "network-vif-plugged", "status": "completed", "tag": "5c076f17-0f48-48db-bda5-c57f1f6e994f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:15.437096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:15.450058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6d619d55-af97-4bfb-b093-634fe618d41b req-08166f38-a896-4d74-bd57-664582a5d5dd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.450329 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9cef5be8-06ee-47e1-a375-8d9b7e2fa00a tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1280 microversion: 2.1 time: 0.120481 Jun 25 20:54:15.451091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6d619d55-af97-4bfb-b093-634fe618d41b req-08166f38-a896-4d74-bd57-664582a5d5dd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.461116 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 291/648] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1280 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:15.467480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.468098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:15.471564 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6d619d55-af97-4bfb-b093-634fe618d41b req-08166f38-a896-4d74-bd57-664582a5d5dd service nova] Creating event network-vif-plugged:5c076f17-0f48-48db-bda5-c57f1f6e994f for instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d on nch2-master-1 Jun 25 20:54:15.475108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.475571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.477030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.477478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.488630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6d619d55-af97-4bfb-b093-634fe618d41b req-08166f38-a896-4d74-bd57-664582a5d5dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059439 Jun 25 20:54:15.490626 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 358/649] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:15.496704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:15.501270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-342d05a7-c549-4b50-b894-228b90d3e67d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.542317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_groups [None req-342d05a7-c549-4b50-b894-228b90d3e67d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Querying cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) for 2 instances {{(pid=137461) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 25 20:54:15.543124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-342d05a7-c549-4b50-b894-228b90d3e67d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.543565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-342d05a7-c549-4b50-b894-228b90d3e67d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.575326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-342d05a7-c549-4b50-b894-228b90d3e67d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/525c24a0-e807-4c3f-820f-5e4f8a95c0c7" status: 200 len: 265 microversion: 2.1 time: 0.082483 Jun 25 20:54:15.576183 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 359/650] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/os-server-groups/525c24a0-e807-4c3f-820f-5e4f8a95c0c7 => generated 265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:15.587657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.593135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:15.607181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.607742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.608645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.609093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.746717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:15.760693 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c657a083-3441-42c0-abb8-97b6fb6d2125 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.296802 Jun 25 20:54:15.761856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 292/651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:15.767283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:15.775040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.775415 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1f1a6f75-d74a-465e-a261-75be5bbb81f9 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.197814 Jun 25 20:54:15.776531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:15.776669 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 360/652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:15.785404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.785795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.786694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.787227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.892088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:15.892934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:15.899791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.900577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:15.901865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:15.902403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.023252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00062e93-154b-4dab-81c1-4124bc2bfaf5 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 200 len: 1619 microversion: 2.1 time: 0.260063 Jun 25 20:54:16.035094 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 293/653] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 1619 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:16.035094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:16.035094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:16.041882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.042379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.043375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.043976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.089658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.100240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.102044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.103347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e750fcb-1b22-4ba8-8553-86d1eae721c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.216103 Jun 25 20:54:16.114062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 361/654] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:15 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:16.114062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:16.114062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:16.127313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.127825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.128610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.129053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.198541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.210335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.212526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.219226 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce171300-f3a4-4a6d-9b8c-110017630a6a tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.192750 Jun 25 20:54:16.229381 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 294/655] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:16 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:16.357916 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f7586ae9-0450-4d1e-bce3-d2eda137bcfb tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 200 len: 1619 microversion: 2.1 time: 0.252416 Jun 25 20:54:16.368943 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 362/656] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:16 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 1619 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:16.375780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: .version_select at 0x7f985cacbdc0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-851597391", "policies": ["anti-affinity"]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:16.393817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:16.398588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:16.414124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:16.441411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:16.445102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:16.456489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e4eeb0c-61c1-43b1-95a4-60ea36eaa952 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.084657 Jun 25 20:54:16.457272 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 295/657] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 20:54:16 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:54:16.467729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:16.468549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:16.475804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.476081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.476900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.477584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.604958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0aaebcf4-77ae-46a5-b86f-c21cf2ed4b87 req-e4de9aed-3e4e-4b9f-977e-2c8651983d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:16.616189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0aaebcf4-77ae-46a5-b86f-c21cf2ed4b87 req-e4de9aed-3e4e-4b9f-977e-2c8651983d38 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.616674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0aaebcf4-77ae-46a5-b86f-c21cf2ed4b87 req-e4de9aed-3e4e-4b9f-977e-2c8651983d38 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.644081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0aaebcf4-77ae-46a5-b86f-c21cf2ed4b87 req-e4de9aed-3e4e-4b9f-977e-2c8651983d38 service nova] Creating event network-changed:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch2-master-1 Jun 25 20:54:16.654249 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0aaebcf4-77ae-46a5-b86f-c21cf2ed4b87 req-e4de9aed-3e4e-4b9f-977e-2c8651983d38 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054791 Jun 25 20:54:16.657030 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 296/658] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:54:16.668664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.672198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1043716317", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a1c91e95-03c1-4e27-a42b-fd4fe8c669d8"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:16.677705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eed585f6-0539-4539-914e-ac11963deda2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.214188 Jun 25 20:54:16.678295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 363/659] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:16 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:16.729463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:16.778618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:16.779165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:16.787457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.788197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.789352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:16.790451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:16.985153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:16.995155 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9be0d302-6404-49a4-b54c-5fbbaf9a93d6 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.220846 Jun 25 20:54:16.997390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 364/660] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:16 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:17.010821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:17.011722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:17.021416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.021598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.022953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.023545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.213135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.227036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1824d31a-25ba-4728-9815-5b6b2378d5e2 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1316 microversion: 2.1 time: 0.228329 Jun 25 20:54:17.231197 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 365/661] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:16 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1316 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:17.241886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:17.242888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:17.250709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.251572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.252628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.253286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.483063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.492884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.495205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.496702 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-50e17169-a88b-4f65-b8e5-bb32615afbea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.263515 Jun 25 20:54:17.506231 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 366/662] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:17 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:17.506231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:17.506231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:17.510548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.511335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.511934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.512452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.543456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:17.544546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:17.545178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:17.545752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:17.546169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:17.564323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.564841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.565673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.566100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.587748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:17.593805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:17.599856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.617259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.619256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.620824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 2 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:17.625186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:17.630239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8679c075-a66d-4b3f-8018-beafc6add2f8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.130433 Jun 25 20:54:17.634130 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 367/663] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:17 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:17.683421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:17.687950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:17.697321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:17.698178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:17.707919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.709039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.710162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:17.710805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:17.783028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:17.792268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:17.807858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=d7ae147d-be89-4776-a815-ca4d5daf079c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:17.890860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:17.895616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:17.916056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:17.928941 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bd7c671-cc15-4a64-bedc-2608446c162b tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.238228 Jun 25 20:54:17.930070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 368/664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:17 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:17.973610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:17.979969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:18.014024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.014707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.021141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.021723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.022660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.023096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.030097 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5c70bf7-feec-4dcf-bfa7-fbb765c12053 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.370600 Jun 25 20:54:18.037612 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 297/665] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:16 2022] POST /compute/v2.1/servers => generated 32 bytes in 1380 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 25 20:54:18.050295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.057003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.057807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Searching by: {'deleted': False, 'project_id': '29037675b33a4f318e1fcafc33b6bed5'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:54:18.090193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.090860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.091855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.092473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.212567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:54:18.230743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.256008 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3a339a6-33e3-4d64-a382-c847435efedd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.242828 Jun 25 20:54:18.277312 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 369/666] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:18.292746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.293502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.309107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.309107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.309107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.309369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.495372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.505665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c354ee3-439e-4d3c-aa1c-91237fb303c7 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1505 microversion: 2.1 time: 0.225903 Jun 25 20:54:18.506810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 370/667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:18.515959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.516940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.520462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:18.525720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.526747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.528117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.528748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.595949 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-babefb05-e412-43f7-8210-42c7268322be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.556868 Jun 25 20:54:18.603147 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 298/668] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers => generated 1663 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:18.603147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.603147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.610951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.612080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.612207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.613144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.668996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.670230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db37d1de-5a34-42b8-afc1-14a86ed76e10 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/os-instance-actions/req-70a0a387-e372-4c6b-a877-a36bbe50fda0" status: 200 len: 313 microversion: 2.1 time: 0.072410 Jun 25 20:54:18.679155 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 299/669] 10.222.0.39 () {58 vars in 1418 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/os-instance-actions/req-70a0a387-e372-4c6b-a877-a36bbe50fda0 => generated 313 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:18.685213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-37f9d000-5e0f-4675-895a-8daad2f6989c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.685902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-37f9d000-5e0f-4675-895a-8daad2f6989c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.712100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.715917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:18.724334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.726122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.727441 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1166c04e-d27f-4824-abaa-5dfc94bcad5d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.215359 Jun 25 20:54:18.738120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 371/670] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:18.738120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.738120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.751352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.752158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.753122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.753582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.754243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-37f9d000-5e0f-4675-895a-8daad2f6989c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.762465 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-37f9d000-5e0f-4675-895a-8daad2f6989c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1219 microversion: 2.1 time: 0.081817 Jun 25 20:54:18.763288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 300/671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:18.768201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0160bc50-6515-48ec-9de8-f3a87fdf6f3c req-0b1b963e-8cdb-419b-9871-83d528560bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e4acd6-ee50-4335-b679-8d8222def197", "tag": "7ce75e06-ab3d-4833-934f-bbf1dd90ffbc"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:18.778878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0160bc50-6515-48ec-9de8-f3a87fdf6f3c req-0b1b963e-8cdb-419b-9871-83d528560bf9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.779382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0160bc50-6515-48ec-9de8-f3a87fdf6f3c req-0b1b963e-8cdb-419b-9871-83d528560bf9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.791720 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0160bc50-6515-48ec-9de8-f3a87fdf6f3c req-0b1b963e-8cdb-419b-9871-83d528560bf9 service nova] Creating event network-changed:7ce75e06-ab3d-4833-934f-bbf1dd90ffbc for instance b5e4acd6-ee50-4335-b679-8d8222def197 on nch2-master-1 Jun 25 20:54:18.797028 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0160bc50-6515-48ec-9de8-f3a87fdf6f3c req-0b1b963e-8cdb-419b-9871-83d528560bf9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Jun 25 20:54:18.797963 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 301/672] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:18.810571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:18.811656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.824049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.825550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.826627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.827423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.844648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.854776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.856898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:18.863151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6fbe586c-d540-4be6-bbe9-1406f6c386a2 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.133606 Jun 25 20:54:18.864129 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 372/673] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:18.927803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ec7f4e6-419b-4aac-8e1d-f74f79236901 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "POST /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/action" status: 202 len: 0 microversion: 2.1 time: 0.128138 Jun 25 20:54:18.928970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 302/674] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:18 2022] POST /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:18.938563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.939301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.948801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:18.949637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:18.951935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.952766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.954228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.954979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.956846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.957526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:18.958819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:18.959315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.125360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:19.128160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:19.134773 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d1484ef-6bb5-47bc-a5a0-9930f3f994a2 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.191932 Jun 25 20:54:19.135683 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 303/675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:19.145275 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25ef101c-6872-4c5b-8d4f-d7a85e77e69c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1507 microversion: 2.1 time: 0.202705 Jun 25 20:54:19.145275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 373/676] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:18 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:19.287281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:19.288368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:19.295803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.296519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.297301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.297751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.441791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:19.449903 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89303e26-f142-4234-985d-5ec4318aac81 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.166729 Jun 25 20:54:19.450763 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 374/677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:19 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:19.746128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:19.746791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:19.749804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:19.756039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.756587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.757381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.758010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.785231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:19.785797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:19.824456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.825208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.825800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:19.826464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:19.968576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:19.980997 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fd431f1a-8462-40f1-bd88-9dcff29c448d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1279 microversion: 2.1 time: 0.203691 Jun 25 20:54:19.991108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 375/678] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:19 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1279 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:20.001206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:20.002071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:20.009693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.010675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.011725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.012315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.067758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.077846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.084824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.086805 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-26a1422f-3ad5-4976-9cf2-7adf150a4eea tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.344548 Jun 25 20:54:20.087949 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 304/679] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:19 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:20.153681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:20.154564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:20.170014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.172514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.173899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.175650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.474905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.484158 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94aeff8d-8b35-46a4-8838-42ab02988f35 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.334985 Jun 25 20:54:20.496896 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 305/680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:20 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:20.496896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:20.496896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:20.500503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.501691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.502173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.502344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.502785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.515770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.517669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.526620 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0e0b9bda-11e3-4635-b45c-662b7bb6a60b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.533772 Jun 25 20:54:20.528557 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 376/681] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:19 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:20.534923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:20.536411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:20.545970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.546687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.549575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:20.550928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:20.828906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.839384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-493db5f0-ccb7-4d84-95b1-2fed89940158 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.309506 Jun 25 20:54:20.850917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 377/682] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:20 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:20.949267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:20.961029 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dde62092-aed4-46fe-82b7-ca72763a071c tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1507 microversion: 2.1 time: 0.471731 Jun 25 20:54:20.968624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 306/683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:20 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:21.003233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:21.004084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:21.018513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.021160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.022137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.023671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.123905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:21.128981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:21.139751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:21.141922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.151508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.152317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.157044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.174076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecabb890-b39f-4953-a41f-2e7db5a01350 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1277 microversion: 2.1 time: 0.175968 Jun 25 20:54:21.181137 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 378/684] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:20 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:21.505913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:21.512532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:21.551542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.552021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.556201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.562305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.835542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:21.858658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:21.860268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:21.861550 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-077d9eaa-8317-4184-87e5-dfea0b62d063 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.756749 Jun 25 20:54:21.872378 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 307/685] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:21 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:21.879416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:21.880882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:21.921583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.923154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:21.924174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:21.924913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.163363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.176328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.178057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.187247 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a568a601-eb01-4087-9acd-a85fae9353b5 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1446 microversion: 2.75 time: 0.313213 Jun 25 20:54:22.188741 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 308/686] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:21 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1446 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:22.201331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:22.202354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:22.219761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.221413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.224272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.227493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.269994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.282206 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8c8ab6a-4468-4f3d-aa0b-d9eaaf5eec5d tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.779575 Jun 25 20:54:22.289492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 379/687] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:21 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:22.294231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:22.294875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:22.308810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.309290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.310082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.310525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.559626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.568249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af51a139-cf24-4040-b4f9-2ff3cde95c46 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1507 microversion: 2.1 time: 0.281635 Jun 25 20:54:22.568887 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 380/688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:22 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:22.576588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:22.577657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:22.585547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.586286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.587854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.588524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.827671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:22.839788 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8c64e28-0aa1-4a6b-8ded-690b9d587b97 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.269617 Jun 25 20:54:22.840901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 381/689] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:22 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:22.895902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:22.898649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:22.908942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.909804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:22.911185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:22.911876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.115704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.155737 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8953e990-0d27-4089-96a5-9d2d851202cf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.965616 Jun 25 20:54:23.156359 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 309/690] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:22 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:23.169599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-20392f6d-b232-4e2a-b1d6-bb33f0bef90d req-f669b6da-28e1-48c7-8c55-c5cb9b5a3442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "name": "network-vif-unplugged", "status": "completed", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:23.180981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-20392f6d-b232-4e2a-b1d6-bb33f0bef90d req-f669b6da-28e1-48c7-8c55-c5cb9b5a3442 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.181930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-20392f6d-b232-4e2a-b1d6-bb33f0bef90d req-f669b6da-28e1-48c7-8c55-c5cb9b5a3442 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.197548 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-20392f6d-b232-4e2a-b1d6-bb33f0bef90d req-f669b6da-28e1-48c7-8c55-c5cb9b5a3442 service nova] Creating event network-vif-unplugged:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch2-master-1 Jun 25 20:54:23.204076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-20392f6d-b232-4e2a-b1d6-bb33f0bef90d req-f669b6da-28e1-48c7-8c55-c5cb9b5a3442 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046132 Jun 25 20:54:23.205552 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 310/691] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:23.212959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:23.214090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:23.224811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.225556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.226575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.227293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.339718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.359354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.372263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.398317 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8995c2bb-3807-4ee7-8501-36f496bd5dbe tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1452 microversion: 2.75 time: 0.188505 Jun 25 20:54:23.399933 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 311/692] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:23 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:23.403196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.415299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.417738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.421498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7dccbe2e-2880-4758-ade6-63341107c8a3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.535767 Jun 25 20:54:23.422103 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 382/693] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:22 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:23.445746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:23.447550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:23.473707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.477497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.479276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.483095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.537688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:23.586940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:23.587835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:23.604277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.606931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.608615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.612741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.918313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:23.941158 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51477bab-64ea-433d-b15a-2f5f78da0704 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1507 microversion: 2.1 time: 0.357248 Jun 25 20:54:23.943267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 383/694] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:23 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:23.957229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:23.958248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:23.971663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.975474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:23.976829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:23.977528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.119837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.137307 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aef57770-18e0-42c3-b392-418c1f697e21 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.733635 Jun 25 20:54:24.138250 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 312/695] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:23 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:24.173539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:24.175021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:24.182517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.183599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.184856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.185544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.515267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.524211 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-751eafaa-e966-4df9-998a-280ee6d104f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.354548 Jun 25 20:54:24.535002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.536401 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 313/696] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:24 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:24.542324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:24.543111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:24.544722 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dea28edd-d409-423d-9749-f76f1359260a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.599022 Jun 25 20:54:24.547507 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 384/697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:23 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:24.555374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:24.555992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:24.558351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.558791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.559579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.560038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.565777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.565777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.566786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.567250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:24.712539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.733343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.734340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.739874 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-679d5379-82b6-477e-b5f7-0e319208aa40 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1452 microversion: 2.75 time: 0.202024 Jun 25 20:54:24.745103 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 314/698] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:24 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1452 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:24.891284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.906500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.911171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:24.912552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2bdda488-c0da-49fc-bbdc-a4183a882c6d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.364060 Jun 25 20:54:24.918856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 385/699] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:24 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:24.967567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:24.968291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:24.994577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:24.998303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.001405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.005134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.157610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:25.159511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:25.181377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.183984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.184902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.185754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.229169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:25.411572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:25.630224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:25.644440 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de937f51-e49d-438b-b22d-c0179d750407 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.490759 Jun 25 20:54:25.645526 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 386/700] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:25 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:25.670740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:25.671894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:25.682513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.683239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.684241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.684898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.697987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:25.707987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c844207f-6fc8-446f-98fa-c06976eb274a tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1505 microversion: 2.1 time: 0.744280 Jun 25 20:54:25.708612 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 315/701] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:24 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1505 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:25.726129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:25.726653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:25.748000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.748566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:25.749240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:25.749672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.209214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.222645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94bde50d-0124-46ff-864f-d8201dd9df0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.564200 Jun 25 20:54:26.224227 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 387/702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:25 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:26.229763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f617ec0b-29b9-4d40-8dbe-836523daa11f req-72c74632-f2aa-49d4-b9bd-e4d3c70a4ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e4acd6-ee50-4335-b679-8d8222def197", "name": "network-vif-plugged", "status": "completed", "tag": "7ce75e06-ab3d-4833-934f-bbf1dd90ffbc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:26.254640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f617ec0b-29b9-4d40-8dbe-836523daa11f req-72c74632-f2aa-49d4-b9bd-e4d3c70a4ff1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.263546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f617ec0b-29b9-4d40-8dbe-836523daa11f req-72c74632-f2aa-49d4-b9bd-e4d3c70a4ff1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.289723 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f617ec0b-29b9-4d40-8dbe-836523daa11f req-72c74632-f2aa-49d4-b9bd-e4d3c70a4ff1 service nova] Creating event network-vif-plugged:7ce75e06-ab3d-4833-934f-bbf1dd90ffbc for instance b5e4acd6-ee50-4335-b679-8d8222def197 on nch2-master-1 Jun 25 20:54:26.307131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f617ec0b-29b9-4d40-8dbe-836523daa11f req-72c74632-f2aa-49d4-b9bd-e4d3c70a4ff1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081265 Jun 25 20:54:26.308076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 388/703] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:26.316954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '.version_select at 0x7f985cb55ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:26.328624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:26.345708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.347067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.348009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.348617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.396234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:26.429068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7f2382e-1e7c-4006-af68-b46acb473ff6 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.117010 Jun 25 20:54:26.435621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 389/704] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 20:54:26 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d/os-instance-actions => generated 611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:26.439589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:26.440324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:26.448337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.449292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.450205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.451065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.631891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.647489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.649417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.655688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10369b9c-7d6e-4c06-aa21-0cc2d88f6277 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1437 microversion: 2.75 time: 0.224084 Jun 25 20:54:26.657108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 390/705] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:26 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1437 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:26.661857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:26.662657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:26.669814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.670257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.671157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.671591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.838650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.840469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.847224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-853e3f16-385d-46dd-b1b3-91e3483d65d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 1.125006 Jun 25 20:54:26.847815 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 316/706] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:25 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:26.853050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.853231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:26.853564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:26.855703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:26.858019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3daf716b-424d-4528-afff-f619fd9248bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.199979 Jun 25 20:54:26.860020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.860505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.861468 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 391/707] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:26 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:26.861642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.862357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.868951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:26.869931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:26.878330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.878785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.879555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:26.879982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:26.906346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:54:27.079982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:27.095471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-798ba206-2101-456f-ac53-fa746ff6d14f tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.232521 Jun 25 20:54:27.096671 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 392/708] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:26 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:27.144475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51a84606-c68c-49b8-9d1c-32f28878e040 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 204 len: 0 microversion: 2.1 time: 0.295118 Jun 25 20:54:27.146086 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 317/709] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:54:26 2022] DELETE /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:54:27.157157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:27.160178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:27.174501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.175464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.177614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.178462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.464318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:27.466288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:27.491210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.491852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.493845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.494377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.654956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:27.657575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:27.658502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:27.660106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:27.661238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:27.801149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:27.809275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.810156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.811435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.812076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.931295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:27.943690 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a495fbde-2fa3-4bb8-9598-211209e1ef65 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1511 microversion: 2.1 time: 0.790446 Jun 25 20:54:27.944347 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 318/710] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:27 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1511 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:27.955286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:27.956666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:27.970027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.970420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:27.971293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:27.981227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.004721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:28.058198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e565738e-21f3-4be1-b600-2f26e845f98b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c/action" status: 202 len: 1940 microversion: 2.75 time: 0.960076 Jun 25 20:54:28.061029 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 393/711] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:54:27 2022] POST /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c/action => generated 1940 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 25 20:54:28.066721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d750021c-daa7-4f9e-b556-c6eb1c4f8188 req-9498f761-0dfb-485d-bd8b-ea66957cff9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79660644-1704-46b2-bf7d-9bc0b2626c80", "tag": "6e5e7147-ad33-4a9b-ab77-5a18067580bf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:28.081482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d750021c-daa7-4f9e-b556-c6eb1c4f8188 req-9498f761-0dfb-485d-bd8b-ea66957cff9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.082316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d750021c-daa7-4f9e-b556-c6eb1c4f8188 req-9498f761-0dfb-485d-bd8b-ea66957cff9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.108055 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d750021c-daa7-4f9e-b556-c6eb1c4f8188 req-9498f761-0dfb-485d-bd8b-ea66957cff9d service nova] Creating event network-changed:6e5e7147-ad33-4a9b-ab77-5a18067580bf for instance 79660644-1704-46b2-bf7d-9bc0b2626c80 on nch1-master-1 Jun 25 20:54:28.114509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d750021c-daa7-4f9e-b556-c6eb1c4f8188 req-9498f761-0dfb-485d-bd8b-ea66957cff9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051879 Jun 25 20:54:28.115449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 394/712] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:28.124533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:28.125571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:28.135160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.135720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.137286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.137996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.164070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:28.364227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.374957 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f91705f-f530-4595-be51-66ef0ae8fe0b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.256071 Jun 25 20:54:28.376564 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 395/713] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:28 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:28.391453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:28.392133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:28.403542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.403791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.404635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.406165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.453802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.463869 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51c6e09c-5cff-486c-8b8c-e939cec2867b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1502 microversion: 2.1 time: 0.518393 Jun 25 20:54:28.474820 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 319/714] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:27 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1502 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:28.480127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:28.481211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:28.489765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.490199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.491226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.491996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.634626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.646371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.648163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.649592 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ac4f3ef-cdb1-4fcb-84ac-6c35d131f693 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.271738 Jun 25 20:54:28.650356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 396/715] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:28 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:28.655227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:28.655838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:28.662864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.663385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.664573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.665002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.740020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:28.774433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=38 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:28.786841 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd5c00a9-a89d-4f7a-8fee-98fd7d404d8b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.310431 Jun 25 20:54:28.799130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 320/716] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:28 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:28.881314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:28.890188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c5255f3-2d2a-4c56-87b4-aaa016c44c79 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1322 microversion: 2.1 time: 0.238981 Jun 25 20:54:28.892159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 397/717] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:28 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:28.962490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:28.963113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:28.969520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.970068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:28.971881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:28.972622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.393614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:29.394219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:29.403761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.404211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.406171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.414495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.616016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:29.629538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ceb72fd-1935-476e-8be3-df2ccb5667c6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.240321 Jun 25 20:54:29.634278 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 398/718] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:29 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:29.650265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:29.650889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:29.678040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.683290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.685283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.687208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.781817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:29.794887 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00ad9d8e-c7f5-44a6-8ea3-b213e67e9a44 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1511 microversion: 2.1 time: 0.835887 Jun 25 20:54:29.796929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 321/719] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:28 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1511 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:29.804137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:29.805312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:29.827084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.828511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.829906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.830884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.925793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:29.934894 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29c5f858-38c5-4f11-b85c-2c32eabf5dec tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1492 microversion: 2.1 time: 0.299349 Jun 25 20:54:29.947599 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 399/720] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:29 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1492 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:29.953670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:29.954471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:29.964984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.965884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:29.966884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:29.967902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.117937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:30.144284 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb9f9b4a-874f-418a-be0d-5cc32576effd tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.195172 Jun 25 20:54:30.144970 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 400/721] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:29 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:30.161504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:30.162137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:30.169365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.169888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.170748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.171188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.510984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:30.522459 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4cc2fe6-5d99-4df7-a941-3dc185a0f3f3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1472 microversion: 2.1 time: 0.368303 Jun 25 20:54:30.522631 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 401/722] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:30 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1472 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:30.547791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1794ed3d-32ae-480c-8622-2668100dcebe tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '.version_select at 0x7f985c0cd9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:30.550696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1794ed3d-32ae-480c-8622-2668100dcebe tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.550940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1794ed3d-32ae-480c-8622-2668100dcebe tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.592306 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1794ed3d-32ae-480c-8622-2668100dcebe tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1163 microversion: 2.1 time: 0.052692 Jun 25 20:54:30.593034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 402/723] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:54:30 2022] GET /compute/v2.1/os-migrations => generated 1163 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:30.611158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1693653f-b6a4-4251-bd45-cba9aefd86ba req-50378a58-6f01-4a36-a491-c5450334b0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ae147d-be89-4776-a815-ca4d5daf079c", "tag": "3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:30.626563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1693653f-b6a4-4251-bd45-cba9aefd86ba req-50378a58-6f01-4a36-a491-c5450334b0a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.626908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1693653f-b6a4-4251-bd45-cba9aefd86ba req-50378a58-6f01-4a36-a491-c5450334b0a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.642212 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1693653f-b6a4-4251-bd45-cba9aefd86ba req-50378a58-6f01-4a36-a491-c5450334b0a8 service nova] Creating event network-changed:3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d for instance d7ae147d-be89-4776-a815-ca4d5daf079c on nch2-master-1 Jun 25 20:54:30.649486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1693653f-b6a4-4251-bd45-cba9aefd86ba req-50378a58-6f01-4a36-a491-c5450334b0a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049417 Jun 25 20:54:30.650444 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 403/724] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:30.656982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:30.657875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:30.666497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.667238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.668292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.669207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.704028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lazy-loading 'flavor' on Instance uuid b5e4acd6-ee50-4335-b679-8d8222def197 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:30.707098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:30.869419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d42732e-26e2-4d0f-849f-b9799d769589 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197/action" status: 202 len: 0 microversion: 2.1 time: 0.216807 Jun 25 20:54:30.870380 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 404/725] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:30 2022] POST /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:54:30.883965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:30.885255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:30.902898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.903671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:30.904668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:30.905287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.162584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:31.173116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:31.178144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:31.182122 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-069cf219-384e-4222-9ce4-19bbd456aeed tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 1.383878 Jun 25 20:54:31.196637 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 322/726] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:29 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:31.208890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:31.214858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:31.225880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.227999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.229098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.236359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.456765 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86969a6f-1619-476b-add1-b99af690bcab tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1643 microversion: 2.1 time: 0.584892 Jun 25 20:54:31.457492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 405/727] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:30 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1643 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:31.462810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:31.463529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:31.480608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.480608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.480608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.480608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.579187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:31.590331 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1635bae-f9b7-4a68-9516-21cc2be1a73b tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.386678 Jun 25 20:54:31.593041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 323/728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:31 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:31.604083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:31.607120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:31.615154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.615802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.616679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.617256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.828170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:31.842401 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91040414-a9c9-4b61-9646-1a913d75eea8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1511 microversion: 2.1 time: 0.383718 Jun 25 20:54:31.852330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 406/729] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:31 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1511 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:31.857636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:31.858539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:31.865633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.866339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:31.867768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:31.868871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.162425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a4e7d88-35b8-42c6-9dd9-b0bde0fd1b49 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1631 microversion: 2.1 time: 0.568071 Jun 25 20:54:32.167035 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 324/730] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:31 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1631 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:32.179908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1520198632", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "df01ad33-2d1d-469d-8a83-fe93f2aaff22"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:32.248395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:32.249622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] validate_networks() for [('df01ad33-2d1d-469d-8a83-fe93f2aaff22', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:32.274389 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9ef399f-1d33-4dca-91fe-66fa073c22ac tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.420172 Jun 25 20:54:32.275262 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 407/731] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:31 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:32.280235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:32.281098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:32.289418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.290128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.291087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.291678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.548594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:32.559624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:32.560807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:32.562024 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2f009c9-f795-4c11-83e1-3ab115183c2c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.285654 Jun 25 20:54:32.562595 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 408/732] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:32 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:32.607963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:32.608780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:32.615368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.616229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.617287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.617864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.709782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:32.710904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:32.711965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:32.712699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:32.713328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:32.733041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.733497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.734304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.734749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.768557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:32.774314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for user e9c6e12528ea4760bed65f994df57783 and project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:32.790922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:32.793828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:32.815154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:32.827240 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0609550d-ba42-4f19-84ed-26d5106ad07c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.223543 Jun 25 20:54:32.837072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 409/733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:32 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:32.845674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e2b1acf3-17bf-4a62-8ab0-760275d2df3f req-3f16a269-3c5a-47c1-87a4-82de9c67d361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d", "name": "network-vif-deleted", "tag": "5c076f17-0f48-48db-bda5-c57f1f6e994f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:32.855603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e2b1acf3-17bf-4a62-8ab0-760275d2df3f req-3f16a269-3c5a-47c1-87a4-82de9c67d361 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.856478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e2b1acf3-17bf-4a62-8ab0-760275d2df3f req-3f16a269-3c5a-47c1-87a4-82de9c67d361 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.868870 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e2b1acf3-17bf-4a62-8ab0-760275d2df3f req-3f16a269-3c5a-47c1-87a4-82de9c67d361 service nova] Creating event network-vif-deleted:5c076f17-0f48-48db-bda5-c57f1f6e994f for instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d on nch2-master-1 Jun 25 20:54:32.870002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b34b72ee-8e18-4dab-9ea5-1d3fe5624a18 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701114 Jun 25 20:54:32.875671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 325/734] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:32.878186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:32.881076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e2b1acf3-17bf-4a62-8ab0-760275d2df3f req-3f16a269-3c5a-47c1-87a4-82de9c67d361 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048685 Jun 25 20:54:32.882096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:32.882224 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 410/735] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:32.891015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.891676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.892705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:32.893189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:32.894567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bbea587-1925-4c9f-a712-0b57274a8cc8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:32.895557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bbea587-1925-4c9f-a712-0b57274a8cc8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:33.036165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9bbea587-1925-4c9f-a712-0b57274a8cc8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:33.045673 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bbea587-1925-4c9f-a712-0b57274a8cc8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1211 microversion: 2.1 time: 0.162142 Jun 25 20:54:33.046260 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 411/736] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:32 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1211 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:33.157766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:33.166899 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1dcde5a2-12f3-4c5d-9f19-0375982919bd tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1469 microversion: 2.1 time: 0.294729 Jun 25 20:54:33.169245 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 326/737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:32 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1469 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:33.183372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:33.183990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:33.190752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.191189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.193125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.193739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.300265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:33.301486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:33.307964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.308704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.309932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.310513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.395097 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c30733f3-071d-4c49-8b9a-931193b08fb9 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1631 microversion: 2.1 time: 0.215622 Jun 25 20:54:33.395934 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 412/738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:33 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1631 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:33.472316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:33.485044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:33.540255 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b23e940-b710-4809-a2a7-c7156523da03 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.248176 Jun 25 20:54:33.542212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 327/739] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:33 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:33.580235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:33.581069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:33.590902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:33.594056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.597575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.598525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.600908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.795026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:33.826685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:33.836600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:33.837927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-084f695b-91db-4568-8d88-e49ec7f18f37 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.261800 Jun 25 20:54:33.838797 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 413/740] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:33 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:33.855572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:33.856203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:33.862935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.863401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:33.864191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:33.864663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.072458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:34.074853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.091218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.092267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.093376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.094573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.175238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:34.185078 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9cfa1de1-81fd-4054-9106-96cd24d8c2d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1263 microversion: 2.1 time: 0.125638 Jun 25 20:54:34.185682 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 414/741] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:34 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1263 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:34.191309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:34.192272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.199073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.199655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.200617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.201291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.237293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.237857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.238385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lazy-loading 'fault' on Instance uuid a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:34.346936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67284d616ad14540b8e798ce389b10a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecaaba0e553049e6a4da58c2c5081305', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:34.356647 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-763537b7-9fbc-47cd-8dc8-46d82ce4ced8 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 200 len: 1306 microversion: 2.1 time: 0.168984 Jun 25 20:54:34.358035 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 415/742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:34 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 1306 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:34.413116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:34.414126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.425029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.427209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.428214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.430635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.742034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92b37329-9014-4e24-8fe4-d0095e9a9bde tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1614 microversion: 2.1 time: 0.332755 Jun 25 20:54:34.745977 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 416/743] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:34 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1614 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:34.761737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:34.762682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.775589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.776027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.776837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.777279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.844415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:34.860222 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc74ca16-4efe-450d-8cfa-60613d4a294c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 1.010386 Jun 25 20:54:34.861156 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 328/744] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:33 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:34.874589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:34.875540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.884082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:34.886729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.887188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.888089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.890085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.906337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c5f28f5-1793-4a4b-ac73-52326dc29586 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.158155 Jun 25 20:54:34.907217 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 417/745] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:34 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:34.925020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:34.925896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:34.933657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.934326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:34.935902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:34.936760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.025796 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] HTTP exception thrown: Cannot 'migrate' instance b5e4acd6-ee50-4335-b679-8d8222def197 while it is in vm_state suspended Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Request method failure captured: Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197/action HTTP/1.1 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 15 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3XbmZNgDob_l16gbocOQfEQpWWYBKjRYU3g4x346xcbVO_OCxZkzMnLU4A-gnGwlycaAfeVzEHjfmAdkdpIHjHb67SIltqMkXrYrljo-zVmgFzLxWWfWgJ8HZEfG0bAlx5yWBgHnuuprSdRXElF6s6vM1wtlrAYczNZ_0SquSCYSvM Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:35.027549 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20751ea751214751af64f3f053198949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20751ea751214751af64f3f053198949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}] Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 026230b7926140c1859a630ebe633242 Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: {"migrate": {}} Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:35.028948 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'migrate' instance b5e4acd6-ee50-4335-b679-8d8222def197 while it is in vm_state suspended Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'b5e4acd6-ee50-4335-b679-8d8222def197', 'body': {'migrate': {}}} Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b5e4acd6-ee50-4335-b679-8d8222def197 in vm_state suspended. Cannot resize while the instance is in this state. Jun 25 20:54:35.029727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance b5e4acd6-ee50-4335-b679-8d8222def197 while it is in vm_state suspended Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.030861 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance b5e4acd6-ee50-4335-b679-8d8222def197 while it is in vm_state suspended Jun 25 20:54:35.032018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.034532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Returning 409 to user: Cannot 'migrate' instance b5e4acd6-ee50-4335-b679-8d8222def197 while it is in vm_state suspended {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:35.035606 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-600ff3f7-f156-42ee-84b1-190ef9d32fbd tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197/action" status: 409 len: 148 microversion: 2.1 time: 0.173227 Jun 25 20:54:35.036697 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 329/746] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:34 2022] POST /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197/action => generated 148 bytes in 175 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:54:35.047883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61231a6f-a40c-4a0f-82ce-7b02c4f37f41 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61231a6f-a40c-4a0f-82ce-7b02c4f37f41 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Request method failure captured: Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action HTTP/1.1 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 39 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3XbmZNgDob_l16gbocOQfEQpWWYBKjRYU3g4x346xcbVO_OCxZkzMnLU4A-gnGwlycaAfeVzEHjfmAdkdpIHjHb67SIltqMkXrYrljo-zVmgFzLxWWfWgJ8HZEfG0bAlx5yWBgHnuuprSdRXElF6s6vM1wtlrAYczNZ_0SquSCYSvM Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:35.051956 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20751ea751214751af64f3f053198949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20751ea751214751af64f3f053198949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}] Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 026230b7926140c1859a630ebe633242 Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: {"os-resetState": {"state": "invalid"}} Jun 25 20:54:35.053594 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f2a6b47f-92e4-4bda-aba5-3a732126f241', 'body': {'os-resetState': {'state': 'invalid'}}} Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'invalid' Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.054344 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:54:35.055944 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jun 25 20:54:35.057274 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.057442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61231a6f-a40c-4a0f-82ce-7b02c4f37f41 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:35.059179 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61231a6f-a40c-4a0f-82ce-7b02c4f37f41 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action" status: 400 len: 144 microversion: 2.1 time: 0.016067 Jun 25 20:54:35.060559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 330/747] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:35 2022] POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action => generated 144 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:54:35.073585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16832f6f-a295-4ab6-83e5-0530a4f9b648 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16832f6f-a295-4ab6-83e5-0530a4f9b648 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Request method failure captured: Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action HTTP/1.1 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 31 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3XbmZNgDob_l16gbocOQfEQpWWYBKjRYU3g4x346xcbVO_OCxZkzMnLU4A-gnGwlycaAfeVzEHjfmAdkdpIHjHb67SIltqMkXrYrljo-zVmgFzLxWWfWgJ8HZEfG0bAlx5yWBgHnuuprSdRXElF6s6vM1wtlrAYczNZ_0SquSCYSvM Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:35.077753 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20751ea751214751af64f3f053198949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20751ea751214751af64f3f053198949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}] Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 026230b7926140c1859a630ebe633242 Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: {"os-resetState": {"state": 1}} Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:35.079109 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f2a6b47f-92e4-4bda-aba5-3a732126f241', 'body': {'os-resetState': {'state': 1}}} Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 1 Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:35.079835 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jun 25 20:54:35.081128 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.084358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16832f6f-a295-4ab6-83e5-0530a4f9b648 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:35.087658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16832f6f-a295-4ab6-83e5-0530a4f9b648 tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action" status: 400 len: 120 microversion: 2.1 time: 0.022189 Jun 25 20:54:35.088804 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 331/748] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:54:35 2022] POST /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241/action => generated 120 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:54:35.098516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:35.099710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Failed to fetch instance by id 999 {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 20:54:35.100475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] HTTP exception thrown: Instance 999 could not be found. Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Request method failure captured: Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 37 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3XbmZNgDob_l16gbocOQfEQpWWYBKjRYU3g4x346xcbVO_OCxZkzMnLU4A-gnGwlycaAfeVzEHjfmAdkdpIHjHb67SIltqMkXrYrljo-zVmgFzLxWWfWgJ8HZEfG0bAlx5yWBgHnuuprSdRXElF6s6vM1wtlrAYczNZ_0SquSCYSvM Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:35.109235 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/20751ea751214751af64f3f053198949"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_20751ea751214751af64f3f053198949"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/20751ea751214751af64f3f053198949"}]}] Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 20751ea751214751af64f3f053198949 Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1126694687 Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 026230b7926140c1859a630ebe633242 Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1126694687-project-admin Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: {"os-resetState": {"state": "error"}} Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:35.110546 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 999 could not be found. Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:54:35.111347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 25 20:54:35.113933 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.116528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:35.117763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0851c18a-8b86-4b2b-96c9-2697cad4792d tempest-ServersAdminNegativeTestJSON-1126694687 tempest-ServersAdminNegativeTestJSON-1126694687-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.023849 Jun 25 20:54:35.118720 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 332/749] 10.222.0.39 () {60 vars in 1178 bytes} [Sat Jun 25 20:54:35 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:54:35.128962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.129462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.147957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.148856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.149645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.150077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.151382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:35.161617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:35.163519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:35.165232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78c529bf-7742-4adb-85c5-8cae0d517860 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.245260 Jun 25 20:54:35.176602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 418/750] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:34 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:35.179343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:54:35.204022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.205235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.214335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.215232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.216268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.217067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.284969 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e20cda1-02c5-4a16-b3a5-c6d70c2cb8b3 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 204 len: 0 microversion: 2.1 time: 0.159965 Jun 25 20:54:35.289500 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 333/751] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:54:35 2022] DELETE /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:54:35.296353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.297298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.298375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:35.305131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.305882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.306876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.307590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba75cc02-f5c9-40fc-9b17-c09e69e5cb8c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1269 microversion: 2.1 time: 0.108438 Jun 25 20:54:35.307835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.310513 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 419/752] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:35 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:35.374270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.375069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] [instance: a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.382263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.382883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.385140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.385976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.403309 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] HTTP exception thrown: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Request method failure captured: Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d HTTP/1.1 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3XnNF_2i-JGOhb8dBibIyCE8lqkA-zlYnaJXY9-iYKXeywFNXqc0XlQfaV9nTDAFkpXQ5Ptt3j_rAMBlNsCGZxzwdVaicmPjhzqhl5_c7y8xknckVfJTekyTuMU08m0d0ASAA5Ravhzm9dHtyMa7j9tFxCZqLsWhC-ennhLHK-PZbI Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ecaaba0e553049e6a4da58c2c5081305 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceActionsTestJSON-847093149 Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:54:35.406446 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ecaaba0e553049e6a4da58c2c5081305"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ecaaba0e553049e6a4da58c2c5081305"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ecaaba0e553049e6a4da58c2c5081305"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ecaaba0e553049e6a4da58c2c5081305"}]}] Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceActionsTestJSON-847093149 Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ecaaba0e553049e6a4da58c2c5081305 Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceActionsTestJSON-847093149 Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceActionsTestJSON-847093149-project Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 67284d616ad14540b8e798ce389b10a7 Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceActionsTestJSON-847093149-project Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. Jun 25 20:54:35.407799 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d'} Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:35.408563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. Jun 25 20:54:35.409752 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:35.412740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] Returning 404 to user: Instance a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:35.412740 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52e721f6-072c-4184-a992-3c05cc5d0cf4 tempest-InstanceActionsTestJSON-847093149 tempest-InstanceActionsTestJSON-847093149-project] 10.222.0.39 "GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d" status: 404 len: 111 microversion: 2.1 time: 0.037787 Jun 25 20:54:35.413600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 420/753] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:35 2022] GET /compute/v2.1/servers/a0dc3ea7-53b5-4f5b-a619-5fd8a7fbb23d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:54:35.822525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:35.841969 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b228f0fd-2462-4638-8b97-255ff17c55cd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1469 microversion: 2.1 time: 0.550158 Jun 25 20:54:35.843854 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 334/754] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:35 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1469 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:35.885532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.886413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.897929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-62ef4da5-94da-4c62-bc31-ad9a3afb0c5b req-41999b28-ff40-4854-9b94-b475bed5c071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79660644-1704-46b2-bf7d-9bc0b2626c80", "name": "network-vif-plugged", "status": "completed", "tag": "6e5e7147-ad33-4a9b-ab77-5a18067580bf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:35.902933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.903445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.905402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.906614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.912129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:35.912798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62ef4da5-94da-4c62-bc31-ad9a3afb0c5b req-41999b28-ff40-4854-9b94-b475bed5c071 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.913244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62ef4da5-94da-4c62-bc31-ad9a3afb0c5b req-41999b28-ff40-4854-9b94-b475bed5c071 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.946990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-62ef4da5-94da-4c62-bc31-ad9a3afb0c5b req-41999b28-ff40-4854-9b94-b475bed5c071 service nova] Creating event network-vif-plugged:6e5e7147-ad33-4a9b-ab77-5a18067580bf for instance 79660644-1704-46b2-bf7d-9bc0b2626c80 on nch1-master-1 Jun 25 20:54:35.961670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-62ef4da5-94da-4c62-bc31-ad9a3afb0c5b req-41999b28-ff40-4854-9b94-b475bed5c071 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068246 Jun 25 20:54:35.962624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 335/755] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:54:35.969900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:35.970615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:35.996722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.997768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:35.999130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:35.999628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.221396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:36.245471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-375dfd5f-6975-48ae-a361-0229d800754c tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.281565 Jun 25 20:54:36.246748 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 336/756] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:35 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:36.265365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:36.266280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:36.273901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.274608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.275615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.276209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.307125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:36.323867 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c59f579e-10d1-4973-bbde-3e1bf15b51b1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.449710 Jun 25 20:54:36.333315 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 421/757] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:35 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:36.338726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:36.339345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:36.345987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.346787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.347723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.348317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.443638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:36.454120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-439a3d2b-bcaf-487b-8c23-4a6c009497eb tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1269 microversion: 2.1 time: 0.119280 Jun 25 20:54:36.455187 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 422/758] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:36 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1269 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:36.684396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:36.693427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:36.702393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:36.703613 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ac61d76-573b-46db-b7b9-d5cbac38fd01 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.455745 Jun 25 20:54:36.704400 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 337/759] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:36 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:36.861824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:36.862443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:36.881904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.882742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:36.883697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:36.885255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.269286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:37.270623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:37.273547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:37.294206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.295310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.296346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.297052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.342491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:37.358946 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e51b31c-5825-4968-a611-f585c035bfbd tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1469 microversion: 2.1 time: 0.502473 Jun 25 20:54:37.370477 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 423/760] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:36 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1469 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:37.375676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:37.376655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:37.384390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.385276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.386310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.392589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.584242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:37.607894 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e106a819-4896-4361-ad89-4ca00f667ce3 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.344770 Jun 25 20:54:37.618794 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 338/761] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:37 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:37.618794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:37.618794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:37.623682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.624304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.625339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.625878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.679177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:37.691602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9e4d323-0237-4e5c-9f9d-1cf3dc037e69 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1319 microversion: 2.1 time: 0.319219 Jun 25 20:54:37.702828 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 424/762] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:37 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:37.723154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:37.724298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:37.731952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.741210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:37.742558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:37.743174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.061066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:38.080937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:38.083855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:38.085720 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5105e5ac-3c86-40ce-8333-cff806a51713 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.366754 Jun 25 20:54:38.097966 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 425/763] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:37 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:38.104039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2577d171-9b27-48f6-9952-1b6c0e6e97c8 req-e8bedc72-342a-44a5-82c4-3eef9c216cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ae147d-be89-4776-a815-ca4d5daf079c", "name": "network-vif-plugged", "status": "completed", "tag": "3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:38.115842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2577d171-9b27-48f6-9952-1b6c0e6e97c8 req-e8bedc72-342a-44a5-82c4-3eef9c216cbb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.116661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2577d171-9b27-48f6-9952-1b6c0e6e97c8 req-e8bedc72-342a-44a5-82c4-3eef9c216cbb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.136288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2577d171-9b27-48f6-9952-1b6c0e6e97c8 req-e8bedc72-342a-44a5-82c4-3eef9c216cbb service nova] Creating event network-vif-plugged:3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d for instance d7ae147d-be89-4776-a815-ca4d5daf079c on nch2-master-1 Jun 25 20:54:38.144063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2577d171-9b27-48f6-9952-1b6c0e6e97c8 req-e8bedc72-342a-44a5-82c4-3eef9c216cbb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044250 Jun 25 20:54:38.145636 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 426/764] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:38.380197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:38.382712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:38.394258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.396072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.397857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.398576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.418395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:38.433343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5514b8d9-f8dc-4b68-b44e-07b7b1e3e436 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.823000 Jun 25 20:54:38.433970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 339/765] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:37 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:38.628456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:38.629475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:38.638832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.639772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.642174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.643373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.666259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:38.680295 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a478a0ca-f009-4a94-95b5-acfe4070d837 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1469 microversion: 2.1 time: 0.306607 Jun 25 20:54:38.689858 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 427/766] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:38 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:38.711701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:38.712750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:38.719265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.719651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.720499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:38.721009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:38.849713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:38.880322 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a770d86-bcc8-4504-8dc4-55ff6f740653 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.252090 Jun 25 20:54:38.881808 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 340/767] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:38 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:39.074369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.082913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-931b1322-dea9-44ff-b62f-0955e4e64de7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1468 microversion: 2.1 time: 0.376592 Jun 25 20:54:39.083738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 428/768] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:38 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1468 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:39.101950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:39.102944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:39.104713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:39.105537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:39.110892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.112213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.113214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.113810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.115160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.115617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.116386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.123951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.300199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.308677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.310185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.312369 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-540f14d7-7df4-4635-a849-55f54450e65a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.212034 Jun 25 20:54:39.313020 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 429/769] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:39 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:39.317487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e732f3db-78b1-439d-b4b0-bba5f76ec80a req-0829c3a9-45e2-4577-a5e1-d2e40afe679e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "name": "network-vif-unplugged", "status": "completed", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:39.326087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e732f3db-78b1-439d-b4b0-bba5f76ec80a req-0829c3a9-45e2-4577-a5e1-d2e40afe679e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.326525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e732f3db-78b1-439d-b4b0-bba5f76ec80a req-0829c3a9-45e2-4577-a5e1-d2e40afe679e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.339102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e732f3db-78b1-439d-b4b0-bba5f76ec80a req-0829c3a9-45e2-4577-a5e1-d2e40afe679e service nova] Creating event network-vif-unplugged:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch2-master-1 Jun 25 20:54:39.344099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e732f3db-78b1-439d-b4b0-bba5f76ec80a req-0829c3a9-45e2-4577-a5e1-d2e40afe679e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029911 Jun 25 20:54:39.344741 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 430/770] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:39.453610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:39.454536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:39.464661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.465638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.466692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.467222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.732310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.741547 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51aad13e-5b11-4480-a7f3-597ae8ec12ac tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.295332 Jun 25 20:54:39.744211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 431/771] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:39 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:39.749091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:39.749897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:39.757370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.757853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.758883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.759322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.841534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.842131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.842830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lazy-loading 'fault' on Instance uuid b5e4acd6-ee50-4335-b679-8d8222def197 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:39.906274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:39.914338 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-725059ec-de24-4362-a7d0-0c81abf22972 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 200 len: 1312 microversion: 2.1 time: 0.168914 Jun 25 20:54:39.915659 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 432/772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:39 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:39.920478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:39.921312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:39.930260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.931057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:39.932050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:39.932730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.033417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:40.059357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63616a0a-c739-4db0-898c-1b1c51be6d0f tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.142348 Jun 25 20:54:40.060629 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 433/773] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:39 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:40.171077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:40.181103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-437d8b27-bf09-4d4d-a005-c79a7d661d84 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1319 microversion: 2.1 time: 1.083785 Jun 25 20:54:40.191546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 341/774] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:39 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1319 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:40.330992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:40.331968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:40.339567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.339934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.340716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.341142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.500667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:40.523919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:40.535282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:40.536550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae881ecc-5e75-4702-934f-651cdfb8461b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.209868 Jun 25 20:54:40.540586 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 434/775] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:40 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:40.759882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:40.761020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:40.767957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.768582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.769875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.770527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.934010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:40.935087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: b5e4acd6-ee50-4335-b679-8d8222def197] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:40.953846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.956083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.957134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:40.958376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:40.991852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] HTTP exception thrown: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Request method failure captured: Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 HTTP/1.1 Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Xa4Ec5KVRzQLwuJa_kD7TDKZ3TAuc-KpDJBmdimfn6H2B-KUzshwD30YnwHP2L4QNBS2xg-_iQbiy4DUCkOMgk1eHLWf0WG_1ou6eIytrWZFc_8oRqieonUrhEqNvkv_BicLCsrKAD94DFLYrQMD1aqlC1gzhQlfaFnBeYxJ4B0-I Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ea50e527346c47a2b3c0f7362ff5449b Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:54:40.995101 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea50e527346c47a2b3c0f7362ff5449b"}]}] Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ea50e527346c47a2b3c0f7362ff5449b Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAdminNegativeTestJSON-419322481-project Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: af65f7ab19604ee1841ce4ae7e65a994 Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419322481-project Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. Jun 25 20:54:40.996712 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b5e4acd6-ee50-4335-b679-8d8222def197'} Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:40.997614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. Jun 25 20:54:40.999196 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:54:41.008664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Returning 404 to user: Instance b5e4acd6-ee50-4335-b679-8d8222def197 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:41.009784 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5c59907-4789-44ba-afa8-1f545800b3c9 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197" status: 404 len: 111 microversion: 2.1 time: 0.082547 Jun 25 20:54:41.013664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 435/776] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:40 2022] GET /compute/v2.1/servers/b5e4acd6-ee50-4335-b679-8d8222def197 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:54:41.029833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.030356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:41.048992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.049519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.055177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.055853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.126083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:41.130001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:54:41.137727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-98eb5fea-68fe-402e-a451-d2f27cc44e12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.381890 Jun 25 20:54:41.139048 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 342/777] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:40 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:41.153436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.154410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:41.162097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.162919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.165875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.166914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.278052 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10791316-1b1b-4420-ba2f-acac944f42e4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 204 len: 0 microversion: 2.1 time: 0.258607 Jun 25 20:54:41.280134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 436/778] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:54:41 2022] DELETE /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:54:41.302655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.306959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:41.330346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.330826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.334292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.335867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.367825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:41.413301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef400302-8315-4c15-86ff-b491ed4dfa58 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.272743 Jun 25 20:54:41.413876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:41.428262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 343/779] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:41 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:41.428262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.428262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:41.445617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.450766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.451736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.452461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.679692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:41.692608 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61e4c7f0-21d0-474f-82b0-e07b40e4c9da tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1477 microversion: 2.1 time: 0.273069 Jun 25 20:54:41.693521 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 344/780] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:41 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:41.699289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e4acd6-ee50-4335-b679-8d8222def197", "name": "network-vif-deleted", "tag": "7ce75e06-ab3d-4833-934f-bbf1dd90ffbc"}, {"name": "network-changed", "server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}, {"name": "network-changed", "server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:41.713989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.714674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.719481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:41.739915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Creating event network-vif-deleted:7ce75e06-ab3d-4833-934f-bbf1dd90ffbc for instance b5e4acd6-ee50-4335-b679-8d8222def197 on nch2-master-1 Jun 25 20:54:41.740552 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Creating event network-changed:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch2-master-1 Jun 25 20:54:41.741130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] Creating event network-changed:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch1-master-1 Jun 25 20:54:41.754141 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4ef81488-f22d-4422-bc24-c240350d2ae4 req-ddee80e5-2b3a-4890-b466-87299997f301 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.059199 Jun 25 20:54:41.758966 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 345/781] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:41.768636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.769806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:41.779725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.780450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.788710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.790650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.882863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:41.892682 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cb73fadf-35af-4f8d-8106-499a6bd97d6f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1468 microversion: 2.1 time: 0.610583 Jun 25 20:54:41.898221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 437/782] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:41 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1468 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:41.916951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:41.920828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:41.922639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Searching by: {'reservation_id': 'r-67s22wj0', 'deleted': False, 'project_id': '29037675b33a4f318e1fcafc33b6bed5'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:54:41.938714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.940693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:41.941672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:41.942663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.165170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:42.179499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:42.181779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:42.185080 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-433e29d2-ccc0-4283-a414-689bb3c9be7d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.421924 Jun 25 20:54:42.191077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 346/783] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:41 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:42.218635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:42.220082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:42.221282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:54:42.247260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:42.250342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.252860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:42.258945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.363796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:42.371508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:42.372310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.631790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01a229c2-e914-4d84-a251-d04da02bfa23 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?reservation_id=r-67s22wj0" status: 200 len: 2929 microversion: 2.1 time: 0.721897 Jun 25 20:54:42.648353 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 438/784] 10.222.0.39 () {58 vars in 1196 bytes} [Sat Jun 25 20:54:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-67s22wj0 => generated 2929 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:42.654405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:42.655962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:42.671151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:42.672173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.691044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:42.691874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:42.761227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:42.786322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:43.002838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:43.046354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:43.060744 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ba43b24-06e4-4f65-9f2f-fe80cc614aff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.866604 Jun 25 20:54:43.067085 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 347/785] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:42 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:43.084402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d062a71-6272-4b00-8421-a51e08bed7a4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:43.090679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d90471ba-8419-4a61-a88d-5164a205afef tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.440548 Jun 25 20:54:43.106993 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 439/786] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:42 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:43.115254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:43.117485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:43.130537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.133149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.136972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.137481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.154574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_groups [None req-4d062a71-6272-4b00-8421-a51e08bed7a4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Querying cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) for 2 instances {{(pid=137462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 25 20:54:43.165251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d062a71-6272-4b00-8421-a51e08bed7a4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.166118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d062a71-6272-4b00-8421-a51e08bed7a4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.293955 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d062a71-6272-4b00-8421-a51e08bed7a4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/a1c91e95-03c1-4e27-a42b-fd4fe8c669d8" status: 200 len: 270 microversion: 2.1 time: 0.224099 Jun 25 20:54:43.294560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 348/787] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:54:43 2022] GET /compute/v2.1/os-server-groups/a1c91e95-03c1-4e27-a42b-fd4fe8c669d8 => generated 270 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:43.322576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:43.334676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:43.358035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.358497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.359307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.359746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.435494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:43.475736 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6bf335af-539c-4345-a6c2-de5c40f70ff1 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1477 microversion: 2.1 time: 0.367287 Jun 25 20:54:43.487518 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 440/788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:43 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:43.522934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:43.527346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:43.560889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.561468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.563977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:43.565868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:43.988692 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dbc791b-5e37-4450-ba66-658a8c17d575 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 200 len: 1619 microversion: 2.1 time: 0.496846 Jun 25 20:54:43.989315 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 441/789] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:43 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 1619 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:44.019315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:44.020249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:44.034018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.034470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.035252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.035691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.174718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:44.185301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:44.186839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:44.188031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e3b759be-5b33-4893-847c-50fc476fb742 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.875356 Jun 25 20:54:44.196737 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 349/790] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:43 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:44.218042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:44.220851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:44.231316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.231780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.242105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.242613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.442525 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ce11dd9-addc-4323-9e9d-380dc24a6380 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1619 microversion: 2.1 time: 0.434212 Jun 25 20:54:44.444515 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 442/791] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:44 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1619 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:44.459825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:44.464920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:44.495284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.499760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.502970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.503705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.660063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:44.710746 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3210f4c0-efa5-4603-b28e-99c23501b9a8 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.264417 Jun 25 20:54:44.712200 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 443/792] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:44 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:44.717916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:44.718794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:44.725305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.726119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.728119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:44.728889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:44.984553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:44.998899 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-835c7642-9acb-476a-a9a1-907824dabf41 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1477 microversion: 2.1 time: 0.285290 Jun 25 20:54:45.017635 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 444/793] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:44 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1477 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:45.034726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2016358147", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "0acaf208-7f08-43b0-a4cf-21cdcf91b5f8"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:45.179619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:45.252031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:45.309769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-26afba4a-1f22-4cbe-a80d-1e4b8fde7bd5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 1.102736 Jun 25 20:54:45.325975 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 350/794] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:44 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:45.332183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:45.333980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:45.349761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.350718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.351985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.353848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.737227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:45.737844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:45.738324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:45.738901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:45.739486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:45.768110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.769005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.769977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.770553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.811915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:45.836554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:45.842091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:45.845079 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ec276d7-7176-42be-8e64-bf9abc9224b0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.515881 Jun 25 20:54:45.850997 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 351/795] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:45 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:45.885589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:45.886722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:45.889912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:45.935649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:45.964561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.966508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.968279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:45.971603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:45.990254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:46.000108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:46.164700 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-48c746c6-d202-4923-be5c-c1c2aca0e76c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146412 Jun 25 20:54:46.172928 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 445/796] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:46.181471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:46.198243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:46.202645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:46.215529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.218812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.220938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.221867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.272159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:46.305151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.305970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.306638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lazy-loading 'fault' on Instance uuid f2a6b47f-92e4-4bda-aba5-3a732126f241 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:46.362444 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38f8a89e-d046-4158-9a36-a7d0b87414d1 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.510201 Jun 25 20:54:46.374676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 352/797] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:45 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:46.386672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b01e3e41-4adc-416a-8431-cd647a2c0d0c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:46.387759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b01e3e41-4adc-416a-8431-cd647a2c0d0c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:46.517681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af65f7ab19604ee1841ce4ae7e65a994', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea50e527346c47a2b3c0f7362ff5449b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:46.588706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b4cfe32-f497-4140-b891-5c20f5053b73 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 200 len: 1312 microversion: 2.1 time: 0.407147 Jun 25 20:54:46.591058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 446/798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:46 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:46.605648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ff12296a-0dd5-4a25-a7af-a8d799939f44 req-1ca6ebf3-5a57-4275-ad62-80da1b389539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2a6b47f-92e4-4bda-aba5-3a732126f241", "name": "network-vif-deleted", "tag": "a63c9fa3-9247-44ee-86e3-e653c20f9e19"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:46.647361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff12296a-0dd5-4a25-a7af-a8d799939f44 req-1ca6ebf3-5a57-4275-ad62-80da1b389539 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.647875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff12296a-0dd5-4a25-a7af-a8d799939f44 req-1ca6ebf3-5a57-4275-ad62-80da1b389539 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.708134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ff12296a-0dd5-4a25-a7af-a8d799939f44 req-1ca6ebf3-5a57-4275-ad62-80da1b389539 service nova] Creating event network-vif-deleted:a63c9fa3-9247-44ee-86e3-e653c20f9e19 for instance f2a6b47f-92e4-4bda-aba5-3a732126f241 on nch1-master-1 Jun 25 20:54:46.729846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ff12296a-0dd5-4a25-a7af-a8d799939f44 req-1ca6ebf3-5a57-4275-ad62-80da1b389539 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130415 Jun 25 20:54:46.731234 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 447/799] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:46.744065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:46.745982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:46.769079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.769717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.770663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.771248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.811357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b01e3e41-4adc-416a-8431-cd647a2c0d0c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:46.825650 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b01e3e41-4adc-416a-8431-cd647a2c0d0c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1217 microversion: 2.1 time: 0.449477 Jun 25 20:54:46.831945 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 353/800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:46 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1217 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:46.865779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:46.868676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:46.888771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.889221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:46.890112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:46.890438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.164396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:47.173583 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d1eab462-d7cc-4d08-85cf-694069924c83 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.439407 Jun 25 20:54:47.186561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 448/801] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:46 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:47.389205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:47.390675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:47.413970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.417068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.423048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.426476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.471409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:47.499433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:47.506329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:47.525854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0d8c501-d73e-467c-9e39-71334fb29dde tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.663539 Jun 25 20:54:47.544111 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 354/802] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:46 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:47.563666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:47.605774 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0196333-8d7c-4975-bf89-4c5dc5efad3e tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.222751 Jun 25 20:54:47.611864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:47.612867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] [instance: f2a6b47f-92e4-4bda-aba5-3a732126f241] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:47.645516 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 449/803] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:47 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:47.647271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.648439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.649763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.650408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.668515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] HTTP exception thrown: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Request method failure captured: Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 HTTP/1.1 Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Xa4Ec5KVRzQLwuJa_kD7TDKZ3TAuc-KpDJBmdimfn6H2B-KUzshwD30YnwHP2L4QNBS2xg-_iQbiy4DUCkOMgk1eHLWf0WG_1ou6eIytrWZFc_8oRqieonUrhEqNvkv_BicLCsrKAD94DFLYrQMD1aqlC1gzhQlfaFnBeYxJ4B0-I Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ea50e527346c47a2b3c0f7362ff5449b Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:54:47.670901 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ea50e527346c47a2b3c0f7362ff5449b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ea50e527346c47a2b3c0f7362ff5449b"}]}] Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ea50e527346c47a2b3c0f7362ff5449b Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-419322481 Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-419322481-project Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: af65f7ab19604ee1841ce4ae7e65a994 Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-419322481-project Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. Jun 25 20:54:47.672253 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f2a6b47f-92e4-4bda-aba5-3a732126f241'} Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:47.673107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. Jun 25 20:54:47.674316 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:47.677129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] Returning 404 to user: Instance f2a6b47f-92e4-4bda-aba5-3a732126f241 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:47.678276 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd8d1cc2-80bb-4539-b64a-be1963746dd4 tempest-ServersAdminNegativeTestJSON-419322481 tempest-ServersAdminNegativeTestJSON-419322481-project] 10.222.0.39 "GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241" status: 404 len: 111 microversion: 2.1 time: 0.070776 Jun 25 20:54:47.682801 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 355/804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:47 2022] GET /compute/v2.1/servers/f2a6b47f-92e4-4bda-aba5-3a732126f241 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:54:47.851472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:47.852448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:47.869492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.871403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:47.872861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:47.878292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:48.101905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:48.125555 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dbc01bf4-b727-4897-8607-105132f661f5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1269 microversion: 2.1 time: 0.279155 Jun 25 20:54:48.133002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 450/805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:47 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1269 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:48.194906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:48.205186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:48.220093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:48.222245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:48.223288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:48.224903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:48.562239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1631210114", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "584e3648-cba8-4e84-a39f-cca5a7e46799"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:48.573245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:48.582490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24e0416d-8b4e-41d1-9c78-ec7370f69f34 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.392383 Jun 25 20:54:48.588775 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 451/806] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:48 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:48.606362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:48.607482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:48.623665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:48.624448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:48.627085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:48.627620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:48.665599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] validate_networks() for [('584e3648-cba8-4e84-a39f-cca5a7e46799', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:48.958921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:48.969429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:48.972981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:48.974453 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c986086c-01a7-4b69-87ba-0a80b8ecf80f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.384396 Jun 25 20:54:48.985727 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 452/807] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:48 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:48.991522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:48.992144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:49.002402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.003149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.004278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.005140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.029689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:49.110305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:49.182042 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0883453a-26cc-4cc5-aaa5-6fdc823307be tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.189468 Jun 25 20:54:49.182945 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 453/808] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:48 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:49.188520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d64bff2e-cb3e-4472-9a1d-b9fa442837a3 req-ff91b164-bba5-4700-8e5f-8c3ce401b100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "name": "network-vif-unplugged", "status": "completed", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:49.210214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d64bff2e-cb3e-4472-9a1d-b9fa442837a3 req-ff91b164-bba5-4700-8e5f-8c3ce401b100 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.211823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d64bff2e-cb3e-4472-9a1d-b9fa442837a3 req-ff91b164-bba5-4700-8e5f-8c3ce401b100 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.239532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d64bff2e-cb3e-4472-9a1d-b9fa442837a3 req-ff91b164-bba5-4700-8e5f-8c3ce401b100 service nova] Creating event network-vif-unplugged:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch2-master-1 Jun 25 20:54:49.250174 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d64bff2e-cb3e-4472-9a1d-b9fa442837a3 req-ff91b164-bba5-4700-8e5f-8c3ce401b100 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065195 Jun 25 20:54:49.252247 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 454/809] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:49.263631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:49.265577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:49.287581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.288346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.290486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.291765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.427444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:49.439662 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1cf83116-88d5-4ae5-87bc-8793a19b4f3e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1275 microversion: 2.1 time: 0.185937 Jun 25 20:54:49.448905 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 455/810] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:49 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:49.639461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:49.644135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:49.664638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.672697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.673843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.676001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.931501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:49.940585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a551f1ef-6297-445d-8800-4466674e55d4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.340440 Jun 25 20:54:49.943818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 456/811] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:49 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:49.955228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:49.956876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:49.957600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:49.958237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:49.959277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:49.976385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.977429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:49.979354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:49.980034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.001503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:50.002121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:50.021759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.022983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.024636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.028759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.054002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:50.080393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for user db1c30066ddd478fafc7c203867fd7de and project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:50.099434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:50.105006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:50.190329 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6ba7260-264e-4f93-9bb7-ad3cfef531e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175960 Jun 25 20:54:50.191617 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 356/812] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 20:54:50.225167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:50.226342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:50.234470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.236034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.237122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.237771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.560076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:50.576171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:50.580030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:50.581548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e3f500a-1e19-4f8a-a438-5233bd3c337c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.583769 Jun 25 20:54:50.591859 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 457/813] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:49 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:50.591859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:50.591859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:50.611854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.612310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.613164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:50.613695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:50.785892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:50.896011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd3cb82f-76e6-4d14-8ff9-27e266137b4b tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.676092 Jun 25 20:54:50.899805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 357/814] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:50 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:50.910573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1408779169", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "584e3648-cba8-4e84-a39f-cca5a7e46799"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:50.941704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:50.955759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dc76f22-620d-4537-bd30-3ed94843bc36 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.371228 Jun 25 20:54:50.956261 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 458/815] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:50 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:50.970730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:50.971358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:51.001776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:51.002498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:51.004934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:51.006721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:51.102767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] validate_networks() for [('584e3648-cba8-4e84-a39f-cca5a7e46799', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:51.451012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:51.464714 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1c77d21-144a-4480-8ec5-afe9b400947c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.507235 Jun 25 20:54:51.476111 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 459/816] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:50 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:51.611672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:51.613608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:51.643466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:51.643935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:51.644828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:51.645272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.036992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:52.058282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:52.080015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:52.082689 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e8a24d7-dba0-4647-aab7-71eb1f6c265e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1567 microversion: 2.25 time: 0.479434 Jun 25 20:54:52.098286 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 460/817] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:51 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:52.125844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:52.133460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:52.141314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.142148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.143953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.144673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.417193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:52.484820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a4a46ec-32d6-40e5-87e9-652560384622 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.384388 Jun 25 20:54:52.504485 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 461/818] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:52 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:52.509799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:52.521138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:52.544460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.545651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.552954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.561489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.911673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:52.927044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88cb268d-3354-4db5-b723-4fb5e523cc14 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.432086 Jun 25 20:54:52.933609 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 462/819] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:52 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:52.940890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:52.941676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:52.953450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.953913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:52.954696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:52.955161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.189384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:53.198197 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c2c7be13-f968-4975-9acc-1287f076cdca tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.269185 Jun 25 20:54:53.208822 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 463/820] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:52 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:53.216031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:53.217254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:53.224270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.225088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.226177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.226825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.466013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:53.478811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:53.480590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:53.481970 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e9d087e-5753-4756-b421-38d911d36b5f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1542 microversion: 2.25 time: 0.271731 Jun 25 20:54:53.482713 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 464/821] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:53 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1542 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:53.514306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c68ac92a-8249-4441-90ff-b24d8977a112 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '.version_select at 0x7f984fd1c4c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:53.517379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c68ac92a-8249-4441-90ff-b24d8977a112 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.518739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c68ac92a-8249-4441-90ff-b24d8977a112 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.538752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c68ac92a-8249-4441-90ff-b24d8977a112 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.036090 Jun 25 20:54:53.541302 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 465/822] 10.222.0.39 () {60 vars in 1183 bytes} [Sat Jun 25 20:54:53 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:53.557783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:53.558405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:53.572575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.573465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.574536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.575594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.672664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:53.699940 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2284892-d525-44c1-8f02-8844eb3483c9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1927 microversion: 2.75 time: 0.155616 Jun 25 20:54:53.709218 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 466/823] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:53 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:53.734328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:53.735168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:53.745252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.746355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.747301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.747906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.804617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:53.805211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:53.807612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:53.809053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:53.810652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:53.844370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.846956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.847920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:53.849481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:53.891260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:53.896292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for user db1c30066ddd478fafc7c203867fd7de and project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:53.910550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:53.914237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:54.007626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4c14d96-a092-4bda-a92b-85ce26808a8b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.106315 Jun 25 20:54:54.011063 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 358/824] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:54.201319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:54.228017 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d51f4302-d6e6-41a0-9188-8d8316de1d69 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 2034 microversion: 2.25 time: 0.516251 Jun 25 20:54:54.228655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 467/825] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:53 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 2034 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:54.234087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-24ec50ee-687e-422b-a5b2-9716b083c07f req-992cf1ad-cdcd-4352-b08a-285e9dcc6f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "name": "network-vif-plugged", "status": "completed", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:54.265324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-24ec50ee-687e-422b-a5b2-9716b083c07f req-992cf1ad-cdcd-4352-b08a-285e9dcc6f62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:54.265778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-24ec50ee-687e-422b-a5b2-9716b083c07f req-992cf1ad-cdcd-4352-b08a-285e9dcc6f62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:54.307800 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-24ec50ee-687e-422b-a5b2-9716b083c07f req-992cf1ad-cdcd-4352-b08a-285e9dcc6f62 service nova] Creating event network-vif-plugged:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch1-master-1 Jun 25 20:54:54.313903 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-24ec50ee-687e-422b-a5b2-9716b083c07f req-992cf1ad-cdcd-4352-b08a-285e9dcc6f62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083789 Jun 25 20:54:54.314889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 468/826] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:54.322589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:54.323332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:54.330600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:54.331098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:54.331929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:54.332398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:54.502124 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1df64008-2236-4638-ad30-a117f88baf6d tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-24T20%3A54%3A53.562499&end=2022-06-26T20%3A54%3A53.562499" status: 404 len: 112 microversion: - time: 0.489686 Jun 25 20:54:54.502926 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 359/827] 10.222.0.39 () {58 vars in 1315 bytes} [Sat Jun 25 20:54:54 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-06-24T20%3A54%3A53.562499&end=2022-06-26T20%3A54%3A53.562499 => generated 112 bytes in 491 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 20:54:54.509429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:54.527494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:54.553597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:54.554360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:54.555790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:54.556617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:54.665865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:54.713669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23fd800c-90e4-42b5-b6e6-e590b782dbee tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.395376 Jun 25 20:54:54.721383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 469/828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:54 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:54.737460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8884ac63-e088-4e4d-9996-d3166b1491dd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: .version_select at 0x7f984fcca040>, body: {"keypair": {"name": "tempest-keypair-1269717586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmf6Uq1wBj7kNymxSHF/sUpf6MajwYZ176r/H6n8a/gZV8PKydoMqHmvO+Stuh67RJ1N975aNhPR1QkhFo4d2d5xIEo7fRkcyJFE2w2UDF+c09e35z++MWoXZ6Jd8tcrA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:54.756502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8884ac63-e088-4e4d-9996-d3166b1491dd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:54.762594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8884ac63-e088-4e4d-9996-d3166b1491dd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for user 39e82edaa30d418d96ea37f942d62755 and project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:54.802546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8884ac63-e088-4e4d-9996-d3166b1491dd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.079413 Jun 25 20:54:54.806339 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 470/829] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 20:54:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 20:54:54.822830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-563440935", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "451", "networks": [{"uuid": "584e3648-cba8-4e84-a39f-cca5a7e46799"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:54.969143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] validate_networks() for [('584e3648-cba8-4e84-a39f-cca5a7e46799', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:55.374732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:55.404896 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a583375-1af2-431e-9cbb-5408a905ef48 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.900973 Jun 25 20:54:55.405680 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 360/830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:54 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:55.416883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd4841cb-b782-4f7f-9a08-24e93f1329ac tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] Calling method '.version_select at 0x7f985ccc3550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:55.437743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fd4841cb-b782-4f7f-9a08-24e93f1329ac tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd4841cb-b782-4f7f-9a08-24e93f1329ac tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] Request method failure captured: Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-simple-tenant-usage/5260992f3b084c389ae95a11610b6983?start=2022-06-26T20%3A54%3A53.562499&end=2022-06-24T20%3A54%3A53.562499 HTTP/1.1 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Yde3IpEolSBHHZpRkIVHH8wWVViBU-2lQZ0dc8Px_IFuTnOCU06cDZgHuD6A7OSct8mSou7cAIqlHUarBmuIX2EARTrU_cUbhVbKS3gzHFakaluyXGj89TVyA9zBXqTA2Ai23zC51UrFb_IpxHseq5ehH2WDoJaH5wXxDpEdggO_w Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ef7317ccfced44c9868ae6c4ffbc8035 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1188633604 Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 20:54:55.450604 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ef7317ccfced44c9868ae6c4ffbc8035"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef7317ccfced44c9868ae6c4ffbc8035"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ef7317ccfced44c9868ae6c4ffbc8035"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ef7317ccfced44c9868ae6c4ffbc8035"}]}] Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1188633604 Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ef7317ccfced44c9868ae6c4ffbc8035 Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1188633604 Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 4181eb50a22c45538246cbe11e4a7443 Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid start time. The start time cannot occur after the end time. Jun 25 20:54:55.452456 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '5260992f3b084c389ae95a11610b6983'} Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 25 20:54:55.453389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jun 25 20:54:55.454902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.456513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd4841cb-b782-4f7f-9a08-24e93f1329ac tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:55.457580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd4841cb-b782-4f7f-9a08-24e93f1329ac tempest-TenantUsagesNegativeTestJSON-1188633604 tempest-TenantUsagesNegativeTestJSON-1188633604-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/5260992f3b084c389ae95a11610b6983?start=2022-06-26T20%3A54%3A53.562499&end=2022-06-24T20%3A54%3A53.562499" status: 400 len: 111 microversion: 2.1 time: 0.050776 Jun 25 20:54:55.458730 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 361/831] 10.222.0.39 () {58 vars in 1411 bytes} [Sat Jun 25 20:54:55 2022] GET /compute/v2.1/os-simple-tenant-usage/5260992f3b084c389ae95a11610b6983?start=2022-06-26T20%3A54%3A53.562499&end=2022-06-24T20%3A54%3A53.562499 => generated 111 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:54:55.464005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:55.471733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:55.491166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:55.492252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:55.493948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:55.494811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:55.689372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:55.727752 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89a7d07a-962d-4728-bbe0-9ff945342524 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1945 microversion: 2.75 time: 0.254557 Jun 25 20:54:55.730958 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 362/832] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:55 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1945 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:55.830438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:55.916439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65766e50-338e-4748-9124-4a591b1108cf tempest-TenantUsagesNegativeTestJSON-1143224981 tempest-TenantUsagesNegativeTestJSON-1143224981-project] Calling method '.version_select at 0x7f985c8e10d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:55.918781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65766e50-338e-4748-9124-4a591b1108cf tempest-TenantUsagesNegativeTestJSON-1143224981 tempest-TenantUsagesNegativeTestJSON-1143224981-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '63142884f27b46e18e3c0a44dc973199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5260992f3b084c389ae95a11610b6983', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65766e50-338e-4748-9124-4a591b1108cf tempest-TenantUsagesNegativeTestJSON-1143224981 tempest-TenantUsagesNegativeTestJSON-1143224981-project] Request method failure captured: Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-24T20%3A54%3A53.562499&end=2022-06-26T20%3A54%3A53.562499&detailed=1 HTTP/1.1 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Ycjr2-Wi__L0XWYP7QRQE0mBo5pMXFvmuoyJo9KDvo7udHSViPgiCHWT9U2mwvcgKdnGmjtHOyfd7oSDh2QpFIKpADnZwsUL6L5o21iZ5ccMQEfG6cCixwUc8k-BGTwnKn8CNeefduhirDHrW9lI0VcXKYsnFltSWMPMqAJzpreh8 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5260992f3b084c389ae95a11610b6983 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1143224981 Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:54:55.920795 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5260992f3b084c389ae95a11610b6983"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5260992f3b084c389ae95a11610b6983"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5260992f3b084c389ae95a11610b6983"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5260992f3b084c389ae95a11610b6983"}]}] Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1143224981 Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5260992f3b084c389ae95a11610b6983 Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1143224981 Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TenantUsagesNegativeTestJSON-1143224981-project Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 63142884f27b46e18e3c0a44dc973199 Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1143224981-project Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: action_args: {} Jun 25 20:54:55.922392 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._index(req) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:54:55.923374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:54:55.924906 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:54:55.926297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jun 25 20:54:55.926297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:54:55.935657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65766e50-338e-4748-9124-4a591b1108cf tempest-TenantUsagesNegativeTestJSON-1143224981 tempest-TenantUsagesNegativeTestJSON-1143224981-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:54:55.947832 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65766e50-338e-4748-9124-4a591b1108cf tempest-TenantUsagesNegativeTestJSON-1143224981 tempest-TenantUsagesNegativeTestJSON-1143224981-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-24T20%3A54%3A53.562499&end=2022-06-26T20%3A54%3A53.562499&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.203588 Jun 25 20:54:55.948979 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 363/833] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 25 20:54:55 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-24T20%3A54%3A53.562499&end=2022-06-26T20%3A54%3A53.562499&detailed=1 => generated 123 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:54:55.964201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:55.964705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:54:55.965191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:54:55.965733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:54:55.966203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:54:55.966789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:54:55.969466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:55.991882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=15 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:56.000653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.001122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.001922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.002400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.005093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.010592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.014456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.015338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.079912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:54:56.088339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Getting quotas for user db1c30066ddd478fafc7c203867fd7de and project af0da2567efe463f90d5db2b4a125ba1. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:54:56.126525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:54:56.132179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:54:56.256580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b22050a9-aa70-4adf-b785-4b903f6cc670 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448482 Jun 25 20:54:56.260242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 471/834] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1453 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:54:56.273422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-07bde9f4-2a80-4015-bc31-43073241d93b req-6762a962-717d-42ea-9e0b-975ede6262d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eb21e49-578b-46a6-9a82-50e2976d3c07", "tag": "34ebf2b2-cc27-4965-900f-ff6458f0c07b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:56.295994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-07bde9f4-2a80-4015-bc31-43073241d93b req-6762a962-717d-42ea-9e0b-975ede6262d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.297035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-07bde9f4-2a80-4015-bc31-43073241d93b req-6762a962-717d-42ea-9e0b-975ede6262d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.313678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-07bde9f4-2a80-4015-bc31-43073241d93b req-6762a962-717d-42ea-9e0b-975ede6262d7 service nova] Creating event network-changed:34ebf2b2-cc27-4965-900f-ff6458f0c07b for instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 on nch2-master-1 Jun 25 20:54:56.319953 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-07bde9f4-2a80-4015-bc31-43073241d93b req-6762a962-717d-42ea-9e0b-975ede6262d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058260 Jun 25 20:54:56.321424 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 472/835] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:54:56.366745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99b684f1-3d6b-4a88-9820-c7ecc5d48220 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:56.367533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99b684f1-3d6b-4a88-9820-c7ecc5d48220 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:56.553252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99b684f1-3d6b-4a88-9820-c7ecc5d48220 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:56.560877 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99b684f1-3d6b-4a88-9820-c7ecc5d48220 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1220 microversion: 2.1 time: 0.235479 Jun 25 20:54:56.571318 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 473/836] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:56 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1220 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:56.576274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:56.577110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:56.591349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.591800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.592633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.593070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.609721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:56.690652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:56.702961 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-292630a2-3f41-4ccc-b59c-1cc482bde2eb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.751018 Jun 25 20:54:56.720583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 364/837] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:55 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:56.754356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:56.754974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:56.761437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.766853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.767874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:56.768573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:56.971055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:57.031636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d1d5c4e-3bad-45d0-bf50-a5bba0c9041d tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1933 microversion: 2.75 time: 0.278106 Jun 25 20:54:57.036762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 365/838] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:56 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1933 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:54:57.317992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:57.329301 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44c5189f-ad42-40d0-94fa-7e1bcf55fdfa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.763565 Jun 25 20:54:57.345330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 474/839] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:56 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:57.579952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:57.580323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:57.592391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:57.592868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:57.595558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:57.599162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:57.727441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:57.728776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:57.737825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:57.738279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:57.739071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:57.739511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:57.926910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:57.938085 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95d72248-81a7-4282-9e8e-cc50ca6e5e3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1272 microversion: 2.1 time: 0.362574 Jun 25 20:54:57.947789 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 366/840] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:57 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1272 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:58.032895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:58.048920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-859c3842-cddd-4151-8bc5-709a35719e00 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.322179 Jun 25 20:54:58.058913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:58.059778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:58.060711 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 475/841] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:57 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:58.072686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.073402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:58.074409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.075003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:58.143130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:58.332003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:58.361879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:58.363530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:58.364141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:58.366659 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db646a1c-add7-4628-b5e3-0b4fe04f84d6 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1933 microversion: 2.75 time: 0.312779 Jun 25 20:54:58.369102 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 367/842] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:58 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1933 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:58.375087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.376602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:58.379159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.381594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:58.427221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1223642632", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "7ef2b2be-dae0-4c92-af7f-25bfe52fff3b"}], "security_groups": [{"name": "tempest-securitygroup--1621159958"}], "key_name": "tempest-keypair-1269717586", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:54:58.662868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:58.704655 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fbdaeb98-7252-461f-8ee7-50e4d09d59b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1311 microversion: 2.1 time: 0.342703 Jun 25 20:54:58.718538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 476/843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:58 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1311 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:54:58.897650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] validate_networks() for [('7ef2b2be-dae0-4c92-af7f-25bfe52fff3b', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:54:58.972100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:58.973381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:58.983251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.987320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:58.992975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:58.993686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.151256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:59.159382 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23bf9836-8480-45c2-803b-0e7801eb745d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1278 microversion: 2.1 time: 0.195012 Jun 25 20:54:59.165500 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 477/844] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:58 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:59.176354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:59.177010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:59.186283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.190323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.191161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.191654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.463025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:54:59.471637 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-462b1e4b-f3ea-433a-b771-a70f997c40e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.305680 Jun 25 20:54:59.472247 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 478/845] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:59 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:54:59.480165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:59.481021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:59.487482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:59.501456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.503741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.507505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.508245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.740031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:54:59.827666 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e285b5c-9de6-4c01-90d8-e09502e764a9 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1933 microversion: 2.75 time: 0.345091 Jun 25 20:54:59.828965 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 479/846] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:54:59 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1933 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:54:59.841935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:54:59.842553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:54:59.855939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.856385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:54:59.857182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:54:59.857611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.380189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:00.393327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-822f7e6f-61b4-4743-b755-d60da36e3c0a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1494 microversion: 2.1 time: 0.563128 Jun 25 20:55:00.394612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 480/847] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:54:59 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1494 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:00.399816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:00.400723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:00.407528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.413099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.414684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.415354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.507294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:00.516289 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9dd4379b-a157-4f3e-b771-4aab937a2f0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1278 microversion: 2.1 time: 0.120392 Jun 25 20:55:00.518127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 481/848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:00 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1278 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:00.523124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:00.524017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:00.537016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.537720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.542573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.543140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.693339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:00.694431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:00.695068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:00.695565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:00.696069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:00.731368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.736628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.745719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.750643 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4db073ef-4285-4913-ad8d-436f599d9aa4 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1645 microversion: 2.1 time: 0.231331 Jun 25 20:55:00.753083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.761402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 482/849] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:00 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1645 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:00.777021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:00.778086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:00.789487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:00.791164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.793869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.794283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for user 39e82edaa30d418d96ea37f942d62755 and project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:00.795413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:00.795980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:00.809214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:00.812235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:00.949290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9650e88e-ed21-472b-93b8-b32f2f3e513a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 2.526978 Jun 25 20:55:00.950591 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 368/850] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:54:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2529 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 20:55:00.963049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6506223c-3ce1-4816-966a-a1f7a427ab2e req-7e018e39-b8f1-46e0-8349-1d8e18e57829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e58ad0c7-18a4-4c83-8060-9fcbe8848dfd", "tag": "dd191e62-5000-418a-92b1-2844693e3a5a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:01.003810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6506223c-3ce1-4816-966a-a1f7a427ab2e req-7e018e39-b8f1-46e0-8349-1d8e18e57829 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.009687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6506223c-3ce1-4816-966a-a1f7a427ab2e req-7e018e39-b8f1-46e0-8349-1d8e18e57829 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.048330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:01.053072 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6506223c-3ce1-4816-966a-a1f7a427ab2e req-7e018e39-b8f1-46e0-8349-1d8e18e57829 service nova] Creating event network-changed:dd191e62-5000-418a-92b1-2844693e3a5a for instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd on nch2-master-1 Jun 25 20:55:01.058303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f527d4e2-0a1c-4e93-8f9f-9f05ab4a0319 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.288601 Jun 25 20:55:01.059082 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 483/851] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:00 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:01.064684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:01.065533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:01.071990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6506223c-3ce1-4816-966a-a1f7a427ab2e req-7e018e39-b8f1-46e0-8349-1d8e18e57829 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117296 Jun 25 20:55:01.073077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.073491 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 369/852] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:01.073608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.075469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.076029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.084767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:01.085971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:01.105094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.106194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.108076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.108734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.303568 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a7e333a-4700-457a-9cfa-1112914b5b3c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1645 microversion: 2.1 time: 0.242700 Jun 25 20:55:01.305205 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 484/853] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:01 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1645 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:01.314490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:01.315190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:01.407340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:01.432797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:01.434563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:01.444974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b7fa819-bee1-40a1-bd48-8edf57b81b70 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1286 microversion: 2.25 time: 0.136211 Jun 25 20:55:01.452765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 485/854] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:01 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:01.468209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:01.471082 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:55:01.471082 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:55:01.473134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.479307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.480231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.481706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.607131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f78f766f-217b-4479-98bd-87d35ca21bb7 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.153100 Jun 25 20:55:01.608019 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 486/855] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:55:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:01.685199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:01.685199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:01.685199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.685199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.686580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.686580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.889766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:01.898696 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a1fef63-23ef-41db-8099-05d03940ee33 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.280990 Jun 25 20:55:01.899307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 487/856] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:01 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:01.914898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:01.915472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:01.924123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.924619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.925580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:01.926030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:01.973398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] Lazy-loading 'services' on Instance uuid 2320f463-061e-4bbd-8c53-fa3a7024584c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:55:02.031648 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9355bbd6-fd67-4753-853d-4f78879dfe76 tempest-ServersAdmin275Test-1146283682 tempest-ServersAdmin275Test-1146283682-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1918 microversion: 2.75 time: 0.956653 Jun 25 20:55:02.037211 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 370/857] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:01 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1918 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:02.081319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.084787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.094212 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25bf7891-cb1c-48a3-a41c-4e50ca4a0b8a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2/action" status: 202 len: 0 microversion: 2.1 time: 0.183559 Jun 25 20:55:02.096677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.097415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.098860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.098991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 488/858] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:01 2022] POST /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:55:02.099804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.116738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.117909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.136857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.137330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.138206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.138644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.161492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:55:02.324042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f222163b-5b9d-4f44-a92d-4c92067d83ec tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 204 len: 0 microversion: 2.75 time: 0.256572 Jun 25 20:55:02.325504 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 371/859] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 20:55:02 2022] DELETE /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:55:02.337135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.347537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.369305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.369754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.370527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.379614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.404186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.412939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84b2793d-eaf4-4def-b58a-c7ead0d36367 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.312620 Jun 25 20:55:02.423883 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 489/860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:02 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:02.429730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.431358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.439513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.440237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.441196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.441782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.542304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.553703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.555815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.562836 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f29fb108-594e-4f7f-a119-33186d3334e8 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1443 microversion: 2.75 time: 0.137486 Jun 25 20:55:02.563936 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 490/861] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:02 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1443 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:02.569520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.570328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.577126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.577932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.578996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.579598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.584382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:02.686337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.713710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.715649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:02.718525 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa19d035-2e03-4c08-a5d9-28bd4cad4f83 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1338 microversion: 2.25 time: 0.151885 Jun 25 20:55:02.719708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 491/862] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:02 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:02.926636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:02.928772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:02.940170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.940665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:02.941715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:02.943148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.215591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.228621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9a306e8-defd-4c97-9fb9-84c67c0d1a52 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.313201 Jun 25 20:55:03.241633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 492/863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:02 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:03.434596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:03.435697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:03.463896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.465536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.466495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.468482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.670975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.681276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff2f9d28-e852-4122-8f2a-2dcd91af85c8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.254662 Jun 25 20:55:03.683032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 493/864] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:03 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:03.698868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:03.700170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:03.709703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.714383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.715746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.718257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.864268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.873896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.875396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.881978 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71a7d110-380a-41fd-bba5-b04dbc04efde tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1443 microversion: 2.75 time: 0.194564 Jun 25 20:55:03.882516 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 494/865] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:03 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1443 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:03.887358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:03.887975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:03.894902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.895328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.896093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:03.896557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:03.976005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.984967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.986478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:03.987615 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72a0753b-f2ef-41f8-a806-cf9fbdc45b1a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1344 microversion: 2.25 time: 0.104282 Jun 25 20:55:03.988604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 495/866] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:03 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:04.100872 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2348630-656e-4fe8-8737-ad12d8c383d2 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1650 microversion: 2.1 time: 1.772288 Jun 25 20:55:04.113857 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 372/867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:02 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1650 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:04.248490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:04.249256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:04.259183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.259763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:04.260668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.261196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:04.443030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:04.452088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8acbc41-97e9-4531-b053-980f2c7d0dc7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.208409 Jun 25 20:55:04.465037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 496/868] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:04 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:04.699802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:04.700578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:04.710862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.713463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:04.720123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.720795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:04.901664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:04.902299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:04.919385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.919835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:04.920739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:04.921164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.056817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.066788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.076715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.087100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e29fc75a-eec6-4cda-89e4-457307b37b8b tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1443 microversion: 2.75 time: 0.189401 Jun 25 20:55:05.088819 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 497/869] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:04 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1443 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:55:05.100625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:05.101271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:05.116465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.117050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.118628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.119243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.193107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.205683 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e4dcc1b3-5fcd-4c81-9ae2-0ae875dd4bf8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.510238 Jun 25 20:55:05.211472 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 373/870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:04 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:05.223195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:05.224221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:05.241400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.242069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.246084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.246725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.473733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.487902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.492531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:05.495182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72fc9020-bb76-495f-a2f1-41f74539e8d9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1344 microversion: 2.25 time: 0.404200 Jun 25 20:55:05.497402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 498/871] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:05 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1344 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:05.509028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:05.509931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:05.522492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.523237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.524765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.525364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.650354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78ca476e-32cd-4c39-a0a4-de70df66ce1c tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1630 microversion: 2.1 time: 0.437371 Jun 25 20:55:05.653788 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 374/872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:05 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1630 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:05.672195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:05.673424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:05.685679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.686384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.687343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:05.687926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:05.746740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lazy-loading 'flavor' on Instance uuid 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:55:05.776334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Going to try to live migrate instance to nch2-master-1 {{(pid=137462) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:55:06.092060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:06.113501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fd9229e-b34c-43ec-a352-41e23c5d5bdd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.607625 Jun 25 20:55:06.116189 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 499/873] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:05 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:06.132794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-70b18113-f4f5-44a4-a0da-092583afa115 req-a17bf7a5-b171-422b-b238-a76f0982cea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb21e49-578b-46a6-9a82-50e2976d3c07", "name": "network-vif-plugged", "status": "completed", "tag": "34ebf2b2-cc27-4965-900f-ff6458f0c07b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:06.152864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-70b18113-f4f5-44a4-a0da-092583afa115 req-a17bf7a5-b171-422b-b238-a76f0982cea7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:06.154864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-70b18113-f4f5-44a4-a0da-092583afa115 req-a17bf7a5-b171-422b-b238-a76f0982cea7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:06.196009 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-70b18113-f4f5-44a4-a0da-092583afa115 req-a17bf7a5-b171-422b-b238-a76f0982cea7 service nova] Creating event network-vif-plugged:34ebf2b2-cc27-4965-900f-ff6458f0c07b for instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 on nch2-master-1 Jun 25 20:55:06.214510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-70b18113-f4f5-44a4-a0da-092583afa115 req-a17bf7a5-b171-422b-b238-a76f0982cea7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095569 Jun 25 20:55:06.215664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 500/874] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:06.231774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:06.236476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:06.251413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:06.254837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:06.257843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:06.258481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:06.475993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:06.487804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:06.497218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7001fd3982074ec9ac00f5acd8efd71d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b3a9ffdd5b4cf5b483c2a770e54a85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:06.526643 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc37435b-4af7-4e0c-a4f1-c6296854397e tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 200 len: 1443 microversion: 2.75 time: 0.308850 Jun 25 20:55:06.548963 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 501/875] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:06 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 1443 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:06.555071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:06.556098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:06.567909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:06.568859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:06.569940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:06.571004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:07.322826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:07.336562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cbeed765-d700-4b08-945d-eed46e9d8f26 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.786077 Jun 25 20:55:07.346637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 502/876] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:06 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:07.352777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5fdf6a77-c319-429a-979d-98297b6c21f4 req-a57d748c-e77f-47e3-988d-5729fccb8a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8505f371-d80e-4de9-8d6f-def9249e9029", "tag": "dec92e90-403a-4ca6-bc6f-8f0b0625e6b8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:07.365250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fdf6a77-c319-429a-979d-98297b6c21f4 req-a57d748c-e77f-47e3-988d-5729fccb8a25 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:07.366004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fdf6a77-c319-429a-979d-98297b6c21f4 req-a57d748c-e77f-47e3-988d-5729fccb8a25 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:07.414292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5fdf6a77-c319-429a-979d-98297b6c21f4 req-a57d748c-e77f-47e3-988d-5729fccb8a25 service nova] Creating event network-changed:dec92e90-403a-4ca6-bc6f-8f0b0625e6b8 for instance 8505f371-d80e-4de9-8d6f-def9249e9029 on nch2-master-1 Jun 25 20:55:07.421302 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5fdf6a77-c319-429a-979d-98297b6c21f4 req-a57d748c-e77f-47e3-988d-5729fccb8a25 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072958 Jun 25 20:55:07.422686 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 503/877] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:07.450152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:07.461293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:07.479052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:07.483301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:07.485045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:07.492714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:07.743609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:07.758041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:07.759776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:07.765275 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02789595-c134-4e9e-93eb-8e0cb239785d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1344 microversion: 2.25 time: 0.322727 Jun 25 20:55:07.766530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 504/878] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:07 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1344 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:07.780216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:07.781342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:07.794620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:07.795297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:07.796317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:07.797009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.258782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:08.273142 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-710cd895-53b1-4b61-84c8-aacc2880645b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.502986 Jun 25 20:55:08.275234 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 505/879] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:07 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:08.281207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:08.282298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] [instance: 2320f463-061e-4bbd-8c53-fa3a7024584c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:08.291089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.291910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.292967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.293607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.322874 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] HTTP exception thrown: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Request method failure captured: Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c HTTP/1.1 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3XT3B9RnQwhCv7fz13Th06P4g7USL0XRS-ygArcQwVrZJEkj5GVCNs5BB5XrW5BLYI81vQxPRHBA2cVVTygkpaHYAw8aoCBE5RPkFj8f0cgEhWSyN_7JnsXnPwy6QT0YPcb2vttlxwyL6wjPPx0naRAL9plZq8GFJCjPz5fx_Ot4fE Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.75 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 26b3a9ffdd5b4cf5b483c2a770e54a85 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAdmin275Test-1161447156 Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:55:08.325636 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26b3a9ffdd5b4cf5b483c2a770e54a85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26b3a9ffdd5b4cf5b483c2a770e54a85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26b3a9ffdd5b4cf5b483c2a770e54a85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26b3a9ffdd5b4cf5b483c2a770e54a85"}]}] Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAdmin275Test-1161447156 Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 26b3a9ffdd5b4cf5b483c2a770e54a85 Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAdmin275Test-1161447156 Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAdmin275Test-1161447156-project Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 7001fd3982074ec9ac00f5acd8efd71d Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAdmin275Test-1161447156-project Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. Jun 25 20:55:08.327109 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '2320f463-061e-4bbd-8c53-fa3a7024584c'} Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:55:08.327988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. Jun 25 20:55:08.329466 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:08.332271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] Returning 404 to user: Instance 2320f463-061e-4bbd-8c53-fa3a7024584c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:55:08.332271 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3ba6b29-3738-45bf-b4ff-1d9082781844 tempest-ServersAdmin275Test-1161447156 tempest-ServersAdmin275Test-1161447156-project] 10.222.0.39 "GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c" status: 404 len: 111 microversion: 2.75 time: 0.053558 Jun 25 20:55:08.336576 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 506/880] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:08 2022] GET /compute/v2.1/servers/2320f463-061e-4bbd-8c53-fa3a7024584c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:55:08.354657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:08.355557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:08.362025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.362744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.363739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.364444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.858959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:08.891626 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-afb2d00b-db21-45f7-ad6a-561a3e0b16cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1317 microversion: 2.1 time: 0.517895 Jun 25 20:55:08.900842 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 507/881] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:08 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1317 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:08.907782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:08.909956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:08.936133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.938391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.942041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:08.945538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:08.995162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb9fdafc-40f8-4232-8197-bf7cb593770a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2/action" status: 202 len: 0 microversion: 2.1 time: 3.327029 Jun 25 20:55:08.996172 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 375/882] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:05 2022] POST /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2/action => generated 0 bytes in 3329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:55:09.007724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:09.008936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:09.062861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.063859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.069528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.070057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.316694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:09.336903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:09.341496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:09.345459 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34878f74-f5d8-41c3-b3f1-76283f868f33 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.451798 Jun 25 20:55:09.357562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 508/883] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:08 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:09.366466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:09.382016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:09.389129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.389852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.390820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.391696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.707025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:09.709869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:09.722562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f7ab18e-9f9e-45bf-b8e0-219ef8fdee8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.363441 Jun 25 20:55:09.724041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 509/884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:09 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:09.732240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3f924452-c54d-41d8-87da-8a387c88430d req-cc0d72ce-db83-44b4-b77b-f8e5840bb7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cac27ed-8830-4d48-837c-fa36a7d437dd", "tag": "1072ee83-51a7-445b-96fe-48d45e8fdb63"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:09.755049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3f924452-c54d-41d8-87da-8a387c88430d req-cc0d72ce-db83-44b4-b77b-f8e5840bb7d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.757098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3f924452-c54d-41d8-87da-8a387c88430d req-cc0d72ce-db83-44b4-b77b-f8e5840bb7d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.786995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3f924452-c54d-41d8-87da-8a387c88430d req-cc0d72ce-db83-44b4-b77b-f8e5840bb7d0 service nova] Creating event network-changed:1072ee83-51a7-445b-96fe-48d45e8fdb63 for instance 0cac27ed-8830-4d48-837c-fa36a7d437dd on nch2-master-1 Jun 25 20:55:09.795652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3f924452-c54d-41d8-87da-8a387c88430d req-cc0d72ce-db83-44b4-b77b-f8e5840bb7d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067382 Jun 25 20:55:09.809294 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 510/885] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:09.910524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:09.911393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:09.928831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.934073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:09.935858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:09.936549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.419890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:10.438430 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a4369ed-4bd5-4b18-9a77-11315fb4ae39 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 1.437711 Jun 25 20:55:10.444239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 376/886] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:08 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:10.449730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:10.450353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:10.469380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.469956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.470801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.471236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.700553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:10.714021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:10.716589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:10.719133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:10.721774 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a0fb502-ad25-4144-bc62-2778e0385f72 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.275652 Jun 25 20:55:10.724779 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 377/887] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:10 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:10.735999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68646e21-35dc-4601-8bc0-9f51e9fd1438 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1465 microversion: 2.1 time: 0.830377 Jun 25 20:55:10.736663 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 511/888] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:09 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1465 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:10.741865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:10.743268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:10.752911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:10.753531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:10.761239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.761712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.762661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.763096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.771425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.772012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.783235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:10.788587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:10.793521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:10.818844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=20 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:11.095065 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d391de5f-4618-4e89-bfaf-269278743be8 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1616 microversion: 2.1 time: 0.345369 Jun 25 20:55:11.112904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 512/889] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:10 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1616 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:11.302166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1055538363", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["0acaf208-7f08-43b0-a4cf-21cdcf91b5f8"]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:11.384892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:55:11.413093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:11.424463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=9 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:11.445786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66fb9e38-b00e-452c-9a46-25627dcb5e8a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.708866 Jun 25 20:55:11.446396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 378/890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:10 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:11.475823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:11.477489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:11.497367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:11.507712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:11.511293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:11.517013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:11.517641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:11.854614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:11.870165 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f6fd507-823e-4c6a-8e78-8321404e102b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.416118 Jun 25 20:55:11.870803 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 379/891] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:11 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:11.885948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:11.887887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:11.905389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:11.906466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:11.912812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:11.913538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.171877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:12.173047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:12.173743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:12.174356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:12.174967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:12.192060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.195082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.196181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.198757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.244231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:12.263478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:12.291137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:12.300384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:12.432585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2b9b14c9-dca1-4d04-a432-39df70d55042 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.134436 Jun 25 20:55:12.436492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 513/892] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:55:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:55:12.445018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6bbdd453-60ce-46d6-8c5b-fca3f4513d8d req-827ede79-bfa3-4ad0-b6f2-6367c875d2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:12.477005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6bbdd453-60ce-46d6-8c5b-fca3f4513d8d req-827ede79-bfa3-4ad0-b6f2-6367c875d2d3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.479615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6bbdd453-60ce-46d6-8c5b-fca3f4513d8d req-827ede79-bfa3-4ad0-b6f2-6367c875d2d3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.501790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6bbdd453-60ce-46d6-8c5b-fca3f4513d8d req-827ede79-bfa3-4ad0-b6f2-6367c875d2d3 service nova] Creating event network-changed:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:55:12.526186 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6bbdd453-60ce-46d6-8c5b-fca3f4513d8d req-827ede79-bfa3-4ad0-b6f2-6367c875d2d3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088119 Jun 25 20:55:12.529767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 514/893] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:12.546252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f283dd20-4542-4ee8-be06-40ebbf45d836 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:12.547471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f283dd20-4542-4ee8-be06-40ebbf45d836 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:12.550842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:12.556150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:12.566346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:12.567844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:12.573919 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65a879de-34df-4e05-b5de-a7173c57f669 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.701160 Jun 25 20:55:12.580719 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 380/894] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:11 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:12.597472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:12.598114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:12.626850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.627313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.628094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.636729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.658656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:12.872411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f283dd20-4542-4ee8-be06-40ebbf45d836 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:12.886905 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f283dd20-4542-4ee8-be06-40ebbf45d836 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1217 microversion: 2.1 time: 0.355028 Jun 25 20:55:12.901216 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 515/895] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:12 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1217 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:12.921330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fef216b1-8aee-458c-ad34-bfc24e8e75ea req-bdcc8f48-e077-4998-8419-ed7456e931d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58ad0c7-18a4-4c83-8060-9fcbe8848dfd", "name": "network-vif-plugged", "status": "completed", "tag": "dd191e62-5000-418a-92b1-2844693e3a5a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:12.951836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fef216b1-8aee-458c-ad34-bfc24e8e75ea req-bdcc8f48-e077-4998-8419-ed7456e931d9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:12.958070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fef216b1-8aee-458c-ad34-bfc24e8e75ea req-bdcc8f48-e077-4998-8419-ed7456e931d9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:12.989546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fef216b1-8aee-458c-ad34-bfc24e8e75ea req-bdcc8f48-e077-4998-8419-ed7456e931d9 service nova] Creating event network-vif-plugged:dd191e62-5000-418a-92b1-2844693e3a5a for instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd on nch2-master-1 Jun 25 20:55:13.001288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fef216b1-8aee-458c-ad34-bfc24e8e75ea req-bdcc8f48-e077-4998-8419-ed7456e931d9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096096 Jun 25 20:55:13.005792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 516/896] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:13.017741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:13.019483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:13.036214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.036975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:13.037960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.038555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:13.211019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:13.227678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0160a1c-b69e-44f8-87d4-979d07240813 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.645712 Jun 25 20:55:13.228322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 381/897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:12 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:13.599539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:13.600295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:13.614413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.614943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:13.619883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.621012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:13.694891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:13.722232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76583dbe-9965-44ba-a63a-c08ec1369147 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.714257 Jun 25 20:55:13.740085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 517/898] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:13 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:13.906906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:13.907544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:13.921743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.922475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:13.923455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:13.925816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:14.291583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:14.306656 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc7d25f3-0308-44cf-b90c-5b483d52823f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1213 microversion: 2.1 time: 0.399822 Jun 25 20:55:14.307648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 518/899] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:13 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1213 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:14.331078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:14.331937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:14.351157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:14.351906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:14.354274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:14.356063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:14.803518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:14.813821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:14.815334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:14.827174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fde89752-885f-4038-820b-17fc652c7880 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 1.229573 Jun 25 20:55:14.827942 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 382/900] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:13 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:55:14.845337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:14.855664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:14.874604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:14.880094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:14.881003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:14.884121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-043e4793-048d-4a05-bbd0-3d572c74d0e7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.565447 Jun 25 20:55:14.886524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:14.888460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:14.892625 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 519/901] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:14 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:15.325113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:15.326179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:15.343038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:15.350759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:15.354971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:15.356629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:15.457553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:15.467612 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d45d568-68dd-456a-8299-4cfa9b345aa7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1275 microversion: 2.1 time: 0.146856 Jun 25 20:55:15.500174 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 520/902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:15 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1275 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:15.707103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:15.722319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-24878d75-178c-4f3a-99c5-ee1d263919af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.892408 Jun 25 20:55:15.723107 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 383/903] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:14 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:15.851038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:15.853030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:15.881862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:15.886604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:15.887685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:15.888023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.100100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] Calling method '.version_select at 0x7f984fc9e430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:16.196248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb could not be found", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 20:55:16.197265 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] HTTP exception thrown: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] Request method failure captured: Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-floating-ips/5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb HTTP/1.1 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3YzKNGUDjnMgcdmD-YyNJTsJ8AsEPz2Qrz-olh2IehrQz-rzc25ODY8yh2l-d1tMfLURCgfaf_tGsZmglWG0zmSZ9494VlU8QteOeY3Eu1Yl-LVsgaaiMb7FB-vY-dH-_6UlZV7_cbIZ9BlT5uzU8oQGg5un7YYJlWpUdYX-poKJpY Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 0801d9a5f554498ca601b58fd3b7f273 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-649131315 Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:55:16.200319 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0801d9a5f554498ca601b58fd3b7f273"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0801d9a5f554498ca601b58fd3b7f273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0801d9a5f554498ca601b58fd3b7f273"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0801d9a5f554498ca601b58fd3b7f273"}]}] Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-649131315 Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 0801d9a5f554498ca601b58fd3b7f273 Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-649131315 Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-649131315-project Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: d3905dd6225b4bb897143cd1a27df118 Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-649131315-project Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb Jun 25 20:55:16.202291 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb'} Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:16.203202 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb could not be found Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-613eeac9-a33b-407d-9eb4-f389a182ba7c'] Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb. Jun 25 20:55:16.204895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:16.206209 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:55:16.207661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:55:16.207661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb Jun 25 20:55:16.207661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:16.209647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] Returning 404 to user: Floating IP not found for ID 5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:55:16.211071 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2f85b76-747c-46ae-96cf-d7d2d0b34dd8 tempest-FloatingIPDetailsNegativeTestJSON-649131315 tempest-FloatingIPDetailsNegativeTestJSON-649131315-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb" status: 404 len: 111 microversion: 2.1 time: 0.709734 Jun 25 20:55:16.211818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 521/904] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 20:55:15 2022] GET /compute/v2.1/os-floating-ips/5f1998f5-bd38-441c-a0d3-0f7b5e1eb2cb => generated 111 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:55:16.226660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:16.227723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:16.247902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.249526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.252519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.254127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.482971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:16.497700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:16.499262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:16.509915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48a789cd-9cc8-4d0c-99f2-e0a8f7387a4c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.667199 Jun 25 20:55:16.512680 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 384/905] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:15 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:16.524485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:16.525048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:16.548756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.556090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.557027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.557507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.844549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:16.879462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24f136c1-c7bf-4def-ad86-a83ad14e7a36 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.662645 Jun 25 20:55:16.880172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 522/906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:16 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:16.893475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:16.894090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:16.909776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.910484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:16.914279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:16.914892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:17.191231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:17.207517 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3cc804dc-2f29-4464-b93c-df7ff0a3d110 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1275 microversion: 2.1 time: 0.693423 Jun 25 20:55:17.208451 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 385/907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:16 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1275 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:17.221087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:17.230989 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-31984f40-11a3-4c74-92c8-72ef3a63998a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.344091 Jun 25 20:55:17.246455 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 523/908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:16 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:17.533197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:17.534397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:17.570860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:17.575971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:17.580834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:17.583643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:17.897994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:17.899937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:17.921756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:17.925015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:17.927604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:17.928341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:18.380116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:18.398394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-619cea3c-6826-4fd3-892d-a90d39546582 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.501953 Jun 25 20:55:18.400900 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 524/909] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:17 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:18.415026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:18.418100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:18.437294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:18.439539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:18.440918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:18.441887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:18.738437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:18.757140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:18.759293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:18.760916 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-938df9d6-28f0-4099-af6f-c52e3860c747 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 1.232932 Jun 25 20:55:18.775756 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 386/910] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:17 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:18.782314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:18.783338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:18.793063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:18.793798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:18.795955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:18.796717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:18.913894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:18.922888 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c8456c8-adb1-4cb6-a9e8-4aa7e6f67122 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1275 microversion: 2.1 time: 0.520243 Jun 25 20:55:18.931313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 525/911] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:18 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1275 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:19.288195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d56b1bb-2b8d-4ba6-8ff1-91b9ab7fc7f1 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Action: 'create', calling method: .version_select at 0x7f984fc9e700>, body: {"keypair": {"name": "tempest-keypair-984068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrQZD443jgfiXrNs5ZzhMad5f4CuZiML4BWUn6SLyEBvXnWKUX24t0mobJ+HlarKmSnXSmuhfQHPL87Kb6xaoGkQ/TLG+vHuLwkD4qEfzwfcTTf+yp/Z1bW9Gz1GO3Llg=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:19.316914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8d56b1bb-2b8d-4ba6-8ff1-91b9ab7fc7f1 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Getting quotas for project c734d57dbb974b2bba1efc21917a7269. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:19.341467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8d56b1bb-2b8d-4ba6-8ff1-91b9ab7fc7f1 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Getting quotas for user 9a8cd690a02e4b47afb24d9d4dba52b9 and project c734d57dbb974b2bba1efc21917a7269. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:19.356299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:19.367636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f22cc458-e728-4fc8-b80a-191aae2c28f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.590013 Jun 25 20:55:19.370694 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 387/912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:18 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:19.377210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d56b1bb-2b8d-4ba6-8ff1-91b9ab7fc7f1 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.444391 Jun 25 20:55:19.379900 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 526/913] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:55:18 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:19.382116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ece10493-6594-46f5-8121-4517d6847318 req-63407860-ffb0-4441-9843-27403add886b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8505f371-d80e-4de9-8d6f-def9249e9029", "name": "network-vif-plugged", "status": "completed", "tag": "dec92e90-403a-4ca6-bc6f-8f0b0625e6b8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:19.392015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ece10493-6594-46f5-8121-4517d6847318 req-63407860-ffb0-4441-9843-27403add886b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.392635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ece10493-6594-46f5-8121-4517d6847318 req-63407860-ffb0-4441-9843-27403add886b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.405685 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ece10493-6594-46f5-8121-4517d6847318 req-63407860-ffb0-4441-9843-27403add886b service nova] Creating event network-vif-plugged:dec92e90-403a-4ca6-bc6f-8f0b0625e6b8 for instance 8505f371-d80e-4de9-8d6f-def9249e9029 on nch2-master-1 Jun 25 20:55:19.417328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:19.418306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:19.426291 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ece10493-6594-46f5-8121-4517d6847318 req-63407860-ffb0-4441-9843-27403add886b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049900 Jun 25 20:55:19.429542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.430018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.430845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.431469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 388/914] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:19.431898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.700495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1f00d82a-e3e7-4a3b-a472-b6599d923ae9 req-48c53ecf-5214-4865-a2ad-a36c066c1ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "name": "network-vif-unplugged", "status": "completed", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:19.721323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1f00d82a-e3e7-4a3b-a472-b6599d923ae9 req-48c53ecf-5214-4865-a2ad-a36c066c1ea6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.725794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1f00d82a-e3e7-4a3b-a472-b6599d923ae9 req-48c53ecf-5214-4865-a2ad-a36c066c1ea6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.742447 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1f00d82a-e3e7-4a3b-a472-b6599d923ae9 req-48c53ecf-5214-4865-a2ad-a36c066c1ea6 service nova] Creating event network-vif-unplugged:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch1-master-1 Jun 25 20:55:19.751135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:19.757712 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1f00d82a-e3e7-4a3b-a472-b6599d923ae9 req-48c53ecf-5214-4865-a2ad-a36c066c1ea6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068691 Jun 25 20:55:19.763368 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1d6afc1-fbe5-4489-b48d-9415771939e6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.350457 Jun 25 20:55:19.765092 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 389/915] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:55:19.766146 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 527/916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:19 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:19.783773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:19.784718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:19.792240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.793208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.795120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.796021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.947771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:19.948611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:19.956636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.957476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:19.958504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:19.959239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:20.190027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:20.200367 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f23576e8-c48a-4a36-93cd-663dc5405873 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.256590 Jun 25 20:55:20.211576 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 528/917] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:19 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:20.387958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:20.388623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:20.398180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:20.398642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:20.399653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:20.400094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:20.603189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:20.615860 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-60ba1757-f719-4fb0-9b1d-de03967f5e84 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.231886 Jun 25 20:55:20.626603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 529/918] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:20 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:20.795856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:20.797919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:20.810865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:20.811656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:20.813651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:20.814984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:20.937304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:20.949738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:20.951286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:20.952769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1071e298-4193-4832-bbad-57fc064bb689 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 1.173694 Jun 25 20:55:20.955355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 390/919] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:19 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:21.110542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:21.119761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccde5657-7e7b-4a90-8563-13d774cca30c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.339092 Jun 25 20:55:21.120611 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 530/920] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:20 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:21.219310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:21.219846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:21.227637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.228344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.229319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.229906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.473294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cac27ed-8830-4d48-837c-fa36a7d437dd", "name": "network-vif-plugged", "status": "completed", "tag": "1072ee83-51a7-445b-96fe-48d45e8fdb63"}, {"server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "name": "network-vif-plugged", "status": "completed", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:21.488209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.488751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.508803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] Creating event network-vif-plugged:1072ee83-51a7-445b-96fe-48d45e8fdb63 for instance 0cac27ed-8830-4d48-837c-fa36a7d437dd on nch2-master-1 Jun 25 20:55:21.509373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] Creating event network-vif-plugged:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:55:21.546633 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5c81ea6d-78b3-4471-b4b4-eb7dde13e1e7 req-dc546ff3-02f2-49d8-ba93-4647359180d1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.077486 Jun 25 20:55:21.547289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 531/921] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:21.635585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:21.637357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:21.648256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.648723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.649590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.649920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.918457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:21.930115 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7c75268d-c4af-47e0-869a-b7cf458df7f7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.714700 Jun 25 20:55:21.942370 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 391/922] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:21 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:21.951095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f5f7e620-63ed-4cb8-9113-33c77d90dac1 req-cd6c381a-df19-485a-98a2-df1a1ec3d67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:21.965142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f5f7e620-63ed-4cb8-9113-33c77d90dac1 req-cd6c381a-df19-485a-98a2-df1a1ec3d67b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:21.965907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f5f7e620-63ed-4cb8-9113-33c77d90dac1 req-cd6c381a-df19-485a-98a2-df1a1ec3d67b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:21.980765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f5f7e620-63ed-4cb8-9113-33c77d90dac1 req-cd6c381a-df19-485a-98a2-df1a1ec3d67b service nova] Creating event network-changed:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch1-master-1 Jun 25 20:55:21.987003 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f5f7e620-63ed-4cb8-9113-33c77d90dac1 req-cd6c381a-df19-485a-98a2-df1a1ec3d67b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041101 Jun 25 20:55:21.988255 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 392/923] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:21.994590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:21.995566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:22.002762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.003902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:22.004922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.005612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:22.074680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:22.077840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:22.098493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-606b529e-add9-450d-88f0-d78e0d5f8c17 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.468039 Jun 25 20:55:22.100043 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 532/924] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:21 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:22.137947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:22.139704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:22.149252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.150341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:22.152677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.153373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:22.225284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:22.424237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:22.441965 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32b31844-a2c5-47c3-a928-04514304be98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.306497 Jun 25 20:55:22.444313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 533/925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:22 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:22.692679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:22.711626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:22.715521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:22.717818 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5925afe-1878-45c5-adaf-8ad654d81c2e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.728106 Jun 25 20:55:22.718617 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 393/926] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:21 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:22.949055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:22.950251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:22.970534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.971326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:22.974090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:22.975099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.118386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:23.118998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:23.147762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.151700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.152698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.153147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.430691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:23.444944 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-402a5a34-6c1f-451a-879e-255790b2ae90 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.501410 Jun 25 20:55:23.448462 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 534/927] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:22 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:23.460843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:23.461651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:23.469815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.470426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.471353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.471958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.732892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:23.750503 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c965eae3-c124-4366-bef5-24b758a7bc2a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1320 microversion: 2.1 time: 0.291974 Jun 25 20:55:23.752265 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 535/928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:23 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:23.760919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:23.770240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:23.782415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.785353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:23.786465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:23.788255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.107825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:24.119020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:24.121379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:24.123095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a562afd9-16f0-4d2c-b0c7-ce733ec10368 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1412 microversion: 2.25 time: 0.369351 Jun 25 20:55:24.124639 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 536/929] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:23 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1412 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:24.164104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:24.172182 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f00a919-99ff-4d89-9ef3-672aec7d59de tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 1.059688 Jun 25 20:55:24.182106 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 394/930] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:23 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:24.409151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:24.409884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:24.423456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.424207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.425207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.427856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.463533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:24.463946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:24.475003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.478516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.481024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.481930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.501076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:55:24.669006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e204a9c5-81f7-4ee4-a0cc-9c406c43e2f8 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 204 len: 0 microversion: 2.1 time: 0.263398 Jun 25 20:55:24.672513 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 537/931] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:55:24 2022] DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:55:24.701530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-20587cb9-b688-4736-afe3-b7d77381a6d8 req-bb50998e-af62-45ad-a6e9-ab88580346a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82702564-48ff-43c9-9848-c8aae19dde22", "tag": "5b02d65a-11dd-4a59-9689-166d5c8c55cf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:24.729396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-20587cb9-b688-4736-afe3-b7d77381a6d8 req-bb50998e-af62-45ad-a6e9-ab88580346a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.730060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-20587cb9-b688-4736-afe3-b7d77381a6d8 req-bb50998e-af62-45ad-a6e9-ab88580346a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.795226 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-20587cb9-b688-4736-afe3-b7d77381a6d8 req-bb50998e-af62-45ad-a6e9-ab88580346a8 service nova] Creating event network-changed:5b02d65a-11dd-4a59-9689-166d5c8c55cf for instance 82702564-48ff-43c9-9848-c8aae19dde22 on nch2-master-1 Jun 25 20:55:24.803600 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-20587cb9-b688-4736-afe3-b7d77381a6d8 req-bb50998e-af62-45ad-a6e9-ab88580346a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128775 Jun 25 20:55:24.804971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 538/932] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:24.810609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:24.811537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:24.821959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.827013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:24.828512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:24.830809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:25.250053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:25.258738 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b83edf4-afbe-4822-9526-0af8b27c5dc7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.800424 Jun 25 20:55:25.270497 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 395/933] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:24 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:25.277916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1916428792", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "2022263478", "adminPass": "***", "networks": [{"uuid": "865bd5da-70b8-4a43-99a3-edc759baf240"}], "security_groups": [{"name": "tempest-securitygroup--2008530787"}], "key_name": "tempest-keypair-238536916", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:25.358589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:25.375519 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c823c8e-0c81-46c3-878d-eca591763acf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1510 microversion: 2.1 time: 0.569106 Jun 25 20:55:25.376780 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 539/934] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:24 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1510 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:25.391508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:25.392308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:25.398818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:25.399532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:25.400592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:25.401185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:25.537264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] validate_networks() for [('865bd5da-70b8-4a43-99a3-edc759baf240', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:55:25.779445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:25.804951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:25.808473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:25.813837 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dadd036-5ab1-46a8-8fbe-3a5c8a4c56f4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1608 microversion: 2.25 time: 0.435765 Jun 25 20:55:25.816515 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 540/935] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:55:25 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1608 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:55:25.837453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:25.838001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:25.846193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:25.846698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:25.848055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:25.848547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.577471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:26.606220 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93656179-b057-4dd7-abb5-97c0570eece7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.787548 Jun 25 20:55:26.607888 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 541/936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:25 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:26.618455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:26.619820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:26.628515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.629204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.630470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.631120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.709602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:26.712007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:26.712719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:26.713738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:26.715018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:26.746197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.747638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.748639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.749621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.783278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for project 2ce47feeb3ff411a8511889a370e746e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:26.790555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Getting quotas for user 33d0756150114bc7bd3f6f72b93cb56a and project 2ce47feeb3ff411a8511889a370e746e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:26.805698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:26.809119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:26.864662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:26.909442 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ecb16bf-9802-4cf4-927e-b8f0925a258a tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.636342 Jun 25 20:55:26.915034 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 396/937] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:55:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:55:26.917692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:26.918324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:26.929821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.930453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:26.931578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:26.932065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:27.130827 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee69faa8-4759-4127-81a6-4a79e977d0b1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.217598 Jun 25 20:55:27.131804 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 397/938] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 20:55:26 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-interface => generated 284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:55:27.137492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:27.138794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:27.145978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:27.146610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:27.147570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:27.148233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:27.162251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:27.170479 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19beefc8-b313-4bac-b6e0-1215939a955b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1511 microversion: 2.1 time: 0.560780 Jun 25 20:55:27.173460 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 542/939] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:26 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1511 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:27.188345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1179524304", "imageRef": "6301f895-aca1-4444-a43f-ee8448978bac", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e50ed457-27f4-4d51-aa21-ce8f8a1b02d6"}], "security_groups": [{"name": "tempest-securitygroup--1113313327"}], "key_name": "tempest-keypair-984068", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:27.510949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] validate_networks() for [('e50ed457-27f4-4d51-aa21-ce8f8a1b02d6', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:55:28.356657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:28.373855 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f9401ea-021b-428e-8d08-b63fc6240133 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 1.240707 Jun 25 20:55:28.375280 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 398/940] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:27 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:28.385005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:28.388644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:28.413334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.414917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:28.416875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.417564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:28.630210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:28.651653 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f51cad0a-1729-4582-b500-af25638f41ff tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1316 microversion: 2.1 time: 0.274874 Jun 25 20:55:28.653113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 399/941] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:28 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:28.660286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:28.661544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:28.673248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.674594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:28.675692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.676873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:28.961338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:28.961876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:28.962236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:28.962653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:28.963068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:28.978276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.978730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:28.979530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:28.979977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:29.030390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Getting quotas for project c734d57dbb974b2bba1efc21917a7269. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:29.036709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Getting quotas for user 9a8cd690a02e4b47afb24d9d4dba52b9 and project c734d57dbb974b2bba1efc21917a7269. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:29.059228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:29.066392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6301f895-aca1-4444-a43f-ee8448978bac',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:29.185141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-97626de5-19be-42d0-af69-753cabf133e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.999616 Jun 25 20:55:29.187695 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 543/942] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:55:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:55:29.196841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:29.201315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:29.217435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:29.218026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:29.219064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:29.219691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:29.355047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:29.357612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:29.367547 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e93ea9e6-6a9e-41cf-b3d2-e58b784138e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1512 microversion: 2.1 time: 0.712985 Jun 25 20:55:29.368174 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 400/943] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:28 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1512 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:29.374826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ba717ea-961f-4c76-b326-929a1a10d549 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:29.379138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ba717ea-961f-4c76-b326-929a1a10d549 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:29.793841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:29.808896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58712dba-9e2e-46d0-afa8-54b5e05627e0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.619881 Jun 25 20:55:29.816345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 544/944] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:29 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:29.982692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8ba717ea-961f-4c76-b326-929a1a10d549 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:29.996841 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ba717ea-961f-4c76-b326-929a1a10d549 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1242 microversion: 2.1 time: 0.626316 Jun 25 20:55:30.001454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 401/945] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:29 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1242 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:30.019563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:30.023459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:30.024352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:30.051030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:30.051879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:30.052968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:30.060832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:30.143055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-396040181", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "2d859c08-4c28-4367-9987-3696c8e87ecb"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:30.198753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:30.278605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] validate_networks() for [('2d859c08-4c28-4367-9987-3696c8e87ecb', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:55:30.408529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:30.426097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:30.429139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:31.304215 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fac05d0e-6850-4731-97d3-e9ef395f62e2 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 1.298951 Jun 25 20:55:31.305002 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 402/946] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 20:55:29 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:31.310382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:31.311009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:31.331097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:31.331551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:31.337685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:31.338504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.208817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:32.210500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:32.211244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:32.211866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:32.212518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:32.229474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.231739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.233834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.235842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.292774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Getting quotas for project a5871754d5114ee3a8093652ebb6b2b5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:32.302658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Getting quotas for user f9190ad58b5c40958a4fcec77ccdfc5a and project a5871754d5114ee3a8093652ebb6b2b5. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:32.311455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:32.352701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:32.359604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:32.422419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a246d7a-f3dd-464d-9992-a022ad2becfe tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.604245 Jun 25 20:55:32.429044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 545/947] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:55:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:55:32.435542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:32.436531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:32.446675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.449721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.450888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.451567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.683140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:32.701074 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2447541a-24c3-45a7-a759-1739348ce1d9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 1.395065 Jun 25 20:55:32.702186 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 403/948] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:31 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:32.714841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-98127380-96a9-4f1b-a6c5-68cbfef867eb req-ccbbaeb7-6bce-4ef4-8df3-30d0a8c966bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabdeb25-a01e-4754-813d-31771aad3b7a", "name": "network-vif-unplugged", "status": "completed", "tag": "ddfb9b3f-76b0-41bb-b549-9c7accacfc1b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:32.736614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-98127380-96a9-4f1b-a6c5-68cbfef867eb req-ccbbaeb7-6bce-4ef4-8df3-30d0a8c966bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.737072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-98127380-96a9-4f1b-a6c5-68cbfef867eb req-ccbbaeb7-6bce-4ef4-8df3-30d0a8c966bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.756026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-98127380-96a9-4f1b-a6c5-68cbfef867eb req-ccbbaeb7-6bce-4ef4-8df3-30d0a8c966bf service nova] Creating event network-vif-unplugged:ddfb9b3f-76b0-41bb-b549-9c7accacfc1b for instance cabdeb25-a01e-4754-813d-31771aad3b7a on nch2-master-1 Jun 25 20:55:32.803868 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-98127380-96a9-4f1b-a6c5-68cbfef867eb req-ccbbaeb7-6bce-4ef4-8df3-30d0a8c966bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099900 Jun 25 20:55:32.818989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 404/949] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:32.828822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:32.829563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:32.863164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.863599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:32.864645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:32.868124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.023814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:33.034797 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d98fe841-008c-48fa-92fc-88a9757c951f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.604370 Jun 25 20:55:33.035986 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 546/950] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:32 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:33.050430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:33.063742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:33.104603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:33.105550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.106685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:33.107348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.431308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:33.444717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19e8fcf1-a6e2-4bd0-a30b-f8862ba79b3a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1300 microversion: 2.1 time: 0.405163 Jun 25 20:55:33.445504 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 547/951] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:33 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1300 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:33.451884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5fec0b30-a38f-463b-ae9d-c3fffa514a5b req-24c65662-7834-4e17-8e46-70e65c8d7b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "name": "network-vif-unplugged", "status": "completed", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:33.491529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fec0b30-a38f-463b-ae9d-c3fffa514a5b req-24c65662-7834-4e17-8e46-70e65c8d7b3a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:33.501231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fec0b30-a38f-463b-ae9d-c3fffa514a5b req-24c65662-7834-4e17-8e46-70e65c8d7b3a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.548102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5fec0b30-a38f-463b-ae9d-c3fffa514a5b req-24c65662-7834-4e17-8e46-70e65c8d7b3a service nova] Creating event network-vif-unplugged:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch1-master-1 Jun 25 20:55:33.574703 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5fec0b30-a38f-463b-ae9d-c3fffa514a5b req-24c65662-7834-4e17-8e46-70e65c8d7b3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127105 Jun 25 20:55:33.575559 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 548/952] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:33.595627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:33.601066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:33.616630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1631210114', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:33.635437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:33.636440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.640282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:33.641061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:33.947729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:34.166129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:34.184617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:34.188036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:34.197801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:34.441742 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f46d91c2-265a-409f-88a0-06858b64a16b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1631210114" status: 200 len: 1514 microversion: 2.1 time: 0.864717 Jun 25 20:55:34.457650 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 549/953] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:55:33 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1631210114 => generated 1514 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:34.472802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:34.476255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:34.493077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:34.493536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:34.495685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:34.496120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:34.876342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:34.890271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85af40e4-8134-4fdf-b255-6ce4fb722e4c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 2.069695 Jun 25 20:55:34.903034 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 405/954] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:32 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:34.918485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-902a3bcf-72f7-4f4c-aee1-965036d79570 req-a8cbe475-1113-4bdf-a6ce-7237e6c51d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbf8859-587d-4ebf-bb82-bae77019b6ec", "tag": "e1e39cec-14aa-4e84-a644-b370a5775db8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:34.951155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-902a3bcf-72f7-4f4c-aee1-965036d79570 req-a8cbe475-1113-4bdf-a6ce-7237e6c51d14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:34.952002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-902a3bcf-72f7-4f4c-aee1-965036d79570 req-a8cbe475-1113-4bdf-a6ce-7237e6c51d14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:34.972983 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-902a3bcf-72f7-4f4c-aee1-965036d79570 req-a8cbe475-1113-4bdf-a6ce-7237e6c51d14 service nova] Creating event network-changed:e1e39cec-14aa-4e84-a644-b370a5775db8 for instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec on nch1-master-1 Jun 25 20:55:34.990903 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-902a3bcf-72f7-4f4c-aee1-965036d79570 req-a8cbe475-1113-4bdf-a6ce-7237e6c51d14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085956 Jun 25 20:55:34.992314 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 406/955] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:34.999566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:35.007706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:35.021836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:35.022739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:35.025770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:35.026589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:35.301372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:35.313548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47167754-0c7b-41e0-8625-f5db28a2c885 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1283 microversion: 2.1 time: 0.853919 Jun 25 20:55:35.315649 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 550/956] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:34 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1283 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:35.321283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:35.331364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:35.349803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:35.351145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:35.352275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:35.353519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:35.984908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:36.005329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13b82f4d-d2d4-486c-8d78-cd4e2d89074f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.687804 Jun 25 20:55:36.008993 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 551/957] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:35 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:36.028014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:36.073259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:36.074333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:36.110176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:36.110651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:36.116926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:36.119854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:36.514409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:36.762799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:36.795358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:36.795846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.025675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:37.049879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8557580d-e650-4478-8561-1742c1b9b01a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 2.055850 Jun 25 20:55:37.051242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 407/958] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:34 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:37.064264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:37.065355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:37.079953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.080751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.082345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.083710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.208343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:37.230902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-522632f1-b6b3-4026-91e1-e247be87fea4 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1300 microversion: 2.1 time: 0.176199 Jun 25 20:55:37.232785 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 408/959] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:37 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:37.244587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-96a9a04b-15a2-4331-8eca-1e2720fd79e9 req-2adaf640-5fd5-45cd-97d1-850be837dde9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82702564-48ff-43c9-9848-c8aae19dde22", "name": "network-vif-plugged", "status": "completed", "tag": "5b02d65a-11dd-4a59-9689-166d5c8c55cf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:37.259216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3f845731-b0ed-46a1-b754-aea0958af7b0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 1.249048 Jun 25 20:55:37.260377 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 552/960] 10.222.0.39 () {58 vars in 1172 bytes} [Sat Jun 25 20:55:36 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:37.263204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-96a9a04b-15a2-4331-8eca-1e2720fd79e9 req-2adaf640-5fd5-45cd-97d1-850be837dde9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.273280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-96a9a04b-15a2-4331-8eca-1e2720fd79e9 req-2adaf640-5fd5-45cd-97d1-850be837dde9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.274316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:37.274942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:37.288476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.288935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.289760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.290777 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-96a9a04b-15a2-4331-8eca-1e2720fd79e9 req-2adaf640-5fd5-45cd-97d1-850be837dde9 service nova] Creating event network-vif-plugged:5b02d65a-11dd-4a59-9689-166d5c8c55cf for instance 82702564-48ff-43c9-9848-c8aae19dde22 on nch2-master-1 Jun 25 20:55:37.298485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.303312 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-96a9a04b-15a2-4331-8eca-1e2720fd79e9 req-2adaf640-5fd5-45cd-97d1-850be837dde9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068972 Jun 25 20:55:37.307038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 409/961] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:37.329450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:37.333830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:37.350396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.358382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.359605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.360240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.504563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:37.522499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b993e218-aff4-4883-9bec-1f00dbcba190 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1289 microversion: 2.1 time: 0.213875 Jun 25 20:55:37.533429 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 410/962] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:37 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1289 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:37.539048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fd589efe-be6a-44d4-87e1-384e5279e776 req-88f1cf43-d026-4049-9b1f-64e43138f0cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:37.567361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd589efe-be6a-44d4-87e1-384e5279e776 req-88f1cf43-d026-4049-9b1f-64e43138f0cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.568053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd589efe-be6a-44d4-87e1-384e5279e776 req-88f1cf43-d026-4049-9b1f-64e43138f0cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.610547 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fd589efe-be6a-44d4-87e1-384e5279e776 req-88f1cf43-d026-4049-9b1f-64e43138f0cc service nova] Creating event network-changed:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:55:37.634529 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fd589efe-be6a-44d4-87e1-384e5279e776 req-88f1cf43-d026-4049-9b1f-64e43138f0cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099254 Jun 25 20:55:37.643141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 411/963] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:37.649756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:37.661916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:37.686750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.697229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:37.698571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:37.699261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:38.445743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:38.458044 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8668d6bb-97ec-42e2-8e45-f7df7111d6e1 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.812767 Jun 25 20:55:38.465164 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 412/964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:37 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:38.490006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:38.501102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:38.509166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.servers [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Removing options 'limit' from query {{(pid=137462) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 25 20:55:38.517732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:38.531749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:38.534186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:38.537045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:38.540171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:38.834543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:38.858220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:38.858557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:39.054861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:39.064354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a853cb11-8b49-4b8d-a810-b0dcd204f3b3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 1.802911 Jun 25 20:55:39.068033 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 553/965] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:37 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:39.080143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:39.082889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:39.097925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:39.100758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:39.101909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:39.103716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:39.398140 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-708e67ab-dc7e-4ef9-a12f-1a6baa7b8d17 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.931713 Jun 25 20:55:39.411582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 413/966] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:55:38 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:39.417318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:39.418161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:39.436564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:39.437251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:39.438493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:39.443170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.013919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.023443 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ddc70105-3783-4b3a-8a03-acd4cfcfab6a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.610452 Jun 25 20:55:40.029717 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 414/967] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:39 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.037800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.038656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:40.050232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.051077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.052826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.053602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.118273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.130885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ea1c080-fddf-4204-948c-828309bdb688 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 1.055506 Jun 25 20:55:40.132075 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 554/968] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:39 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.140338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.150076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.150810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:40.163408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.164138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.165952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.167198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.178221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.213194 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fce29a0f-ce7d-46ef-bcd4-3d83a18d202d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1289 microversion: 2.1 time: 0.182089 Jun 25 20:55:40.223783 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 415/969] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1289 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.225482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.242235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:40.257085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.260264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.265485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.268221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.362139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:40.452853 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a3e2da5-87c0-4f51-8cfa-d5408da577e4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.319131 Jun 25 20:55:40.453453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 555/970] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.463503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cc0cbdaf-1fba-43ba-a5bc-bb56dd657925 req-1b77c2af-5b71-419c-a8d4-26e5190368b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cabdeb25-a01e-4754-813d-31771aad3b7a", "name": "network-vif-deleted", "tag": "ddfb9b3f-76b0-41bb-b549-9c7accacfc1b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:40.472172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cc0cbdaf-1fba-43ba-a5bc-bb56dd657925 req-1b77c2af-5b71-419c-a8d4-26e5190368b2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.472659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cc0cbdaf-1fba-43ba-a5bc-bb56dd657925 req-1b77c2af-5b71-419c-a8d4-26e5190368b2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.486546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cc0cbdaf-1fba-43ba-a5bc-bb56dd657925 req-1b77c2af-5b71-419c-a8d4-26e5190368b2 service nova] Creating event network-vif-deleted:ddfb9b3f-76b0-41bb-b549-9c7accacfc1b for instance cabdeb25-a01e-4754-813d-31771aad3b7a on nch2-master-1 Jun 25 20:55:40.492399 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cc0cbdaf-1fba-43ba-a5bc-bb56dd657925 req-1b77c2af-5b71-419c-a8d4-26e5190368b2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037765 Jun 25 20:55:40.494137 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 556/971] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:40.500190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.500931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:40.510143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.511396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.512357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.512975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.534572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.547408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a1f5970-c581-4ce1-8b52-1b779e874fda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.325052 Jun 25 20:55:40.548537 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 416/972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.572560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.579419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.581040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.servers [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Removing options 'limit' from query {{(pid=137462) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 25 20:55:40.582017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:40.596376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.599577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.601935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.602820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.667050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:40.731824 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c9aed08-3599-486b-9e72-ce13d223b01a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.169832 Jun 25 20:55:40.734488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 417/973] 10.222.0.39 () {58 vars in 1149 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:40.750949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.778080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.782360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:40.788764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.789213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.789993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.791794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.835414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:40.876931 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf8c3eca-84ef-4265-9a07-1f2f773c6a35 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.136087 Jun 25 20:55:40.881681 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 418/974] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers => generated 1011 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:40.893960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:40.899213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:40.901784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:40.919117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.919817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:40.920862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:40.921557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.016070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:41.031870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:41.089697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3313c94c-2d2b-4f29-bcfc-db80681b6ae9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.199789 Jun 25 20:55:41.090888 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 419/975] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:41.091090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.096286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.097457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:41.105557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.106285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.107087 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fc3d283a-ba26-4ff6-90f0-9b291b40f7b9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.611099 Jun 25 20:55:41.107412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.107874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.108506 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 557/976] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:40 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:41.118432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.123869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.125260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.servers [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Removing options 'limit' from query {{(pid=137461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 25 20:55:41.127263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:41.135702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.136171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.137023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.137471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.176535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0aba734c-9ccf-416d-ba57-7668715b89a1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.066403 Jun 25 20:55:41.178546 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 558/977] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:41.185273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.190461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:41.199223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.199652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.201254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.201858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.291454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.300174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68f12029-c6b3-41a4-9494-984a93fe1e96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.207843 Jun 25 20:55:41.300928 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 420/978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:41.314623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.318435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.319651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1631210114', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:55:41.325304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.325720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.326693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.327132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.431882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:55:41.513002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2bf0eef9-8536-4c3e-bc70-a7ebcd2e9a98 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1631210114" status: 200 len: 346 microversion: 2.1 time: 0.202783 Jun 25 20:55:41.513621 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 421/979] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1631210114 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:41.518949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.519253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:41.530463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.530868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.531976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.532459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.560124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.572881 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1817aa1-b9b0-409b-a20b-b12e1d1de4be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.392199 Jun 25 20:55:41.586236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 559/980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:41.596635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5c0dbf6-1f62-43a6-9ea7-7c2355fa7d96 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:41.605032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5c0dbf6-1f62-43a6-9ea7-7c2355fa7d96 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.606262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5c0dbf6-1f62-43a6-9ea7-7c2355fa7d96 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.750918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5c0dbf6-1f62-43a6-9ea7-7c2355fa7d96 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 20:55:41.795398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:41.812344 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39fa0687-81ff-411b-ab5b-38e6e69f91dc tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.296974 Jun 25 20:55:41.813098 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 422/981] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:41.828300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.829018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:41.835915 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5c0dbf6-1f62-43a6-9ea7-7c2355fa7d96 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "POST /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.246923 Jun 25 20:55:41.837152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 560/982] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:41 2022] POST /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:55:41.843445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.844317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.845222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.845844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.849273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:41.850195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:41.860968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.861692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:41.862687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:41.863300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.100899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:42.116789 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e359d825-71ad-45b5-9012-55b64d1909a5 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.302344 Jun 25 20:55:42.117752 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 423/983] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:42.129304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:42.132484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:42.144585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.145391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.146649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.147353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.201666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:42.213695 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10ee87c6-3491-46c3-9594-5af4ab2cb253 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.371916 Jun 25 20:55:42.226690 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 561/984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:41 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:42.319268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:42.320196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:42.330915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.336087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.341355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.342925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.762303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:42.772884 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0e7c79d5-e7a3-4c9d-8a32-3732437c0c96 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.458922 Jun 25 20:55:42.774556 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 562/985] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:42 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:42.787069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-857b474b-9f82-436b-b56a-f92bb06e308b req-14cc1f5c-360b-4f09-b351-8ee1cda74037 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3a67cd-7af0-47bf-a9af-932927da6b7e", "tag": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:42.813743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-857b474b-9f82-436b-b56a-f92bb06e308b req-14cc1f5c-360b-4f09-b351-8ee1cda74037 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.814225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-857b474b-9f82-436b-b56a-f92bb06e308b req-14cc1f5c-360b-4f09-b351-8ee1cda74037 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.839287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-857b474b-9f82-436b-b56a-f92bb06e308b req-14cc1f5c-360b-4f09-b351-8ee1cda74037 service nova] Creating event network-changed:d5f9efe4-e605-4c04-9430-8c8cd11aacf3 for instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e on nch1-master-1 Jun 25 20:55:42.847639 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-857b474b-9f82-436b-b56a-f92bb06e308b req-14cc1f5c-360b-4f09-b351-8ee1cda74037 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067666 Jun 25 20:55:42.849505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 563/986] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:42.859753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:42.860763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:42.865018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:42.871600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.872475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.875312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.877119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.877247 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68742df9-031f-44c7-9005-0adbb9cf1964 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.754730 Jun 25 20:55:42.877892 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 424/987] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:42 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:42.888257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1aeef75e-dbf4-499d-8aac-c3d616833870 req-1a7daf68-b6aa-4ecb-b89b-ea12bb7d813d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff14b19d-5125-4e28-ba7d-47329c4b0529", "tag": "52fe34cc-908a-4760-a1bd-ea8e1b504505"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:42.911276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1aeef75e-dbf4-499d-8aac-c3d616833870 req-1a7daf68-b6aa-4ecb-b89b-ea12bb7d813d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.911525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1aeef75e-dbf4-499d-8aac-c3d616833870 req-1a7daf68-b6aa-4ecb-b89b-ea12bb7d813d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.923658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1aeef75e-dbf4-499d-8aac-c3d616833870 req-1a7daf68-b6aa-4ecb-b89b-ea12bb7d813d service nova] Creating event network-changed:52fe34cc-908a-4760-a1bd-ea8e1b504505 for instance ff14b19d-5125-4e28-ba7d-47329c4b0529 on nch2-master-1 Jun 25 20:55:42.929030 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1aeef75e-dbf4-499d-8aac-c3d616833870 req-1a7daf68-b6aa-4ecb-b89b-ea12bb7d813d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049718 Jun 25 20:55:42.929909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 425/988] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:42.935425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:42.936452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:42.943972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.944464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:42.945250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:42.945765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.162689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:43.180503 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a9c763e-fb3d-469a-97de-bc311b83d165 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.328908 Jun 25 20:55:43.182044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 564/989] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:42 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:43.188060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-25d5f41b-2e51-4ab1-afeb-6dd6f2007d3a req-535e2590-2546-4073-9d33-5cc5eb15d51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbf8859-587d-4ebf-bb82-bae77019b6ec", "name": "network-vif-plugged", "status": "completed", "tag": "e1e39cec-14aa-4e84-a644-b370a5775db8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:43.200021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-25d5f41b-2e51-4ab1-afeb-6dd6f2007d3a req-535e2590-2546-4073-9d33-5cc5eb15d51b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.200975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-25d5f41b-2e51-4ab1-afeb-6dd6f2007d3a req-535e2590-2546-4073-9d33-5cc5eb15d51b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.215557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:43.227552 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3710d4c-9e8f-4a4a-b190-7cc7355228a6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.296546 Jun 25 20:55:43.230624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 426/990] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:42 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:43.242458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:43.242811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-25d5f41b-2e51-4ab1-afeb-6dd6f2007d3a req-535e2590-2546-4073-9d33-5cc5eb15d51b service nova] Creating event network-vif-plugged:e1e39cec-14aa-4e84-a644-b370a5775db8 for instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec on nch1-master-1 Jun 25 20:55:43.243384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:43.254577 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-25d5f41b-2e51-4ab1-afeb-6dd6f2007d3a req-535e2590-2546-4073-9d33-5cc5eb15d51b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070559 Jun 25 20:55:43.256290 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 565/991] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:43.257847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.258322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.259108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.259547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.269550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:43.271317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:43.283784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.284571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.285931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.286555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.447274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:43.457969 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-524a627d-ce1e-4de9-ad5c-f463ad987d16 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.224528 Jun 25 20:55:43.466604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 427/992] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:43 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:43.495979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:43.501586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:43.520129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f6042f2-7a1f-43f3-9d6e-c567060f6e7e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.260880 Jun 25 20:55:43.528038 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 566/993] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:43 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:43.791329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:43.792240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:43.798850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.799301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.800075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.800528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.895903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:43.896565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:43.904373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.905204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:43.906327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:43.906994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.070916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.081007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12bbf726-ff3a-4ef0-97c8-48f6d1dda387 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.293254 Jun 25 20:55:44.093013 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 428/994] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:43 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:44.112962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.123221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c207cff-e2d7-49d7-9719-54ffb8fc015e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.231668 Jun 25 20:55:44.124631 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 567/995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:43 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:44.199199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:44.200239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:44.206839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.207338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.208188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.208679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.246599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:44.247241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:44.254059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.254596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.255423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.256103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.479729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.490679 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b641926a-2984-4989-8ade-c39af9d2463f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.295719 Jun 25 20:55:44.491626 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 429/996] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:44 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:44.497319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:44.498368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:44.513612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.514384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.515677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.516763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.583453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.593725 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1314be8d-de9c-46b2-9dd9-76427b9597fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.351015 Jun 25 20:55:44.594467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 568/997] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:44 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:44.599578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:44.600530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:44.618611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.619190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.620209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:44.620794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:44.811200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.816224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:44.825566 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5daf33b2-54df-4c4c-8a1b-df8ce2edf895 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.332563 Jun 25 20:55:44.825736 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7984fa30-fe7d-4d27-98a7-d1e566f17f30 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.229906 Jun 25 20:55:44.826607 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 569/998] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:44 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:44.832879 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 430/999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:44 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:45.099780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:45.100690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:45.109678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.110135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.112677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.113119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.142247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:45.142873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:45.149279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.149741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.150540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.150982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.292636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:45.294240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:45.301092 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f63b4b2f-42ed-4673-8503-041b59d58004 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.205651 Jun 25 20:55:45.301915 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 570/1000] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:45.302758 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5878b832-a37d-4a07-b45f-a5b0d7b30226 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.164740 Jun 25 20:55:45.303327 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 431/1001] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:45.366211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-995388663", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "6c2b5444-8281-4087-89d2-2d927563a53b"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:45.428696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] validate_networks() for [('6c2b5444-8281-4087-89d2-2d927563a53b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:55:45.507777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:45.509015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:45.516704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.517516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.518297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.518721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.717134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:45.733088 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf0ee46a-3a52-439d-a2b2-a613ed5abd4e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.229145 Jun 25 20:55:45.743925 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 432/1002] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:45.749350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:45.750002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:45.756732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.757453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.758672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.759646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.882693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:55:45.883292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:55:45.884036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:55:45.884681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:55:45.885243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:55:45.895157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=29 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:45.897935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.898878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.900139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.903057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.921841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:55:45.926284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for user cdf4dbb95b6a440fad542fad69b6a5d8 and project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:55:45.938270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:55:45.940646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:55:45.941104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:45.948900 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd4de538-2456-4ba9-b1d9-1cdc8ac6b28a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.203590 Jun 25 20:55:45.949676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 433/1003] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:45.958184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:45.959048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:45.966027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.966849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.967848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:45.972211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:45.991629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c621bcb4-1ac6-46b0-96df-620706c8b7fa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688103 Jun 25 20:55:45.992698 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 571/1004] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:55:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:55:46.006784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.007877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.019790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.020347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.021192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.021621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.188536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.198009 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5d2e9a17-bc5f-4cec-b352-b20a135299dd tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.203120 Jun 25 20:55:46.208328 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 572/1005] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.216044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.216967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47b93691-d7d4-460b-afda-0ae8434e7986 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.218020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47b93691-d7d4-460b-afda-0ae8434e7986 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.224301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0fd15a4d-f333-4808-ab70-fafb9084ca55 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1390 microversion: 2.1 time: 0.273397 Jun 25 20:55:46.225257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 434/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:45 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.279714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47b93691-d7d4-460b-afda-0ae8434e7986 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.287642 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47b93691-d7d4-460b-afda-0ae8434e7986 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1217 microversion: 2.1 time: 0.078125 Jun 25 20:55:46.288574 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 573/1007] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:46 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.320075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.322959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.323294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.324396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.332634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.333413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.334423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.335402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.337520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.338007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.338754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.343045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.515949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.528093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69e28361-8b93-4c9c-876a-bb0103956ed8 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.211807 Jun 25 20:55:46.531062 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 435/1008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:46 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.578622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.592068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a2c6a1e-d0a6-46bc-b879-0865a0da9b3b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.272612 Jun 25 20:55:46.593245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 574/1009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:46 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.751346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.752041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.758712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.759160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.759950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.760380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.779390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:46.905725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:46.913901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9d3e821-1b11-4836-8d5d-12e12113abba tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.166775 Jun 25 20:55:46.923154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 436/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:46 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:46.967273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:46.967884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:46.975840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.976714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:46.977534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:46.977982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.215679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.216505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.228481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.228943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.229739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.230179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.432952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.444108 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5e929cf-4299-42b8-bab0-8bde478b57d1 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.481024 Jun 25 20:55:47.454684 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 575/1011] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:46 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:47.460546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.460888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.461803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.469891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.470373 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3448d26d-c2d9-4e97-870f-d228030267f6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.258355 Jun 25 20:55:47.470909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.471722 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 437/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:47.472126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.472827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.476808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.477451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.484337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.485038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.486214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.486767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.563732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.585573 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65648062-e325-4ef1-b84d-8e312f557133 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.112556 Jun 25 20:55:47.586435 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 438/1013] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:47.591830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.593362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.604184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.608185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.611207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.612768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.661101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.670392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16464f59-c78d-4461-8c5d-64efdc6197da tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1588 microversion: 2.1 time: 0.214237 Jun 25 20:55:47.671621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 576/1014] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1588 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:47.689068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.689999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.697329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.698115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.699536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.700269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.849115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.860020 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dad12672-8355-4ddd-a842-1d1923ac4628 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.272357 Jun 25 20:55:47.860658 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 439/1015] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:47.866885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.867397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.876132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.876920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.877740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.878362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.911902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:47.920267 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-12c96253-bdd7-4c3b-96b5-7cb641ab5e55 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.234930 Jun 25 20:55:47.921717 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 577/1016] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:47.930338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:47.930996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:47.937654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.938101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.939221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:47.939813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:47.972928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d26589b2-7483-4298-90af-daec91b2b28b tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110932 Jun 25 20:55:47.973642 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 440/1017] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:48.088020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:48.097947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c6d2b6e-889b-4282-aef5-1546ca767883 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.171840 Jun 25 20:55:48.098850 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 578/1018] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:47 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:48.463599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:48.464263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:48.467788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f8d71c85-7b0b-46d9-99a4-07da3e6791cd req-9aefd27f-08f3-472b-a0fd-1d6aacc85208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3a67cd-7af0-47bf-a9af-932927da6b7e", "name": "network-vif-plugged", "status": "completed", "tag": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:48.474738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=99 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:48.476684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.477641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.478171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.478619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.486004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f8d71c85-7b0b-46d9-99a4-07da3e6791cd req-9aefd27f-08f3-472b-a0fd-1d6aacc85208 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.486908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f8d71c85-7b0b-46d9-99a4-07da3e6791cd req-9aefd27f-08f3-472b-a0fd-1d6aacc85208 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.501371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f8d71c85-7b0b-46d9-99a4-07da3e6791cd req-9aefd27f-08f3-472b-a0fd-1d6aacc85208 service nova] Creating event network-vif-plugged:d5f9efe4-e605-4c04-9430-8c8cd11aacf3 for instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e on nch1-master-1 Jun 25 20:55:48.507552 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f8d71c85-7b0b-46d9-99a4-07da3e6791cd req-9aefd27f-08f3-472b-a0fd-1d6aacc85208 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050404 Jun 25 20:55:48.508901 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 441/1019] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:48.517362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:48.518560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:48.526420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.527222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.529138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.530028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.753711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:48.763427 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf5682bd-6421-4e66-8768-30e4311a69d6 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.304928 Jun 25 20:55:48.764206 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 579/1020] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:48 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:48.770267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:48.771205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:48.779419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.780104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.781133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.781541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:48.781994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.790018 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0543434d-69aa-49d0-9e1f-7b3b50c52190 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.279598 Jun 25 20:55:48.790607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 442/1021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:48 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:48.852008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:48.861105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2bc801b7-d720-4b23-b04a-35d322bae217 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.095370 Jun 25 20:55:48.861722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 580/1022] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:48 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:48.877724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:48.878347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:48.882079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:48.888400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.888879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.889664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.890290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.937568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:48.938651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:48.945660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.947746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:48.948859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:48.949459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.096347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:49.103416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:49.106575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4baf211d-5256-4008-ad92-3c8179942287 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.173192 Jun 25 20:55:49.107225 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 581/1023] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:48 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:49.115294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:49.115988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:49.119251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:49.121100 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6bce560c-26dd-42e6-aea6-31f8459105e5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.247082 Jun 25 20:55:49.121846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 443/1024] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:48 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:49.124341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.124814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.125806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.126239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.200815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:49.201470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:49.209037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.210121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.211112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.211746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.311052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:49.319721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cbaf0034-c5e6-424e-8c47-d8177801d819 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.208677 Jun 25 20:55:49.320345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 582/1025] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:49 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:49.326644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-991252f8-25f2-46d2-8848-72b969c0ad0d req-be5ec6c6-a8fe-47b0-bf30-dc7724117b6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dbf8859-587d-4ebf-bb82-bae77019b6ec", "tag": "e1e39cec-14aa-4e84-a644-b370a5775db8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:49.336147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-991252f8-25f2-46d2-8848-72b969c0ad0d req-be5ec6c6-a8fe-47b0-bf30-dc7724117b6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.336925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-991252f8-25f2-46d2-8848-72b969c0ad0d req-be5ec6c6-a8fe-47b0-bf30-dc7724117b6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.350405 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-991252f8-25f2-46d2-8848-72b969c0ad0d req-be5ec6c6-a8fe-47b0-bf30-dc7724117b6c service nova] Creating event network-changed:e1e39cec-14aa-4e84-a644-b370a5775db8 for instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec on nch1-master-1 Jun 25 20:55:49.355521 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-991252f8-25f2-46d2-8848-72b969c0ad0d req-be5ec6c6-a8fe-47b0-bf30-dc7724117b6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032812 Jun 25 20:55:49.356563 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 583/1026] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:49.418052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:49.426875 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13c50e12-21ed-4529-b9f9-fd11e7388854 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1588 microversion: 2.1 time: 0.230290 Jun 25 20:55:49.427754 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 444/1027] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:49 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1588 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:49.786533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:49.787230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:49.807423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:49.809262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:49.814685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.815154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.818734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.819184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.820758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.821455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:49.824734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:49.825426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.129108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.142908 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71fa423b-e703-4ce8-817a-a2b39e2d0c1f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.338345 Jun 25 20:55:50.144218 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 445/1028] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:49 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:50.152320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:50.153430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:50.159868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.160665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.161663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.163041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.225498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.236370 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-323fde6a-79c0-4ee2-825e-0534086e162b tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1331 microversion: 2.1 time: 0.457915 Jun 25 20:55:50.239462 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 584/1029] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:49 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1331 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:50.252954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:50.256077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:50.265606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.266268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.267215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.276912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.309864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.318853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45fe24cb-6213-4691-b2fd-0ce54455cbf2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.172369 Jun 25 20:55:50.329865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 446/1030] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:50 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:50.335573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:50.336586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:50.344258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.345086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.346117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.346780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.575611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.587725 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a58b8cd-54ca-4566-8fd2-da94fde68851 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.256283 Jun 25 20:55:50.598271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 447/1031] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:50 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:50.598271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:50.598271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:50.605152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.605623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.606404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:50.607181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:50.609168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.613373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:50.625452 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ae54457-e531-47ae-bd1d-296ea0e64d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.384839 Jun 25 20:55:50.630585 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 585/1032] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:50 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:50.791138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:50.800370 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-edf3ec8a-831a-4f6e-b170-90a930c873d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.209740 Jun 25 20:55:50.810074 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 448/1033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:50 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:51.161561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.162329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:51.170194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.170646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.171457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.172088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.253950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.254637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:51.263345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.264139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.265118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.265770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.326001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:51.338895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e94329fd-a06b-4e97-bf25-09035d0a24c5 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.181333 Jun 25 20:55:51.339607 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 586/1034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:51.344848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.346788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:51.356229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.357790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.359848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.360374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:51.360835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.427913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:51.441651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1859fbab-91bc-47a2-a64e-621fa0bb46ac tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.100430 Jun 25 20:55:51.443251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 587/1035] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:51.606837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.608173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:51.625305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.626140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.627394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.628038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.771458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:51.779490 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-896f0e55-b6fc-4cfc-b119-0e6e1fe2826d tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1535 microversion: 2.1 time: 0.529716 Jun 25 20:55:51.782166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:51.792709 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 449/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1535 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:51.798748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.799281 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-017bf961-27e9-4b1c-9179-1c4fb05f527c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.196814 Jun 25 20:55:51.799616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:51.799974 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 588/1037] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:51.808185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af374360-2107-4c4d-88c7-cfb2f4a9cfc4 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'create', calling method: .version_select at 0x7f984fe1a5e0>, body: {"pool": "44774a18-2ab5-4f45-acd8-0f01387b275f"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:51.808411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.808411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.808411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:51.808411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:51.968946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:51.980096 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d78af4ed-7364-4d4e-beb9-22635e99ed21 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.186067 Jun 25 20:55:51.993331 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 450/1038] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:51.995612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:51.997075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:52.007572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.008022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.009313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.009596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.165519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:52.185018 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a497577-ffb5-425b-a8b2-c3932a7140cb tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.199887 Jun 25 20:55:52.185843 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 451/1039] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:51 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:52.356292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:52.357044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:52.363732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.364223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.365016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.365450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.528557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:52.537815 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a4789d88-2cb9-45a3-a8f2-efef4e6b3c16 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.185418 Jun 25 20:55:52.547802 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 452/1040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:52 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:52.553675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:52.554705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:52.561073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.563832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.563832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.563832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.630255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:52.639196 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3592680b-6c47-48ea-b9ba-f77f488e97fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.089271 Jun 25 20:55:52.649033 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 453/1041] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:52 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:52.818713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:52.820484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:52.830419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.830950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.831861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:52.832566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:52.838729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:53.022616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:53.032664 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8611ea51-cb69-4dd8-800a-5e99c233ec5c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.218657 Jun 25 20:55:53.033852 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 454/1042] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:52 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:53.038636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:53.039363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:53.046014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.046572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.047467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.048018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.224697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:53.233176 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-916718b5-b4ed-4c4c-9bb9-2c6b5d6a3588 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.198125 Jun 25 20:55:53.234251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 455/1043] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:53 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:53.239528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:53.240272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:53.247893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.248689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.249774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.250321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.255630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af374360-2107-4c4d-88c7-cfb2f4a9cfc4 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.454590 Jun 25 20:55:53.256239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 589/1044] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:55:51 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:53.266891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: .version_select at 0x7f985f20dc10>, body: {"addFloatingIp": {"address": "172.35.3.90"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:53.268347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:53.276713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.277416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.278350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.279072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.370782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Acquired lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:55:53.422526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:53.431668 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-33e7e552-ce0e-495d-b4d8-dca6b0a74c76 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.196207 Jun 25 20:55:53.433797 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 456/1045] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:53 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:53.555398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:53.557325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:53.565330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.566063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.567062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.567492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.718807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:53.727031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a918fedb-46b9-47fe-8a3a-853f53bc1fee tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.175716 Jun 25 20:55:53.727602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 457/1046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:53 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:53.732064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:53.732710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:53.739727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.740188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.741110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:53.741583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:53.829574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:53.838878 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f17ebbc4-0253-49db-99b8-8865c4d39497 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.110210 Jun 25 20:55:53.839820 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 458/1047] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:53 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:54.054935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:54.055644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:54.063277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.063740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.065387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.065898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.226049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:54.234213 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2767792e-07bd-4f4b-bceb-ab98fc3281a5 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.188172 Jun 25 20:55:54.235124 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 459/1048] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:54 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:54.253421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:54.254794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:54.261843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.262381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.264825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.264825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.410912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:54.423781 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9617ed62-67e1-44d4-951f-8418e0f2a8f5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.176245 Jun 25 20:55:54.424822 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 460/1049] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:54 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:54.453724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:54.454349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:54.461368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.461820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.462586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.463010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.593465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:54.601554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd104e34-d351-45e8-9091-f4e5084c29e1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.152002 Jun 25 20:55:54.602477 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 461/1050] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:54 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:54.745018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:54.746327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:54.752957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.753509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.754593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.755100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.759454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:55:54.920208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:54.927962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3662ba0-c658-423e-90a4-790cf453e66e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.188462 Jun 25 20:55:54.928720 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 462/1051] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:54 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:54.942164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8b5d93b4-db27-478f-80e8-823eee821621 req-283629d6-32d9-4b0f-94d0-097924141a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3a67cd-7af0-47bf-a9af-932927da6b7e", "tag": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:54.950186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8b5d93b4-db27-478f-80e8-823eee821621 req-283629d6-32d9-4b0f-94d0-097924141a56 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.950656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8b5d93b4-db27-478f-80e8-823eee821621 req-283629d6-32d9-4b0f-94d0-097924141a56 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.962768 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8b5d93b4-db27-478f-80e8-823eee821621 req-283629d6-32d9-4b0f-94d0-097924141a56 service nova] Creating event network-changed:d5f9efe4-e605-4c04-9430-8c8cd11aacf3 for instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e on nch1-master-1 Jun 25 20:55:54.967775 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8b5d93b4-db27-478f-80e8-823eee821621 req-283629d6-32d9-4b0f-94d0-097924141a56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029355 Jun 25 20:55:54.968834 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 463/1052] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:54.974212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:54.974909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:54.982438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.982886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:54.983850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:54.984080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.062255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:55.074093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be9ac2e5-d236-4bf1-b4b8-011378f2e2a7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.103910 Jun 25 20:55:55.074684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 464/1053] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:54 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:55.253291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:55.254177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:55.261275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.261738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.262511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.262948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.403263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:55.413230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-606e4993-e569-4bca-8adf-9df4f86ec56a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.163890 Jun 25 20:55:55.413837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 465/1054] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:55 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:55.441441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:55.443047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:55.453693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.454503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.455294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.455893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.581888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Updating instance_info_cache with network_info: [{"id": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3", "address": "fa:16:3e:63:63:92", "network": {"id": "2d859c08-4c28-4367-9987-3696c8e87ecb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-774983985-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a5871754d5114ee3a8093652ebb6b2b5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5f9efe4-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:55:55.603464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Releasing lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:55:55.604915 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b50f6150-4be8-428f-af7d-6a25fd033ee7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 202 len: 0 microversion: 2.1 time: 2.341929 Jun 25 20:55:55.605925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:55.611373 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 590/1055] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:53 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 0 bytes in 2349 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Jun 25 20:55:55.616176 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0cd3739b-d41f-487d-b0ba-88a2579be1c0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.178430 Jun 25 20:55:55.617500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f285612a-ac66-4d62-9915-74d6b9d5f762 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'create', calling method: .version_select at 0x7f984ff190d0>, body: {"pool": "44774a18-2ab5-4f45-acd8-0f01387b275f"} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:55.626406 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 466/1056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:55 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:55.631882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:55.632749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:55.639804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.640300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.641198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.641688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.791550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:55.801787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01589472-60c6-49d1-848b-5bda864cb322 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.173928 Jun 25 20:55:55.803383 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 467/1057] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:55 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:55.911953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=14 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:55.945086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:55.945617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:55.952717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.953164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:55.953924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:55.954361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.095218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:56.103738 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59a129cf-80e9-4fc2-bbf4-44c3feab2a0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.162611 Jun 25 20:55:56.104333 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 468/1058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:55 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:56.110043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:56.110657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:56.116890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.117473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.118248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.118687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.182089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:56.189751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ca0d4a1-200a-4919-a824-741dd5b3b7ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.083648 Jun 25 20:55:56.190338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 469/1059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:56 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:56.284657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=7 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:56.430789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:56.431530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:56.438518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.438972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.439734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.440170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.580560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:56.591130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5bbe1a7-a9e0-41ea-b656-f4a7d0ad19c0 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.163937 Jun 25 20:55:56.599410 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 470/1060] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:56 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:56.633134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:56.633849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:56.640053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.640541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.641315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.641749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.659946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:56.777385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:56.786415 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f285612a-ac66-4d62-9915-74d6b9d5f762 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.173490 Jun 25 20:55:56.787000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 591/1061] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:55:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:55:56.789037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29068f31-9a84-45a2-80dd-328f5737a9f7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.159953 Jun 25 20:55:56.789645 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 471/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:56 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:56.798354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.33"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:56.799524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:56.809175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.809631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.810406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.810847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.819215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:56.819929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:56.826495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.826944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.827859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:56.828333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:56.836161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Acquired lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:55:56.961284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:56.969563 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66d549ae-c161-4b0b-abd4-03f412525478 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.154284 Jun 25 20:55:56.970261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 472/1063] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:56 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:57.120365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.121053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:57.127295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.127611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.128364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.128816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.231399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f.", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 20:55:57.232021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Releasing lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:55:57.232628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.232628 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Request method failure captured: Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action HTTP/1.1 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 45 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ZBki82xgyZk7zjQEBNPmAusK5Iwf9TTElpdrfBOrfKoFZ0AYavaLC6SE-sC1JGTvaPKdbiN41SqqjsmeX-omSbywUZsMingonAXGl9IkK74hWXQ61m5Tcrj7P_JP_pc9uoeTuMKNxk6zXBqQmSW2kAB97nY_8lmy8W8LG2X4mpto8 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:55:57.234804 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}] Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f9190ad58b5c40958a4fcec77ccdfc5a Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: {"addFloatingIp": {"address": "172.35.3.33"}} Jun 25 20:55:57.236110 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f3a67cd-7af0-47bf-a9af-932927da6b7e', 'body': {'addFloatingIp': {'address': '172.35.3.33'}}} Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.236924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 20:55:57.237994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.240467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.242625 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Returning 400 to user: Cannot associate floating IP 172.35.3.33 (e90e62d2-fd4d-4df1-a09c-c285e1def279) with port d5f9efe4-e605-4c04-9430-8c8cd11aacf3 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network 44774a18-2ab5-4f45-acd8-0f01387b275f. Jun 25 20:55:57.244929 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-1fc1a0a0-f218-45f0-aa30-882dcd841928'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:55:57.245682 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d680edc-f7fb-4f66-8142-cd9430c6cd93 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 400 len: 381 microversion: 2.1 time: 0.441849 Jun 25 20:55:57.245682 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 592/1064] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:56 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 381 bytes in 443 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:55:57.245682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.245682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:57.250353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.250800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.251564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.251997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.265831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:57.273683 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9f6300f5-b26a-476d-a4fe-0c680e20a92e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.157443 Jun 25 20:55:57.274261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 473/1065] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:57 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:57.278672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c5ed8e6-b3bd-4c04-b3fc-866f810330ba tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '.version_select at 0x7f985c79f8b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.311113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:57.318750 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a2ca73b-05c9-4aee-b6da-21891cf02efa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1221 microversion: 2.1 time: 0.080833 Jun 25 20:55:57.319329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 593/1066] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:57 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1221 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:57.607433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.608052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:57.614552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.615010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.615827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.616486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.753784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:57.762756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba87d97a-7fec-4bc2-abeb-51bf8f74c4a7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.159289 Jun 25 20:55:57.764337 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 594/1067] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:57 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:57.813677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.814611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:57.824394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.824870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.825647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.826756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.956591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:57.964990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba1e13b2-9451-4852-a7d8-b5dec78f3dc0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1504 microversion: 2.1 time: 0.159670 Jun 25 20:55:57.965534 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 595/1068] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:57 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:57.986698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:57.987402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:57.993436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.993889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:57.994649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:57.995086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.147740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:58.155861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91a9f32b-fa15-456a-91dc-5f67192869f9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1317 microversion: 2.1 time: 0.173093 Jun 25 20:55:58.156877 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 596/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:57 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:58.254803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c5ed8e6-b3bd-4c04-b3fc-866f810330ba tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/e90e62d2-fd4d-4df1-a09c-c285e1def279" status: 202 len: 0 microversion: 2.1 time: 0.979426 Jun 25 20:55:58.258879 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 474/1070] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:55:57 2022] DELETE /compute/v2.1/os-floating-ips/e90e62d2-fd4d-4df1-a09c-c285e1def279 => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:55:58.264952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: .version_select at 0x7f985f20db80>, body: {"removeFloatingIp": {"address": "172.35.3.90"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:55:58.291523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:58.292183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:58.299404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.299926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.300772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.301459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.421297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:58.427986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.428474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.429310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.429745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.586616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:58.594591 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1a3e202c-8205-4cea-919e-3edaabe7aaa0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.307273 Jun 25 20:55:58.595145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 475/1071] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:58 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:55:58.599931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:58.600825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:58.612194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.613175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.614688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.615484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.654471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Acquired lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:55:58.693054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:58.700958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-062285cc-47a4-41a6-9122-ca9897307fcd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1269 microversion: 2.1 time: 0.104558 Jun 25 20:55:58.701555 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 476/1072] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:58 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:58.781436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:58.781971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:58.800209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.800694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:58.801554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:58.801995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.203029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:59.211298 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-08173a86-d9b1-4af8-8ba6-61539b9dae0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.433877 Jun 25 20:55:59.220634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 477/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:58 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:59.220634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:59.220634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:59.226658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.227270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.228257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.228786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.612776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:59.621444 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bee99ad8-5459-406c-af51-4e659ac95372 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1479 microversion: 2.1 time: 0.408252 Jun 25 20:55:59.622264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 478/1074] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:59 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1479 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:59.654656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:59.657708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:59.668530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.669664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.670779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.671822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.677201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:55:59.904014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:55:59.912609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-46788349-3529-4898-a5fc-f32f7b692ae1 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1466 microversion: 2.1 time: 0.289080 Jun 25 20:55:59.924476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 479/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:59 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:55:59.924476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:55:59.924476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:55:59.943031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.943486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:55:59.944282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:55:59.944753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.189450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:00.202652 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d06c660-49ef-4a91-b008-9134956ae5d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.288346 Jun 25 20:56:00.204663 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 480/1076] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:55:59 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:00.211959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c0c071a-192c-42c4-bd05-5b90d8bd1253 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '.version_select at 0x7f985c5d5790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:00.218219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c0c071a-192c-42c4-bd05-5b90d8bd1253 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.218700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c0c071a-192c-42c4-bd05-5b90d8bd1253 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.231425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c0c071a-192c-42c4-bd05-5b90d8bd1253 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.024941 Jun 25 20:56:00.232410 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 481/1077] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:56:00 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:00.239406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4bf50e05-59ae-45d6-9c1b-ab040791374b req-1b0f8b31-6b77-448a-b7ce-5e518b460b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3a67cd-7af0-47bf-a9af-932927da6b7e", "tag": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:00.254249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4bf50e05-59ae-45d6-9c1b-ab040791374b req-1b0f8b31-6b77-448a-b7ce-5e518b460b8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.254732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4bf50e05-59ae-45d6-9c1b-ab040791374b req-1b0f8b31-6b77-448a-b7ce-5e518b460b8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.268725 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4bf50e05-59ae-45d6-9c1b-ab040791374b req-1b0f8b31-6b77-448a-b7ce-5e518b460b8c service nova] Creating event network-changed:d5f9efe4-e605-4c04-9430-8c8cd11aacf3 for instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e on nch1-master-1 Jun 25 20:56:00.275277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4bf50e05-59ae-45d6-9c1b-ab040791374b req-1b0f8b31-6b77-448a-b7ce-5e518b460b8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041465 Jun 25 20:56:00.276341 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 482/1078] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:00.283952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:00.284686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:00.292747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.294192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.295084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.295598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.335486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Updating instance_info_cache with network_info: [{"id": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3", "address": "fa:16:3e:63:63:92", "network": {"id": "2d859c08-4c28-4367-9987-3696c8e87ecb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-774983985-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a5871754d5114ee3a8093652ebb6b2b5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd5f9efe4-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:56:00.352244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Releasing lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:56:00.354381 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1cbf096f-7295-4ecb-9926-ca7e0d16a518 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 202 len: 0 microversion: 2.1 time: 2.092763 Jun 25 20:56:00.356566 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 597/1079] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:55:58 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 0 bytes in 2097 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 20:56:00.364740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:00.366320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:00.375747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.376663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.378349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.379031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.666912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd2eca53-2902-4bd1-8378-f4e1d58326d4 tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1617 microversion: 2.1 time: 0.308541 Jun 25 20:56:00.668964 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 598/1080] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:00 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1617 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:00.677977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:00.680898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:00.688072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.688689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.700758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.701226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.844490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:00.856738 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b0c46014-5858-4e88-93b2-691c88e9299d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.579082 Jun 25 20:56:00.857970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 483/1081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:00 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:00.882711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:00.883472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:00.890324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.891003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.891856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:00.892373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:00.988105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:00.996967 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59de321d-f7d2-44c7-8ba2-f98a801a7907 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.325922 Jun 25 20:56:01.009604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 599/1082] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:00 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:01.015011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8703cd5d-4d29-442a-a2e4-40fc18bbac8e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '.version_select at 0x7f984ff198b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.040731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02c12057-0923-4e1e-9022-658beda7f99e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1630 microversion: 2.1 time: 0.164363 Jun 25 20:56:01.041547 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 484/1083] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:00 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1630 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:01.068361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.069024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:01.075504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.075963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.076927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.077371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.222669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:01.239329 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88824353-8018-4bc1-b93c-a9bd6dd00b2c tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 2346 microversion: 2.25 time: 0.183434 Jun 25 20:56:01.252582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 485/1084] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:01 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 2346 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:01.258199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1063213036", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0acaf208-7f08-43b0-a4cf-21cdcf91b5f8"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:01.309673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:01.539887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:01.540349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:01.540897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:01.541312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:01.541724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:01.552830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.553281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.554134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.554634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.572347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:01.577166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Getting quotas for user c6773441662d41b2aecf9e43100633d3 and project 29037675b33a4f318e1fcafc33b6bed5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:01.589371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:56:01.591879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:01.611351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:01.637131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee9841c9-9da2-45aa-8ea2-866af2c58b30 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.383188 Jun 25 20:56:01.638150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 486/1085] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:56:01.643083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14bb2594-d9bb-42c9-b471-6d90b76c354d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: .version_select at 0x7f985c5201f0>, body: {"keypair": {"name": "tempest-keypair-1471838632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8bGRgdci5xQ5aMxL/ekqiB3IOWlUt2rUMBNmtjnOOXBpg5u+lXYSGCC/1utpDR2J2oDnj5rN3gYNXNVVzfk9dSzrsNjINlfLS+jWyvOrsAltJFmWU4xCKKjSReuP5PHw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:01.658900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-14bb2594-d9bb-42c9-b471-6d90b76c354d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:01.662949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-14bb2594-d9bb-42c9-b471-6d90b76c354d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for user e9c6e12528ea4760bed65f994df57783 and project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:01.688859 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14bb2594-d9bb-42c9-b471-6d90b76c354d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049350 Jun 25 20:56:01.694929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 487/1086] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:56:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:01.694929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.695192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:01.703390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.703852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.704696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.705142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.897999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8703cd5d-4d29-442a-a2e4-40fc18bbac8e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/daf34fa2-60da-41ea-a4ba-6dce42aaa127" status: 202 len: 0 microversion: 2.1 time: 0.886827 Jun 25 20:56:01.899547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 600/1087] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:56:01 2022] DELETE /compute/v2.1/os-floating-ips/daf34fa2-60da-41ea-a4ba-6dce42aaa127 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:56:01.904205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.905683 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:56:01.905683 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:56:01.906918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.908802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.911893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:01.913115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:01.942104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:01.945700 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7863922-f3fa-4f62-8313-be79bff7e130 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044915 Jun 25 20:56:01.952936 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 601/1088] 10.222.0.39 () {60 vars in 1216 bytes} [Sat Jun 25 20:56:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:56:01.955851 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8161018-305b-4ade-8a50-8df9080b13c0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.264879 Jun 25 20:56:01.961365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b912a62e-7e55-473c-abfb-8b73eca28e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.962012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b912a62e-7e55-473c-abfb-8b73eca28e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:01.967758 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 488/1089] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:01 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:01.973725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:01.974488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.003048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.003877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.005141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.005847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.049498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b912a62e-7e55-473c-abfb-8b73eca28e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:02.057529 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b912a62e-7e55-473c-abfb-8b73eca28e54 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1217 microversion: 2.1 time: 0.106016 Jun 25 20:56:02.060744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 602/1090] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:01 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:02.066131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fca3e8d1-cc59-4a4a-9587-1cf93165979f tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fca3e8d1-cc59-4a4a-9587-1cf93165979f tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Request method failure captured: Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action HTTP/1.1 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 34 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ZBki82xgyZk7zjQEBNPmAusK5Iwf9TTElpdrfBOrfKoFZ0AYavaLC6SE-sC1JGTvaPKdbiN41SqqjsmeX-omSbywUZsMingonAXGl9IkK74hWXQ61m5Tcrj7P_JP_pc9uoeTuMKNxk6zXBqQmSW2kAB97nY_8lmy8W8LG2X4mpto8 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:02.069120 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}] Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f9190ad58b5c40958a4fcec77ccdfc5a Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: {"addFloatingIp": {"address": ""}} Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:56:02.070590 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f3a67cd-7af0-47bf-a9af-932927da6b7e', 'body': {'addFloatingIp': {'address': ''}}} Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi '' Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:02.071510 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:56:02.072919 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:56:02.074245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jun 25 20:56:02.074245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.075782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fca3e8d1-cc59-4a4a-9587-1cf93165979f tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:02.076937 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fca3e8d1-cc59-4a4a-9587-1cf93165979f tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 400 len: 142 microversion: 2.1 time: 0.014884 Jun 25 20:56:02.078147 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 603/1091] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:02 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 142 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:56:02.085681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:02.088342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.098151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.098841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.099896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.100733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.183741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:02.194108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-84566fed-cc02-49c1-a1ac-63480b9711fd tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.224964 Jun 25 20:56:02.203934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 489/1092] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:01 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:02.210344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: .version_select at 0x7f985f20dc10>, body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:02.211517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.218685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.229986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.231106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.231607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.322420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Acquired lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:56:02.343130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:02.370750 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b42b531b-941c-458a-8089-a4ff896c4b0b tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.290500 Jun 25 20:56:02.380934 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 604/1093] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:02 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:02.485712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Releasing lock "refresh_cache-5f3a67cd-7af0-47bf-a9af-932927da6b7e" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:56:02.486594 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] HTTP exception thrown: floating IP not found Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Request method failure captured: Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action HTTP/1.1 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 41 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ZBki82xgyZk7zjQEBNPmAusK5Iwf9TTElpdrfBOrfKoFZ0AYavaLC6SE-sC1JGTvaPKdbiN41SqqjsmeX-omSbywUZsMingonAXGl9IkK74hWXQ61m5Tcrj7P_JP_pc9uoeTuMKNxk6zXBqQmSW2kAB97nY_8lmy8W8LG2X4mpto8 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:02.491760 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}] Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: f9190ad58b5c40958a4fcec77ccdfc5a Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: {"addFloatingIp": {"address": "0.0.0.0"}} Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:56:02.493547 ncdv-master-1 devstack@n-api.service[137462]: exception: floating IP not found Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '5f3a67cd-7af0-47bf-a9af-932927da6b7e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.494559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jun 25 20:56:02.495904 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.498496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Returning 404 to user: floating IP not found {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:02.499858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e95f2d5-957e-4ede-9c55-1c8586ac242e tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 404 len: 67 microversion: 2.1 time: 0.294487 Jun 25 20:56:02.501139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 490/1094] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:02 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 67 bytes in 296 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:56:02.511198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95fc74b-5a8a-4978-a468-70240803431a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:02.600716 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c95fc74b-5a8a-4978-a468-70240803431a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95fc74b-5a8a-4978-a468-70240803431a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Request method failure captured: Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action HTTP/1.1 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 44 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ZBki82xgyZk7zjQEBNPmAusK5Iwf9TTElpdrfBOrfKoFZ0AYavaLC6SE-sC1JGTvaPKdbiN41SqqjsmeX-omSbywUZsMingonAXGl9IkK74hWXQ61m5Tcrj7P_JP_pc9uoeTuMKNxk6zXBqQmSW2kAB97nY_8lmy8W8LG2X4mpto8 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:02.602584 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}] Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f9190ad58b5c40958a4fcec77ccdfc5a Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:56:02.604174 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f3a67cd-7af0-47bf-a9af-932927da6b7e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:02.607544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jun 25 20:56:02.608881 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:02.612999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95fc74b-5a8a-4978-a468-70240803431a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:02.612999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c95fc74b-5a8a-4978-a468-70240803431a tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action" status: 404 len: 88 microversion: 2.1 time: 0.098034 Jun 25 20:56:02.612999 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 605/1095] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:02 2022] POST /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e/action => generated 88 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 25 20:56:02.621297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:02.621928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.630613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.631314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.642582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.643383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.704066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:02.722911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:02.846915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a74df4f4-78d1-4fd2-8e33-9d545bbc1999 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "DELETE /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 204 len: 0 microversion: 2.1 time: 0.231624 Jun 25 20:56:02.848439 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 491/1096] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:02 2022] DELETE /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:02.860564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:02.861493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.876780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.877421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.878283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.879025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.975435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:02.977176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:02.984905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.985738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:02.987532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:02.988967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.132826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:03.152181 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a477e32-ee25-4cce-93ab-100247d036d7 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1541 microversion: 2.1 time: 0.299298 Jun 25 20:56:03.166415 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 606/1097] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:02 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1541 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:03.169788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:03.171686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:03.175620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:03.178181 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d899c282-2456-4376-923d-a8bae108b41f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.208291 Jun 25 20:56:03.188064 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 492/1098] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:02 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:03.194513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.197292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.198230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.198586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.214722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:03.215344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:03.232759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.233119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.234833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.237099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.295115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:03.299121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:03.307729 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0880bc1c-c870-4b49-a999-56e0816ed16c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1277 microversion: 2.1 time: 0.139644 Jun 25 20:56:03.320089 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 607/1099] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:03 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:03.394811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:03.395912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:03.413906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.418803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.420244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.422069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.583567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:03.623342 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fca00fe-070f-40a2-96a2-584947b430d9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.413090 Jun 25 20:56:03.629878 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 493/1100] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:03 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:03.814849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d543fa11-3651-4b40-8566-6d5355b7867d req-7290aa79-97c5-4b9f-90c3-99957d20312e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9b59ef-7ca9-4fea-b49d-66fe34e9c813", "tag": "94688529-efd3-4eab-97fe-d16d44c3d1ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:03.841391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:03.848620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d543fa11-3651-4b40-8566-6d5355b7867d req-7290aa79-97c5-4b9f-90c3-99957d20312e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.849115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d543fa11-3651-4b40-8566-6d5355b7867d req-7290aa79-97c5-4b9f-90c3-99957d20312e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.860915 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-051716c7-994d-47b0-b5b5-f0f77a61ce1c tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.472641 Jun 25 20:56:03.861691 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 608/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:03 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:03.873259 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d543fa11-3651-4b40-8566-6d5355b7867d req-7290aa79-97c5-4b9f-90c3-99957d20312e service nova] Creating event network-changed:94688529-efd3-4eab-97fe-d16d44c3d1ad for instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 on nch2-master-1 Jun 25 20:56:03.885586 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d543fa11-3651-4b40-8566-6d5355b7867d req-7290aa79-97c5-4b9f-90c3-99957d20312e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080810 Jun 25 20:56:03.886679 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 494/1102] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:03.940774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea776117-2993-45a1-9ace-9a0e96e6fb96", "device": "/dev/xvdb"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:03.942554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:03.956666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.957435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:03.958467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:03.959109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.173821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:04.174702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:04.183587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.184038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.190761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.191227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.509039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32404ed4-607d-4dfc-8228-71a25cefd9a1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.572695 Jun 25 20:56:04.509683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 609/1103] 10.222.0.39 () {62 vars in 1363 bytes} [Sat Jun 25 20:56:03 2022] POST /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:56:04.515356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:04.516063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:04.523039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.523403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.524170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.524635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.594906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:04.605389 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1221876-1f88-4f68-9884-69c5791b74fa tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1541 microversion: 2.1 time: 0.435767 Jun 25 20:56:04.605986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 495/1104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:04 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1541 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:04.612378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-590092748", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "df01ad33-2d1d-469d-8a83-fe93f2aaff22"}], "security_groups": [{"name": "tempest-securitygroup--1171239098"}], "key_name": "tempest-keypair-1471838632", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:04.733536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:04.741859 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c9a9c92-8ee2-4bd9-adf2-136b111d528c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.231004 Jun 25 20:56:04.742638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 610/1105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:04 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:04.747685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:04.748432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:04.754988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.755567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.756566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.757114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.835480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:04.845544 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f138c51-df51-447d-8f12-261fe6d61117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1275 microversion: 2.1 time: 0.101564 Jun 25 20:56:04.846118 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 611/1106] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:04 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:04.851221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:04.852258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:04.863608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.864071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.869944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:04.870980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:04.881652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] validate_networks() for [('df01ad33-2d1d-469d-8a83-fe93f2aaff22', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:05.155191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:05.168649 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68e25c7e-fb3e-4c53-a17c-2fdabc36f0ce tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.321246 Jun 25 20:56:05.170683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 612/1107] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:04 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:05.180933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:05.182425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:05.208252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.209370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.210856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.211523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.491380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:05.503756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-018e0d61-5900-49d0-a30c-013c6995b8e2 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.331662 Jun 25 20:56:05.504415 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 613/1108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:05 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:05.626515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:05.628054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:05.641320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.645799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.652077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.653099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.721171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:05.722232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:05.723599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:05.724365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:05.725559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:05.748008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.749198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.751040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.753490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.771260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.771773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.772249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lazy-loading 'fault' on Instance uuid 5f3a67cd-7af0-47bf-a9af-932927da6b7e {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:05.779073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:05.786480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for user e9c6e12528ea4760bed65f994df57783 and project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:05.801958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:56:05.804602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:05.858223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9190ad58b5c40958a4fcec77ccdfc5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5871754d5114ee3a8093652ebb6b2b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:05.866475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7112d88-aeb9-4953-9296-9febbaf3032d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.258983 Jun 25 20:56:05.868051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 496/1109] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:56:05.869525 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a4f8312-9f9b-4384-8f4d-eb2635b09efd tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 200 len: 1321 microversion: 2.1 time: 0.248043 Jun 25 20:56:05.870254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 614/1110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:05 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:05.874641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:05.877045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:05.885974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:05.886349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.886599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:05.887033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.887933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.888525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.900626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.901080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:05.901862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:05.902298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.163425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:06.172958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1fd53494-5577-49c8-ba0f-683b7ce5d1d0 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.303555 Jun 25 20:56:06.176830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 497/1111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:05 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:06.194467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1116660-ae4b-4184-9daa-b7621979a61c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:06.202719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1116660-ae4b-4184-9daa-b7621979a61c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:06.273106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1116660-ae4b-4184-9daa-b7621979a61c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:06.283337 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1116660-ae4b-4184-9daa-b7621979a61c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1234 microversion: 2.1 time: 0.092448 Jun 25 20:56:06.284683 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 498/1112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:06 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:06.296414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-849c19b2-132b-4eae-8fc7-c0732bc63864 req-d425584b-1f43-46a9-8fad-9c9a6849e1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3a67cd-7af0-47bf-a9af-932927da6b7e", "name": "network-vif-deleted", "tag": "d5f9efe4-e605-4c04-9430-8c8cd11aacf3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:06.307426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-849c19b2-132b-4eae-8fc7-c0732bc63864 req-d425584b-1f43-46a9-8fad-9c9a6849e1e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.308705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-849c19b2-132b-4eae-8fc7-c0732bc63864 req-d425584b-1f43-46a9-8fad-9c9a6849e1e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.334988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-849c19b2-132b-4eae-8fc7-c0732bc63864 req-d425584b-1f43-46a9-8fad-9c9a6849e1e2 service nova] Creating event network-vif-deleted:d5f9efe4-e605-4c04-9430-8c8cd11aacf3 for instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e on nch1-master-1 Jun 25 20:56:06.340921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-849c19b2-132b-4eae-8fc7-c0732bc63864 req-d425584b-1f43-46a9-8fad-9c9a6849e1e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053047 Jun 25 20:56:06.342371 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 499/1113] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:06.350692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:06.352001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:06.361330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.362242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.366810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.367774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.574491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:06.586790 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3d1f244f-2b41-41ee-8cda-ff46a3cfb0ba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.242358 Jun 25 20:56:06.596524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 500/1114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:06 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:06.605031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-01623197-6b7b-4a7b-a516-c6d64708ad0f req-e44cdc66-0476-4043-84b4-10d6b65a52e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff14b19d-5125-4e28-ba7d-47329c4b0529", "name": "network-vif-plugged", "status": "completed", "tag": "52fe34cc-908a-4760-a1bd-ea8e1b504505"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:06.614573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-01623197-6b7b-4a7b-a516-c6d64708ad0f req-e44cdc66-0476-4043-84b4-10d6b65a52e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.614972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-01623197-6b7b-4a7b-a516-c6d64708ad0f req-e44cdc66-0476-4043-84b4-10d6b65a52e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.630597 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-01623197-6b7b-4a7b-a516-c6d64708ad0f req-e44cdc66-0476-4043-84b4-10d6b65a52e2 service nova] Creating event network-vif-plugged:52fe34cc-908a-4760-a1bd-ea8e1b504505 for instance ff14b19d-5125-4e28-ba7d-47329c4b0529 on nch2-master-1 Jun 25 20:56:06.641803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-01623197-6b7b-4a7b-a516-c6d64708ad0f req-e44cdc66-0476-4043-84b4-10d6b65a52e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050820 Jun 25 20:56:06.643207 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 501/1115] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:06.649111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:06.650143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:06.657942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.658710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.659667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.660248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.717206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:06.734584 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bb16074-b96f-4e9f-8d26-a1a32fdf1eed tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.863372 Jun 25 20:56:06.745044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 615/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:05 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:06.890526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:06.893248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] [instance: 5f3a67cd-7af0-47bf-a9af-932927da6b7e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:06.900251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.900745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.901517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.901958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.907326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:06.917056 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cbe55264-46f5-4e9b-a66c-a1c1bd5d4838 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.272473 Jun 25 20:56:06.917946 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] HTTP exception thrown: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Request method failure captured: Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e HTTP/1.1 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ZBki82xgyZk7zjQEBNPmAusK5Iwf9TTElpdrfBOrfKoFZ0AYavaLC6SE-sC1JGTvaPKdbiN41SqqjsmeX-omSbywUZsMingonAXGl9IkK74hWXQ61m5Tcrj7P_JP_pc9uoeTuMKNxk6zXBqQmSW2kAB97nY_8lmy8W8LG2X4mpto8 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:06.919952 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5871754d5114ee3a8093652ebb6b2b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5871754d5114ee3a8093652ebb6b2b5"}]}] Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5871754d5114ee3a8093652ebb6b2b5 Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f9190ad58b5c40958a4fcec77ccdfc5a Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. Jun 25 20:56:06.921302 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f3a67cd-7af0-47bf-a9af-932927da6b7e'} Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:06.922317 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. Jun 25 20:56:06.923717 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:06.925094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] Returning 404 to user: Instance 5f3a67cd-7af0-47bf-a9af-932927da6b7e could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:06.925094 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1101ec0c-5ec2-4bec-89bf-6fb9007dcbf5 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018 tempest-FloatingIPsAssociationNegativeTestJSON-1455507018-project] 10.222.0.39 "GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e" status: 404 len: 111 microversion: 2.1 time: 0.036429 Jun 25 20:56:06.925094 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 616/1117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:06 2022] GET /compute/v2.1/servers/5f3a67cd-7af0-47bf-a9af-932927da6b7e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:06.926576 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 502/1118] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:06 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:06.955257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-032ac4c4-a880-454b-86af-68ec923ff060 req-b82db90e-6c96-41f8-a162-ad9de16de30b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964069ea-dfde-433b-81c5-fc9e8bce11e8", "tag": "68ff6ce0-9995-484b-9057-b1855f9f7ac8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:06.965151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-032ac4c4-a880-454b-86af-68ec923ff060 req-b82db90e-6c96-41f8-a162-ad9de16de30b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:06.965595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-032ac4c4-a880-454b-86af-68ec923ff060 req-b82db90e-6c96-41f8-a162-ad9de16de30b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:06.979015 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-032ac4c4-a880-454b-86af-68ec923ff060 req-b82db90e-6c96-41f8-a162-ad9de16de30b service nova] Creating event network-changed:68ff6ce0-9995-484b-9057-b1855f9f7ac8 for instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 on nch1-master-1 Jun 25 20:56:06.984120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-032ac4c4-a880-454b-86af-68ec923ff060 req-b82db90e-6c96-41f8-a162-ad9de16de30b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034518 Jun 25 20:56:06.985525 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 617/1119] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:07.194647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:07.195259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:07.201491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.201939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.202810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.203178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.302656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:07.303401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:07.312203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.312819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.313603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.314042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.427176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:07.440224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-361628bc-e850-4dce-aac9-f178ef2baec7 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1521 microversion: 2.1 time: 0.249515 Jun 25 20:56:07.440896 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 503/1120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:07 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:07.441804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:07.451761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9899c28e-7400-410b-b5c8-c8110fbab35f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1286 microversion: 2.1 time: 0.154122 Jun 25 20:56:07.452479 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 618/1121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:07 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:07.609635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:07.610948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:07.618807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.619352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.620242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.620782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.751868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:07.752523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:07.765558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.766012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.766981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.767684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.869015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:07.881302 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb0e5a04-58af-400a-887e-63394f8ac2e2 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.279503 Jun 25 20:56:07.892372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 504/1122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:07 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:07.943896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:07.944933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:07.956312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.957116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:07.958357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:07.958806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.055255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:08.064034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc10b1ae-e2ad-4116-ba90-1946cdea638e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.316424 Jun 25 20:56:08.065404 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 619/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:07 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:08.225016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:08.232869 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a0baa4ae-6cfc-4b2a-b594-69a18b6e8e66 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1368 microversion: 2.1 time: 0.293628 Jun 25 20:56:08.244645 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 505/1124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:07 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1368 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:08.459356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:08.460669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:08.468861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:08.469830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:08.502411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.503714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.504676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.505697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.506332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.507048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.511278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.511720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.736323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:08.746955 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d072fac-db0b-417b-90a3-5ea6b7dde4f1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.281970 Jun 25 20:56:08.747634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 506/1125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:08 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:08.795457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:08.804808 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-acef554e-243f-4573-b10d-55dffe3e614e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1498 microversion: 2.1 time: 0.350125 Jun 25 20:56:08.806422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 620/1126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:08 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1498 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:08.823612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:08.827162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:08.828072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:08.834581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.835481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.836391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.836931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.900102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:08.901754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:08.915079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.915174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.915963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:08.916402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:08.967618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:09.038158 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4faaed2-57e3-47c4-81f7-636fe24a7e0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.219865 Jun 25 20:56:09.039236 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 507/1127] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Jun 25 20:56:08 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:09.050695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e1ca2fe-f7e5-47ad-81be-9d064c75565e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:09.057045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e1ca2fe-f7e5-47ad-81be-9d064c75565e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.057494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e1ca2fe-f7e5-47ad-81be-9d064c75565e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.122608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e1ca2fe-f7e5-47ad-81be-9d064c75565e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Going to try to start instance {{(pid=137462) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 20:56:09.189161 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e1ca2fe-f7e5-47ad-81be-9d064c75565e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "POST /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.143268 Jun 25 20:56:09.190873 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 508/1128] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:09 2022] POST /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:56:09.195560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:09.201188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:09.203117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:09.207152 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-532832dc-c3ff-4511-bc27-117eb6cc8415 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.311566 Jun 25 20:56:09.217747 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 621/1129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:08 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:09.223641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.224750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.225963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.226942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.231000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:09.231630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:09.241674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.242111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.245518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.249644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.263521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:09.479696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:09.488562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aee156e6-90c3-43c2-88ec-e41ae82c9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1507 microversion: 2.1 time: 0.269208 Jun 25 20:56:09.490837 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 622/1130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:09 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:09.496077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:09.496884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:09.506444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.508218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.509324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.509924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.825934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:09.835420 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32fef891-4348-41b7-97fc-2e9461b9b887 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1552 microversion: 2.1 time: 0.342868 Jun 25 20:56:09.847056 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 623/1131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:09 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1552 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:09.856258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:09.859416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:09.868958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.869695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.870649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:09.871230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:09.878620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:10.032345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:10.046852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:10.048189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1570807-d630-4dc0-b3d1-0bc2f1dbc9da tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.199435 Jun 25 20:56:10.050540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 624/1132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:09 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:10.056919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:10.057812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:10.060156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e901741-8149-4ef4-aada-af8ebd1d0424 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.867156 Jun 25 20:56:10.062558 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 509/1133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:09 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:10.077539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.078548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.079363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.080256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.188754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:10.189590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:10.201668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.203350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.204410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.205729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.209669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c6e9dfe8-a1c4-47e1-9872-3c21ab0dc49e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.157461 Jun 25 20:56:10.214666 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 625/1134] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 20:56:10 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:10.224014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:10.224673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:10.240357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.240850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.241637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.242084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.507012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:10.515779 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f37f4e4-820f-44f8-a6d0-a3b6e3ed835d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.295617 Jun 25 20:56:10.516640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 626/1135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:10 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:10.521556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:10.522407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:10.528538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.528987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.529964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.530576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.662034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:10.683921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c67d667-5d82-40b9-b3ae-15d1b70838af tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 2424 microversion: 2.25 time: 0.500758 Jun 25 20:56:10.684970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 510/1136] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:10 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 2424 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:10.707416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:10.719243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:10.727418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.727980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.728888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:10.729394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:10.786271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'flavor' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:10.804221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Going to try to live migrate instance to nch2-master-1 {{(pid=137462) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:56:11.228792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:11.243538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b6db898f-df5b-41cd-a9e8-0f0d0da15800 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1507 microversion: 2.1 time: 0.725253 Jun 25 20:56:11.245195 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 627/1137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:10 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1507 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:11.260235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:11.262962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:11.271184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.272018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:11.273387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.274014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:11.569533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:11.582005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6991cd63-5e8d-486e-bbe0-2d37e4f1c81b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.334966 Jun 25 20:56:11.595275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 628/1138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:11 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:11.603330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:11.608074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:11.623637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.624216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:11.625125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.625621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:11.923455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:11.932088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:11.945113 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dab9ba32-7307-42ee-b630-a4eaeaa30117 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.348310 Jun 25 20:56:11.946956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 629/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:11 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:11.955174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:11.958741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:11.968222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.968780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:11.974075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:11.974594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.054296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:12.363083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:12.372676 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8ec0f2d7-e9bf-483e-8edc-8c709193604c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.423185 Jun 25 20:56:12.382656 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 630/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:11 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:12.389718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-91884638-16be-4f5b-a02e-2d876a8717a5 req-61f0089a-098e-4012-8d03-40704e9bb596 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:12.428758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-91884638-16be-4f5b-a02e-2d876a8717a5 req-61f0089a-098e-4012-8d03-40704e9bb596 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.429218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-91884638-16be-4f5b-a02e-2d876a8717a5 req-61f0089a-098e-4012-8d03-40704e9bb596 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.462410 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-91884638-16be-4f5b-a02e-2d876a8717a5 req-61f0089a-098e-4012-8d03-40704e9bb596 service nova] Creating event network-changed:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:56:12.476608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-91884638-16be-4f5b-a02e-2d876a8717a5 req-61f0089a-098e-4012-8d03-40704e9bb596 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088243 Jun 25 20:56:12.477349 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 631/1141] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:12.489410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:12.490156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:12.512706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.513773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.518101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.518994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.763632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa3e413a-6b88-4bac-81af-84a61b054826 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/action" status: 202 len: 0 microversion: 2.25 time: 2.061020 Jun 25 20:56:12.765938 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 511/1142] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:56:10 2022] POST /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/action => generated 0 bytes in 2064 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:12.772740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2d0f04da-97c3-4fde-b345-f85612088b93 req-43358426-371b-4a58-ac56-ce8d7e17b230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff14b19d-5125-4e28-ba7d-47329c4b0529", "tag": "52fe34cc-908a-4760-a1bd-ea8e1b504505"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:12.781337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:12.790486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0575760-327d-4f7c-a0c6-644bd724294a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1511 microversion: 2.1 time: 0.311889 Jun 25 20:56:12.793009 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 632/1143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:12 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:12.794526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2d0f04da-97c3-4fde-b345-f85612088b93 req-43358426-371b-4a58-ac56-ce8d7e17b230 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.795598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2d0f04da-97c3-4fde-b345-f85612088b93 req-43358426-371b-4a58-ac56-ce8d7e17b230 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.799352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:12.800560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:12.814115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.814410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.815197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.817149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.831077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2d0f04da-97c3-4fde-b345-f85612088b93 req-43358426-371b-4a58-ac56-ce8d7e17b230 service nova] Creating event network-changed:52fe34cc-908a-4760-a1bd-ea8e1b504505 for instance ff14b19d-5125-4e28-ba7d-47329c4b0529 on nch2-master-1 Jun 25 20:56:12.842000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2d0f04da-97c3-4fde-b345-f85612088b93 req-43358426-371b-4a58-ac56-ce8d7e17b230 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072882 Jun 25 20:56:12.842911 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 512/1144] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:12.867095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-97671ac2-2556-42ca-8c33-e4d4393a2940 req-dae190d3-fbf2-4269-ba49-e0ab5903a2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b59ef-7ca9-4fea-b49d-66fe34e9c813", "name": "network-vif-plugged", "status": "completed", "tag": "94688529-efd3-4eab-97fe-d16d44c3d1ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:12.880079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-97671ac2-2556-42ca-8c33-e4d4393a2940 req-dae190d3-fbf2-4269-ba49-e0ab5903a2c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.880679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-97671ac2-2556-42ca-8c33-e4d4393a2940 req-dae190d3-fbf2-4269-ba49-e0ab5903a2c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.902981 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-97671ac2-2556-42ca-8c33-e4d4393a2940 req-dae190d3-fbf2-4269-ba49-e0ab5903a2c0 service nova] Creating event network-vif-plugged:94688529-efd3-4eab-97fe-d16d44c3d1ad for instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 on nch2-master-1 Jun 25 20:56:12.911004 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-97671ac2-2556-42ca-8c33-e4d4393a2940 req-dae190d3-fbf2-4269-ba49-e0ab5903a2c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065212 Jun 25 20:56:12.911749 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 513/1145] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:12.918126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:12.919041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:12.927941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.928794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:12.929739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:12.930263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.060256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.071360 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a814cf0-ab56-4409-b30c-a73cf96dc00e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.277081 Jun 25 20:56:13.071981 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 633/1146] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:12 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:13.077215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.081718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.082175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.servers [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Removing options 'limit' from query {{(pid=137461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 25 20:56:13.083248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:13.085287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.085815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.086823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.087584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.089301 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80c6fe27-e26c-4f36-970f-6ccb27355f0c tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.016258 Jun 25 20:56:13.090602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 634/1147] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:56:13.095817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.096520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:13.105897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:13.108572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.110628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.111789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.112241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.292829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.301073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-50064542-6825-4edd-8a2a-c5ec33f82a66 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.209185 Jun 25 20:56:13.302444 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 635/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:13.307175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.307913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:13.314503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.315191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.315994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.317187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.463957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.474902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f38e85a-7708-465b-9371-4bb4714fcc5e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1511 microversion: 2.1 time: 0.171213 Jun 25 20:56:13.487634 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 636/1149] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:13.495797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.496456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:13.504529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.504994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.505778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.506381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.692657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.703935 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-307ef78f-b74d-4821-a76d-059f2ecd6f3b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.215060 Jun 25 20:56:13.718248 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 637/1150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:13.724412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.725721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:13.735793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.736505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.737452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.738597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.741174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.755834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.761691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.762989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da749123-0b6e-4326-beaa-841192e0bef0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.849990 Jun 25 20:56:13.763609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 514/1151] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:12 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:13.885106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:13.892867 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47bf8e27-60b9-4029-a28f-eabf5b185539 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1512 microversion: 2.1 time: 0.182088 Jun 25 20:56:13.893682 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 638/1152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:13.910021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:13.910778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:13.917930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.919028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:13.920035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:13.920696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.088919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.089800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:14.098972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.099507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.100391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.100984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.250852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:14.259934 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29fd45c2-405d-4f38-b2f3-654abd0e5913 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.175367 Jun 25 20:56:14.270134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 639/1153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:14.318900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.319650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:14.326970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.327417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.328182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.328660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.336815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:14.350043 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b8f7ebb-0293-4242-8dad-bd49e1c3edbf tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1510 microversion: 2.1 time: 0.443772 Jun 25 20:56:14.351242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 515/1154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:13 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:14.369644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.374191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:14.375802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:14.543853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.545099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.546269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.547026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.548237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:14.557688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a116a30-7adb-48ad-802b-583792914e01 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.242757 Jun 25 20:56:14.558838 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 640/1155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:14.656498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:14.727708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.728533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:14.736511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.736998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.737789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.738461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.910147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:14.919896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8ad63ce-ed27-4ae9-b522-2bfc2b5fd9eb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1317 microversion: 2.1 time: 0.197267 Jun 25 20:56:14.921157 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 641/1156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:14.937719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.945347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:14.947534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1cc959a1-addf-4b07-b38d-f8231c7fd58e tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.584015 Jun 25 20:56:14.958040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 516/1157] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:14.964235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.965954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:14.966363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.966909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:14.967880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.970592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.975774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.976448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:14.977414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:14.978005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.179259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.183627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:15.191466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.193639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.195099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d580023b-481a-4a55-bfd9-38c4b4bb06b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.272744 Jun 25 20:56:15.195938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 642/1158] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:15.281460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.282426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:15.290366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.291485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.292050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.292983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.293496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.300390 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40bafbde-24c6-4dfc-ae77-67e587b26293 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1511 microversion: 2.1 time: 0.340850 Jun 25 20:56:15.300973 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 517/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:14 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:15.318696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.319318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:15.325484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.326345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.327096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.327535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.456540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.466674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34fb48ed-434e-4503-aef6-d9baf9eb636a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.192786 Jun 25 20:56:15.467724 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 643/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:15.525814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.535042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f20f4937-d97d-4415-ba65-b6cb5ee7dd20 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1512 microversion: 2.1 time: 0.222260 Jun 25 20:56:15.536227 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 518/1161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:15.551439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.552829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:15.562107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.562795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.563723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.564314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.574742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.575608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:15.578913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:15.583219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.583666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.584445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.585244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.790984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.800567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26edb520-51d3-4a2c-b528-a2a19cc438a4 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1510 microversion: 2.1 time: 0.253130 Jun 25 20:56:15.801983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 644/1162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:15.819812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.829240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.830082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:15.836610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.837090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.837979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.838414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.838976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:15.847047 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-844f8609-9a06-493d-b139-dd5120a9ccc6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.276101 Jun 25 20:56:15.848041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 519/1163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:15.939179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:15.939795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:15.955811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:15.959055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.962473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:15.963821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:15.964682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.032340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.040319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.040789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.241919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.253647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9969b7bc-aad8-4619-a378-64e32834f83b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1506 microversion: 2.1 time: 0.318278 Jun 25 20:56:16.254302 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 520/1164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:16.262565 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72eddf7a-04d2-46b7-ac3d-6c43fe122c6d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.447423 Jun 25 20:56:16.263620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 645/1165] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:56:15 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:16.272540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:16.273552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:16.274388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:16.275471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:16.280461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=18 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:16.282591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.283123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.284377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.284757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.292477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.292942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.293732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.294175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.445090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.460344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-492a7232-cccb-4127-b614-f112e1f0beba tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1506 microversion: 2.1 time: 0.189770 Jun 25 20:56:16.461638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 646/1166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:16 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:16.476139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:16.480954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.481958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:16.624864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.625060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.625525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.626645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.627327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.636706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.638688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:16.640148 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b07efd4-000e-4417-886c-75de97939eca tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.378074 Jun 25 20:56:16.641792 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 521/1167] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:16 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:16.646801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:16.648648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:16.655110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.656223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.657343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.657982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.767506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:16.767848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:16.768581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:16.769172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:16.769979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:16.827734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:16.868681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:16.885612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.886359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.888469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.890112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.953913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:16.961336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53674f98-67bc-4ec2-91da-0bc7bd98c77b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.498096 Jun 25 20:56:16.968677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 647/1168] 10.222.0.39 () {58 vars in 1149 bytes} [Sat Jun 25 20:56:16 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:16.973728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:16.976877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:16.982519 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-594d5159-4f41-4f78-8b69-b5b0a5617235 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "POST /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813/action" status: 202 len: 1108 microversion: 2.1 time: 0.338925 Jun 25 20:56:16.992470 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 522/1169] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:16 2022] POST /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813/action => generated 1108 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 25 20:56:16.992877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.993379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:16.998506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:16.998957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.017972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.018867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:17.030522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.032863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.034000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.034656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.269909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.288838 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-483009f2-8276-474c-8fca-d6907732d6a8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.314329 Jun 25 20:56:17.290085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 648/1170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:16 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:17.302984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.317310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.318845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:17.327172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.331663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.332510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.333741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.334619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.336314 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab6f89f4-2bfe-49d2-a097-13c062ba10df tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.341996 Jun 25 20:56:17.337967 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 523/1171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:16 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:17.362658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.362920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:17.373158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.374013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.375137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.375749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.485989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:17.557195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.569714 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59ec9e68-c657-4f3e-8627-eb30818ed335 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.278192 Jun 25 20:56:17.569942 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8011c12d-b384-4b09-a5a4-4e6910861a8b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.229704 Jun 25 20:56:17.579676 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 649/1173] 10.222.0.39 () {58 vars in 1211 bytes} [Sat Jun 25 20:56:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:17.579892 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 524/1173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:17 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:17.586061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.593298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9ce731d5-40a2-45bc-b286-6094f72390f8 req-9d0a8903-3b0f-433d-8b38-0c1f495e732e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964069ea-dfde-433b-81c5-fc9e8bce11e8", "name": "network-vif-plugged", "status": "completed", "tag": "68ff6ce0-9995-484b-9057-b1855f9f7ac8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:17.596753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.598952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:17.618703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.620785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.622599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9ce731d5-40a2-45bc-b286-6094f72390f8 req-9d0a8903-3b0f-433d-8b38-0c1f495e732e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.623836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.624718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9ce731d5-40a2-45bc-b286-6094f72390f8 req-9d0a8903-3b0f-433d-8b38-0c1f495e732e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.626411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.658546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9ce731d5-40a2-45bc-b286-6094f72390f8 req-9d0a8903-3b0f-433d-8b38-0c1f495e732e service nova] Creating event network-vif-plugged:68ff6ce0-9995-484b-9057-b1855f9f7ac8 for instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 on nch1-master-1 Jun 25 20:56:17.675458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9ce731d5-40a2-45bc-b286-6094f72390f8 req-9d0a8903-3b0f-433d-8b38-0c1f495e732e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098449 Jun 25 20:56:17.676239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 650/1174] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:17.687706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.693643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:17.712375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.718799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.719797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.721195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.827454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:17.920052 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6440307b-79da-436d-aa1e-485068c70da3 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.341869 Jun 25 20:56:17.920684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 525/1175] 10.222.0.39 () {58 vars in 1195 bytes} [Sat Jun 25 20:56:17 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:17.932350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:17.937011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:17.937686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': '1631210114', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:17.943469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.943913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:17.944831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:17.945505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.014682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.030804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.040976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.043455 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54ae009d-9166-40df-9d96-e6cdb60ccd79 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.363314 Jun 25 20:56:18.054567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:18.057168 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 651/1176] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:17 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:18.117826 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9c4259e-b846-44f5-a82b-0ca4459e1181 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=1631210114" status: 200 len: 346 microversion: 2.1 time: 0.189570 Jun 25 20:56:18.118749 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 526/1177] 10.222.0.39 () {58 vars in 1155 bytes} [Sat Jun 25 20:56:17 2022] GET /compute/v2.1/servers?name=1631210114 => generated 346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:18.130196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.134623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.136252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:18.151430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.152064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.153095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.153540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.264086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:18.306418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.307066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:18.313239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.313693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.314465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.314900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.333218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e985123e-646b-4fc7-bc77-ad6ec9067c03 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.207044 Jun 25 20:56:18.334755 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 652/1178] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:18.345931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.351359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.352039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-163121011', 'deleted': False, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:18.358408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.358869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.359676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.360151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.476386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.484680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:56:18.485803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92a52832-ecdd-4059-aa64-535557124d75 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.182291 Jun 25 20:56:18.486748 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 527/1179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:18.496157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.496812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:18.505392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.505842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.506622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.507052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.566322 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0dd22cc-30c3-4137-a223-37d0817f7af6 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-163121011" status: 200 len: 346 microversion: 2.1 time: 0.224141 Jun 25 20:56:18.567656 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 653/1180] 10.222.0.39 () {58 vars in 1227 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-163121011 => generated 346 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:18.585925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.586439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:18.595695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.596158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.597568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.598095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.633235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:18.662463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.670172 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7da38027-4ae7-4769-b102-f7275c700bb7 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1317 microversion: 2.1 time: 0.182335 Jun 25 20:56:18.676412 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 528/1181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:18.676412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.676412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:18.683650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.684097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.685014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.685521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.727298 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25ebc814-1506-47ec-b6f6-a11a35896606 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 204 len: 0 microversion: 2.1 time: 0.148897 Jun 25 20:56:18.730897 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 654/1182] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:18 2022] DELETE /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:18.738591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:18.739416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:18.746249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.746703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.747479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:18.747918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:18.847393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:18.868628 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e8e6ea3e-8799-4c6d-804b-976653e07501 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.196570 Jun 25 20:56:18.869241 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 529/1183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:19.062146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:19.064696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:19.076051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.076409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.077434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.078088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.249934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:19.259490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:19.261049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:19.262648 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-67b37a7a-4a17-4dd8-b57a-9e6743c82ee5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.204783 Jun 25 20:56:19.263981 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 530/1184] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:19 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:19.335385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:19.345168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e34d1571-34c2-4c3f-8c69-6725aac00aba tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1516 microversion: 2.1 time: 0.609858 Jun 25 20:56:19.348847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 655/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:18 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1516 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:19.503417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:19.504449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:19.517043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.517657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.519347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.522923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.687630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:19.688238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:19.701762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.702134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.702926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.703362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.745256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:19.745962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:19.756297 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc0c1dfd-a837-4056-a17f-74c59dc192ad tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.257261 Jun 25 20:56:19.757377 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 531/1186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:19 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:19.762451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-80217163-895a-48a2-a31e-9001f1e4cedc req-bcf04a83-7621-4096-8d49-f28aa4e2a00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "name": "network-vif-plugged", "status": "completed", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:19.773790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-80217163-895a-48a2-a31e-9001f1e4cedc req-bcf04a83-7621-4096-8d49-f28aa4e2a00a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.774245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-80217163-895a-48a2-a31e-9001f1e4cedc req-bcf04a83-7621-4096-8d49-f28aa4e2a00a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.786727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-80217163-895a-48a2-a31e-9001f1e4cedc req-bcf04a83-7621-4096-8d49-f28aa4e2a00a service nova] Creating event network-vif-plugged:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:56:19.796177 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-80217163-895a-48a2-a31e-9001f1e4cedc req-bcf04a83-7621-4096-8d49-f28aa4e2a00a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037444 Jun 25 20:56:19.797312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 532/1187] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:19.893218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:19.894437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:19.903418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.904169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:19.905171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:19.908276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.147256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.156775 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4813a023-5f91-4675-8a2b-6767741f4815 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1467 microversion: 2.1 time: 0.473349 Jun 25 20:56:20.157384 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 656/1188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:19 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:20.174905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.175514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.187800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.188307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.189329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.189895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.227300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.235890 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9fc411d6-6f2f-4a06-a1c1-413401305cc1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.353018 Jun 25 20:56:20.240502 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 533/1189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:19 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:20.282106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.282715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.292091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.292570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.293365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.293801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.431871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8408da14-7848-4693-8c51-9f8cabcb4b7f tempest-ServersOnMultiNodesTest-2001813206 tempest-ServersOnMultiNodesTest-2001813206-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1618 microversion: 2.1 time: 0.260647 Jun 25 20:56:20.436575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 657/1190] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:20 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1618 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:20.442060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.442942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.471517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.471970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.474832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.475581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.480585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.494281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.497567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.504756 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5701dac4-4f8d-4130-bb4e-0f8ceed6fe90 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.220727 Jun 25 20:56:20.505724 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 534/1191] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:20 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:20.510665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.511158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.523158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.524238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.525212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.525801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.567505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:20.674195 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47ba2f5a-ef3c-4ee9-9036-43684985c4e5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 204 len: 0 microversion: 2.1 time: 0.167056 Jun 25 20:56:20.676473 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 535/1192] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:20 2022] DELETE /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:20.686224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.687120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.694760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.695223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.696009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.696467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.763562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.780790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-472fce11-93ea-43f0-9759-790dae35c936 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1516 microversion: 2.1 time: 0.338583 Jun 25 20:56:20.781994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 658/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:20 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1516 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:20.788200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:20.789078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:20.797032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.815217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.832584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:20.833525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:20.883287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:20.891880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4cb607e7-900a-43c4-8c17-203e04b0f63a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1473 microversion: 2.1 time: 0.211809 Jun 25 20:56:20.892840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 536/1194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:20 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1473 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:21.070652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.081544 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dff18d5f-ded8-4b51-92b3-49bdc64ba309 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.298168 Jun 25 20:56:21.082833 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 659/1195] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:20 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:21.253242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:21.259652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:21.266866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.267452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.268247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.268723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.418213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.425650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:21.428928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d241ce3-2ca8-40a1-b8f3-fcfb8b9161b9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.179735 Jun 25 20:56:21.429596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 537/1196] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:21 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:21.523233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:21.523861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:21.533297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.533750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.537450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.537870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.783063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.798836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:21.799454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:21.802151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.803980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.805578 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57fbcd70-98db-4afe-bbbe-4a82f7ad6acc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.286453 Jun 25 20:56:21.806699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 660/1197] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:21 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:21.806816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.807295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.808148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.808636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.909307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:21.909928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:21.916272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.917029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.917803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:21.918401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:21.977777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:21.986379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65152734-7a16-4017-8419-62b1f598254f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1516 microversion: 2.1 time: 0.191764 Jun 25 20:56:21.987419 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 538/1198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:21 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:22.106570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:22.114357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a6a8ddf4-a869-4adc-b4e2-7d2373d870d8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1473 microversion: 2.1 time: 0.208901 Jun 25 20:56:22.114911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 661/1199] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:21 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:22.119373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:22.119968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:22.127539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.127982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.128785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.129245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.129755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1807297351", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "3c6cf7a6-2345-4f61-9904-003c4d5dc289"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:22.185132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] validate_networks() for [('3c6cf7a6-2345-4f61-9904-003c4d5dc289', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:22.267942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:22.284827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e61b394b-b499-4bb0-9985-1a305acc862f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1360 microversion: 2.1 time: 0.168787 Jun 25 20:56:22.285550 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 662/1200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:22 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1360 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:22.448550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:22.449738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:22.458361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.459135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.461109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.461794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.599405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:22.608665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-188c2d82-8dc5-46e6-9165-05fe0adeaea7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.166056 Jun 25 20:56:22.609268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 663/1201] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:22 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:22.632546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:22.633091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:22.633573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:22.634172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:22.634618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:22.644213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.644762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.645558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.645992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.666616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:22.671131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for user dbd8d82d694941b58fa2d18311ea5785 and project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:22.683176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:56:22.685695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:22.735292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6c77e8d-3825-42ed-878b-375f93ac6f5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.746361 Jun 25 20:56:22.736651 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 539/1202] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:56:22.747137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e81ee41-9d69-46dc-b3fa-bfa3d3cfd577 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:22.747769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e81ee41-9d69-46dc-b3fa-bfa3d3cfd577 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:22.823482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e81ee41-9d69-46dc-b3fa-bfa3d3cfd577 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:22.824611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:22.825627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:22.831974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e81ee41-9d69-46dc-b3fa-bfa3d3cfd577 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1208 microversion: 2.1 time: 0.088627 Jun 25 20:56:22.836789 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 664/1203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:22 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1208 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:22.839742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.841007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:22.842227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:22.842836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.004331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.005218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.013081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.013808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.014808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.015410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.199987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.209345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f0ac730-3de8-47e4-b072-17e5ee881ae1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1516 microversion: 2.1 time: 0.208827 Jun 25 20:56:23.220411 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 665/1204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:22 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1516 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:23.226144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.227022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.234353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.234828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.235830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.236343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.409794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.417902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de5b7d4d-2a30-49c1-beb8-c85002bb4f03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1473 microversion: 2.1 time: 0.196197 Jun 25 20:56:23.418735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 666/1205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:23 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:23.423423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.424166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.430732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.431375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.432316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.432879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.553273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.567841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.569513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.570616 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bfb87643-c5de-45c4-b45e-07fe26980c6a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.751366 Jun 25 20:56:23.571188 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 540/1206] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:22 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:23.627760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.628792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.641356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.643998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.645160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.646615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.657233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:23.671105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f97e8a03-0a92-45c4-8bef-54592485f462 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1542 microversion: 2.1 time: 0.250671 Jun 25 20:56:23.687179 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 667/1207] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:23 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:23.694938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.697411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.706884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.708409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.709494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.710590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.840696 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4579ee8a-bbdb-44bb-ade4-b806e7ca5e49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151923 Jun 25 20:56:23.849622 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 668/1208] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 20:56:23 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-interface => generated 284 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:23.850382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:23.851073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:23.866902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.867510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:23.868300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:23.870798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.011289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:24.021896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b05d8e01-332c-4556-90c7-846170c5ae31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1260 microversion: 2.1 time: 0.176318 Jun 25 20:56:24.024980 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 669/1209] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:23 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:24.037171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e7dddc4b-d7df-46c5-91c1-15928ae77862 req-56d8ebe5-ada3-4c29-b583-b454c932cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964069ea-dfde-433b-81c5-fc9e8bce11e8", "name": "network-vif-deleted", "tag": "68ff6ce0-9995-484b-9057-b1855f9f7ac8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:24.057258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e7dddc4b-d7df-46c5-91c1-15928ae77862 req-56d8ebe5-ada3-4c29-b583-b454c932cbb4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.057710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e7dddc4b-d7df-46c5-91c1-15928ae77862 req-56d8ebe5-ada3-4c29-b583-b454c932cbb4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.089730 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e7dddc4b-d7df-46c5-91c1-15928ae77862 req-56d8ebe5-ada3-4c29-b583-b454c932cbb4 service nova] Creating event network-vif-deleted:68ff6ce0-9995-484b-9057-b1855f9f7ac8 for instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 on nch1-master-1 Jun 25 20:56:24.103178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e7dddc4b-d7df-46c5-91c1-15928ae77862 req-56d8ebe5-ada3-4c29-b583-b454c932cbb4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076851 Jun 25 20:56:24.103981 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 670/1210] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:24.141571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:24.151005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ccc242d4-abfd-4e37-9933-c11a5b9c9fd9 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.528147 Jun 25 20:56:24.156119 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 541/1211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:23 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:24.228807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:24.229944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:24.248670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.252814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.255044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.255823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.436854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:24.437771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:24.450739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.451204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.452007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.452468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.518349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.519075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.519745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lazy-loading 'fault' on Instance uuid 964069ea-dfde-433b-81c5-fc9e8bce11e8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:24.650665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:24.653706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:24.661791 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f600140a-7df6-45a6-92b6-c59ed7aa40bd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 200 len: 1307 microversion: 2.1 time: 0.230374 Jun 25 20:56:24.669417 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 542/1212] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:24 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:24.685183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:24.686064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:24.694336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.699242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96475325-98bb-4f36-b690-4d289d05c71b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1516 microversion: 2.1 time: 0.473829 Jun 25 20:56:24.699595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.700461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:24.701083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:24.707633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 671/1213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:24 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1516 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:25.050800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:25.056754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:25.085971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:25.106293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:25.107838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:25.109142 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-259c725d-494b-4ac3-97f2-12bb0e158ba1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.438337 Jun 25 20:56:25.109762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 543/1214] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:24 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:25.115282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.119988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.123888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.127899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.170887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:25.171530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:25.187220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.187708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.188536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.189021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.298358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:25.312519 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bcb66338-c7ef-44d6-ae51-85079faa47e5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1266 microversion: 2.1 time: 0.273672 Jun 25 20:56:25.313136 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 672/1215] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:25 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:25.552896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0b7eae30-a0b7-47c3-aac0-7a97bd05753b req-0661f2d3-f09c-443e-b2c8-8f276c3262b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:25.570667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0b7eae30-a0b7-47c3-aac0-7a97bd05753b req-0661f2d3-f09c-443e-b2c8-8f276c3262b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.574268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0b7eae30-a0b7-47c3-aac0-7a97bd05753b req-0661f2d3-f09c-443e-b2c8-8f276c3262b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.598379 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0b7eae30-a0b7-47c3-aac0-7a97bd05753b req-0661f2d3-f09c-443e-b2c8-8f276c3262b3 service nova] Creating event network-changed:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:56:25.606842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0b7eae30-a0b7-47c3-aac0-7a97bd05753b req-0661f2d3-f09c-443e-b2c8-8f276c3262b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058792 Jun 25 20:56:25.613541 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 673/1216] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:25.688954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:25.689247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:25.690308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 964069ea-dfde-433b-81c5-fc9e8bce11e8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:25.705823 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d45c5bc-b6c0-41c6-b744-b601d956a969 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.538837 Jun 25 20:56:25.709567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.710682 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 544/1217] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:25 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:25.742732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.744029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.744768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.748503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:25.753361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:25.773685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.774144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.774938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.775381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.811819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 HTTP/1.1 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:25.814331 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. Jun 25 20:56:25.816147 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '964069ea-dfde-433b-81c5-fc9e8bce11e8'} Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:25.817248 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. Jun 25 20:56:25.818754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:25.820133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 964069ea-dfde-433b-81c5-fc9e8bce11e8 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:25.838121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c73afce-cf16-4746-9add-0c53cdbaf3d0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8" status: 404 len: 111 microversion: 2.1 time: 0.152165 Jun 25 20:56:25.839899 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 674/1218] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:25 2022] GET /compute/v2.1/servers/964069ea-dfde-433b-81c5-fc9e8bce11e8 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:56:25.847549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:25.848110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:25.885225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.886121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.890690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.891919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.911323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:25.911683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:25.918069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lazy-loading 'fault' on Instance uuid 0cac27ed-8830-4d48-837c-fa36a7d437dd {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:25.983402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:26.065535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:26.199288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:26.215103 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0104ebd4-1648-4440-843c-985fcbb385c9 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 204 len: 0 microversion: 2.1 time: 0.371891 Jun 25 20:56:26.216449 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d097d33a-e3a0-4a49-8f9b-658a9d2d8e0b tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 200 len: 1310 microversion: 2.1 time: 0.491004 Jun 25 20:56:26.227811 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 545/1220] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:25 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 1310 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:26.228514 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 675/1220] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:25 2022] DELETE /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:26.236501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:26.239157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:26.248457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:26.250328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:26.256975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.264556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.265747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.266550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.270375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.271893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.274378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.275983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.345600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:26.540780 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b1c9545-2134-4cb1-af38-1e2852e0954d tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 204 len: 0 microversion: 2.1 time: 0.308775 Jun 25 20:56:26.542335 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 546/1221] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:26 2022] DELETE /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:26.557024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cac27ed-8830-4d48-837c-fa36a7d437dd", "name": "network-vif-deleted", "tag": "1072ee83-51a7-445b-96fe-48d45e8fdb63"}, {"server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "name": "network-vif-unplugged", "status": "completed", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:26.579329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.579954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.628132 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] Creating event network-vif-deleted:1072ee83-51a7-445b-96fe-48d45e8fdb63 for instance 0cac27ed-8830-4d48-837c-fa36a7d437dd on nch2-master-1 Jun 25 20:56:26.635042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] Creating event network-vif-unplugged:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:56:26.649816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fb9779ec-871b-49ba-bdf6-0d39cb1f0311 req-dc9f53f9-a973-49fc-8fab-7f051c13fd5c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.105458 Jun 25 20:56:26.652794 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 547/1222] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:26.700219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:26.703714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:26.723290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.723793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.733700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:26.734806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:26.976227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:26.987417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:26.988970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:26.992465 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e1b91c1-4631-4dd9-88e6-ec164b52702d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.762196 Jun 25 20:56:26.993640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 676/1223] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:26 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:26.999530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.000367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.011447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.012283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.013842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.014444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.110612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:27.120724 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-87c4906b-fdfc-4993-8196-2132f7916aeb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1266 microversion: 2.1 time: 0.125516 Jun 25 20:56:27.121929 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 677/1224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:26 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:27.126892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.127856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.142691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:27.145381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.146166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.147558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.148203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.256600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:27.275505 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1e2ed802-5f24-4b47-9a76-91a84d7c6ece tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1472 microversion: 2.1 time: 0.620887 Jun 25 20:56:27.284990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 548/1225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:26 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1472 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:27.284990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.284990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.297391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.297849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.298640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.299074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.388234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:27.400233 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5964374f-6518-4a20-b202-83b98b14b790 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1712 microversion: 2.1 time: 0.276193 Jun 25 20:56:27.401189 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 678/1226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:27 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1712 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:27.407119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.410558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 0cac27ed-8830-4d48-837c-fa36a7d437dd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.424269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.425187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.426339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.426985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.447033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] HTTP exception thrown: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Request method failure captured: Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd HTTP/1.1 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3YXmTtX2kIkXoh19DeBqssndjIZwctUmcaU9XSfnbQ3nvfjga9JaeHvuQ_KJnZBm1tEJ8Zlm4bCDmQv0FSD0Rx87hkYDGQa2Pp4MJmoUR6qMcBzqr5BfuyxzLtnfE3zzmB8ga5j2BpKTk5KbBhqB7-gA8oV2kP0h1A6CM_0aYBgJno Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:27.449261 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}] Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: db1c30066ddd478fafc7c203867fd7de Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. Jun 25 20:56:27.450598 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0cac27ed-8830-4d48-837c-fa36a7d437dd'} Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:27.451418 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. Jun 25 20:56:27.452612 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:27.459282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Returning 404 to user: Instance 0cac27ed-8830-4d48-837c-fa36a7d437dd could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:27.460853 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8683513e-e43a-426c-94d8-a88348ec565d tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd" status: 404 len: 111 microversion: 2.1 time: 0.058080 Jun 25 20:56:27.463086 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 679/1227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:27 2022] GET /compute/v2.1/servers/0cac27ed-8830-4d48-837c-fa36a7d437dd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:27.471878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.472786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.480849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.481549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.482585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.483249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.512387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:27.577515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:27.592776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e05fb3ba-8c3f-4f80-8e13-77dae6c39921 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.313274 Jun 25 20:56:27.594943 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 549/1228] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:27 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:27.660147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c45f614-5c0a-433f-98f8-fd4f51aa2d50 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 204 len: 0 microversion: 2.1 time: 0.192164 Jun 25 20:56:27.661205 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 680/1229] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:27 2022] DELETE /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:27.672253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:27.673023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:27.685430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.687508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.688495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:27.688897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:27.984543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:27.994486 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b6eef7f-a985-4c50-8a87-9534aa804b3a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1518 microversion: 2.1 time: 0.328791 Jun 25 20:56:27.995270 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 550/1230] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:27 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1518 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:28.012577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:28.013551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:28.026045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.026856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.027646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.028134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.141196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:28.141871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:28.155615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.156205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.159885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.161050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.213773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.231202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.236774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.240872 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2f80027-6c16-45c8-8429-e34478a8897e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.232598 Jun 25 20:56:28.243065 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 681/1231] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:28 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:28.292592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:28.293835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:28.300865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.301726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.302699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.303600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.402496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:28.478806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.488961 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9cef6c5-09cf-4204-90d7-eddbfe55e29c tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1472 microversion: 2.1 time: 0.199543 Jun 25 20:56:28.492963 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 682/1232] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:28 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:28.500575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:28.501455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:28.509200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.509862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.510818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.511312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.649102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.657598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bace11dd-c905-42e6-a747-a5d1971ace26 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1712 microversion: 2.1 time: 0.162136 Jun 25 20:56:28.658329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 683/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:28 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1712 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:28.663394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:28.664006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:28.670970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.671421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.672206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.672655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.808974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.817475 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-185ee39d-dbc1-4c50-a3a3-bf340ba8f1aa tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.157883 Jun 25 20:56:28.818295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 684/1234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:28 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:28.823253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2f9e10d3-78d9-48d1-b8b4-a2dca28e9db4 req-39fc7070-c25b-4a02-87da-61ce89196ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:28.831784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2f9e10d3-78d9-48d1-b8b4-a2dca28e9db4 req-39fc7070-c25b-4a02-87da-61ce89196ae7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:28.832633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2f9e10d3-78d9-48d1-b8b4-a2dca28e9db4 req-39fc7070-c25b-4a02-87da-61ce89196ae7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:28.845382 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2f9e10d3-78d9-48d1-b8b4-a2dca28e9db4 req-39fc7070-c25b-4a02-87da-61ce89196ae7 service nova] Creating event network-changed:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:56:28.850444 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2f9e10d3-78d9-48d1-b8b4-a2dca28e9db4 req-39fc7070-c25b-4a02-87da-61ce89196ae7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030732 Jun 25 20:56:28.851139 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 685/1235] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:28.869652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:28.889242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd880a17-8966-405c-9c58-8f829ba7fe04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.753615 Jun 25 20:56:28.890166 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 551/1236] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:28 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:29.013043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.013668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.021157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.021870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.023207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.024356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.206461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.214553 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee37408a-8318-4882-b549-8f2c1f7649e1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1518 microversion: 2.1 time: 0.206992 Jun 25 20:56:29.215266 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 686/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:29.260065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.260849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.263016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:29.269023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.269500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.270280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.270736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.508934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.509730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.522466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.522868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.523632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.524068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.659045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.678670 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9877175-8f58-42b4-a285-911578eb97b0 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1472 microversion: 2.1 time: 0.174370 Jun 25 20:56:29.688699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 687/1238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:29.694138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.694756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.702495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.702937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.703708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.704401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.774915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.787365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.789561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.790788 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1fb33af-f7a7-4e1b-9101-b2cdcaaf6ab0 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.534911 Jun 25 20:56:29.792019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 552/1239] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:29.805581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:29.816949 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0eceff99-e569-4686-bee9-1c84ae157679 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1644 microversion: 2.1 time: 0.126141 Jun 25 20:56:29.817243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 688/1240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1644 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:29.835820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.836448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.842580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.843036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.843813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.844248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.862737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:29.907415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:29.908189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:29.914968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.915516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:29.916289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:29.916763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.144522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:30.152820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-165ea872-f247-48da-8ec3-35be4b0ba912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.250660 Jun 25 20:56:30.163953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 689/1241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:30.232236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:30.233086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:30.239625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.240086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.240888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.241330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.365548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:30.377004 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-608880f2-8261-48f8-b203-65bffda93399 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.545610 Jun 25 20:56:30.388581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 553/1242] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:29 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:30.393430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:30.402166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8dd334d5-a15c-471c-b257-9f91b91fa33f tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1518 microversion: 2.1 time: 0.174008 Jun 25 20:56:30.404839 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 690/1243] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:30 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:30.695813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:30.696452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:30.703100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.703525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.704492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.704925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.811516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:30.813234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:30.819989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.820356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.825526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.826119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.831166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:30.854530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:30.863791 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0304116-db13-4820-8e73-8f14837b3571 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 200 len: 1430 microversion: 2.1 time: 0.171826 Jun 25 20:56:30.868435 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 554/1244] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:30 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 1430 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:30.877095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:30.880992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:30.892291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.895828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:30.896880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:30.897478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.103360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.113975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33d0756150114bc7bd3f6f72b93cb56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce47feeb3ff411a8511889a370e746e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.129158 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e34cf773-09a5-4c2d-b61e-6f20ff1b54eb tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 200 len: 1644 microversion: 2.1 time: 0.256167 Jun 25 20:56:31.134329 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 555/1245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:30 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 1644 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:31.136769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.141322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.143525 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a6069ed-cbe4-4050-94fb-e90332c9a912 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.338742 Jun 25 20:56:31.144880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b67313d3-ae68-4163-9955-63b0d6e9dbb6 req-9503a747-09ff-4d89-b18b-b5006e196204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dbf8859-587d-4ebf-bb82-bae77019b6ec", "name": "network-vif-deleted", "tag": "e1e39cec-14aa-4e84-a644-b370a5775db8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:31.162156 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 691/1246] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:30 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:31.165536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b67313d3-ae68-4163-9955-63b0d6e9dbb6 req-9503a747-09ff-4d89-b18b-b5006e196204 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.167297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b67313d3-ae68-4163-9955-63b0d6e9dbb6 req-9503a747-09ff-4d89-b18b-b5006e196204 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.174689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:31.177034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:31.195422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b67313d3-ae68-4163-9955-63b0d6e9dbb6 req-9503a747-09ff-4d89-b18b-b5006e196204 service nova] Creating event network-vif-deleted:e1e39cec-14aa-4e84-a644-b370a5775db8 for instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec on nch1-master-1 Jun 25 20:56:31.198104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.199930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.202190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.204797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.207619 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b67313d3-ae68-4163-9955-63b0d6e9dbb6 req-9503a747-09ff-4d89-b18b-b5006e196204 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071570 Jun 25 20:56:31.211339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 556/1247] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:31.399745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:31.400623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:31.417602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.418148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.419896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.420352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.442338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.451855 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a33d752f-ca1a-4ef4-9366-a93754ceb3b8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.284182 Jun 25 20:56:31.453796 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 692/1248] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:31 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:31.465508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:31.466180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:31.475352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.475695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.476708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.477152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.571274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:31.597075 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1ef0b0c-a6e1-45e4-9202-ffde66af0987 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1476 microversion: 2.1 time: 0.142133 Jun 25 20:56:31.597706 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 693/1249] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:31 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1476 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:31.881456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:31.882108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 82702564-48ff-43c9-9848-c8aae19dde22] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:31.889054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.895192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.897086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.897862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.940171 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 HTTP/1.1 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:31.944702 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. Jun 25 20:56:31.946148 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '82702564-48ff-43c9-9848-c8aae19dde22'} Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:31.946895 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. Jun 25 20:56:31.948073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:31.950005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 82702564-48ff-43c9-9848-c8aae19dde22 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:31.950005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53ed730a-359d-46ee-84ec-24507de1b4cd tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22" status: 404 len: 111 microversion: 2.1 time: 0.070088 Jun 25 20:56:31.951003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 694/1250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:31 2022] GET /compute/v2.1/servers/82702564-48ff-43c9-9848-c8aae19dde22 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:56:31.966064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:31.966594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:31.985509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.992182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:31.994285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:31.994867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.069245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:32.215644 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0ff586a-1035-4133-b3e5-03fd3f57fdae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 204 len: 0 microversion: 2.1 time: 0.260879 Jun 25 20:56:32.216894 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 695/1251] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:31 2022] DELETE /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:32.221634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.223204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.224103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.230385 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3fa842cb-97b7-4417-84be-b4fbe6d5cc1a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.838362 Jun 25 20:56:32.234147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.234764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.235632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.236072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.243245 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 557/1252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:31 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:32.249701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.250329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.253060 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec HTTP/1.1 Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:32.255004 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:32.256621 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0dbf8859-587d-4ebf-bb82-bae77019b6ec'} Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:32.257846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:32.259302 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.260733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:32.260733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59768651-5572-4c4d-834b-e632b0deb9db tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 404 len: 111 microversion: 2.1 time: 0.038125 Jun 25 20:56:32.260733 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 696/1253] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:32.260979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.260979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.260979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.260979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.265036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.265698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.272198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.272696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.273496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.273922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.420636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.432712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.434895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.443623 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d511bfec-3eb2-4a5f-a669-088ff497b0ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.199064 Jun 25 20:56:32.444703 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 558/1254] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:32.452721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.465258 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-299df864-fbf9-4071-be9e-4af346972f96 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1471 microversion: 2.1 time: 0.203924 Jun 25 20:56:32.465751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.466749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 697/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:32.467472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.472105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.472849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.479991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.480579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.481481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.481984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.483548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.484021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.486285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.486939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.515315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a HTTP/1.1 Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:32.517060 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.518744 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'cabdeb25-a01e-4754-813d-31771aad3b7a'} Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:32.519848 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.521406 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.522853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:32.522853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32fab212-3754-4d59-9c1e-2e82e0860d86 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 404 len: 111 microversion: 2.1 time: 0.061000 Jun 25 20:56:32.522853 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 559/1256] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:32 2022] DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:32.528462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.529070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.535613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.536050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.536864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.537287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.552204 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a HTTP/1.1 Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:32.553790 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.555131 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'cabdeb25-a01e-4754-813d-31771aad3b7a'} Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:32.555842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:32.557072 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:32.558150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:32.558150 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb3c0f0f-2f74-44e2-9606-60cf0b3b6cda tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 404 len: 111 microversion: 2.1 time: 0.031194 Jun 25 20:56:32.558150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 560/1257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:32.566953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ea75b4fc-1d2e-42a3-9f4f-dd836e5c6a82 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '.version_select at 0x7f985c86aee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.588684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ea75b4fc-1d2e-42a3-9f4f-dd836e5c6a82 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238536916" status: 202 len: 0 microversion: 2.1 time: 0.026995 Jun 25 20:56:32.589516 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 561/1258] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 20:56:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238536916 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:56:32.616987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:32.618507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:32.627954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.628742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.630777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.631437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.654576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:32.672881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:32.673800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:32.674544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lazy-loading 'fault' on Instance uuid 8505f371-d80e-4de9-8d6f-def9249e9029 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:32.678287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:32.687043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.707407 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-585a2ea7-ea4a-449f-a19a-4f4659fc4a08 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.236888 Jun 25 20:56:32.713829 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 698/1259] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:32.748235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:32.758054 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9cf5472-d565-402c-9237-5842f6bf0028 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 200 len: 1311 microversion: 2.1 time: 0.147459 Jun 25 20:56:32.768204 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 562/1260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:32 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 1311 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:33.251391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.252106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.255064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:33.257929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82702564-48ff-43c9-9848-c8aae19dde22", "name": "network-vif-deleted", "tag": "5b02d65a-11dd-4a59-9689-166d5c8c55cf"}, {"server_uuid": "8505f371-d80e-4de9-8d6f-def9249e9029", "name": "network-vif-deleted", "tag": "dec92e90-403a-4ca6-bc6f-8f0b0625e6b8"}, {"name": "network-changed", "server_uuid": "006b6ab3-0114-493d-9b7d-380d2d564df7", "tag": "347e3efb-597b-4c24-b1c7-79ea68a77b14"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:33.262302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.262954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.263729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.264357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.269414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.269965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.284809 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Creating event network-vif-deleted:5b02d65a-11dd-4a59-9689-166d5c8c55cf for instance 82702564-48ff-43c9-9848-c8aae19dde22 on nch2-master-1 Jun 25 20:56:33.285351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Creating event network-vif-deleted:dec92e90-403a-4ca6-bc6f-8f0b0625e6b8 for instance 8505f371-d80e-4de9-8d6f-def9249e9029 on nch2-master-1 Jun 25 20:56:33.285847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] Creating event network-changed:347e3efb-597b-4c24-b1c7-79ea68a77b14 for instance 006b6ab3-0114-493d-9b7d-380d2d564df7 on nch2-master-1 Jun 25 20:56:33.293547 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2778ffda-98dc-42fe-8ebd-5aa406b24fc4 req-5901eb44-c355-4f99-829b-cc8e7753c5d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.040424 Jun 25 20:56:33.294175 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 563/1261] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:33.302555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6f53d0b-e3c6-42f6-93c6-f9e801011cd1 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.303363 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:56:33.303363 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:56:33.321319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6f53d0b-e3c6-42f6-93c6-f9e801011cd1 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/619076461" status: 202 len: 0 microversion: 2.1 time: 0.022586 Jun 25 20:56:33.321952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 564/1262] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 20:56:33 2022] DELETE /compute/v2.1/flavors/619076461 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:56:33.329792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a53cdaf-73c4-4e7a-979d-59c5eca95a9d tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.348869 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a53cdaf-73c4-4e7a-979d-59c5eca95a9d tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.022465 Jun 25 20:56:33.349459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 565/1263] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:33.365288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da281251-6c8f-4655-a6fd-c4a6a185ad42 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.383649 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da281251-6c8f-4655-a6fd-c4a6a185ad42 tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/2022263478" status: 202 len: 0 microversion: 2.1 time: 0.021898 Jun 25 20:56:33.384271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 566/1264] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 20:56:33 2022] DELETE /compute/v2.1/flavors/2022263478 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 20:56:33.392472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45fd6ae3-2059-474f-a8d5-237fb06635dd tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.399594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:33.407469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f7b52be-b57d-4d03-ab43-9440dcfe183d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.161201 Jun 25 20:56:33.408142 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 699/1265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:33.411084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45fd6ae3-2059-474f-a8d5-237fb06635dd tempest-ServersWithSpecificFlavorTestJSON-1069500556 tempest-ServersWithSpecificFlavorTestJSON-1069500556-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022466 Jun 25 20:56:33.411671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 567/1266] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:33.435282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.435788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.442144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.442591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.443381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.443868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.456964 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec HTTP/1.1 Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:33.458553 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.459884 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0dbf8859-587d-4ebf-bb82-bae77019b6ec'} Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:33.463939 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.465434 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.466829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:33.466829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d204aae1-7af2-4ed7-9970-b2105863dea2 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 404 len: 111 microversion: 2.1 time: 0.028542 Jun 25 20:56:33.466829 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 700/1267] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:33 2022] DELETE /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:33.467078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.467078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.468232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.468879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: 0dbf8859-587d-4ebf-bb82-bae77019b6ec] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.470950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.471399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.472164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.472617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.475035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.475487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.476301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.476805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.492677 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec HTTP/1.1 Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:33.494267 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.495790 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0dbf8859-587d-4ebf-bb82-bae77019b6ec'} Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:33.500309 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. Jun 25 20:56:33.501937 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.503298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance 0dbf8859-587d-4ebf-bb82-bae77019b6ec could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:33.503298 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4e41bd9d-5f6a-474f-b673-8dfd2b9b0819 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec" status: 404 len: 111 microversion: 2.1 time: 0.030965 Jun 25 20:56:33.503298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 701/1268] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/0dbf8859-587d-4ebf-bb82-bae77019b6ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:33.503298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.503298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.507486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.507935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.508721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.509156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.619455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:33.628484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:33.630056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:33.631232 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f83d1e9-5414-4472-a62f-404f2f06a149 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.172097 Jun 25 20:56:33.631811 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 568/1269] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:33.636334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.637068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.643700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:33.645727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.646200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.646975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.647412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.651718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5cca5bf3-90bb-4023-b369-311f6cfd161e tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1471 microversion: 2.1 time: 0.154276 Jun 25 20:56:33.652332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 702/1270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:33.661743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a HTTP/1.1 Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:33.663429 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.665043 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'cabdeb25-a01e-4754-813d-31771aad3b7a'} Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:33.665957 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.667491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.669385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:33.669385 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-523f23bb-ea66-46ee-844b-841b9d088b2f tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 404 len: 111 microversion: 2.1 time: 0.032089 Jun 25 20:56:33.669385 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 569/1271] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:33 2022] DELETE /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:33.673242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.673857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] [instance: cabdeb25-a01e-4754-813d-31771aad3b7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.680158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.680688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.681420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.681854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.696852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] HTTP exception thrown: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Request method failure captured: Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a HTTP/1.1 Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WvIl-PQGOu3srsMnxEnkThUVvNiQSxx6ISH38uNtHVYh7zCq9rCIal2s1wWr43dEf4DJdLJX5dKzmx7yDnN9kttYRnTtv4D4MpgEyML4a6mIknxKocXAbusgq2xZsXfh9PVIvcz9DfroKoHGCkDmMTdzGNjsHSvGVmAbK7uvLwKrE Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:33.698351 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2ce47feeb3ff411a8511889a370e746e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2ce47feeb3ff411a8511889a370e746e"}]}] Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2ce47feeb3ff411a8511889a370e746e Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108 Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 33d0756150114bc7bd3f6f72b93cb56a Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-290815108-project Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.700061 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cabdeb25-a01e-4754-813d-31771aad3b7a'} Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:33.701459 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. Jun 25 20:56:33.702927 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.704230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] Returning 404 to user: Instance cabdeb25-a01e-4754-813d-31771aad3b7a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:33.704230 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f14f918-31ec-4ac1-8926-350738c4de81 tempest-ServersWithSpecificFlavorTestJSON-290815108 tempest-ServersWithSpecificFlavorTestJSON-290815108-project] 10.222.0.39 "GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a" status: 404 len: 111 microversion: 2.1 time: 0.030309 Jun 25 20:56:33.704230 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 703/1272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/cabdeb25-a01e-4754-813d-31771aad3b7a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:56:33.730417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.731471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.742715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.743774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.744882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.745546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.777777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.778905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: 8505f371-d80e-4de9-8d6f-def9249e9029] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.786474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.787359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.788750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.789593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.810632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] HTTP exception thrown: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Request method failure captured: Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 HTTP/1.1 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3YXmTtX2kIkXoh19DeBqssndjIZwctUmcaU9XSfnbQ3nvfjga9JaeHvuQ_KJnZBm1tEJ8Zlm4bCDmQv0FSD0Rx87hkYDGQa2Pp4MJmoUR6qMcBzqr5BfuyxzLtnfE3zzmB8ga5j2BpKTk5KbBhqB7-gA8oV2kP0h1A6CM_0aYBgJno Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:33.822750 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}] Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: db1c30066ddd478fafc7c203867fd7de Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. Jun 25 20:56:33.824264 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8505f371-d80e-4de9-8d6f-def9249e9029'} Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:33.828124 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. Jun 25 20:56:33.829538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:33.830826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Returning 404 to user: Instance 8505f371-d80e-4de9-8d6f-def9249e9029 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:33.830826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1b604d39-9f10-4356-bf03-3af7f9b581ff tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029" status: 404 len: 111 microversion: 2.1 time: 0.051947 Jun 25 20:56:33.830826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 704/1273] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/8505f371-d80e-4de9-8d6f-def9249e9029 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:56:33.834777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.835684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.842048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.842507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.843285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.843724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.871478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:33.956182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bba9e780-5fbe-43fa-9bc3-5d9db4b250b8 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 204 len: 0 microversion: 2.1 time: 0.125034 Jun 25 20:56:33.957446 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 705/1274] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:33 2022] DELETE /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:33.966236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:33.967216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:33.974606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.975357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:33.976358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:33.976971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.081769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.091113 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9badb94-416d-4309-9804-1b7ed3b887a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.367596 Jun 25 20:56:34.092373 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 570/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:34.224137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.232738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2843b193-a861-4752-a901-3a27629b9caa tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1517 microversion: 2.1 time: 0.270658 Jun 25 20:56:34.233620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 706/1276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:33 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:34.425247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:34.425971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:34.433882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.434337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.435113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.435550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.578507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.587295 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a9133c5-088f-4669-88ae-b8654bb7ef45 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.166091 Jun 25 20:56:34.587876 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 571/1277] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:34 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:34.650672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:34.651492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:34.658944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.659402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.660162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.660866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.669208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:34.670178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:34.678114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.679031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.681432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:34.681966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:34.851134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.859811 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27f34742-175b-4177-a501-4bc4918ab30f tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1471 microversion: 2.1 time: 0.195087 Jun 25 20:56:34.860846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 572/1278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:34 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:34.918933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.927805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.929354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:34.930541 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba46ed33-4979-4b3a-8f38-c73ddaad11bf tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.284089 Jun 25 20:56:34.931088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 707/1279] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:34 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:35.109051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:35.109547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:35.116051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.116535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.117317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.117763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.247803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:35.250075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:35.250759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:35.256299 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a935ed9d-f089-4bb6-aa85-31cba0f6815f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.151200 Jun 25 20:56:35.257363 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 573/1280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:35 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:35.257498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.257755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.258541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.258978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.281334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:35.410075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:35.417975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b0953bf-dd07-49e9-9343-f895f8dde471 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1517 microversion: 2.1 time: 0.171854 Jun 25 20:56:35.420466 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 708/1281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:35 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:35.605354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:35.605976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:35.612656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.613381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.614803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.615430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.841191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:35.849958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec54a401-1fd6-465b-949e-a4e4a9b72869 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.249320 Jun 25 20:56:35.850683 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 574/1282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:35 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:35.877696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:35.878314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:35.886175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.886681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.887497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.887935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.950321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:35.951105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:35.959545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.960073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:35.961293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:35.961780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.033209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.041173 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5817a697-287c-429f-be4c-e43011167526 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1471 microversion: 2.1 time: 0.167675 Jun 25 20:56:36.041687 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 709/1283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:35 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:36.273305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:36.274123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:36.281022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.281487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.282282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.282722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.415014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.422781 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3924957b-3c72-4a53-b5b5-22eecc4c1f5a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.153649 Jun 25 20:56:36.423336 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 710/1284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:36 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:36.436963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:36.437664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:36.443870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.444296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.445127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.445592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.550398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.570320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.571835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.573080 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd3c0ab9-b276-47ba-82bd-1790099d0a94 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.628038 Jun 25 20:56:36.583791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 575/1285] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:35 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:36.638596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:36.655575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fad34abd-7b71-4498-a586-8a2a4f1203d1 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1517 microversion: 2.1 time: 0.222121 Jun 25 20:56:36.656651 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 711/1286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:36 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:36.868880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:36.869495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:36.878476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.879511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:36.880682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:36.881329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.054471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-168ad3e2-483c-4287-a348-fc02faad4040 req-4d0bab53-c72d-4acd-a4ea-47727a1c3bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eb21e49-578b-46a6-9a82-50e2976d3c07", "name": "network-vif-deleted", "tag": "34ebf2b2-cc27-4965-900f-ff6458f0c07b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:37.066758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-168ad3e2-483c-4287-a348-fc02faad4040 req-4d0bab53-c72d-4acd-a4ea-47727a1c3bcb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.067639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-168ad3e2-483c-4287-a348-fc02faad4040 req-4d0bab53-c72d-4acd-a4ea-47727a1c3bcb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.087182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-168ad3e2-483c-4287-a348-fc02faad4040 req-4d0bab53-c72d-4acd-a4ea-47727a1c3bcb service nova] Creating event network-vif-deleted:34ebf2b2-cc27-4965-900f-ff6458f0c07b for instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 on nch2-master-1 Jun 25 20:56:37.094111 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-168ad3e2-483c-4287-a348-fc02faad4040 req-4d0bab53-c72d-4acd-a4ea-47727a1c3bcb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043846 Jun 25 20:56:37.095112 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 712/1287] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:37.103380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:37.104701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:37.112714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.114799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.115888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.116583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.134670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.144370 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0dbbc6a4-fa3c-4de4-8972-bf4fbe0011b3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.279594 Jun 25 20:56:37.151693 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 576/1288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:36 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:37.347772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.362417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-203cedb5-68b4-42cf-98e5-f87a6a27e209 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1429 microversion: 2.1 time: 0.265574 Jun 25 20:56:37.363063 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 713/1289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:37 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1429 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:37.440720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:37.442617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:37.456787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.458086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.460081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.461070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.594183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:37.595581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:37.603278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.603944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.609232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.610190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.705568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.716478 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ebb348b1-9cd9-4166-bf11-7a12e4416161 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.281058 Jun 25 20:56:37.717837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 577/1290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:37 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:37.724242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:37.725124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:37.734712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.735601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.736943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:37.738457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:37.744243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:37.782650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.793595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.795850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:37.797292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42dd14d6-c285-472f-a36e-6d98d3c6b894 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.209182 Jun 25 20:56:37.808908 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 714/1291] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:37 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:37.996265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:38.007380 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94862119-dc90-4744-ac7d-9272a99bb995 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1517 microversion: 2.1 time: 0.288152 Jun 25 20:56:38.007999 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 578/1292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:37 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1517 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:38.161860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:38.162673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:38.170258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.170680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.171471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.171899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.379322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:38.379934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:38.386623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.387079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.387855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.388287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.391430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:38.400501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b28a469-df4a-496b-a75c-35d16d988b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.242646 Jun 25 20:56:38.411196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 715/1293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:38 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:38.469026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:38.477442 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a6235fb0-55c9-47d2-b460-54f06ae7c736 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1429 microversion: 2.1 time: 0.102082 Jun 25 20:56:38.478067 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 579/1294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:38 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:38.733517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:38.734721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:38.741411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.741856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.742815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.743395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.821558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:38.822554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:38.829982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.830428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.831657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:38.832130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:38.946642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:38.959476 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f6447f7d-4cdf-4a56-97c8-073186c30fbf tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.230115 Jun 25 20:56:38.964969 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 716/1295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:38 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:39.026454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:39.027082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:39.038566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.039350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.040577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.041295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.314050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.347950 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7708d89-d204-49c0-b632-5c2ca58a0e29 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1517 microversion: 2.1 time: 0.325150 Jun 25 20:56:39.349951 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 717/1296] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:39 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:39.420179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:39.421388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:39.431952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.432697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.434329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.434989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.592312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.608749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.611301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.612847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d300a085-e294-488b-b5ac-55f2685f5fbe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.799011 Jun 25 20:56:39.613584 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 580/1297] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:38 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:39.623073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-148b2d29-6bbe-4675-8082-857c06c8cd9e req-feb2f6a3-7ed4-4743-a66a-05e38ee41422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "name": "network-vif-unplugged", "status": "completed", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:39.645921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-148b2d29-6bbe-4675-8082-857c06c8cd9e req-feb2f6a3-7ed4-4743-a66a-05e38ee41422 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.647822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-148b2d29-6bbe-4675-8082-857c06c8cd9e req-feb2f6a3-7ed4-4743-a66a-05e38ee41422 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.675278 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-148b2d29-6bbe-4675-8082-857c06c8cd9e req-feb2f6a3-7ed4-4743-a66a-05e38ee41422 service nova] Creating event network-vif-unplugged:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch1-master-1 Jun 25 20:56:39.682187 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-148b2d29-6bbe-4675-8082-857c06c8cd9e req-feb2f6a3-7ed4-4743-a66a-05e38ee41422 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066911 Jun 25 20:56:39.683361 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 581/1298] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:39.688681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:39.689383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:39.695731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.696175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.696968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.697395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.724395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.732246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.732721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.733175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lazy-loading 'fault' on Instance uuid 3eb21e49-578b-46a6-9a82-50e2976d3c07 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:39.738324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c9d9d81-a947-4a89-abce-eb5e6afb6cd5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.324008 Jun 25 20:56:39.740450 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 718/1299] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:39 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:39.854896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:39.866251 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-676ba8a4-458c-47b9-b694-b439f068d849 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 200 len: 1307 microversion: 2.1 time: 0.181525 Jun 25 20:56:39.866849 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 582/1300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:39 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:39.978896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:39.979800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:39.983163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:39.987651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.988342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:39.990107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:39.990698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.264768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:40.276974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4080e20-475a-4745-90cf-705eefbc786c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.301695 Jun 25 20:56:40.290637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 719/1301] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:39 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:40.366374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:40.367034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:40.379486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.381285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.382725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.383619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.483202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db1c30066ddd478fafc7c203867fd7de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af0da2567efe463f90d5db2b4a125ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:40.502042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a113a537-6348-4bce-a564-bff55918bc0a tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 200 len: 1475 microversion: 2.1 time: 0.140751 Jun 25 20:56:40.503332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 583/1302] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:40 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 1475 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:40.631874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:40.632709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:40.647483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.649099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.652790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.655575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.761511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:40.762684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:40.777514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.778892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:40.782238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:40.784123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.020352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.029248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03167b4c-0cc1-4d51-af3c-bd5baab6a3e1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.273699 Jun 25 20:56:41.029824 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 584/1303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:40 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:41.035635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.036471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 3eb21e49-578b-46a6-9a82-50e2976d3c07] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.045997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.045997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.046538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.047129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.062756 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 HTTP/1.1 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:41.064628 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. Jun 25 20:56:41.066305 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '3eb21e49-578b-46a6-9a82-50e2976d3c07'} Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:41.067271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. Jun 25 20:56:41.068705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.069902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 3eb21e49-578b-46a6-9a82-50e2976d3c07 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:41.069902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27a52bcf-61b1-44b9-9d1e-05f1a79511f4 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07" status: 404 len: 111 microversion: 2.1 time: 0.035209 Jun 25 20:56:41.069902 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 585/1304] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:41 2022] GET /compute/v2.1/servers/3eb21e49-578b-46a6-9a82-50e2976d3c07 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:41.079035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.093288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.100239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.100379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.101867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.102314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.107550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.133058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.138280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.139756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:41.141319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4fe9f1a-b2af-49c9-8642-00acd6e8d2ff tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.513954 Jun 25 20:56:41.143357 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 720/1305] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:40 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:41.298647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.299655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.318301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.319424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.328031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.329230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.375722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-180fa9fe-f4be-4885-92b0-d161c2ab2c80 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 204 len: 0 microversion: 2.1 time: 0.299325 Jun 25 20:56:41.380915 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 586/1306] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:41 2022] DELETE /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:41.386450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.387129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.393829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.394348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.395219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.395714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.424498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:41.549639 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c51d5b53-0c15-462b-bdad-c525f21a7ed8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 204 len: 0 microversion: 2.1 time: 0.166512 Jun 25 20:56:41.551292 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 587/1307] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:41 2022] DELETE /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:41.557014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.558325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.559826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] [instance: e58ad0c7-18a4-4c83-8060-9fcbe8848dfd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.563443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:41.573525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.574449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.576027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.576699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.592295 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3b952b0-5aea-498b-96b6-78692cef4222 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.298007 Jun 25 20:56:41.604032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 721/1308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:41 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:41.614325 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] HTTP exception thrown: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. Jun 25 20:56:41.615383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:41.616454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Request method failure captured: Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd HTTP/1.1 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3YXmTtX2kIkXoh19DeBqssndjIZwctUmcaU9XSfnbQ3nvfjga9JaeHvuQ_KJnZBm1tEJ8Zlm4bCDmQv0FSD0Rx87hkYDGQa2Pp4MJmoUR6qMcBzqr5BfuyxzLtnfE3zzmB8ga5j2BpKTk5KbBhqB7-gA8oV2kP0h1A6CM_0aYBgJno Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:41.622091 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_af0da2567efe463f90d5db2b4a125ba1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/af0da2567efe463f90d5db2b4a125ba1"}]}] Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: af0da2567efe463f90d5db2b4a125ba1 Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1207123731 Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: db1c30066ddd478fafc7c203867fd7de Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ListServerFiltersTestJSON-1207123731-project Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. Jun 25 20:56:41.623822 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e58ad0c7-18a4-4c83-8060-9fcbe8848dfd'} Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:41.624886 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. Jun 25 20:56:41.626484 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:41.627687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] Returning 404 to user: Instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:41.627687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-377366c3-b0e0-4f5a-b00c-c460cfedbbb9 tempest-ListServerFiltersTestJSON-1207123731 tempest-ListServerFiltersTestJSON-1207123731-project] 10.222.0.39 "GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd" status: 404 len: 111 microversion: 2.1 time: 0.071305 Jun 25 20:56:41.627687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 588/1309] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:41 2022] GET /compute/v2.1/servers/e58ad0c7-18a4-4c83-8060-9fcbe8848dfd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:41.642422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.643016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.643670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.644111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.713603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2830f9c2-bdc4-4ce1-8ae2-3c6c1e05d3c7 req-a1a2708e-8511-4d9c-9138-af9a218a93ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e58ad0c7-18a4-4c83-8060-9fcbe8848dfd", "name": "network-vif-deleted", "tag": "dd191e62-5000-418a-92b1-2844693e3a5a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:41.724656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2830f9c2-bdc4-4ce1-8ae2-3c6c1e05d3c7 req-a1a2708e-8511-4d9c-9138-af9a218a93ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:41.725879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2830f9c2-bdc4-4ce1-8ae2-3c6c1e05d3c7 req-a1a2708e-8511-4d9c-9138-af9a218a93ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:41.746856 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2830f9c2-bdc4-4ce1-8ae2-3c6c1e05d3c7 req-a1a2708e-8511-4d9c-9138-af9a218a93ec service nova] Creating event network-vif-deleted:dd191e62-5000-418a-92b1-2844693e3a5a for instance e58ad0c7-18a4-4c83-8060-9fcbe8848dfd on nch2-master-1 Jun 25 20:56:41.751984 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2830f9c2-bdc4-4ce1-8ae2-3c6c1e05d3c7 req-a1a2708e-8511-4d9c-9138-af9a218a93ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042547 Jun 25 20:56:41.753148 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 589/1310] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:41.899359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:41.930588 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8be0ca1f-bf81-4878-b446-0fb95332f9a6 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1474 microversion: 2.1 time: 0.322044 Jun 25 20:56:41.950734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 722/1311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:41 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:42.047227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:42.047943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:42.060366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.063692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.064747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.065351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.161451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:42.162368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:42.168945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.169670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.170785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.171401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.382872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:42.395282 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd598125-1e88-43b7-888a-f3572d7abe60 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.352908 Jun 25 20:56:42.396417 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 590/1312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:42 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:42.463817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:42.481213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:42.487514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:42.489092 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3044b1ad-8dd1-430b-ae1f-2677b3c46ce9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.331796 Jun 25 20:56:42.493922 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 723/1313] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:42 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:42.611312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:42.611975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:42.623877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.624651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.626031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.626743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.700792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b80756e0-b2db-4f53-8b0e-999cd55314f1 req-279db864-4ed7-4a0e-92ff-e61407bf1b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b6ab3-0114-493d-9b7d-380d2d564df7", "name": "network-vif-plugged", "status": "completed", "tag": "347e3efb-597b-4c24-b1c7-79ea68a77b14"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:42.710234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b80756e0-b2db-4f53-8b0e-999cd55314f1 req-279db864-4ed7-4a0e-92ff-e61407bf1b2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.711004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b80756e0-b2db-4f53-8b0e-999cd55314f1 req-279db864-4ed7-4a0e-92ff-e61407bf1b2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.751150 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b80756e0-b2db-4f53-8b0e-999cd55314f1 req-279db864-4ed7-4a0e-92ff-e61407bf1b2c service nova] Creating event network-vif-plugged:347e3efb-597b-4c24-b1c7-79ea68a77b14 for instance 006b6ab3-0114-493d-9b7d-380d2d564df7 on nch2-master-1 Jun 25 20:56:42.759243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b80756e0-b2db-4f53-8b0e-999cd55314f1 req-279db864-4ed7-4a0e-92ff-e61407bf1b2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062108 Jun 25 20:56:42.759881 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 724/1314] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:42.956709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:42.957312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:42.967551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.968012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:42.974616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:42.975092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:43.122880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:43.126511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:43.137432 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79746871-ca8b-49ea-b32c-b2e37111f638 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.529812 Jun 25 20:56:43.148955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 591/1315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:42 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:43.158343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3deba113-ade2-4cce-9126-257e5637a5b8 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1474 microversion: 2.1 time: 0.206567 Jun 25 20:56:43.159316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 725/1316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:42 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1474 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:43.413677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:43.414377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:43.420693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:43.421429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:43.422439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:43.422935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:43.511366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:43.512736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:43.520187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:43.520997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:43.522016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:43.522932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:43.548848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:43.740091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:43.752218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:43.755099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:43.757492 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-45b77bbf-e181-4805-9f6d-c651a73b97b6 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1815 microversion: 2.25 time: 0.250109 Jun 25 20:56:43.770518 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 726/1317] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:43 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1815 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:44.077664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:44.090349 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2606b6a-03f2-4bff-b10a-9ae001fe6ca3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.681096 Jun 25 20:56:44.101540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 592/1318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:43 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:44.155358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:44.156368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:44.163375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.163908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.164772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.165271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.175651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:44.176658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:44.185969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.187886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.188806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.194479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.394254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:44.404602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75e3c968-58c9-4724-8d2f-145715c2b2f7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.253571 Jun 25 20:56:44.406066 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 727/1319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:44 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:44.546886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:44.550789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:44.556100 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8dbc7302-a441-490e-83cd-c9b2fa48f341 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1474 microversion: 2.1 time: 0.384591 Jun 25 20:56:44.561824 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 593/1320] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:44 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:44.632195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79660644-1704-46b2-bf7d-9bc0b2626c80", "name": "network-vif-deleted", "tag": "6e5e7147-ad33-4a9b-ab77-5a18067580bf"}, {"server_uuid": "d7ae147d-be89-4776-a815-ca4d5daf079c", "name": "network-vif-deleted", "tag": "3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:44.648904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.649735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.666011 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] Creating event network-vif-deleted:6e5e7147-ad33-4a9b-ab77-5a18067580bf for instance 79660644-1704-46b2-bf7d-9bc0b2626c80 on nch1-master-1 Jun 25 20:56:44.666817 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] Creating event network-vif-deleted:3a8e5af3-8d05-42b2-8d0e-0b6e2130d46d for instance d7ae147d-be89-4776-a815-ca4d5daf079c on nch2-master-1 Jun 25 20:56:44.679021 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7f6d1503-080d-46bf-bf48-784ebb407983 req-340114b2-d2f3-43fe-8bfb-5d86f8829bd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050788 Jun 25 20:56:44.680335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 728/1321] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:44.780079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:44.780860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:44.791008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.791716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:44.792614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:44.793272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.032765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:45.051962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:45.073782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:45.079421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1821d00c-7f40-4086-b35f-d33627a548ba tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1805 microversion: 2.25 time: 0.301666 Jun 25 20:56:45.098224 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 594/1322] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:44 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1805 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:45.100059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cde2c41e-c464-455f-8905-59874165ce38 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '.version_select at 0x7f984f5cc280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.102691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cde2c41e-c464-455f-8905-59874165ce38 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.103172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cde2c41e-c464-455f-8905-59874165ce38 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.116879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.119921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.127693 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cde2c41e-c464-455f-8905-59874165ce38 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2360 microversion: 2.25 time: 0.031930 Jun 25 20:56:45.128339 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 729/1323] 10.222.0.39 () {60 vars in 1183 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/os-migrations => generated 2360 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:45.140756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.141500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.151357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.151822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.152633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.153079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.164528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.164753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.165558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.165983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.434190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:45.442712 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f08be05e-2530-4458-9554-3ae2ee1eb32a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1513 microversion: 2.1 time: 0.337435 Jun 25 20:56:45.443312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 595/1324] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:45.447030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:45.448689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.449508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.463326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.464176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.465516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.466118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.485807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bba909de-bb8e-41b3-a319-52551d14095f tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 2424 microversion: 2.25 time: 0.345713 Jun 25 20:56:45.486991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 730/1325] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 2424 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:56:45.506763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.509929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.524406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.526207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.528601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.530872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.799218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:45.824047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:45.832898 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed910022-e472-4b5b-8451-a2282456c5a9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 2424 microversion: 2.25 time: 0.332421 Jun 25 20:56:45.840589 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-863460a5-9993-46a2-bda9-86577b663621 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1308 microversion: 2.1 time: 0.393101 Jun 25 20:56:45.842890 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 596/1326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:45.852781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 731/1327] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 2424 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:56:45.859848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.860788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.878727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.879254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.881614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.882193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.950438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:45.950957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:45.958086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.958700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.959486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.959921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.962338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:45.962794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:45.963256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lazy-loading 'fault' on Instance uuid d7ae147d-be89-4776-a815-ca4d5daf079c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:46.090342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:46.100329 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-626747c3-386f-4495-9088-60cc6029d100 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 200 len: 1309 microversion: 2.1 time: 0.253487 Jun 25 20:56:46.105021 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 597/1328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:45 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:46.142567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lazy-loading 'services' on Instance uuid 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:46.320264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee399a9b-6a98-4da1-b3c5-7db9916dad5b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments/ea776117-2993-45a1-9ace-9a0e96e6fb96" status: 202 len: 0 microversion: 2.25 time: 0.373414 Jun 25 20:56:46.322322 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 732/1329] 10.222.0.39 () {60 vars in 1456 bytes} [Sat Jun 25 20:56:45 2022] DELETE /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments/ea776117-2993-45a1-9ace-9a0e96e6fb96 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:46.335398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3a9081c4-58ef-4463-bdaa-a991a47328f6 tempest-InstanceUsageAuditLogTestJSON-2146112812 tempest-InstanceUsageAuditLogTestJSON-2146112812-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:46.337065 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:56:46.337065 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:56:46.346873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:46.348802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:46.356552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.357305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.358100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.358535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.375346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3a9081c4-58ef-4463-bdaa-a991a47328f6 tempest-InstanceUsageAuditLogTestJSON-2146112812 tempest-InstanceUsageAuditLogTestJSON-2146112812-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log/2022-06-25 20:56:46" status: 200 len: 318 microversion: 2.1 time: 0.268616 Jun 25 20:56:46.383550 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 598/1330] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 20:56:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-06-25%2020%3A56%3A46 => generated 318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:46.394344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-321d9bac-2cfe-4eed-b8ef-39968c3cb36b tempest-InstanceUsageAuditLogTestJSON-2146112812 tempest-InstanceUsageAuditLogTestJSON-2146112812-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:46.395379 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:56:46.395379 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 20:56:46.397079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2b55b61-7738-40f3-9fc0-a15e068abe22 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.058507 Jun 25 20:56:46.400573 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 733/1331] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 20:56:46 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:56:46.412224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-321d9bac-2cfe-4eed-b8ef-39968c3cb36b tempest-InstanceUsageAuditLogTestJSON-2146112812 tempest-InstanceUsageAuditLogTestJSON-2146112812-project-admin] 10.222.0.39 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.021983 Jun 25 20:56:46.413104 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 599/1332] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 20:56:46 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:46.468992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:46.469801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:46.476821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.477643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.478644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.479166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.858415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:46.860091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:46.861442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:46.868511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.869967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.870083 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-718c2464-33b4-4d29-8e85-76cf67ff52d5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.414406 Jun 25 20:56:46.871384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:46.872018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:46.880613 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 734/1333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:46 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:47.119377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.120060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: d7ae147d-be89-4776-a815-ca4d5daf079c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.127485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.127975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.128919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.129659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.144703 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c HTTP/1.1 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:47.146445 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. Jun 25 20:56:47.147866 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd7ae147d-be89-4776-a815-ca4d5daf079c'} Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:47.148671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. Jun 25 20:56:47.150491 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.152558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance d7ae147d-be89-4776-a815-ca4d5daf079c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:47.152558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a35b1d3d-724a-4053-a399-b38b0dc9486d tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c" status: 404 len: 111 microversion: 2.1 time: 0.033014 Jun 25 20:56:47.152558 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 735/1334] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/d7ae147d-be89-4776-a815-ca4d5daf079c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:47.157365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.158082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 79660644-1704-46b2-bf7d-9bc0b2626c80] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.164948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.165398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.166178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.166604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.180696 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 HTTP/1.1 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:47.182601 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. Jun 25 20:56:47.184214 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '79660644-1704-46b2-bf7d-9bc0b2626c80'} Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:47.185228 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. Jun 25 20:56:47.186664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:47.188242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 79660644-1704-46b2-bf7d-9bc0b2626c80 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:47.188242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28fff8f0-6f58-49dc-8e9b-9af20fbf2626 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80" status: 404 len: 111 microversion: 2.1 time: 0.030932 Jun 25 20:56:47.188242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 736/1335] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/79660644-1704-46b2-bf7d-9bc0b2626c80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:47.192890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-87684bdb-04b1-4f7a-afa3-54428d243b4a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.201583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:47.211479 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20d4da86-2902-45b0-a467-a79728ed4eff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1489 microversion: 2.1 time: 0.355649 Jun 25 20:56:47.212074 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 600/1336] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:46 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1489 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:47.226804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-87684bdb-04b1-4f7a-afa3-54428d243b4a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/a1c91e95-03c1-4e27-a42b-fd4fe8c669d8" status: 204 len: 0 microversion: 2.1 time: 0.037544 Jun 25 20:56:47.227410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 737/1337] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 20:56:47 2022] DELETE /compute/v2.1/os-server-groups/a1c91e95-03c1-4e27-a42b-fd4fe8c669d8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:47.231615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:47.232600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.235736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.236241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.239206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.239722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.240596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.241103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.243208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.243890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.244757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.245263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.271317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:47.314433 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9117b20-c3eb-4b93-a634-a1f42b704d97 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7/action" status: 202 len: 0 microversion: 2.1 time: 0.087516 Jun 25 20:56:47.318390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 601/1338] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:47 2022] POST /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:56:47.326779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.327001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.334759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.336922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.336922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.336922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.358607 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3d40bb9-6a61-45e2-9138-b0c83da1fc03 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 204 len: 0 microversion: 2.1 time: 0.126504 Jun 25 20:56:47.359551 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 738/1339] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:47 2022] DELETE /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:56:47.368933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.369858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.376474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.376925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.377693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.378123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.408288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:47.563927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:47.572260 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e20912b-042e-49f6-8a64-f7842bcc5028 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1494 microversion: 2.1 time: 0.251541 Jun 25 20:56:47.573320 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 602/1340] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1494 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:47.578792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.579850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.587655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.588551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.589869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.590529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.629335 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6ee182c6-4a24-4c4b-b36a-9cadd5118e5e tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.054508 Jun 25 20:56:47.630618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 603/1341] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:56:47.757358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25e9093e-a569-4e6b-84d6-26473b10e043 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 204 len: 0 microversion: 2.1 time: 0.392705 Jun 25 20:56:47.758051 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 739/1342] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:47 2022] DELETE /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:47.766909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.767884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.782593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.783584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.784915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.785593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.887741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:47.888561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:47.902450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.904415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:47.908734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:47.909426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:48.215569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:48.235580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dabf9ce-16ef-4241-a42a-cf5e78e030a8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.351162 Jun 25 20:56:48.236912 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 740/1343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:48.289639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:48.299177 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-15b951ff-60a7-4271-89e7-6dbec8d802ae tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 200 len: 1474 microversion: 2.1 time: 0.536740 Jun 25 20:56:48.300257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 604/1344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:47 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 1474 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:48.590583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:48.591212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:48.597775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:48.600250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:48.603281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:48.604128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:48.643419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:48.644545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:48.660230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:48.660794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:48.674774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:48.675469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:48.737568 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d32876a6-c8f5-4bda-9907-8a2ee514c972 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.098086 Jun 25 20:56:48.738836 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 605/1345] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 20:56:48 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 20:56:48.858503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:48.868940 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c56fd65d-ab5a-4608-a76e-99de3314ba31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1494 microversion: 2.1 time: 0.282124 Jun 25 20:56:48.869778 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 741/1346] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:48 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1494 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:49.253788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:49.255767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:49.264675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.265460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.266265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.266708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.316978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:49.317797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:49.330575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.331192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.333879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.334555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.345427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:49.483958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:49.491709 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-690dada3-4220-4403-835a-f1f25cd3d6c5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.243152 Jun 25 20:56:49.492291 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 606/1347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:49 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:49.613783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:49.627696 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25a7aca2-67ad-43e0-b72d-48b0720f9284 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 200 len: 1474 microversion: 2.1 time: 0.310380 Jun 25 20:56:49.661794 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 742/1348] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:49 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 1474 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:49.761516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:49.765177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:49.785528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.785979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.787257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.790228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.863787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fdc93c9-3e11-4974-a603-0010a058331b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.117309 Jun 25 20:56:49.870912 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 607/1349] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 20:56:49 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:49.887233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:49.888611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:49.904638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.908652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:49.909777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:49.910297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:50.255153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:50.294981 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a958877e-3f74-4bbc-813b-c0f5e8ad3c31 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 200 len: 1474 microversion: 2.1 time: 0.407070 Jun 25 20:56:50.296810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 743/1350] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:49 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 1474 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:50.321578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2024859610"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:50.325483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:50.343499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:50.347742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:50.349351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:50.351285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:50.990992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a540b2bf-4937-4b24-9778-bf19e989c310 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Calling method '.version_select at 0x7f984f59c8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:51.041394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4bcba9c1-075d-4070-8034-1c19044272fe tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7/action" status: 202 len: 0 microversion: 2.1 time: 0.731437 Jun 25 20:56:51.045277 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 608/1351] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:56:50 2022] POST /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 20:56:51.053923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:51.055735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:51.070838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.071771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.072939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.073739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.182630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a540b2bf-4937-4b24-9778-bf19e989c310 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 371 microversion: 2.1 time: 0.726265 Jun 25 20:56:51.187592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 744/1352] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 20:56:50 2022] GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 371 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:51.212392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:51.213056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:51.250678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.251581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.253849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.256304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.339815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.342585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.343294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lazy-loading 'fault' on Instance uuid 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:51.540176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:51.546657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:51.549021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-095a5d8c-1548-4076-aefc-36563e3a94c7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.501672 Jun 25 20:56:51.559625 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 609/1353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:51 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:51.563738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2e144fa4-cb74-4ebc-a44f-142b6bc45820 req-cb6255bb-3e26-4ba4-92f4-58e7733b7a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f", "name": "network-vif-deleted", "tag": "2e2edaa7-e682-4d9a-8daf-556fe88fa547"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:51.578838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2e144fa4-cb74-4ebc-a44f-142b6bc45820 req-cb6255bb-3e26-4ba4-92f4-58e7733b7a7f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.579293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2e144fa4-cb74-4ebc-a44f-142b6bc45820 req-cb6255bb-3e26-4ba4-92f4-58e7733b7a7f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.607076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2e144fa4-cb74-4ebc-a44f-142b6bc45820 req-cb6255bb-3e26-4ba4-92f4-58e7733b7a7f service nova] Creating event network-vif-deleted:2e2edaa7-e682-4d9a-8daf-556fe88fa547 for instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f on nch1-master-1 Jun 25 20:56:51.612580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2e144fa4-cb74-4ebc-a44f-142b6bc45820 req-cb6255bb-3e26-4ba4-92f4-58e7733b7a7f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060532 Jun 25 20:56:51.613420 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 610/1354] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:51.619560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-802d5c1a-a0fb-4b07-98a4-69f44e499a94 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985cc55940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:51.730401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:51.733736 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-802d5c1a-a0fb-4b07-98a4-69f44e499a94 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.110165 Jun 25 20:56:51.734526 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 611/1355] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:51 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:51.750121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40837a53-ea1c-4ad9-9740-c08b96834a08 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 200 len: 1308 microversion: 2.1 time: 0.561121 Jun 25 20:56:51.754974 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 745/1356] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:51 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 1308 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:51.758919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f985cc653a0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:51.763682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-480c32ba-4f98-4c22-8315-f9615b0fa544 req-adba3140-8840-4133-84a6-516f50c27710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16ab884a-b59d-442c-b1c2-3d43353e4a9e", "name": "network-vif-deleted", "tag": "fa7c0560-1ab7-41bb-8da1-cb540138a79e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:51.792812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-480c32ba-4f98-4c22-8315-f9615b0fa544 req-adba3140-8840-4133-84a6-516f50c27710 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.796750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-480c32ba-4f98-4c22-8315-f9615b0fa544 req-adba3140-8840-4133-84a6-516f50c27710 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.820474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-480c32ba-4f98-4c22-8315-f9615b0fa544 req-adba3140-8840-4133-84a6-516f50c27710 service nova] Creating event network-vif-deleted:fa7c0560-1ab7-41bb-8da1-cb540138a79e for instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e on nch1-master-1 Jun 25 20:56:51.836212 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-480c32ba-4f98-4c22-8315-f9615b0fa544 req-adba3140-8840-4133-84a6-516f50c27710 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078794 Jun 25 20:56:51.837127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 746/1357] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:51.849974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b2846344-0e75-4446-85ec-b5fedef38639 req-0e1ca2dd-d0ea-4c25-8a94-1c1dbedda7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b59ef-7ca9-4fea-b49d-66fe34e9c813", "name": "network-vif-unplugged", "status": "completed", "tag": "94688529-efd3-4eab-97fe-d16d44c3d1ad"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:51.880713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b2846344-0e75-4446-85ec-b5fedef38639 req-0e1ca2dd-d0ea-4c25-8a94-1c1dbedda7c7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.881159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b2846344-0e75-4446-85ec-b5fedef38639 req-0e1ca2dd-d0ea-4c25-8a94-1c1dbedda7c7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.883358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.888499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.889593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:51.890715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:51.905885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b2846344-0e75-4446-85ec-b5fedef38639 req-0e1ca2dd-d0ea-4c25-8a94-1c1dbedda7c7 service nova] Creating event network-vif-unplugged:94688529-efd3-4eab-97fe-d16d44c3d1ad for instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 on nch2-master-1 Jun 25 20:56:51.929946 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b2846344-0e75-4446-85ec-b5fedef38639 req-0e1ca2dd-d0ea-4c25-8a94-1c1dbedda7c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089057 Jun 25 20:56:51.930925 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 747/1358] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:52.021816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ad8f30c5-2b59-4e8a-b5b9-e6653d15022e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 328 microversion: 2.1 time: 0.285739 Jun 25 20:56:52.023187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 612/1359] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:51 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 328 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:52.348268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1987222417", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:52.425810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:52.567697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:52.568624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:52.586902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.587705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.588850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.589298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.805680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:52.815168 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3cdc4cf2-87e2-4cd6-a804-af4c85db563e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.252460 Jun 25 20:56:52.816324 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 613/1360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:52 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:52.831767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16bead53-f2e1-41ee-a5d9-81238b23348f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c86a5e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:52.891451 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16bead53-f2e1-41ee-a5d9-81238b23348f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.063761 Jun 25 20:56:52.897768 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 614/1361] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:52 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:52.907530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:52.908171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:52.918672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.919380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.921065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.921510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.938637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f HTTP/1.1 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:52.940738 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. Jun 25 20:56:52.942383 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f'} Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:52.943133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. Jun 25 20:56:52.944321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.946211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:52.949964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e11d6c4-7f08-4404-bb04-f3c0bbeac304 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f" status: 404 len: 111 microversion: 2.1 time: 0.047647 Jun 25 20:56:52.950776 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 615/1362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:52 2022] GET /compute/v2.1/servers/9bce4a4b-6a36-45fa-90f4-c46d7ec7e07f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:52.961193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:52.962129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 16ab884a-b59d-442c-b1c2-3d43353e4a9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:52.969189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.969989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.970968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:52.971580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:52.991057 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e HTTP/1.1 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:56:52.993532 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. Jun 25 20:56:52.994855 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '16ab884a-b59d-442c-b1c2-3d43353e4a9e'} Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:52.995714 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. Jun 25 20:56:52.997216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:56:52.999676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:52.999676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:52.999676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:53.000184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 16ab884a-b59d-442c-b1c2-3d43353e4a9e could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:53.000337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:53.000517 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b93ccbe-c8d7-4094-8eed-e1b7c6dee483 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e" status: 404 len: 111 microversion: 2.1 time: 0.043116 Jun 25 20:56:53.000687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:53.000840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 616/1363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:52 2022] GET /compute/v2.1/servers/16ab884a-b59d-442c-b1c2-3d43353e4a9e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:56:53.007262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90bb8ac8-9f08-4139-a7a5-37ef48ec4dd5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:53.016577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.017031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.017847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.019503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.049831 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90bb8ac8-9f08-4139-a7a5-37ef48ec4dd5 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/525c24a0-e807-4c3f-820f-5e4f8a95c0c7" status: 204 len: 0 microversion: 2.1 time: 0.046363 Jun 25 20:56:53.050817 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 617/1364] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 20:56:53 2022] DELETE /compute/v2.1/os-server-groups/525c24a0-e807-4c3f-820f-5e4f8a95c0c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:53.062531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:53.063858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:53.071127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:53.078334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.080840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.083728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.084912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for user a47744d718c64cf59765b192c38b8fdb and project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:53.085588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.110103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.utils [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] cores quota exceeded for 54e6d79ca8ed4ca2b0e8ebd835d52e37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137461) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 25 20:56:53.111382 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Request method failure captured: Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 145 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aRiARDYqc7-Fbn7USm97SmIOV_PYKBYNHj-2dDVMQ7cGCXBChFy79byBQ7WYLToh0zeOOuDd2HyPfeBJeNmg435IFN9Cg8zZ5DWsBVW2cyhv517KL2jQfiQ8u2vrRuEoPk-Ueryq1VjLIT5NaluuVYYI0qU8K8-_FXfwORMY116dM Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:53.116457 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}] Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a47744d718c64cf59765b192c38b8fdb Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1987222417", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} Jun 25 20:56:53.118016 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1987222417', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452'}}} Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 25 20:56:53.118808 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:53.119909 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.121237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jun 25 20:56:53.122509 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:53.125529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:53.126652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1cd659e9-0b9c-409f-a468-e9b4daab1ad1 tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.915637 Jun 25 20:56:53.127830 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 748/1365] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:52 2022] POST /compute/v2.1/servers => generated 111 bytes in 918 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:53.137091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f984f56d280>, body: {"quota_set": {"cores": 20}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:53.139345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:56:53.302494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.315484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.318530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.319160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.332532 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1897345-9eb1-437c-a365-9f9da6eed604 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 204 len: 0 microversion: 2.1 time: 0.276974 Jun 25 20:56:53.333674 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 618/1366] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:53 2022] DELETE /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 20:56:53.359269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:53.362383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:53.375621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.376709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.378019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.380172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.425341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:53.465088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47c9acf0-28c0-419b-ac35-8b7bbad9c969 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 329 microversion: 2.1 time: 0.330514 Jun 25 20:56:53.465701 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 749/1367] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:53 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 329 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:53.482826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-086a6fce-7fb7-4e22-ad70-8794745205c9 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Calling method '.version_select at 0x7f985c41cca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:53.609748 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-086a6fce-7fb7-4e22-ad70-8794745205c9 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 371 microversion: 2.1 time: 0.135405 Jun 25 20:56:53.610900 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 750/1368] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 20:56:53 2022] GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:56:53.624687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f984f62faf0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:53.679579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:53.689668 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec622995-b6f2-4f0d-8d20-9ccfac95ab5a tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1472 microversion: 2.1 time: 0.348975 Jun 25 20:56:53.704596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 619/1369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:53 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:53.795167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.795631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.796641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.797090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.832906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:53.833391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:53.840830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.841285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.842175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:53.842612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:53.875657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-944a9423-4842-4f39-928e-1d58f4341665 tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 328 microversion: 2.1 time: 0.258184 Jun 25 20:56:53.877972 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 751/1370] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:53 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:53.918960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a473b2bc-98ab-4e59-af72-2df4c4926b90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f98620c6550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:54.015032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a473b2bc-98ab-4e59-af72-2df4c4926b90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.108335 Jun 25 20:56:54.017569 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 752/1371] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:53 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:54.025418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1460264982", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:54.054971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:54.065879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba1c3271-0e51-43df-981c-af184a11e9da tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.237286 Jun 25 20:56:54.070342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 620/1372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:53 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:54.102293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:54.482519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:54.483175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:54.483411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:54.483827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:54.484240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:54.500097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.500652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.501392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.501823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.540154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:54.549696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for user a47744d718c64cf59765b192c38b8fdb and project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:54.579139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.utils [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] instances quota exceeded for 54e6d79ca8ed4ca2b0e8ebd835d52e37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137461) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 25 20:56:54.580406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Request method failure captured: Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 145 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aRiARDYqc7-Fbn7USm97SmIOV_PYKBYNHj-2dDVMQ7cGCXBChFy79byBQ7WYLToh0zeOOuDd2HyPfeBJeNmg435IFN9Cg8zZ5DWsBVW2cyhv517KL2jQfiQ8u2vrRuEoPk-Ueryq1VjLIT5NaluuVYYI0qU8K8-_FXfwORMY116dM Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:54.583702 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}] Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a47744d718c64cf59765b192c38b8fdb Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1460264982", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} Jun 25 20:56:54.586399 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1460264982', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452'}}} Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 25 20:56:54.587592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:54.589449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.591439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jun 25 20:56:54.593333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:54.601497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:54.602785 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-56416daa-0292-4273-aa98-8fdcbe72d39c tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.584001 Jun 25 20:56:54.603546 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 753/1373] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:54 2022] POST /compute/v2.1/servers => generated 119 bytes in 585 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:54.611768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f985c8e1ca0>, body: {"quota_set": {"instances": 10}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:54.707126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:54.707916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:54.715918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.729810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.730296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.731054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.731482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.736702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.741557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:54.744130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:54.822425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-001abca9-1ce5-45cd-bc37-b556a5bdf05a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 329 microversion: 2.1 time: 0.214261 Jun 25 20:56:54.833495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 621/1374] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:54 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 329 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:54.841183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9feec8e0-7e71-49ed-b97a-0f338ab4b95e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Calling method '.version_select at 0x7f985c437d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:54.947749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:54.994626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9feec8e0-7e71-49ed-b97a-0f338ab4b95e tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 371 microversion: 2.1 time: 0.159462 Jun 25 20:56:54.996394 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 622/1375] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 20:56:54 2022] GET /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:55.010336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f985cba40d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:55.025249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:55.040818 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-438886cf-bd55-4f30-8e6f-77475df8d5be tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1472 microversion: 2.1 time: 0.333421 Jun 25 20:56:55.041650 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 754/1376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:54 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:55.059687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9651564d-2b16-421f-89e3-e8b39ecdaf9e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f98620c6ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:55.117280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:55.117743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:55.118563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:55.119001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:55.165948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9651564d-2b16-421f-89e3-e8b39ecdaf9e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.113343 Jun 25 20:56:55.166816 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 755/1377] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:55 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:55.173570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f351d13c-df4b-4e77-a9da-992a683451ae req-e06a5271-468a-4460-a7aa-6dd62cf44d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b59ef-7ca9-4fea-b49d-66fe34e9c813", "name": "network-vif-plugged", "status": "completed", "tag": "94688529-efd3-4eab-97fe-d16d44c3d1ad"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:55.188999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f351d13c-df4b-4e77-a9da-992a683451ae req-e06a5271-468a-4460-a7aa-6dd62cf44d3b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:55.189907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f351d13c-df4b-4e77-a9da-992a683451ae req-e06a5271-468a-4460-a7aa-6dd62cf44d3b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:55.205634 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f351d13c-df4b-4e77-a9da-992a683451ae req-e06a5271-468a-4460-a7aa-6dd62cf44d3b service nova] Creating event network-vif-plugged:94688529-efd3-4eab-97fe-d16d44c3d1ad for instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 on nch2-master-1 Jun 25 20:56:55.214298 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f351d13c-df4b-4e77-a9da-992a683451ae req-e06a5271-468a-4460-a7aa-6dd62cf44d3b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045854 Jun 25 20:56:55.215714 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 756/1378] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:55.222343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:55.222797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78acca11-952a-44b3-b5f1-5814cd65704a tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 325 microversion: 2.1 time: 0.216983 Jun 25 20:56:55.234270 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 623/1379] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:55 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:55.234751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:55.234751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:55.234751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:55.235117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:55.236473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:55.358387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-786885077", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "44f808a5-2812-49fc-86f7-357c1eb714f7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:55.443635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] validate_networks() for [('44f808a5-2812-49fc-86f7-357c1eb714f7', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:55.544105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:55.566288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-60d02e83-94f7-4d19-9f86-7e7e928e864a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.349054 Jun 25 20:56:55.566992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 757/1380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:55 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:55.583188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-707596699", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:55.709286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:56:56.005431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:56.006385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:56.007087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:56.007700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:56.009225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:56.024308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.025376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.026824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.027395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.052037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:56.057079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Getting quotas for user a47744d718c64cf59765b192c38b8fdb and project 54e6d79ca8ed4ca2b0e8ebd835d52e37. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:56.071290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:56:56.071873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:56:56.072458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:56:56.072922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:56:56.073339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:56:56.075277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.utils [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] ram quota exceeded for 54e6d79ca8ed4ca2b0e8ebd835d52e37, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137461) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jun 25 20:56:56.076314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Request method failure captured: Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 144 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aRiARDYqc7-Fbn7USm97SmIOV_PYKBYNHj-2dDVMQ7cGCXBChFy79byBQ7WYLToh0zeOOuDd2HyPfeBJeNmg435IFN9Cg8zZ5DWsBVW2cyhv517KL2jQfiQ8u2vrRuEoPk-Ueryq1VjLIT5NaluuVYYI0qU8K8-_FXfwORMY116dM Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:56.078981 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}] Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a47744d718c64cf59765b192c38b8fdb Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-707596699", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} Jun 25 20:56:56.080386 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-707596699', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452'}}} Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 25 20:56:56.081320 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:56.082542 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.086943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jun 25 20:56:56.091057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.094942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:56.096532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42aff552-f75a-4ae7-b0c3-306127e4573b tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.517220 Jun 25 20:56:56.098277 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 758/1381] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:55 2022] POST /compute/v2.1/servers => generated 110 bytes in 531 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:56.099522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.100336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.101551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.101998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.104503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-54000884-410d-4653-8c5a-9376ff0aad51 req-2e24d59a-f050-43ad-8488-ebdf72ece2fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acaf208-7f08-43b0-a4cf-21cdcf91b5f8", "name": "network-vif-deleted", "tag": "ef4735f1-38e8-43c9-a3ce-04d3807f0d03"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:56.115490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-54000884-410d-4653-8c5a-9376ff0aad51 req-2e24d59a-f050-43ad-8488-ebdf72ece2fb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.116274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-54000884-410d-4653-8c5a-9376ff0aad51 req-2e24d59a-f050-43ad-8488-ebdf72ece2fb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.148131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Getting quotas for project 5fc39b845ba24fc49935ae2ecbf9eefc. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:56:56.153259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Getting quotas for user b9793101e6554c61bd3276d4290c0331 and project 5fc39b845ba24fc49935ae2ecbf9eefc. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:56:56.156327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-54000884-410d-4653-8c5a-9376ff0aad51 req-2e24d59a-f050-43ad-8488-ebdf72ece2fb service nova] Creating event network-vif-deleted:ef4735f1-38e8-43c9-a3ce-04d3807f0d03 for instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 on nch1-master-1 Jun 25 20:56:56.170778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Going to run 3 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:56:56.171924 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-54000884-410d-4653-8c5a-9376ff0aad51 req-2e24d59a-f050-43ad-8488-ebdf72ece2fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072191 Jun 25 20:56:56.174480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:56.177081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 759/1382] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:56.189717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:56.190771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:56.197907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.198624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.199591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.200188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.225721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:56.278320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=de80939b-d842-449d-a2ce-daa00ec9d501,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:56:56.285238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.288289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.289735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lazy-loading 'fault' on Instance uuid 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:56:56.363195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6773441662d41b2aecf9e43100633d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29037675b33a4f318e1fcafc33b6bed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:56.366411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1695bfa-fcbe-4723-9565-2f915a339e62 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.126056 Jun 25 20:56:56.372413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 624/1383] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:56:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:56:56.372413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Action: 'update', calling method: .version_select at 0x7f985cc65a60>, body: {"quota_set": {"ram": 51200}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:56.373205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84c992b1-ef38-4bc6-8ea4-9bc6e709dce3 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 200 len: 1306 microversion: 2.1 time: 0.193717 Jun 25 20:56:56.374698 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 760/1384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:56 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 1306 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:56.389877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9d64772-5b9d-4649-9197-d7a11ebc2bec tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f98620c6af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:56.456537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9d64772-5b9d-4649-9197-d7a11ebc2bec tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.078632 Jun 25 20:56:56.457216 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 761/1385] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:56 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:56.462903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:56.466756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:56.466925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.467213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.467880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:56:56.469024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.476075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.493979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.494928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.497084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.497826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.524344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d5b7171-46eb-4a97-8011-648a65031a3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.065559 Jun 25 20:56:56.526131 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 762/1386] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:56:56 2022] GET /compute/v2.1/servers => generated 1015 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:56.539722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9368e73-cba8-4f76-bcf2-25197d1efc0a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:56.541594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9368e73-cba8-4f76-bcf2-25197d1efc0a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:56.590030 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d0e0923-cab7-4af4-8920-23e0ed894a7f tempest-QuotasAdminNegativeTest-497259267 tempest-QuotasAdminNegativeTest-497259267-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 200 len: 329 microversion: 2.1 time: 0.220420 Jun 25 20:56:56.592763 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 625/1387] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:56 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 329 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:56:56.608974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:56.609871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:56.617489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9368e73-cba8-4f76-bcf2-25197d1efc0a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:56.621133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.622374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.623680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:56.624376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:56.632576 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9368e73-cba8-4f76-bcf2-25197d1efc0a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1222 microversion: 2.1 time: 0.098297 Jun 25 20:56:56.642547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 763/1388] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:56 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:56.647253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9958e24-ee4a-4d21-874f-376b85e3f9ec tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Action: 'update', calling method: .version_select at 0x7f984f7aa310>, body: {"quota_set": {"ram": 0}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:56:56.649901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9958e24-ee4a-4d21-874f-376b85e3f9ec tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'a47744d718c64cf59765b192c38b8fdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54e6d79ca8ed4ca2b0e8ebd835d52e37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9958e24-ee4a-4d21-874f-376b85e3f9ec tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Request method failure captured: Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 HTTP/1.1 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 25 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aRiARDYqc7-Fbn7USm97SmIOV_PYKBYNHj-2dDVMQ7cGCXBChFy79byBQ7WYLToh0zeOOuDd2HyPfeBJeNmg435IFN9Cg8zZ5DWsBVW2cyhv517KL2jQfiQ8u2vrRuEoPk-Ueryq1VjLIT5NaluuVYYI0qU8K8-_FXfwORMY116dM Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:56.652372 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/54e6d79ca8ed4ca2b0e8ebd835d52e37"}]}] Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 54e6d79ca8ed4ca2b0e8ebd835d52e37 Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-608470079 Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a47744d718c64cf59765b192c38b8fdb Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-QuotasAdminNegativeTest-608470079-project Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: {"quota_set": {"ram": 0}} Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 25 20:56:56.654079 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '54e6d79ca8ed4ca2b0e8ebd835d52e37', 'body': {'quota_set': {'ram': 0}}} Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:56:56.655354 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.enforce( Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.656799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9958e24-ee4a-4d21-874f-376b85e3f9ec tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9958e24-ee4a-4d21-874f-376b85e3f9ec tempest-QuotasAdminNegativeTest-608470079 tempest-QuotasAdminNegativeTest-608470079-project] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37" status: 403 len: 116 microversion: 2.1 time: 0.018821 Jun 25 20:56:56.658290 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 764/1389] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:56:56 2022] PUT /compute/v2.1/os-quota-sets/54e6d79ca8ed4ca2b0e8ebd835d52e37 => generated 116 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:56.876835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:56.888813 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d52690a-9500-4dcd-8d95-64a505fe52d1 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1519 microversion: 2.1 time: 0.285845 Jun 25 20:56:56.890276 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 626/1390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:56 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1519 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:57.396296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:57.397630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] [instance: 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:57.420731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:57.422704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:57.423704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:57.429109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:57.460647 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] HTTP exception thrown: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Request method failure captured: Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 HTTP/1.1 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W_sy8E5tdt88E2eyllNrhMuCHyjh153SrE4wAL9cOuc6C2MMH_x-nqzJJaVe5e6nqRO0_1xVQPACFi_T-EACqqf7Y3yaKhktGhuw0A9IDguj-h7hlAm9abQTOYHSM6e5GQVVD1Geciu6VXA-djP0S62kq5jz2ovpFw_d-3zeWwuz0 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:56:57.465136 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29037675b33a4f318e1fcafc33b6bed5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29037675b33a4f318e1fcafc33b6bed5"}]}] Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 29037675b33a4f318e1fcafc33b6bed5 Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-814734454 Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c6773441662d41b2aecf9e43100633d3 Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersOnMultiNodesTest-814734454-project Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. Jun 25 20:56:57.466610 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0acaf208-7f08-43b0-a4cf-21cdcf91b5f8'} Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:56:57.467377 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. Jun 25 20:56:57.468851 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:56:57.471122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] Returning 404 to user: Instance 0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:56:57.474671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4fa3cbfe-529a-4183-9b52-a00957de2434 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c42de50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:57.481625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8cc9681c-cb77-409a-b5fa-112d3308a894 tempest-ServersOnMultiNodesTest-814734454 tempest-ServersOnMultiNodesTest-814734454-project] 10.222.0.39 "GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8" status: 404 len: 111 microversion: 2.1 time: 0.093742 Jun 25 20:56:57.484685 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 765/1391] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:57 2022] GET /compute/v2.1/servers/0acaf208-7f08-43b0-a4cf-21cdcf91b5f8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:56:57.580510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4fa3cbfe-529a-4183-9b52-a00957de2434 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.113935 Jun 25 20:56:57.582787 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 627/1392] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:57 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:56:57.657163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4776e980-48ac-469a-a2a3-37002f11fd41 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:57.658414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4776e980-48ac-469a-a2a3-37002f11fd41 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:57.817817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4776e980-48ac-469a-a2a3-37002f11fd41 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:57.843328 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4776e980-48ac-469a-a2a3-37002f11fd41 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1222 microversion: 2.1 time: 0.195679 Jun 25 20:56:57.845508 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 766/1393] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:57 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:57.909253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:57.911364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:57.930318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:57.931281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:57.934260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:57.935793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:58.510823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:58.520412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e5fa1fd5-effc-49e4-a8ba-e217be44b38c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1504 microversion: 2.1 time: 0.617163 Jun 25 20:56:58.521055 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 628/1394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:57 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1504 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:58.543764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:58.544722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:58.565294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:58.568118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:58.573215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:58.574131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:58.595183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a0d6d37-9fa5-4b6d-b64b-67b6a005c8b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c79fd30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:59.164498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:59.183965 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86ccadbd-36d4-4c3c-a119-32749b59dfb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 200 len: 1504 microversion: 2.1 time: 0.646868 Jun 25 20:56:59.199620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 767/1395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:58 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 1504 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:59.215067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:59.216775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:59.231477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:59.231942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:59.236683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:59.237153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:59.662259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:56:59.676043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8332e1cb-a41f-47b8-abca-5d733dff9a5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1274 microversion: 2.1 time: 0.473185 Jun 25 20:56:59.681734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 768/1396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:56:59 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1274 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:56:59.715997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:56:59.718825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:56:59.743111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:59.747697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:59.751116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:56:59.752122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:56:59.872973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:00.154315 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d7c7d66-398b-42cd-9b74-b72286fedbb8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 204 len: 0 microversion: 2.1 time: 0.464316 Jun 25 20:57:00.157242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 769/1397] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:56:59 2022] DELETE /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:00.423648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-981911334", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "6c2b5444-8281-4087-89d2-2d927563a53b"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:06.494110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:06.504696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:06.572350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=48 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:07.825006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=42 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:07.918899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=11,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:08.515681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:10.033571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:10.467863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:11.924941 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a0d6d37-9fa5-4b6d-b64b-67b6a005c8b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 13.332318 Jun 25 20:57:11.925590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 629/1398] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:58 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 13335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:11.935653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:11.936262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:11.974222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:11.974683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:11.987312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:11.987703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:12.079682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] validate_networks() for [('6c2b5444-8281-4087-89d2-2d927563a53b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:12.258696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:12.267379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-168abe51-2bad-471e-b40b-0543ad803b5d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.336056 Jun 25 20:57:12.268015 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 630/1399] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:11 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:12.289175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d81b9d27-c549-441c-9d01-33804a0c8061 req-beb4b38a-c379-4e55-8221-1dfa77574e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b6ab3-0114-493d-9b7d-380d2d564df7", "name": "network-vif-plugged", "status": "completed", "tag": "347e3efb-597b-4c24-b1c7-79ea68a77b14"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:12.329466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d81b9d27-c549-441c-9d01-33804a0c8061 req-beb4b38a-c379-4e55-8221-1dfa77574e11 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:12.331576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d81b9d27-c549-441c-9d01-33804a0c8061 req-beb4b38a-c379-4e55-8221-1dfa77574e11 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:12.364491 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d81b9d27-c549-441c-9d01-33804a0c8061 req-beb4b38a-c379-4e55-8221-1dfa77574e11 service nova] Creating event network-vif-plugged:347e3efb-597b-4c24-b1c7-79ea68a77b14 for instance 006b6ab3-0114-493d-9b7d-380d2d564df7 on nch2-master-1 Jun 25 20:57:12.378792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d81b9d27-c549-441c-9d01-33804a0c8061 req-beb4b38a-c379-4e55-8221-1dfa77574e11 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094859 Jun 25 20:57:12.381915 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 631/1400] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:12.394773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:12.395747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:12.421637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:12.422694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:12.424301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:12.425513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:12.697215 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4ade110-3c92-4b21-b9db-0baab374f22e tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1811 microversion: 2.1 time: 0.307305 Jun 25 20:57:12.698077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 632/1401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:12 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1811 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:12.937051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8e0ac89a-7dfb-4cb9-a7ce-da22a0503f00 req-527c40c4-f9a2-4633-90a0-03f555fc32e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9b59ef-7ca9-4fea-b49d-66fe34e9c813", "name": "network-vif-deleted", "tag": "94688529-efd3-4eab-97fe-d16d44c3d1ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:12.959849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8e0ac89a-7dfb-4cb9-a7ce-da22a0503f00 req-527c40c4-f9a2-4633-90a0-03f555fc32e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:12.962486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8e0ac89a-7dfb-4cb9-a7ce-da22a0503f00 req-527c40c4-f9a2-4633-90a0-03f555fc32e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:12.991686 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8e0ac89a-7dfb-4cb9-a7ce-da22a0503f00 req-527c40c4-f9a2-4633-90a0-03f555fc32e2 service nova] Creating event network-vif-deleted:94688529-efd3-4eab-97fe-d16d44c3d1ad for instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 on nch2-master-1 Jun 25 20:57:13.007000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8e0ac89a-7dfb-4cb9-a7ce-da22a0503f00 req-527c40c4-f9a2-4633-90a0-03f555fc32e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305977 Jun 25 20:57:13.011455 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 633/1402] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:13.123035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2093456370", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:13.163315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:13.164926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:13.166285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:13.167102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:13.168144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:13.191811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.195960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.199599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.200217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.235529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:13.261092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:13.273195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for user cdf4dbb95b6a440fad542fad69b6a5d8 and project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:13.298096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:13.300919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:13.373970 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-283ecbf4-377f-4ac8-9ef2-311ef8f159ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.958102 Jun 25 20:57:13.380757 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 770/1403] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 12966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:57:13.536674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1cdeea11-c012-4596-94e8-a88f8ebd1307 req-9f7ab84c-c411-4d57-ae4f-3c495c511b17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa", "tag": "789e38a9-fd2b-4b4e-bb20-7643cbaa6b53"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:13.565325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1cdeea11-c012-4596-94e8-a88f8ebd1307 req-9f7ab84c-c411-4d57-ae4f-3c495c511b17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.566041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1cdeea11-c012-4596-94e8-a88f8ebd1307 req-9f7ab84c-c411-4d57-ae4f-3c495c511b17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.595727 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1cdeea11-c012-4596-94e8-a88f8ebd1307 req-9f7ab84c-c411-4d57-ae4f-3c495c511b17 service nova] Creating event network-changed:789e38a9-fd2b-4b4e-bb20-7643cbaa6b53 for instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa on nch1-master-1 Jun 25 20:57:13.612196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1cdeea11-c012-4596-94e8-a88f8ebd1307 req-9f7ab84c-c411-4d57-ae4f-3c495c511b17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229940 Jun 25 20:57:13.619236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 771/1404] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:13.665573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:13.669361 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:57:13.669361 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:57:13.675827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.676942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.678060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.680561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.776919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:13.776919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:13.776919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:13.776919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:13.776919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:13.803402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.806010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.807108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:13.809152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:13.811537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7116642e-4b0b-4b10-9d44-b079fa253f54 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.190252 Jun 25 20:57:13.818254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 772/1405] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:57:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:13.844265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b167151-5107-444e-9501-e9289098ce78 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f738820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:13.869491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Getting quotas for project cac44a003ea94dfba170af264c2412ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:13.885638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Getting quotas for user ab974f6a346044b39b4e0a9a57ce4dd9 and project cac44a003ea94dfba170af264c2412ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:13.919295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:13.926221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:13.981558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b167151-5107-444e-9501-e9289098ce78 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.165377 Jun 25 20:57:13.989276 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 773/1406] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:13 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:14.047877 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbcfb60e-3ad6-4ccb-889f-8970b43481d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.032525 Jun 25 20:57:14.049346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 634/1407] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:57:14.069886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:14.073281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:14.104479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:14.106965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:14.109705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:14.110152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:14.192726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-846238114", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "5f5ddf21-0e70-4c38-91b7-fe48bd042905"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:14.322169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] validate_networks() for [('5f5ddf21-0e70-4c38-91b7-fe48bd042905', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:14.978802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:15.011873 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-741f5886-0341-4983-bec9-6034fcf5a6b9 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.942252 Jun 25 20:57:15.031594 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 635/1408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:14 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:15.047937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:15.058045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:15.083473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.084412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.090597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.092685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.413884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:15.414946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:15.415648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:15.416280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:15.417501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:15.422219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:15.442381 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c7fcab66-b5a4-4bfc-a6cd-14d4d9fbd376 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1269 microversion: 2.1 time: 0.404253 Jun 25 20:57:15.443001 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 636/1409] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:15 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1269 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:15.461683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:15.463650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:15.484485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.484986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.488789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.489287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.490274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.497051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.498235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.498916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.537376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:15.550202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for user 662ef2b3df5e4c59b373fccab9c911c2 and project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:15.587101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:15.593308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:15.712301 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a7f26c4-41ae-4cdd-8b4e-ee8bd74fd6f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719685 Jun 25 20:57:15.715697 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 774/1410] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:57:15.758686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a12e729-70e8-4026-b254-49f3385a8dea tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f738820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:15.841876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a12e729-70e8-4026-b254-49f3385a8dea tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.106482 Jun 25 20:57:15.849431 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 775/1411] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:15 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:15.863466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de80939b-d842-449d-a2ce-daa00ec9d501", "tag": "94e55b2e-f52a-488a-b7e6-5d963332eea0"}, {"name": "network-changed", "server_uuid": "6b534da3-5074-41e2-931a-0c7ab761dc89", "tag": "93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:15.892135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:15.893043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:15.930176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:15.941697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-238cb8bd-77fa-434a-82b5-f003bd59532c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1218 microversion: 2.1 time: 0.492326 Jun 25 20:57:15.943331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] Creating event network-changed:94e55b2e-f52a-488a-b7e6-5d963332eea0 for instance de80939b-d842-449d-a2ce-daa00ec9d501 on nch1-master-1 Jun 25 20:57:15.945169 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] Creating event network-changed:93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f for instance 6b534da3-5074-41e2-931a-0c7ab761dc89 on nch2-master-1 Jun 25 20:57:15.956900 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 637/1412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:15 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1218 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:15.967042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-073a6a0d-7a5c-4c25-a56a-39edb29b3d34 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:15.967847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-073a6a0d-7a5c-4c25-a56a-39edb29b3d34 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:15.978168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-028ef040-0464-45a6-aa64-56c018ad2893 req-0453f929-b5ce-40cc-800f-06ea04841120 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.121246 Jun 25 20:57:15.982164 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 776/1413] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:16.040550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:16.041857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:16.050389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.058309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.059335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.059932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.181059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-073a6a0d-7a5c-4c25-a56a-39edb29b3d34 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:16.196479 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-073a6a0d-7a5c-4c25-a56a-39edb29b3d34 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1224 microversion: 2.1 time: 0.237118 Jun 25 20:57:16.197692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 638/1414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:15 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1224 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:16.218413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfb3f3d7-81ce-4d96-93a2-b60490b5cf87", "device": "/dev/xvdb"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:16.222527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:16.233010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.234031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.235481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.236140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.315308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:16.329013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9cd4165-9cee-46f7-9c45-3ee72c6da536 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.294403 Jun 25 20:57:16.340896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 777/1415] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:16 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:16.460459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:16.462396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:16.478007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.478462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.479259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:16.486926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:16.630453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:16.641974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-283c46c0-ad77-4aa6-9d39-9f4103ddb4fe tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1275 microversion: 2.1 time: 0.186422 Jun 25 20:57:16.649193 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 778/1416] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:16 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:16.857857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3983d5b-f35b-4cbd-96ac-b12b6651b912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f7aaee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:16.882779 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19d4c056-9bef-4945-bb83-01d898930451 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683448 Jun 25 20:57:16.883520 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 639/1417] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 20:57:16 2022] POST /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:16.971282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:16.971604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:17.008372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.011370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.012233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.018960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.045143 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3983d5b-f35b-4cbd-96ac-b12b6651b912 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.192237 Jun 25 20:57:17.046074 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 779/1418] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:16 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:17.216285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:17.217685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:17.226713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.228151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.229652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.231891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.311680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:17.323116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a05b2436-964e-47d8-8966-453efea0a43e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1228 microversion: 2.1 time: 0.111919 Jun 25 20:57:17.333448 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 780/1419] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:17 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1228 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:17.347210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:17.348141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:17.359059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.365300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.368764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.369115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.473356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:17.482305 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff586c92-b17f-4bb4-8ea1-fce29ccbf942 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1272 microversion: 2.1 time: 0.526805 Jun 25 20:57:17.491724 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 640/1420] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:16 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1272 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:17.665741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:17.671927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:17.686916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.687365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.688159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:17.688712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:17.697229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:17.718861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-feca427c-df9d-4966-9c0a-056656dbae9f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.376019 Jun 25 20:57:17.725118 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 781/1421] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:17 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:18.199974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fcb6bc59-6433-4505-bb9f-49f646926604 req-20ed6ef6-3d92-4ec5-b27b-93eeb0d28a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa", "name": "network-vif-plugged", "status": "completed", "tag": "789e38a9-fd2b-4b4e-bb20-7643cbaa6b53"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:18.222593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fcb6bc59-6433-4505-bb9f-49f646926604 req-20ed6ef6-3d92-4ec5-b27b-93eeb0d28a75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.228942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fcb6bc59-6433-4505-bb9f-49f646926604 req-20ed6ef6-3d92-4ec5-b27b-93eeb0d28a75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.273595 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fcb6bc59-6433-4505-bb9f-49f646926604 req-20ed6ef6-3d92-4ec5-b27b-93eeb0d28a75 service nova] Creating event network-vif-plugged:789e38a9-fd2b-4b4e-bb20-7643cbaa6b53 for instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa on nch1-master-1 Jun 25 20:57:18.295505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fcb6bc59-6433-4505-bb9f-49f646926604 req-20ed6ef6-3d92-4ec5-b27b-93eeb0d28a75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298871 Jun 25 20:57:18.301172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 782/1422] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:18.354439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10c047ed-9ce4-4e58-8edc-37aeecf454ad tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fa6e9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:18.425727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:18.442225 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-34e1d372-220a-49de-9887-596eb55df316 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1275 microversion: 2.1 time: 0.780534 Jun 25 20:57:18.457489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 641/1423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:17 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1275 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:18.465131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:18.466399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:18.477143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.478306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.479386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.479517 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10c047ed-9ce4-4e58-8edc-37aeecf454ad tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.176042 Jun 25 20:57:18.480136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.480840 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 783/1424] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:18 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:18.505804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:18.507164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:18.521589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.522319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.523296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.525590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.676599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:18.689179 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-727f7021-4db4-4f4f-8115-ca3d3ec90a38 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1272 microversion: 2.1 time: 0.186875 Jun 25 20:57:18.702512 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 784/1425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:18 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1272 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:18.742813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:18.743735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:18.754417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.756550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:18.760394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:18.761181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:19.005388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:19.015331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02e6743c-172d-4c80-a26f-6fd3c852254a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.277591 Jun 25 20:57:19.020745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 785/1426] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:18 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:19.463633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:19.467107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:19.488112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:19.490329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:19.491953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:19.496785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:19.594340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:19.606415 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd203f9d-e556-494d-a169-355e6317efa1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1282 microversion: 2.1 time: 1.147438 Jun 25 20:57:19.608490 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 642/1427] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:18 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1282 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:19.617865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-385a5cd6-6e8d-4744-8d64-18140af6aec0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c0dadc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:19.716330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-385a5cd6-6e8d-4744-8d64-18140af6aec0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.106517 Jun 25 20:57:19.716956 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 643/1428] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:19 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:19.743082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:19.747362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:19.774759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:19.778059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:19.781373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:19.785007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:20.037971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:20.049336 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c94da655-df82-4960-9d29-3dfb0d2a7593 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1272 microversion: 2.1 time: 0.323080 Jun 25 20:57:20.051339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 644/1429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:19 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:20.067837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:20.068879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:20.081514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:20.082405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:20.085248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:20.087079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:20.087931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:20.094945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28e5b482-9c51-420c-9326-c7784e9dd7e4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1275 microversion: 2.1 time: 0.636611 Jun 25 20:57:20.101144 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 786/1430] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:19 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1275 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:20.385311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c2acdb96-c886-4dbf-9a03-5d8310bcfc5a req-c28a8101-a626-4948-824e-7285e5cc99e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de80939b-d842-449d-a2ce-daa00ec9d501", "name": "network-vif-plugged", "status": "completed", "tag": "94e55b2e-f52a-488a-b7e6-5d963332eea0"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:20.401919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c2acdb96-c886-4dbf-9a03-5d8310bcfc5a req-c28a8101-a626-4948-824e-7285e5cc99e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:20.403631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c2acdb96-c886-4dbf-9a03-5d8310bcfc5a req-c28a8101-a626-4948-824e-7285e5cc99e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:20.436871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c2acdb96-c886-4dbf-9a03-5d8310bcfc5a req-c28a8101-a626-4948-824e-7285e5cc99e2 service nova] Creating event network-vif-plugged:94e55b2e-f52a-488a-b7e6-5d963332eea0 for instance de80939b-d842-449d-a2ce-daa00ec9d501 on nch1-master-1 Jun 25 20:57:20.443459 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c2acdb96-c886-4dbf-9a03-5d8310bcfc5a req-c28a8101-a626-4948-824e-7285e5cc99e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064413 Jun 25 20:57:20.444870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 787/1431] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:20.626614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:20.627743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:20.651888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:20.656315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:20.659113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:20.659796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.145650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:21.184595 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d46dbfde-d277-4db2-ad61-9f6a19c90170 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.562452 Jun 25 20:57:21.185641 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 788/1432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:20 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:21.221642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39534334-0fc7-43d2-8dc4-fbe9da6b6f1e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f85c160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:21.285134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39534334-0fc7-43d2-8dc4-fbe9da6b6f1e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.098197 Jun 25 20:57:21.286361 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 789/1433] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:21 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:21.291234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:21.293260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:21.301216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.301909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.302981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.303599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.531118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:21.543972 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7125995-6e09-440c-9827-011f5beeb568 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1272 microversion: 2.1 time: 0.256346 Jun 25 20:57:21.560232 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 790/1434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:21 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1272 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:21.573021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:21.573728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:21.596068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.596545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.597343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.607988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.790836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:21.800311 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03a97079-3f16-4aec-8337-24293cce6758 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 1.747655 Jun 25 20:57:21.808244 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 645/1435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:20 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:21.958252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:21.958989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:21.970666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.971344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:21.972264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:21.980997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:22.488385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:22.497051 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3274a79e-287a-41b6-9e05-c78f7478d4ec tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.935127 Jun 25 20:57:22.497668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 791/1436] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:21 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:22.516640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:22.517497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:22.534098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:22.534782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:22.539752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:22.540492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:22.931158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:22.940509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dc57479-80d5-43e4-8e99-b275f02e2359 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.441735 Jun 25 20:57:22.959566 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 792/1437] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:22 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:22.963398 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4568bcb2-f900-42a2-a232-dfb1bb994468 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1857 microversion: 2.1 time: 1.009404 Jun 25 20:57:22.970912 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 646/1438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:21 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1857 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:22.976868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-abc88b8e-59d8-4b81-8906-5fb7c20609f1 req-eba3999d-7888-4fb6-a4f9-d3422fcca38e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b534da3-5074-41e2-931a-0c7ab761dc89", "name": "network-vif-plugged", "status": "completed", "tag": "93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:22.977080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b337999-4ce5-45f5-8bce-b480fd6f91f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fc479d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:22.999185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-abc88b8e-59d8-4b81-8906-5fb7c20609f1 req-eba3999d-7888-4fb6-a4f9-d3422fcca38e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.002785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-abc88b8e-59d8-4b81-8906-5fb7c20609f1 req-eba3999d-7888-4fb6-a4f9-d3422fcca38e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.036174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-abc88b8e-59d8-4b81-8906-5fb7c20609f1 req-eba3999d-7888-4fb6-a4f9-d3422fcca38e service nova] Creating event network-vif-plugged:93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f for instance 6b534da3-5074-41e2-931a-0c7ab761dc89 on nch2-master-1 Jun 25 20:57:23.054483 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-abc88b8e-59d8-4b81-8906-5fb7c20609f1 req-eba3999d-7888-4fb6-a4f9-d3422fcca38e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070111 Jun 25 20:57:23.057933 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 647/1439] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:23.090876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:23.093369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:23.118221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b337999-4ce5-45f5-8bce-b480fd6f91f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.156751 Jun 25 20:57:23.125356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 793/1440] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:22 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:23.136781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:23.137417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:23.142096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.144985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.145720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.146348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.147450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.148040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.149487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.150850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.598109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:23.614056 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fe3dee8d-d1a6-4c10-8dc7-8a01cf922fc8 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1272 microversion: 2.1 time: 0.554657 Jun 25 20:57:23.614658 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 648/1441] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:23 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1272 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:23.627812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:23.635235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:23.655305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.657411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.658982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.660234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.691783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:23.704346 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d1684081-f06d-4c7f-a1ce-b060e6f08730 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.575896 Jun 25 20:57:23.715586 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 794/1442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:23 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:23.726627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-83b6c493-e79f-4f9c-83fd-aa5cad533430 req-759100f5-b0b7-460c-883a-c02d0331a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d91bd66b-2391-4c6c-a25b-679179fdbc1a", "tag": "52968236-0245-45d5-854a-e954662fe7da"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:23.742113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lazy-loading 'flavor' on Instance uuid f3d924f3-73b1-427e-8d6d-423bec6b8fdb {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:57:23.744812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-83b6c493-e79f-4f9c-83fd-aa5cad533430 req-759100f5-b0b7-460c-883a-c02d0331a4cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.746709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-83b6c493-e79f-4f9c-83fd-aa5cad533430 req-759100f5-b0b7-460c-883a-c02d0331a4cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.751152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:23.783945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-83b6c493-e79f-4f9c-83fd-aa5cad533430 req-759100f5-b0b7-460c-883a-c02d0331a4cc service nova] Creating event network-changed:52968236-0245-45d5-854a-e954662fe7da for instance d91bd66b-2391-4c6c-a25b-679179fdbc1a on nch1-master-1 Jun 25 20:57:23.796259 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-83b6c493-e79f-4f9c-83fd-aa5cad533430 req-759100f5-b0b7-460c-883a-c02d0331a4cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076341 Jun 25 20:57:23.798396 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 795/1443] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:23.801465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Going to try to live migrate instance to nch2-master-1 {{(pid=137462) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:57:23.814626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:23.825004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:23.832584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.833205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.834290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:23.834879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:23.846153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:24.136445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:24.148006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a7d46f6-6a17-434c-b3e2-1cfde5fcee91 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.347997 Jun 25 20:57:24.148645 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 796/1444] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:23 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:24.173689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:24.174635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:24.191095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:24.191617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:24.192465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:24.197450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:24.627279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:24.635284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:24.666964 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d11e2a3b-5cef-44df-95dd-251664c95d51 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.505355 Jun 25 20:57:24.669055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 797/1445] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:24 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:24.677023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69a04f62-adf9-4796-9fd5-1d2073d52629 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fa6eee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:24.870662 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69a04f62-adf9-4796-9fd5-1d2073d52629 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1412 microversion: 2.1 time: 0.198754 Jun 25 20:57:24.873056 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 798/1446] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:24 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1412 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:24.906857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:24.915405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:24.943692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:24.944714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:24.946906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:24.948020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:25.498427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:25.516306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:25.521376 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed291be4-6d6b-4e76-ab03-bab07a27d285 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.646343 Jun 25 20:57:25.524827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 799/1447] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:24 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:25.537297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:25.545653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:25.583229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:25.586144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:25.587509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:25.588908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:25.589498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.187190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:26.390053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:26.402286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2b4caca2-79bf-4890-b641-a3fe7fcbed0b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1322 microversion: 2.1 time: 0.875995 Jun 25 20:57:26.404467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 800/1448] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:25 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1322 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:26.415378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cb22dbe9-e0df-44aa-80be-fcde58c15a3d req-57749ebb-b45a-46b0-8695-e8d54b593bff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144c68b4-6ee5-44a9-afd3-8143cce8d29c", "tag": "06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:26.438669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cb22dbe9-e0df-44aa-80be-fcde58c15a3d req-57749ebb-b45a-46b0-8695-e8d54b593bff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.445150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cb22dbe9-e0df-44aa-80be-fcde58c15a3d req-57749ebb-b45a-46b0-8695-e8d54b593bff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.492639 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cb22dbe9-e0df-44aa-80be-fcde58c15a3d req-57749ebb-b45a-46b0-8695-e8d54b593bff service nova] Creating event network-changed:06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd for instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c on nch2-master-1 Jun 25 20:57:26.502373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cb22dbe9-e0df-44aa-80be-fcde58c15a3d req-57749ebb-b45a-46b0-8695-e8d54b593bff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096245 Jun 25 20:57:26.505068 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 801/1449] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:26.516925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:26.517638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:26.525660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.526091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.526940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.527393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.740243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:26.750984 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f521d42c-b0be-4cad-801c-0dcf42b7eec4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.241392 Jun 25 20:57:26.751186 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6fec9fad-e4d6-4b61-b5d3-6677f22e361b tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/action" status: 202 len: 0 microversion: 2.1 time: 3.135183 Jun 25 20:57:26.751763 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 649/1450] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:57:23 2022] POST /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/action => generated 0 bytes in 3136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:57:26.755678 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 802/1451] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:26 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:26.757815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:26.758678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:26.768624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a4ada25-8cff-411b-b169-84e249c30295 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f50a8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:26.779571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.780220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.781946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.782878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.862568 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a4ada25-8cff-411b-b169-84e249c30295 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1421 microversion: 2.1 time: 0.104381 Jun 25 20:57:26.863165 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 803/1452] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:26 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1421 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:26.877423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:26.878279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:26.888202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.890089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.891618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:26.892147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:26.983507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:26.992999 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6cce07dc-83c4-4630-98a3-e220266882f8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.239601 Jun 25 20:57:26.994910 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 650/1453] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:26 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.000548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.001702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:27.009085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.010929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.012097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.012787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.078751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:27.088248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11d50960-8f5d-41dc-82e7-e5a8e6eac993 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.222264 Jun 25 20:57:27.093050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 804/1454] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:26 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.097145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7693ebfe-9fcf-4473-ae8c-4a10547ed5d1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984f913af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.157894 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7693ebfe-9fcf-4473-ae8c-4a10547ed5d1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 200 len: 1421 microversion: 2.1 time: 0.067795 Jun 25 20:57:27.159462 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 805/1455] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:27 2022] GET /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.173994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6584e27c-bae4-4a0c-87a8-40670d791455 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fa0eca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.196844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:27.205519 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f00d9863-9352-430a-aeb8-57d530196b01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.209379 Jun 25 20:57:27.206109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 651/1456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:26 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.421148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.421842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:27.445658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.446118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.446905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.447339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.630816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:27.642839 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e83e3b3c-85f1-42ed-a63b-c8493aadfc58 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1516 microversion: 2.1 time: 0.225666 Jun 25 20:57:27.643454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 652/1457] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:27 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.677108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.677743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:27.685382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.686090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.687176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.687673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.869761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6584e27c-bae4-4a0c-87a8-40670d791455 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 204 len: 0 microversion: 2.1 time: 0.700667 Jun 25 20:57:27.870689 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 806/1458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:27 2022] DELETE /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 0 bytes in 702 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:27.875741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.876362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:27.885029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:27.885912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.886697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.887534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.888149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.895221 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eeb188af-624e-49e9-86b2-b406135d058a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 200 len: 1516 microversion: 2.1 time: 0.224035 Jun 25 20:57:27.896205 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 653/1459] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:27 2022] GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:27.913554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:27.914068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:27.921032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.921482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.922306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:27.922937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:27.951424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:28.057810 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92595771-caa9-4639-9939-0275313b72b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 204 len: 0 microversion: 2.1 time: 0.147385 Jun 25 20:57:28.061091 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 654/1460] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:27 2022] DELETE /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:28.075216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.075216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.075558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.075889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.075889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.076785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.077327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.082723 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de8047c4-fccb-4988-9829-812683ae4b36 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.209327 Jun 25 20:57:28.083398 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 807/1461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:27 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:28.089259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.090223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.102224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.102644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.104051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.106834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.313664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.322071 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff370cd2-ee73-445b-9998-7df8fb621df4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.237194 Jun 25 20:57:28.322847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 808/1462] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:28 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:28.328494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.329630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.336376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.337378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.338520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.339136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.341564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.353053 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43afce9d-7c21-43fc-87eb-8a8cb6721d8c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 200 len: 1516 microversion: 2.1 time: 0.290333 Jun 25 20:57:28.365268 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 655/1463] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:28 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 1516 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:28.370937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.371818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.379133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.379882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.380928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.381514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.509403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.522467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53d28da8-c8e7-4b11-9db0-2ef1c694e532 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.196206 Jun 25 20:57:28.523717 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 809/1464] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:28 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:28.537111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-487764021", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "3c6cf7a6-2345-4f61-9904-003c4d5dc289"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:28.555334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.565954 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40077fad-2ed3-4d19-9df7-c467cac82fb3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.199406 Jun 25 20:57:28.567265 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 656/1465] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:28 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:28.572069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.572793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.580473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.581490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.582772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.583276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.603095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] validate_networks() for [('3c6cf7a6-2345-4f61-9904-003c4d5dc289', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:28.612719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:28.703485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00cb5619-bfb2-421e-86a9-574f5d40d829 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 204 len: 0 microversion: 2.1 time: 0.134655 Jun 25 20:57:28.706230 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 657/1466] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:28 2022] DELETE /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:28.712541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ee4f4ef6-d3dc-43bd-9207-09be62ca1fba req-7b70a80e-9f45-456a-963c-e09c7f3d9d18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65be067-d27c-4249-b7dc-e5a5e54d588e", "tag": "7d5fe1e2-0e84-4aaf-9146-b811576250d7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:28.721388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ee4f4ef6-d3dc-43bd-9207-09be62ca1fba req-7b70a80e-9f45-456a-963c-e09c7f3d9d18 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.721832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ee4f4ef6-d3dc-43bd-9207-09be62ca1fba req-7b70a80e-9f45-456a-963c-e09c7f3d9d18 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.732948 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ee4f4ef6-d3dc-43bd-9207-09be62ca1fba req-7b70a80e-9f45-456a-963c-e09c7f3d9d18 service nova] Creating event network-changed:7d5fe1e2-0e84-4aaf-9146-b811576250d7 for instance a65be067-d27c-4249-b7dc-e5a5e54d588e on nch2-master-1 Jun 25 20:57:28.737884 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ee4f4ef6-d3dc-43bd-9207-09be62ca1fba req-7b70a80e-9f45-456a-963c-e09c7f3d9d18 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029943 Jun 25 20:57:28.738534 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 658/1467] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:28.743685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:28.744375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:28.750999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.751445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.752215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:28.752686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:28.898670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:28.907305 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-37600493-c9fc-4bb3-ae8a-452c358db9c7 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 200 len: 1522 microversion: 2.1 time: 0.167433 Jun 25 20:57:28.908459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 659/1468] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:28 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:29.034265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:29.034836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:29.035289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:29.035870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:29.036520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:29.056462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.057184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.058124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.058979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.095838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:29.100932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for user dbd8d82d694941b58fa2d18311ea5785 and project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:29.101188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.101819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.116071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:29.116310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.116864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.118270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.118785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:29.118911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.122382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:29.176710 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d11dd810-3a13-4982-80f6-c79b12042cb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651202 Jun 25 20:57:29.177573 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 810/1469] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:57:29.187109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d396eb38-d38e-4c5c-9929-0c87cb400b54 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.188360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d396eb38-d38e-4c5c-9929-0c87cb400b54 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.279173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:29.284542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d396eb38-d38e-4c5c-9929-0c87cb400b54 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:29.289108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8137a84-5d2e-4d85-9230-5f9e389047bf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.192614 Jun 25 20:57:29.290496 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 660/1470] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:29.294974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d396eb38-d38e-4c5c-9929-0c87cb400b54 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1207 microversion: 2.1 time: 0.111627 Jun 25 20:57:29.295788 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 811/1471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1207 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:29.339763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.340370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.346863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.347676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.348166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.348634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.507903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:29.514914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:29.524992 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-571a4159-342f-4771-8df7-a4fbc7b79e11 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.189311 Jun 25 20:57:29.541109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 661/1472] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:29.544222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.545361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.553609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.554503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.555502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.556108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.594471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.595527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.618672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.619447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.626935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.627793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.765152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:29.775780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71b8852b-3d00-4ce9-a277-4a61fdc7e434 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.240524 Jun 25 20:57:29.785831 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 812/1473] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:29.932493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:29.933470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:29.940664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.941314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:29.942365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:29.943043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.162107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:30.170349 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e631acc-ae1e-4e1f-a41a-b4917dbf0931 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 200 len: 1522 microversion: 2.1 time: 0.241857 Jun 25 20:57:30.170939 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 813/1474] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:30.227703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:30.236035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6c02964-bfa6-4b0d-bb16-f3a2c31aa933 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.653964 Jun 25 20:57:30.236688 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 662/1475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:29 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:30.306646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:30.307267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:30.313546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:30.314124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:30.323729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.324985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.325762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.326675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.333117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.333587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.334396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.334837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.456980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:30.471401 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d19dc0f5-05bb-4f44-9e2f-7f7e472aefb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1259 microversion: 2.1 time: 0.161628 Jun 25 20:57:30.471994 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 663/1476] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:30 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:30.557037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:30.558356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:30.577502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.579724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.581244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.581930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.612803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:30.621610 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-391010f9-0489-405e-a59e-9a229bcd75ef tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.318835 Jun 25 20:57:30.623781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 814/1477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:30 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:30.674043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b37d5256-cf50-47f5-9bf1-1a26c37b0b05 req-fb411780-4b80-41a6-b3bc-c3ee8d3156c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d91bd66b-2391-4c6c-a25b-679179fdbc1a", "name": "network-vif-plugged", "status": "completed", "tag": "52968236-0245-45d5-854a-e954662fe7da"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:30.684321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b37d5256-cf50-47f5-9bf1-1a26c37b0b05 req-fb411780-4b80-41a6-b3bc-c3ee8d3156c1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.684804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b37d5256-cf50-47f5-9bf1-1a26c37b0b05 req-fb411780-4b80-41a6-b3bc-c3ee8d3156c1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.713145 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b37d5256-cf50-47f5-9bf1-1a26c37b0b05 req-fb411780-4b80-41a6-b3bc-c3ee8d3156c1 service nova] Creating event network-vif-plugged:52968236-0245-45d5-854a-e954662fe7da for instance d91bd66b-2391-4c6c-a25b-679179fdbc1a on nch1-master-1 Jun 25 20:57:30.719745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b37d5256-cf50-47f5-9bf1-1a26c37b0b05 req-fb411780-4b80-41a6-b3bc-c3ee8d3156c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049542 Jun 25 20:57:30.720803 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 815/1478] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:30.796203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:30.797776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:30.813687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.814578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:30.823086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:30.825580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:31.167418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:31.180380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-05cec25c-66f1-4f2e-9066-d88da35c5d1b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.391263 Jun 25 20:57:31.181043 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 816/1479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:30 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:31.198351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:31.205011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:31.231042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:31.231494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:31.232349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:31.232814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:31.518465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:31.551688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be5f52ae-24a2-48ac-9729-08172682e29f tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 200 len: 1480 microversion: 2.1 time: 0.357187 Jun 25 20:57:31.555167 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 817/1480] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:31 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 1480 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:31.563705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:31.564682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:31.572599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:31.573226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:31.574208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:31.574802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.062163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:32.072968 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4aa2716-9f31-4dc3-a9ef-7610cc0f4929 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 1.525728 Jun 25 20:57:32.076687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 664/1481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:30 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:32.086807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:32.088706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:32.095442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:32.125265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.131030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.136728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.137370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.321822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:32.388020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d336c30-1469-4e56-89c3-4a57c3daa7c8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.830986 Jun 25 20:57:32.389621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 818/1482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:31 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:32.412712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:32.414389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:32.440595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.441757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.443532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.448232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.663057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:32.686801 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b4231ad-fa00-4d60-88f8-4941a4d6792c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1265 microversion: 2.1 time: 0.608808 Jun 25 20:57:32.687900 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 665/1483] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:32 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1265 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:32.697807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-25c22a5b-8ded-4e70-84c2-994df4a9e20e req-d18e2d3e-442a-42d8-a035-89f1f3f6482b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa", "name": "network-vif-deleted", "tag": "789e38a9-fd2b-4b4e-bb20-7643cbaa6b53"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:32.715893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25c22a5b-8ded-4e70-84c2-994df4a9e20e req-d18e2d3e-442a-42d8-a035-89f1f3f6482b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.717100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25c22a5b-8ded-4e70-84c2-994df4a9e20e req-d18e2d3e-442a-42d8-a035-89f1f3f6482b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.741812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-25c22a5b-8ded-4e70-84c2-994df4a9e20e req-d18e2d3e-442a-42d8-a035-89f1f3f6482b service nova] Creating event network-vif-deleted:789e38a9-fd2b-4b4e-bb20-7643cbaa6b53 for instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa on nch1-master-1 Jun 25 20:57:32.755420 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-25c22a5b-8ded-4e70-84c2-994df4a9e20e req-d18e2d3e-442a-42d8-a035-89f1f3f6482b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063583 Jun 25 20:57:32.756545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 666/1484] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:32.778462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:32.779845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:32.795276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.795736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:32.796568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:32.797011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.011248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:33.024053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16786d0b-0384-43dc-a45c-ad75db06ddad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.631505 Jun 25 20:57:33.025071 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 819/1485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:32 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:33.036356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:33.046303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:33.058467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.059020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.059924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.060400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.092088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] HTTP exception thrown: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa HTTP/1.1 Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:33.094544 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:33.096910 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa'} Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:33.097853 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:33.099276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:33.102703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 404 to user: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:33.104486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eba097af-061a-41e7-a973-66f887bfeff2 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 404 len: 111 microversion: 2.1 time: 0.078280 Jun 25 20:57:33.105952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 820/1486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:33 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:33.113083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2b86ccbf-8315-4cd4-a63a-89efae702e24 req-b9574a39-d4de-40f9-8d31-e4d4cf163270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c68b4-6ee5-44a9-afd3-8143cce8d29c", "name": "network-vif-plugged", "status": "completed", "tag": "06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:33.127105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2b86ccbf-8315-4cd4-a63a-89efae702e24 req-b9574a39-d4de-40f9-8d31-e4d4cf163270 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.127950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2b86ccbf-8315-4cd4-a63a-89efae702e24 req-b9574a39-d4de-40f9-8d31-e4d4cf163270 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.143970 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2b86ccbf-8315-4cd4-a63a-89efae702e24 req-b9574a39-d4de-40f9-8d31-e4d4cf163270 service nova] Creating event network-vif-plugged:06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd for instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c on nch2-master-1 Jun 25 20:57:33.156279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2b86ccbf-8315-4cd4-a63a-89efae702e24 req-b9574a39-d4de-40f9-8d31-e4d4cf163270 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048155 Jun 25 20:57:33.157402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 821/1487] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:33.187681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:33.188875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:33.199472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.200088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.201191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.202636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.478265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:33.482530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:33.487211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2028cc97-9c83-4067-b326-45bb4b780cdf tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1324 microversion: 2.1 time: 0.328067 Jun 25 20:57:33.487805 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 822/1488] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:33 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:33.499121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:33.505272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:33.506294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:33.513572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.514374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.515414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.515889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.620139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:33.634167 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb2755bb-b840-41d5-a76b-ed785394f03d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.872307 Jun 25 20:57:33.635078 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 667/1489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:32 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:33.663435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:33.671710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:33.675303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d12acd00-8045-423d-86bf-70b86e5a2aa3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.180767 Jun 25 20:57:33.680627 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 823/1490] 10.222.0.39 () {58 vars in 1229 bytes} [Sat Jun 25 20:57:33 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:33.685534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.685982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.687280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.689705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6dd8ada4-2839-42a5-ac94-ae375a885f43"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:33.690298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.691287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:33.707703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.708670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:33.709950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:33.710585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.214937 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c21f9d85-da7f-40d0-bbf7-c1e6145581fd tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "POST /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.532341 Jun 25 20:57:34.217149 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 824/1491] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 20:57:33 2022] POST /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments => generated 194 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:34.221465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f826a292-2e89-4d4a-8c19-482313ac7f22 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f826a292-2e89-4d4a-8c19-482313ac7f22 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:34.224816 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 25 20:57:34.227317 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi '2011/01/01' Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:34.228547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:34.231603 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f826a292-2e89-4d4a-8c19-482313ac7f22 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f826a292-2e89-4d4a-8c19-482313ac7f22 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009397 Jun 25 20:57:34.233624 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 825/1492] 10.222.0.39 () {58 vars in 1181 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:34.237223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.238110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:34.260733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.261447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.262869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.262869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.367980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:34.397823 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5647af9-d218-4738-be9c-d73927edf2bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1265 microversion: 2.1 time: 0.163701 Jun 25 20:57:34.398699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 826/1493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:34.410685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.410685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:34.414186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.414853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.415875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.416310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.610687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:34.639592 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-262cbd7c-b3cc-4af9-bddd-2814651ca829 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1317 microversion: 2.1 time: 0.239381 Jun 25 20:57:34.641021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 827/1494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:34.646970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.651157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:34.652115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:34.661320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.662069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.663311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.663605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.705323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:57:34.750228 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58f90811-f5a9-40b4-9246-3a2383f2ec54 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.107033 Jun 25 20:57:34.750896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 828/1495] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers => generated 681 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:34.759167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.759557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:34.767293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.767755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.768637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.769082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.875768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:34.894248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4c00386f-bdd9-4643-9a69-ae2671858a2b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 1.257108 Jun 25 20:57:34.894991 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 668/1496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:33 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:34.903391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:34.904296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:34.947961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.948767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:34.949605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:34.950077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.080479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:35.091020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4de51ba5-1984-46ca-bb26-4eb142680f80 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.338928 Jun 25 20:57:35.105456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 829/1497] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:35.109507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:35.116199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:35.116731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.servers [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Removing options 'limit' from query {{(pid=137461) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Jun 25 20:57:35.117485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:35.143032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.143156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.144137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.147464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.230845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:57:35.278824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abba4988-20f4-452e-8a11-fc7568e347f3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.186019 Jun 25 20:57:35.280105 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 830/1498] 10.222.0.39 () {58 vars in 1143 bytes} [Sat Jun 25 20:57:35 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:35.309590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:35.320661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:35.328365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.328723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.329673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.330266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.696835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:35.710819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-375d3737-dde2-4b12-a99f-ec4f8972c201 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.429178 Jun 25 20:57:35.721827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 831/1499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:35 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:35.730370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3316a2c1-efbd-482c-881a-82a6580421c5 req-85f248a6-423d-4ab4-941e-e68d3f207594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b6ab3-0114-493d-9b7d-380d2d564df7", "name": "network-vif-unplugged", "status": "completed", "tag": "347e3efb-597b-4c24-b1c7-79ea68a77b14"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:35.747958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3316a2c1-efbd-482c-881a-82a6580421c5 req-85f248a6-423d-4ab4-941e-e68d3f207594 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.749076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3316a2c1-efbd-482c-881a-82a6580421c5 req-85f248a6-423d-4ab4-941e-e68d3f207594 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.777273 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3316a2c1-efbd-482c-881a-82a6580421c5 req-85f248a6-423d-4ab4-941e-e68d3f207594 service nova] Creating event network-vif-unplugged:347e3efb-597b-4c24-b1c7-79ea68a77b14 for instance 006b6ab3-0114-493d-9b7d-380d2d564df7 on nch2-master-1 Jun 25 20:57:35.797254 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3316a2c1-efbd-482c-881a-82a6580421c5 req-85f248a6-423d-4ab4-941e-e68d3f207594 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075958 Jun 25 20:57:35.799102 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 832/1500] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:35.814107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a6451cc-61a2-43c0-9abe-cc53ff33726b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a6451cc-61a2-43c0-9abe-cc53ff33726b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:35.817914 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 25 20:57:35.819387 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi '-1' Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:35.820170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.822699 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a6451cc-61a2-43c0-9abe-cc53ff33726b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a6451cc-61a2-43c0-9abe-cc53ff33726b tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.018882 Jun 25 20:57:35.824046 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 833/1501] 10.222.0.39 () {58 vars in 1141 bytes} [Sat Jun 25 20:57:35 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:35.827943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:35.829512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:35.868794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.869397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.870603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.871048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.940960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:35.953011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-300b9cfd-6a2f-47d7-b755-171ef886a2bf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 1.056598 Jun 25 20:57:35.964693 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 669/1502] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:34 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:35.971025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:35.971644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:35.979055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.979675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:35.980653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:35.981416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.016918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.026579 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4407199f-89c9-414f-a672-74f718e21b84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1265 microversion: 2.1 time: 0.205105 Jun 25 20:57:36.027356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 834/1503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:35 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.046871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2275645e-767a-4f25-b97e-ef0f32b11993 req-5d8e6f70-4062-42c2-a347-20c32f1a921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006b6ab3-0114-493d-9b7d-380d2d564df7", "name": "network-vif-deleted", "tag": "347e3efb-597b-4c24-b1c7-79ea68a77b14"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:36.067645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2275645e-767a-4f25-b97e-ef0f32b11993 req-5d8e6f70-4062-42c2-a347-20c32f1a921c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.067645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2275645e-767a-4f25-b97e-ef0f32b11993 req-5d8e6f70-4062-42c2-a347-20c32f1a921c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.085337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2275645e-767a-4f25-b97e-ef0f32b11993 req-5d8e6f70-4062-42c2-a347-20c32f1a921c service nova] Creating event network-vif-deleted:347e3efb-597b-4c24-b1c7-79ea68a77b14 for instance 006b6ab3-0114-493d-9b7d-380d2d564df7 on nch2-master-1 Jun 25 20:57:36.091216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2275645e-767a-4f25-b97e-ef0f32b11993 req-5d8e6f70-4062-42c2-a347-20c32f1a921c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049612 Jun 25 20:57:36.092547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 835/1504] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:36.101755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e53a5ce8-d9ba-40ab-98d8-d2e74b33ee0e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2118281639", "metadata": {"": ""}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e53a5ce8-d9ba-40ab-98d8-d2e74b33ee0e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action HTTP/1.1 Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 107 Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:36.105603 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2118281639", "metadata": {"": ""}}} Jun 25 20:57:36.107314 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2118281639', 'metadata': {'': ''}}}} Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'': ''} Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:36.108355 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.110067 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.111643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e53a5ce8-d9ba-40ab-98d8-d2e74b33ee0e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:36.112602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e53a5ce8-d9ba-40ab-98d8-d2e74b33ee0e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action" status: 400 len: 170 microversion: 2.1 time: 0.017589 Jun 25 20:57:36.113825 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 836/1505] 10.222.0.39 () {60 vars in 1278 bytes} [Sat Jun 25 20:57:36 2022] POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:36.118801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15227b7c-1d4d-4048-8d98-c4c5e3eb35ec tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15227b7c-1d4d-4048-8d98-c4c5e3eb35ec tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:36.121648 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 25 20:57:36.123343 ncdv-master-1 devstack@n-api.service[137461]: action_args: {} Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance[0]: Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'testing' Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:36.124269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.126074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:36.127732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15227b7c-1d4d-4048-8d98-c4c5e3eb35ec tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:36.130172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-15227b7c-1d4d-4048-8d98-c4c5e3eb35ec tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.013134 Jun 25 20:57:36.130172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 837/1506] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:36.138024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.139576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:36.149704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.150385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.151308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.151862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.308872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.324879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e2dd51d-1995-4dc5-b086-8789254f9572 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1506 microversion: 2.1 time: 0.353361 Jun 25 20:57:36.329474 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 670/1507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:35 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1506 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.344792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.347387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:36.362705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.364962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.366129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.366569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.399153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.410612 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9953be1-4a7d-4135-9a5c-eeebe1e93ed5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.279289 Jun 25 20:57:36.411208 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 838/1508] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.425245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f743d3e-513e-424f-8e9b-2ef9ae9c5b3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.429106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f743d3e-513e-424f-8e9b-2ef9ae9c5b3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.429887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f743d3e-513e-424f-8e9b-2ef9ae9c5b3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:36.443516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.servers [None req-9f743d3e-513e-424f-8e9b-2ef9ae9c5b3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Flavor 'non_existing_flavor' could not be found {{(pid=137461) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Jun 25 20:57:36.444751 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f743d3e-513e-424f-8e9b-2ef9ae9c5b3e tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.032518 Jun 25 20:57:36.450996 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 839/1509] 10.222.0.39 () {58 vars in 1177 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:36.450996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.451327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:36.457800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.458243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.459187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.459431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.666795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.676790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9685151-83c6-4c81-87c6-e0867c510503 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1506 microversion: 2.1 time: 0.229652 Jun 25 20:57:36.678256 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 840/1510] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.683484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.687502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.689909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:36.696717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.697522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.699218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.699936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.738759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.750496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9890181-2f8d-45d6-8127-bb1638492d92 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.419173 Jun 25 20:57:36.771755 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 671/1511] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.782300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:36.783514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:36.802822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.803275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.804114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.804583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.821585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51741722-edb8-4bf1-b228-08cfa89fc122 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.141955 Jun 25 20:57:36.823254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 841/1512] 10.222.0.39 () {58 vars in 1173 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:36.829977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.830821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:36.839523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.840207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.841874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.842525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.954943 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f0e60a9-0f6a-40da-a6db-ded90b1b3f6c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "PUT /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1078 microversion: 2.1 time: 0.181760 Jun 25 20:57:36.956722 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 672/1513] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 20:57:36 2022] PUT /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1078 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:36.963157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:36.967293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:36.968882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:36.975411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.976106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:36.977100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:36.977874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.026143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.042010 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5507d3cf-441c-4869-8807-b63fbc4f3445 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.214863 Jun 25 20:57:37.054239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 842/1514] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.059702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.061679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.068287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.068791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.069582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.070029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.094138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83a26288-abc3-4f39-b197-e0a94e980105 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.134357 Jun 25 20:57:37.097208 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 673/1515] 10.222.0.39 () {58 vars in 1183 bytes} [Sat Jun 25 20:57:36 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:37.109909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.110603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.132156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.136460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.137541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.138750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.288194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.300672 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1636bb4-a2cc-46c1-bc6f-b52b5361e66b tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.245093 Jun 25 20:57:37.301453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 843/1516] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.308384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.309976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.320012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.321316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.322918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.323419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.367560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.376235 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d0beff5-e9c1-4183-9c29-28238375f481 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1504 microversion: 2.1 time: 0.277191 Jun 25 20:57:37.376731 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 674/1517] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.382589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6f0261c-157a-4fba-b55b-b7940718dda0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-717451526", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6f0261c-157a-4fba-b55b-b7940718dda0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action HTTP/1.1 Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 618 Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:57:37.385642 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:37.387067 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:57:37.387684 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-717451526", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jun 25 20:57:37.387684 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:57:37.387684 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-717451526', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jun 25 20:57:37.387910 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:37.388679 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.390177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 20:57:37.392350 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:37.394236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6f0261c-157a-4fba-b55b-b7940718dda0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:37.395838 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6f0261c-157a-4fba-b55b-b7940718dda0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action" status: 400 len: 938 microversion: 2.1 time: 0.017983 Jun 25 20:57:37.397228 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 675/1518] 10.222.0.39 () {60 vars in 1278 bytes} [Sat Jun 25 20:57:37 2022] POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:37.402495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.405879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.406623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:37.413445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.414235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.415349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.416011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.449864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:57:37.521207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.531884 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eee43540-c46f-4689-ad34-de2326adb4e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.228825 Jun 25 20:57:37.532371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.533139 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 844/1519] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.538397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.539160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.547849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.548673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.549719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.550425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.552634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.552976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.583424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:37.725800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.734341 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee575775-0994-44ba-be87-2249c7b7d2a0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1504 microversion: 2.1 time: 0.199724 Jun 25 20:57:37.734973 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 845/1520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1504 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.744464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.745967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.752945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.753831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.754655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.755264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.832514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3dad6ec7-5496-4395-874a-03ba1328c9a3 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 3025 microversion: 2.1 time: 0.433473 Jun 25 20:57:37.833546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 676/1521] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/detail => generated 3025 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.839612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:37.840463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.852400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.852884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.853660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.854311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.902210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:37.910098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5fd6e82-9426-46e3-810a-997c97393c97 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.173849 Jun 25 20:57:37.910728 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 846/1522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:37.915583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:37.917537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:37.923968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.924444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:37.925227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:37.925669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.005339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:38.005768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:38.006247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:38.006655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:38.007067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:38.065900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.077111 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e341a57c-b888-41c0-afad-832f58c97940 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.242283 Jun 25 20:57:38.078945 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 677/1523] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:37 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.085233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7328cb72-8463-4346-89eb-d38a85577dff tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.089493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.095861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.096591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.097692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.098350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.116034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7328cb72-8463-4346-89eb-d38a85577dff tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.117722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7328cb72-8463-4346-89eb-d38a85577dff tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.037412 Jun 25 20:57:38.126668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 678/1524] 10.222.0.39 () {58 vars in 1177 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:38.138728 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30be926b-34fc-4f01-9ee0-17b258e6cbb6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "POST /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c/action" status: 202 len: 1110 microversion: 2.1 time: 0.226852 Jun 25 20:57:38.141036 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 847/1525] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:57:37 2022] POST /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c/action => generated 1110 bytes in 229 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 25 20:57:38.141765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.143938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.155511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.158739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.160839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.163709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.164401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.188785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.191641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Searching by: {'deleted': False, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:57:38.209741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.210424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.212236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.212975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.272401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:57:38.310173 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c50fa2d-5cc3-4715-ae6e-8cd0a0072885 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.169064 Jun 25 20:57:38.311163 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 848/1526] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:38.316502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.317219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.323877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.324330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.325131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.325555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.355134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.364821 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69125ffb-10f9-4dd6-84a7-bd152cd0f284 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.235440 Jun 25 20:57:38.365413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 679/1527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.370378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5ce1720e-d0fd-4ff9-86d4-08d2956263af req-5e5f79e4-ce46-40a8-b14c-fc5db8ef2782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7335cff-0cba-4acd-8c67-5ae7c8bdbf99", "tag": "01332024-f454-43ee-8562-8a92172352de"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:38.379208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5ce1720e-d0fd-4ff9-86d4-08d2956263af req-5e5f79e4-ce46-40a8-b14c-fc5db8ef2782 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.379732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5ce1720e-d0fd-4ff9-86d4-08d2956263af req-5e5f79e4-ce46-40a8-b14c-fc5db8ef2782 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.392084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5ce1720e-d0fd-4ff9-86d4-08d2956263af req-5e5f79e4-ce46-40a8-b14c-fc5db8ef2782 service nova] Creating event network-changed:01332024-f454-43ee-8562-8a92172352de for instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 on nch1-master-1 Jun 25 20:57:38.397908 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5ce1720e-d0fd-4ff9-86d4-08d2956263af req-5e5f79e4-ce46-40a8-b14c-fc5db8ef2782 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030784 Jun 25 20:57:38.398767 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 680/1528] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:38.403741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.404461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.411900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.411900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.412672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.413107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.418062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:38.487690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.497236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18472326-248f-4e06-bcb8-142ec5c5268a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.184880 Jun 25 20:57:38.498234 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 849/1529] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.527369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.527892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.547207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.548250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.550159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.550965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.569422 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] HTTP exception thrown: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa HTTP/1.1 Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:38.571479 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.573084 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa'} Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:38.574364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.576003 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.577795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 404 to user: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:38.577795 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7cc83346-23f7-4d0a-8928-047609d4cfa5 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 404 len: 111 microversion: 2.1 time: 0.073735 Jun 25 20:57:38.577795 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 850/1530] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:38 2022] DELETE /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:38.579764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-073618b8-4ed3-4c19-8148-b6ec4113c3ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-073618b8-4ed3-4c19-8148-b6ec4113c3ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action HTTP/1.1 Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 285 Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:38.582807 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:57:38.584125 ncdv-master-1 devstack@n-api.service[137461]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:57:38.585064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:57:38.589631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:57:38.591216 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:57:38.592165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 20:57:38.592165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.592165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-073618b8-4ed3-4c19-8148-b6ec4113c3ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:38.592165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-073618b8-4ed3-4c19-8148-b6ec4113c3ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action" status: 400 len: 619 microversion: 2.1 time: 0.009101 Jun 25 20:57:38.592699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 851/1531] 10.222.0.39 () {60 vars in 1278 bytes} [Sat Jun 25 20:57:38 2022] POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:57:38.592852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.593401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.606200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.606639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.607420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.607872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.616562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.624376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f8f1fda-d057-466d-b69a-39e9fadfa280 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.224736 Jun 25 20:57:38.625076 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 681/1532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.629812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.630640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.636901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.637349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.638145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.638569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.665343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:38.744094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.753106 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f52e2fe7-973c-46d9-b570-abdf9f75588d tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "DELETE /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 204 len: 0 microversion: 2.1 time: 0.126600 Jun 25 20:57:38.753763 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40648ef0-986f-4cfc-88c7-c28c7c5ddf8b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.166540 Jun 25 20:57:38.754444 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 682/1533] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:38 2022] DELETE /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:38.754780 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 852/1534] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.764962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.766064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.767734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.768337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.773721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.774620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.775111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.775656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.775833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.776088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.776928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.777540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.807529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:38.899075 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf525f1b-1694-4fe0-adca-f205b8502c61 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 204 len: 0 microversion: 2.1 time: 0.139849 Jun 25 20:57:38.899913 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 853/1535] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:38 2022] DELETE /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:38.910031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.910965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.918321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.918783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.919566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.920195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.935384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] HTTP exception thrown: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa HTTP/1.1 Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:38.937205 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.938786 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa'} Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:38.939576 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. Jun 25 20:57:38.940849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:38.941983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 404 to user: Instance e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:38.941983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81f9c9b8-741b-4ae1-b8e1-b0450c66f19c tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa" status: 404 len: 111 microversion: 2.1 time: 0.034633 Jun 25 20:57:38.941983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 854/1536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/e7ef6d22-caef-4c47-ba7c-8ab6f963c4fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:57:38.947112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.947732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.954041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.954491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.955411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.955705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.958388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:38.968772 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d474ee0-51a7-4d8d-a979-49182701e5f0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.210788 Jun 25 20:57:38.969649 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 683/1537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:38.986542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:38.987283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:38.994434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.994893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:38.995723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:38.996671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.099049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:39.106801 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-630eed26-6c88-41f8-9fc7-4db0ea28b180 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 200 len: 1522 microversion: 2.1 time: 0.163434 Jun 25 20:57:39.107469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 855/1538] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:39.112359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:39.113076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:39.119961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.120417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.121216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.121814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.135440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:39.143383 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-090355c8-9d62-4742-aa12-28fc61a1f669 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.160896 Jun 25 20:57:39.144041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 684/1539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:38 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:39.160726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-756829964"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:39.162017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:39.168975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.169424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.170183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.170784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.269738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:39.278038 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd722e4d-90a7-4bd0-a38e-c7132bf3aa01 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.169626 Jun 25 20:57:39.278605 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 856/1540] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:39 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:39.283164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1400053380", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7ef2b2be-dae0-4c92-af7f-25bfe52fff3b"}], "block_device_mapping_v2": [{"uuid": "74f093be-e96a-4a80-ad38-abd3f5585611", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:39.291285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:39.293530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:39.365664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] validate_networks() for [('7ef2b2be-dae0-4c92-af7f-25bfe52fff3b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:39.453615 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0cdea82f-e522-4e7d-878e-5de8461fd1ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action" status: 202 len: 0 microversion: 2.1 time: 0.296752 Jun 25 20:57:39.454261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 685/1541] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:57:39 2022] POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Jun 25 20:57:39.465129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1859259995"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:39.466253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:39.472941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.473388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.474181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.474625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.507913 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Cannot 'createImage' instance d91bd66b-2391-4c6c-a25b-679179fdbc1a while it is in task_state image_snapshot_pending Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action HTTP/1.1 Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 85 Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:57:39.509547 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1859259995"}} Jun 25 20:57:39.510930 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'createImage' instance d91bd66b-2391-4c6c-a25b-679179fdbc1a while it is in task_state image_snapshot_pending Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1859259995'}}} Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:39.511671 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance d91bd66b-2391-4c6c-a25b-679179fdbc1a while it is in task_state image_snapshot_pending Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance d91bd66b-2391-4c6c-a25b-679179fdbc1a while it is in task_state image_snapshot_pending Jun 25 20:57:39.513010 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:39.514198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 409 to user: Cannot 'createImage' instance d91bd66b-2391-4c6c-a25b-679179fdbc1a while it is in task_state image_snapshot_pending {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:39.514198 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9896e79f-5321-4747-8f38-004e738caaec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action" status: 409 len: 167 microversion: 2.1 time: 0.050552 Jun 25 20:57:39.514198 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 686/1542] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:57:39 2022] POST /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a/action => generated 167 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 25 20:57:39.516206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:39.516837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:39.523220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.523656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.524433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.524871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.683018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:39.692773 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e0b0c59-7d53-492d-af85-42dc19cc6ece tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.180182 Jun 25 20:57:39.693514 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 687/1543] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:39 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:39.698645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a744b41-d473-4e74-8afc-3679800a209c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f985c0665e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:39.836300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a744b41-d473-4e74-8afc-3679800a209c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/images/eaf07941-cf99-4467-9138-c87f339a45d4" status: 204 len: 0 microversion: 2.1 time: 0.141423 Jun 25 20:57:39.837300 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 688/1544] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:39 2022] DELETE /compute/v2.1/images/eaf07941-cf99-4467-9138-c87f339a45d4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:39.841873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:39.842482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:39.849212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.849656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.850418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:39.850845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:39.983101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:39.992351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4621ea33-509c-4866-8ab4-d9c506a82c1d tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.154025 Jun 25 20:57:39.993070 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 689/1545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:39 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:40.006416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.007030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.013098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.013491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.014271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.014713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.059058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:40.059570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:40.059990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:40.060407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:40.060847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:40.071161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.071620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.072465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.072926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.093522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:40.097838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Getting quotas for user 39e82edaa30d418d96ea37f942d62755 and project 6a2d8b5c82f44807b9d01252ea17cff9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:40.151132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.159034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d21f3dbb-5b14-4712-b316-0556d319ac7a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.156473 Jun 25 20:57:40.159459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:40.159911 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 690/1546] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:39 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:40.161763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='74f093be-e96a-4a80-ad38-abd3f5585611',volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:40.164608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.170455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.177867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.178325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.179240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.179679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.308731 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b127eb9a-d33d-4017-ac2c-445882f9f6bd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.028806 Jun 25 20:57:40.314536 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 857/1547] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 20:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 20:57:40.319695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.320315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.322823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.327811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.328278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.329274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.329720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.331663 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dce14139-f32f-4ea0-9c4b-da9a59f51117 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1540 microversion: 2.1 time: 0.170550 Jun 25 20:57:40.332317 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 691/1548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:40 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:40.337773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.338928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.345755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.346208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.346988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.347615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.508021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.518112 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d2e133a-7082-4a45-8c7a-66ab2ad6b755 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 200 len: 1522 microversion: 2.1 time: 0.201858 Jun 25 20:57:40.519055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 858/1549] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:40 2022] GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:40.533923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.534628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.597022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.617506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.622637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.623632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.625440 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6a7fdfe-e38b-4091-84f1-a4a593bb67e5 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1104 microversion: 2.25 time: 0.104988 Jun 25 20:57:40.625440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 859/1550] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:40 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1104 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:40.630515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3e8c48e3-ce70-4aea-9d7f-000c5c090dba tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.296685 Jun 25 20:57:40.631669 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 692/1551] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:40 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:40.710269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:40.710955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:40.719309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.719760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.720783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:40.720995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:40.882938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:40.890950 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ceac037-cc93-4007-954a-69d0afe0a351 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.185688 Jun 25 20:57:40.892079 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 860/1552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:40 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:41.009779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.010666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.018514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.019140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.020253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.020874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.175737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.182495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.204780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.206653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.210073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.210663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.348931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.352697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:41.357580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7530b8de-abef-4389-a643-7961ee3c3c64 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.185756 Jun 25 20:57:41.358187 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 861/1553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:41.365452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.366065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.372740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.373198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.374027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.374494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.385392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.395154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da50745b-caa5-47f0-bc89-c83ccf6d37eb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.389395 Jun 25 20:57:41.396115 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 693/1554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:41.530397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.540144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abb5ea4f-400c-47de-bbf1-8799099e41dd tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1532 microversion: 2.1 time: 0.178527 Jun 25 20:57:41.541117 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 862/1555] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1532 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:41.543812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.544492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.551462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.551902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.552738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.553256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.643953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.653171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.653901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.657624 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b8eacbb-2012-4928-8262-d469715bcbce tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 200 len: 1480 microversion: 2.1 time: 0.118444 Jun 25 20:57:41.658255 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 694/1556] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 1480 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:41.663283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.676481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.676481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.676481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.683968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.685928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.692125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.692904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.693937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.694869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.869715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.875308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:41.889219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.895795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:41.897240 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77233dab-97f4-4ddc-bb31-2816d2f6e160 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1177 microversion: 2.25 time: 0.237701 Jun 25 20:57:41.898010 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 695/1557] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1177 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:41.918043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:41.919143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:41.941590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.942044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.943047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:41.943483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:41.999172 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38ae5412-3625-4a4b-82d9-22767b408b84 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097186 Jun 25 20:57:42.000861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 696/1558] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:42.008250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-477b09be-10c3-4208-be2c-55a87e574d33 req-1544f6dd-c8fd-419c-b83a-b0a39546fd14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de80939b-d842-449d-a2ce-daa00ec9d501", "name": "network-vif-deleted", "tag": "94e55b2e-f52a-488a-b7e6-5d963332eea0"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:42.016387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:42.022626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-477b09be-10c3-4208-be2c-55a87e574d33 req-1544f6dd-c8fd-419c-b83a-b0a39546fd14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.024461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-477b09be-10c3-4208-be2c-55a87e574d33 req-1544f6dd-c8fd-419c-b83a-b0a39546fd14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.029605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c21a7db-c4cf-442b-9397-7b89dd5887a0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.384512 Jun 25 20:57:42.033020 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 863/1559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:41 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:42.041323 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-477b09be-10c3-4208-be2c-55a87e574d33 req-1544f6dd-c8fd-419c-b83a-b0a39546fd14 service nova] Creating event network-vif-deleted:94e55b2e-f52a-488a-b7e6-5d963332eea0 for instance de80939b-d842-449d-a2ce-daa00ec9d501 on nch1-master-1 Jun 25 20:57:42.043713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.047117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.048456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-477b09be-10c3-4208-be2c-55a87e574d33 req-1544f6dd-c8fd-419c-b83a-b0a39546fd14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045716 Jun 25 20:57:42.049271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 697/1560] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:42.055695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.055924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.057332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.057857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.058638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.059303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.067152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.067607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.068391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.068913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.221578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lazy-loading 'services' on Instance uuid ff14b19d-5125-4e28-ba7d-47329c4b0529 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:57:42.237274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:42.251299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e9a8a43-2be1-49bd-9cca-e205dce351b4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.216637 Jun 25 20:57:42.252596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 864/1561] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:42.264964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-acf3840f-bf97-455e-bd6b-52660022e618 req-e07f7216-de75-4e54-bd10-3882ebd0ec5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65be067-d27c-4249-b7dc-e5a5e54d588e", "name": "network-vif-plugged", "status": "completed", "tag": "7d5fe1e2-0e84-4aaf-9146-b811576250d7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:42.274214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-acf3840f-bf97-455e-bd6b-52660022e618 req-e07f7216-de75-4e54-bd10-3882ebd0ec5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.274716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-acf3840f-bf97-455e-bd6b-52660022e618 req-e07f7216-de75-4e54-bd10-3882ebd0ec5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.288695 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-acf3840f-bf97-455e-bd6b-52660022e618 req-e07f7216-de75-4e54-bd10-3882ebd0ec5f service nova] Creating event network-vif-plugged:7d5fe1e2-0e84-4aaf-9146-b811576250d7 for instance a65be067-d27c-4249-b7dc-e5a5e54d588e on nch2-master-1 Jun 25 20:57:42.294340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-acf3840f-bf97-455e-bd6b-52660022e618 req-e07f7216-de75-4e54-bd10-3882ebd0ec5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040305 Jun 25 20:57:42.296704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 865/1562] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:42.373792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5d633c0-fbbd-4854-bb8e-352255157609 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments/6dd8ada4-2839-42a5-ac94-ae375a885f43" status: 202 len: 0 microversion: 2.1 time: 0.322595 Jun 25 20:57:42.377318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 698/1563] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 20:57:42 2022] DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments/6dd8ada4-2839-42a5-ac94-ae375a885f43 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:57:42.377463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.377463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.400300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.402783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.403686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.404110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.413611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.414319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.428366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.428921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.429626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.430259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.573450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:42.583049 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8894362e-c9d8-43c8-869c-42fb841f5f14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.210832 Jun 25 20:57:42.584328 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 866/1564] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:42.589803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.590605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.603000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.603724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.604898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.605548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.769770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:42.781186 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f79f21df-863e-4485-8147-2f61fadb59d2 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.372670 Jun 25 20:57:42.785416 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 699/1565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:42.790664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.797380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: de80939b-d842-449d-a2ce-daa00ec9d501] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.811485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.817497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.818586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.819219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.856625 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] HTTP exception thrown: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 HTTP/1.1 Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:57:42.862042 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. Jun 25 20:57:42.863769 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'de80939b-d842-449d-a2ce-daa00ec9d501'} Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:42.864790 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. Jun 25 20:57:42.866276 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:42.868248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 404 to user: Instance de80939b-d842-449d-a2ce-daa00ec9d501 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:42.871233 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-856edd0d-3ea5-4f92-be46-c17aa6c4bd15 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501" status: 404 len: 111 microversion: 2.1 time: 0.083814 Jun 25 20:57:42.876468 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 700/1566] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/de80939b-d842-449d-a2ce-daa00ec9d501 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:42.885466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:42.887509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.894744 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c531607-df8e-4028-9d84-0ab5f266b0c7 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1538 microversion: 2.1 time: 0.308924 Jun 25 20:57:42.899713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.915484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 867/1567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1538 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:42.917534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.920332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.921265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.921808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.923249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:42.923889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:42.931522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.931972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.932798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.935242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.986570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:42.987337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:42.987991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lazy-loading 'fault' on Instance uuid 6b534da3-5074-41e2-931a-0c7ab761dc89 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:57:43.008339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.017218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.018746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.019984 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-882c0723-5f41-49a2-9c00-e35252ecc2d2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1241 microversion: 2.25 time: 0.103295 Jun 25 20:57:43.020598 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 868/1568] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:43.050525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:43.051405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:43.058892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.059586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.060794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.061486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.212710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.222063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bb7ee5e-6284-4fb2-9e41-99d77247217c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.175542 Jun 25 20:57:43.223080 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 869/1569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:43 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:43.268773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:43.270529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:43.278356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.278809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.279608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.280076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.348607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9793101e6554c61bd3276d4290c0331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fc39b845ba24fc49935ae2ecbf9eefc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.356604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-224c3869-8bad-4f4c-a9cb-9e0089f0b78a tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 200 len: 1312 microversion: 2.1 time: 0.477703 Jun 25 20:57:43.357507 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 701/1570] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:42 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 1312 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:43.415325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:43.423207 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17b89ab6-6464-43bb-b61d-b2e4979be4fc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.158554 Jun 25 20:57:43.423800 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 870/1571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:43 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:43.601155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:43.601762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:43.611835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.612705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.619913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.620795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.803141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:43.803847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:43.810832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.811718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:43.812742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:43.813349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.032017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.045843 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e18f4109-5390-419c-807e-d6d2327b6159 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.244035 Jun 25 20:57:44.046561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 871/1572] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:43 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:44.053068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.053946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.064727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.066327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.072566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.082695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.085420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.087641 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4675a3e-4ebd-4f91-a218-bd0924e83efa tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.487321 Jun 25 20:57:44.089842 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 702/1573] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:43 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:44.102218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.103102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.110460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.111225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.112481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.113119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.235583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.243907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.246922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.247725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.248706 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5f3e4b0-3a9e-40ea-b49c-1a72864757f2 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1251 microversion: 2.25 time: 0.156198 Jun 25 20:57:44.249827 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 703/1574] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1251 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:44.255520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b534da3-5074-41e2-931a-0c7ab761dc89", "name": "network-vif-deleted", "tag": "93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f"}, {"server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:44.257151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-046c5741-bc57-48ed-b023-bb95d9f4c482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1520 microversion: 2.1 time: 0.208741 Jun 25 20:57:44.268119 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 872/1575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:44.268119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.268119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.270521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.271097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.271951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.272555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.287500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.288589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.308610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] Creating event network-vif-deleted:93c6bdd1-0eb7-4c15-9813-e0270cb7fb4f for instance 6b534da3-5074-41e2-931a-0c7ab761dc89 on nch2-master-1 Jun 25 20:57:44.309346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] Creating event network-vif-unplugged:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:57:44.320228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-013fe760-ea94-435f-9ab5-c90bee5328f1 req-a87fef30-7734-43b3-bbb8-ceb20f4cd63a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.068376 Jun 25 20:57:44.322305 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 704/1576] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:44.328673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.329346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.337574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.338089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.338864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.339367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.374586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:44.433248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.444142 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-98320908-2521-48bd-9b30-d766d4a1aa8a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.184842 Jun 25 20:57:44.445083 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 873/1577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:44.450372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a73ec52f-26a0-4533-bf72-54a32b8ce0d7 req-0ef89bee-ce8c-4758-b678-ee1cddc7865f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7335cff-0cba-4acd-8c67-5ae7c8bdbf99", "name": "network-vif-plugged", "status": "completed", "tag": "01332024-f454-43ee-8562-8a92172352de"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:44.460617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a73ec52f-26a0-4533-bf72-54a32b8ce0d7 req-0ef89bee-ce8c-4758-b678-ee1cddc7865f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.461337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a73ec52f-26a0-4533-bf72-54a32b8ce0d7 req-0ef89bee-ce8c-4758-b678-ee1cddc7865f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.475659 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a73ec52f-26a0-4533-bf72-54a32b8ce0d7 req-0ef89bee-ce8c-4758-b678-ee1cddc7865f service nova] Creating event network-vif-plugged:01332024-f454-43ee-8562-8a92172352de for instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 on nch1-master-1 Jun 25 20:57:44.481016 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a73ec52f-26a0-4533-bf72-54a32b8ce0d7 req-0ef89bee-ce8c-4758-b678-ee1cddc7865f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034345 Jun 25 20:57:44.482351 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 874/1578] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:44.489163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.490285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] [instance: 6b534da3-5074-41e2-931a-0c7ab761dc89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.509021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-748e7742-8a5f-444b-b90d-84354a75da8d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 204 len: 0 microversion: 2.1 time: 0.183313 Jun 25 20:57:44.510355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 705/1579] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:44 2022] DELETE /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:44.511402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.512115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.513148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.513977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.524610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.525485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.530363 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] HTTP exception thrown: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. Jun 25 20:57:44.532956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Request method failure captured: Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 HTTP/1.1 Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aWt7q_AUiG-yT0cHzjEO-rUBVXwdmY6wtEnKv2csc7Fyl71wq1I5sYPngyBhLbpZfsQvQfkrlv-S7-wEen-yffeBqC2ZT8QvsnwUhMh2fxyGwUd-8gcfPPfXAeSWR8gmBgJPrSih_HgAp4tAf9vGtY_s9Lx0ENdLVVYbbEa1GvXYU Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:44.533295 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5fc39b845ba24fc49935ae2ecbf9eefc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5fc39b845ba24fc49935ae2ecbf9eefc"}]}] Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5fc39b845ba24fc49935ae2ecbf9eefc Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-689066626 Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b9793101e6554c61bd3276d4290c0331 Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListServersNegativeTestJSON-689066626-project Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. Jun 25 20:57:44.534911 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6b534da3-5074-41e2-931a-0c7ab761dc89'} Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:44.535831 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. Jun 25 20:57:44.537430 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:44.538615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.539396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] Returning 404 to user: Instance 6b534da3-5074-41e2-931a-0c7ab761dc89 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:44.539569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.540117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.540247 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57d21801-d598-4765-b717-6b27b06d6398 tempest-ListServersNegativeTestJSON-689066626 tempest-ListServersNegativeTestJSON-689066626-project] 10.222.0.39 "GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89" status: 404 len: 111 microversion: 2.1 time: 0.056468 Jun 25 20:57:44.541136 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 875/1580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/6b534da3-5074-41e2-931a-0c7ab761dc89 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:44.550409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.551080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.562758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.563208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.563980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.572752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.882216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:44.890340 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae80bddf-8c07-48fb-8fb5-80976c1bb1bb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.373762 Jun 25 20:57:44.890936 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 706/1581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:44.906037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:44.906986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:44.915026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.915495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:44.916402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:44.917018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.002225 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99475e9a-0e96-4fdf-b242-1f749f3d1ad7 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099507 Jun 25 20:57:45.007403 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 707/1582] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments => generated 25 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:45.068256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.069085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.073261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:45.083893 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea267c5d-afe1-4645-86cc-724bf7106504 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1526 microversion: 2.1 time: 0.541813 Jun 25 20:57:45.094499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 876/1583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:44 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1526 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:45.104905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.107706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.108388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.109799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.112587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.113758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.148402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.149432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.150393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.150847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.464658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:45.474267 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-741d549f-3f9e-42c1-9969-5331cbdd044d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.371474 Jun 25 20:57:45.475601 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 877/1584] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:45 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:45.482485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.489847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.499713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.500662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.502081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.502769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.533329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:45.545411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92d87491-043b-4c47-b687-244ec2ee9a6c tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1314 microversion: 2.1 time: 0.485445 Jun 25 20:57:45.551821 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 708/1585] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:45 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:45.559784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.560794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.568046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.573717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.575154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.577481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.599236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8741ab74-24e5-45ad-80b5-d19e99e7d4eb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122029 Jun 25 20:57:45.600504 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 878/1586] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:57:45 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529/os-volume_attachments => generated 25 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:57:45.622735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.627085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.647322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.650028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.652168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.655197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.957132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:45.973717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da8a931c-0898-4edf-ad72-a29d9d6264ab tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.371045 Jun 25 20:57:45.974670 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 879/1587] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:45 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:45.980658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:45.981431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:45.992699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.994094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:45.995057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:45.995879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.052177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:46.056309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.061080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:46.073794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.075699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.080543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-41af041f-3c07-4f8a-bb27-5fa83dfd712b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.523829 Jun 25 20:57:46.081307 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 709/1588] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:45 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:46.093652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:46.094438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:46.098243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:46.113941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.114393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.115370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.115943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.195242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f49e3487-6c94-41da-bf71-e7c73cb9d1ee tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 204 len: 0 microversion: 2.1 time: 0.219051 Jun 25 20:57:46.195861 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 880/1589] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:45 2022] DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:46.211033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:46.212738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:46.220270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.220757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.221542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.222026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.545954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.556307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.556849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc73fc9d-d780-4a93-b5a9-9dafc4284ec7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.466557 Jun 25 20:57:46.566159 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 710/1590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:46 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:46.567694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11a066cd-4a2a-4f4a-9b7c-55aeeb95cf4e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1526 microversion: 2.1 time: 0.369704 Jun 25 20:57:46.568344 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 881/1591] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:46 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1526 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:46.571595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:46.572207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:46.573592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8dd53466-59ff-44e5-b1b4-de952d4c0621 req-375172e5-a0f2-4989-b733-dc6a3f2fca0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:46.578349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.579023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.579946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.580556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.606555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8dd53466-59ff-44e5-b1b4-de952d4c0621 req-375172e5-a0f2-4989-b733-dc6a3f2fca0e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.607147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8dd53466-59ff-44e5-b1b4-de952d4c0621 req-375172e5-a0f2-4989-b733-dc6a3f2fca0e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.625434 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8dd53466-59ff-44e5-b1b4-de952d4c0621 req-375172e5-a0f2-4989-b733-dc6a3f2fca0e service nova] Creating event network-changed:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:57:46.633798 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8dd53466-59ff-44e5-b1b4-de952d4c0621 req-375172e5-a0f2-4989-b733-dc6a3f2fca0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063186 Jun 25 20:57:46.635179 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 882/1592] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:46.642055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:46.651371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:46.659730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.660569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.661483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.662039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.899334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:46.908790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d59a9a0-3d33-4768-9d59-17119012ca96 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1307 microversion: 2.1 time: 0.271869 Jun 25 20:57:46.909393 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 883/1593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:46 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1307 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:46.918916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:46.919717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:46.926817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.927329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:46.928306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:46.928704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.001734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.005849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:47.019405 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16ba27c7-2de4-49a8-a5ac-48b13da69201 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1676 microversion: 2.1 time: 0.451381 Jun 25 20:57:47.020072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 711/1594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:46 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1676 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:47.037956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.038787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:47.047058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.048667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.049055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.049512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.172463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.184562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-758e54a5-1257-4e37-9c4a-5a0fbe6eabcb tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1463 microversion: 2.1 time: 0.273786 Jun 25 20:57:47.198595 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 884/1595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:46 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1463 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:47.204148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.205124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:47.224047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.224988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.226337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.227018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.432038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:47.469250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.489277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dfd08cc1-11c3-403f-bf46-a1cc949176e4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.455842 Jun 25 20:57:47.498921 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 712/1596] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:47.526620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:47.553446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.565573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Calling method '.version_select at 0x7f985c066f70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.588409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.588409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.598676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.599122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.613054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.621981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.624820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8ff4c11-6353-48d1-b128-695f144b1534 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.424638 Jun 25 20:57:47.638920 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7adbfae2-94d3-493d-b410-1bbe03501847 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/cac44a003ea94dfba170af264c2412ed?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535" status: 200 len: 695 microversion: 2.1 time: 0.134428 Jun 25 20:57:47.638920 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 713/1597] 10.222.0.39 () {58 vars in 1411 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/os-simple-tenant-usage/cac44a003ea94dfba170af264c2412ed?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535 => generated 695 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:47.639159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 885/1598] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:47.641352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.643048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:47.662180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.662681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.663574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.663957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.667108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.668126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:47.683835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.684714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.685677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.686306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.799249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:47.817380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-faedc051-6f3b-47bd-9489-77298e71df5f tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 200 len: 1484 microversion: 2.1 time: 0.178698 Jun 25 20:57:47.821350 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 886/1599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 1484 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:47.841204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '.version_select at 0x7f984ff790d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.862881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.863363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.893471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.894310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.929415 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-114c8756-5257-4c7e-b51c-014514b2d549 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage/cac44a003ea94dfba170af264c2412ed?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535" status: 200 len: 695 microversion: 2.1 time: 0.104686 Jun 25 20:57:47.930892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 887/1600] 10.222.0.39 () {58 vars in 1411 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/os-simple-tenant-usage/cac44a003ea94dfba170af264c2412ed?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535 => generated 695 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:47.935844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:47.936672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:47.949292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.949953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.951058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:47.951671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:47.995678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:48.004940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da260a03-ed9f-467f-a7c5-8fb0c0f16762 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.368019 Jun 25 20:57:48.015647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 714/1601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:48.022261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Calling method '.version_select at 0x7f984fe59670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.031232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.031920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.048502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.049260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.136053 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee745090-12e9-46c2-96a3-74ef985ba688 tempest-TenantUsagesTestJSON-1145298960 tempest-TenantUsagesTestJSON-1145298960-project-admin] 10.222.0.39 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535&detailed=1" status: 200 len: 20190 microversion: 2.1 time: 0.118531 Jun 25 20:57:48.137378 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 715/1602] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Jun 25 20:57:48 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-06-24T20%3A57%3A47.194535&end=2022-06-26T20%3A57%3A47.194535&detailed=1 => generated 20190 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:57:48.142135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.142939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:48.152906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.153621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.154668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.155105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.182729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:48.200109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9247245-4d01-427c-ace9-aca325537be2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1487 microversion: 2.1 time: 0.267901 Jun 25 20:57:48.201040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 888/1603] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:47 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1487 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:48.206911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.208037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:48.217300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.218786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.221846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.222841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.256311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:57:48.372809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f218250e-02eb-45cb-8798-1b34f1e7f3e5 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 204 len: 0 microversion: 2.1 time: 0.168470 Jun 25 20:57:48.373938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 889/1604] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:48 2022] DELETE /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:57:48.388919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee5ee5bf-c12e-4e1b-bf76-1e51083c05c4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:48.397049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5bf-c12e-4e1b-bf76-1e51083c05c4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.397604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee5ee5bf-c12e-4e1b-bf76-1e51083c05c4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.444118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee5ee5bf-c12e-4e1b-bf76-1e51083c05c4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 20:57:48.512145 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee5ee5bf-c12e-4e1b-bf76-1e51083c05c4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99/action" status: 202 len: 0 microversion: 2.1 time: 0.136311 Jun 25 20:57:48.513571 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 890/1605] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:57:48 2022] POST /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:57:48.538337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.539048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:48.550557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.551041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.552250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.552734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.778667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:48.790754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3e1618f-4e36-438d-a25b-b562a9be1364 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1469 microversion: 2.1 time: 0.275404 Jun 25 20:57:48.792802 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 891/1606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:48 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:48.797511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.798120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:48.804291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:48.816235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.816755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.818935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.819376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.826441 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8c5e5f0-3c2b-4dc9-875a-d9422213dc0a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1676 microversion: 2.1 time: 0.675617 Jun 25 20:57:48.827324 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 716/1607] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:48 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1676 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:48.840021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:48.840484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:48.849304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.849766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.850550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:48.851126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:48.996993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.007778 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d14f51b-110d-4d3d-b1bf-11fc4bf5ca21 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.178321 Jun 25 20:57:49.017955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 717/1608] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:48 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:49.017955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:49.017955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:49.022097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.022805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.024462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.025147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.055707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.066249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecba1fe0-5e35-4cb0-a70f-e0fcd1a1fd02 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.272339 Jun 25 20:57:49.076118 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 892/1609] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:48 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:49.081604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}, {"server_uuid": "d91bd66b-2391-4c6c-a25b-679179fdbc1a", "name": "network-vif-deleted", "tag": "52968236-0245-45d5-854a-e954662fe7da"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:49.086222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:49.091378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.091820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.109921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] Creating event network-changed:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch2-master-1 Jun 25 20:57:49.110451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] Creating event network-vif-deleted:52968236-0245-45d5-854a-e954662fe7da for instance d91bd66b-2391-4c6c-a25b-679179fdbc1a on nch1-master-1 Jun 25 20:57:49.119700 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0154770e-aa3f-4d88-a1cd-374d26472f62 req-e576d9cb-76ab-4976-8ad3-2f78964769cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042220 Jun 25 20:57:49.120621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 893/1610] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:49.126479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:49.127438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:49.135940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.136397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.137396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.137841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.156203 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a HTTP/1.1 Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:49.158047 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:57:49.159735 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a'} Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:49.162035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:57:49.163558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:49.165027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:49.165027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bcbec3d-9055-4f57-b6c3-db3d3654a707 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 404 len: 111 microversion: 2.1 time: 0.037860 Jun 25 20:57:49.165027 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 894/1611] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:49 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:49.165631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:49.166093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:49.172565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.173018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.173835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.174410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.194266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:49.325369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.335325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e71d716-4a57-4736-a92b-890c973df772 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.173131 Jun 25 20:57:49.336090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 895/1612] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:49 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:49.350046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63da8f5b-66ae-4763-b10e-f7f15e8aabc4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'create', calling method: .version_select at 0x7f984f913a60>, body: {"keypair": {"name": "tempest-keypair-1718623343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzWSdwjMiey5jTp0Rn0hXz+SuCqnWpJzGOwobS4+h9RPHk4BHQNwPgq6d+2SsOzm0sil+fW+WLsShyEFmNJhkzJjHQ4Ic/epXa0U5SCelV6C/OVWatSkfzydAu/+PP98A=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:49.370058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-63da8f5b-66ae-4763-b10e-f7f15e8aabc4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for project fd2dd16178804914b9afde659428992f. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:49.375137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-63da8f5b-66ae-4763-b10e-f7f15e8aabc4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for user 662ef2b3df5e4c59b373fccab9c911c2 and project fd2dd16178804914b9afde659428992f. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:49.382084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.396403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.398815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:49.400268 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-edb304fc-36ff-41b4-89ee-121f626d1bfc tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.390720 Jun 25 20:57:49.401095 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 718/1613] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:49 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:49.413450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63da8f5b-66ae-4763-b10e-f7f15e8aabc4 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068831 Jun 25 20:57:49.419301 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 896/1614] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:57:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:49.807485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:49.808038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:49.815360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.815809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.818129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.818830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.844013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:49.844667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:49.854527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.855697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:49.861133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:49.861578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.035473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:50.048917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-233550ea-510e-4a80-9b92-9250a31e780d tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1676 microversion: 2.1 time: 0.208793 Jun 25 20:57:50.049787 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 897/1615] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:49 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:50.055042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:50.055896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:50.063557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.067133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.068013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.068713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.250477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:50.258684 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16de334e-b078-41e8-9a35-041e3ae5fa91 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.207676 Jun 25 20:57:50.259545 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 898/1616] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:50 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:50.264978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:50.265740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:50.276007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.276726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.277564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.278044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.286574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:50.300139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4dc49a33-61ee-48d4-85b3-a848258aadbf tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1469 microversion: 2.1 time: 0.496582 Jun 25 20:57:50.323556 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 719/1617] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:49 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1469 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:50.353771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:50.354551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:50.368219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.369002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.370046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.370707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.480245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:50.492801 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8b02ced-dec0-4bfc-b699-537b7b4962e5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.231941 Jun 25 20:57:50.494180 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 899/1618] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:50 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:50.787182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:50.788053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:50.815297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.816333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.817449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:50.818072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:50.843636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:50.853609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc9a140b-279e-4471-a08a-58e22d103b7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.504249 Jun 25 20:57:50.864058 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 720/1619] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:50 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:51.072312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.074296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:51.076287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:51.097641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.098801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.100105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.102751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.103329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.106787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.108243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f4c9da7f-ede0-4aab-aafa-879ca1358a0b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.612622 Jun 25 20:57:51.110309 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 900/1620] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:50 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:51.276927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:51.278566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:51.286716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.287383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.288435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.289153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.424512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.435563 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d1a89c3-49d0-4b6d-9b3e-3e7280c8a4bb tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1676 microversion: 2.1 time: 0.372695 Jun 25 20:57:51.436385 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 721/1621] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:51 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1676 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:51.441634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:51.445306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:51.464021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.464569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.467011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.467610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.548132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.575086 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c69ff120-f6a2-433b-a12a-7d2d921077d4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.301428 Jun 25 20:57:51.576989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 901/1622] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:51 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:51.580326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.592897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8e94aba-c542-498f-ab37-b540998157a0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1427 microversion: 2.1 time: 0.154836 Jun 25 20:57:51.595562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:51.596253 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 722/1623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:51 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:51.597253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:51.605539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ef95e29f-5c00-48b5-be02-bda53a2b0751 req-f36b18f7-b057-4bb6-8f08-ddd8d9793f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65be067-d27c-4249-b7dc-e5a5e54d588e", "name": "network-vif-deleted", "tag": "7d5fe1e2-0e84-4aaf-9146-b811576250d7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:51.606047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.606760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.607868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.608731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.626401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ef95e29f-5c00-48b5-be02-bda53a2b0751 req-f36b18f7-b057-4bb6-8f08-ddd8d9793f2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.633147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ef95e29f-5c00-48b5-be02-bda53a2b0751 req-f36b18f7-b057-4bb6-8f08-ddd8d9793f2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.658127 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ef95e29f-5c00-48b5-be02-bda53a2b0751 req-f36b18f7-b057-4bb6-8f08-ddd8d9793f2e service nova] Creating event network-vif-deleted:7d5fe1e2-0e84-4aaf-9146-b811576250d7 for instance a65be067-d27c-4249-b7dc-e5a5e54d588e on nch2-master-1 Jun 25 20:57:51.667859 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ef95e29f-5c00-48b5-be02-bda53a2b0751 req-f36b18f7-b057-4bb6-8f08-ddd8d9793f2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070232 Jun 25 20:57:51.668774 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 723/1624] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:51.846771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:51.856805 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29e36816-9769-41c1-aa0f-dbb6bf7df2d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.265353 Jun 25 20:57:51.867484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 902/1625] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:51 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:51.872510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:51.873579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:51.882378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.883898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:51.884696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:51.885130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.132533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:52.134158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:52.148764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.165598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.166479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.166927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.213369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.221317 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7635c6d-4d38-43d3-8ef8-5208322ca4c8 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.353330 Jun 25 20:57:52.221920 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 724/1626] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:51 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:52.357698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.370022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.372172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.374184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c5f1163-72bc-460a-ab32-31ab668f7875 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.247928 Jun 25 20:57:52.384494 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 903/1627] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:52 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:52.426352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-198586783", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:52.453838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:52.455135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:52.462359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.463039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.463964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.464571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.488620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] validate_networks() for [('5f5ddf21-0e70-4c38-91b7-fe48bd042905', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:57:52.538283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.547045 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ff120ba-cce1-4a4f-850d-96527a473143 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1608 microversion: 2.1 time: 0.097030 Jun 25 20:57:52.548362 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 904/1628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:52 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1608 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:52.594620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:52.595337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:52.602299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.602759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.603568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.604007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.755046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.763709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f830d3d7-ace3-47f4-adc1-3928ed739a5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.173314 Jun 25 20:57:52.764480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 905/1629] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:52 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:52.769438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:52.770237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:52.776584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.777166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.778064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.778607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.847231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:52.865066 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1d3b5b7-61f5-4642-820c-4dcad0b516b0 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1427 microversion: 2.1 time: 0.099411 Jun 25 20:57:52.866090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 906/1630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:52 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1427 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:52.875591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:52.876377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:52.883034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.883613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:52.885235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:52.885757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.059202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.069462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1aa51d57-6952-4f85-9541-d6d7c170362f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.197778 Jun 25 20:57:53.070797 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 907/1631] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:52 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:53.240715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:53.242505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:53.250630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.251391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.252257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.252812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.402875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.420255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0641b2f4-f8d5-46dd-a82a-f982a82ba7d4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.185600 Jun 25 20:57:53.421626 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 908/1632] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:53 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:53.437734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:53.439888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:53.451952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.452984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.454806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.455874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.523811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:57:53.524865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:57:53.525886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:57:53.526512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:57:53.527847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:57:53.545812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.546640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.547807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.548633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.578151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:57:53.586010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for user 662ef2b3df5e4c59b373fccab9c911c2 and project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:57:53.601247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:57:53.603839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:57:53.697489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6e92a86-9b60-46bf-b487-904ea1c3f0b6 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.275784 Jun 25 20:57:53.701112 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 725/1633] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:57:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:57:53.708658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.714498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:53.717103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:53.723162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.726962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.730480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.732279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.733662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.734504 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c92007ec-6dea-4fa8-8320-4c7bccabb382 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.308627 Jun 25 20:57:53.735553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.744110 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 909/1634] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:53 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:53.749315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-dc942a07-3af8-412a-8d91-0922495a5d36 req-59ffeb5a-1195-4265-899a-8ed5b2641f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff14b19d-5125-4e28-ba7d-47329c4b0529", "name": "network-vif-deleted", "tag": "52fe34cc-908a-4760-a1bd-ea8e1b504505"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:53.778280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.779158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.779957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lazy-loading 'fault' on Instance uuid ff14b19d-5125-4e28-ba7d-47329c4b0529 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:57:53.786158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc942a07-3af8-412a-8d91-0922495a5d36 req-59ffeb5a-1195-4265-899a-8ed5b2641f35 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.788490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc942a07-3af8-412a-8d91-0922495a5d36 req-59ffeb5a-1195-4265-899a-8ed5b2641f35 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.832993 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-dc942a07-3af8-412a-8d91-0922495a5d36 req-59ffeb5a-1195-4265-899a-8ed5b2641f35 service nova] Creating event network-vif-deleted:52fe34cc-908a-4760-a1bd-ea8e1b504505 for instance ff14b19d-5125-4e28-ba7d-47329c4b0529 on nch2-master-1 Jun 25 20:57:53.840018 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-dc942a07-3af8-412a-8d91-0922495a5d36 req-59ffeb5a-1195-4265-899a-8ed5b2641f35 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094495 Jun 25 20:57:53.840686 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 910/1635] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:53.846932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84fbe1c9-7e2a-4e2c-a485-7a941fa75594 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:53.848245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84fbe1c9-7e2a-4e2c-a485-7a941fa75594 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:53.872405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a8cd690a02e4b47afb24d9d4dba52b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c734d57dbb974b2bba1efc21917a7269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:53.885861 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94a3523d-fd47-44b1-a5f2-2586cf916d6e tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 200 len: 1328 microversion: 2.1 time: 0.182912 Jun 25 20:57:53.886993 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 726/1636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:53 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:53.891896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:53.892545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:53.899211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.899673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.900474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:53.901945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:53.997591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84fbe1c9-7e2a-4e2c-a485-7a941fa75594 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:54.006518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84fbe1c9-7e2a-4e2c-a485-7a941fa75594 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1224 microversion: 2.1 time: 0.164351 Jun 25 20:57:54.007116 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 911/1637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:53 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1224 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:54.027734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.031203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:54.044103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.049861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.053164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.055088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.111434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.112129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.112964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lazy-loading 'fault' on Instance uuid a65be067-d27c-4249-b7dc-e5a5e54d588e {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:57:54.246646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab974f6a346044b39b4e0a9a57ce4dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cac44a003ea94dfba170af264c2412ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:54.263871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c93c0d8e-86f8-4f3b-b7a5-dbe786eb9f39 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 200 len: 1304 microversion: 2.1 time: 0.246004 Jun 25 20:57:54.265409 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 912/1638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:54 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 1304 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:54.275983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:54.281440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.286300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:54.291199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d2c5e05-77ab-4579-849b-1280e8723fb0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.402983 Jun 25 20:57:54.296791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 727/1639] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:53 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:54.314269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.315364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.317164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.319420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.441580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.442354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:54.449178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.449681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.450579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.454820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.762277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:54.777343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b37568bd-a79a-4431-aee0-ac700b593d53 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.509877 Jun 25 20:57:54.780770 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 913/1640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:54 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:54.791654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.792271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:54.808298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.816135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.817102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.817551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.829553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:54.840534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9942fd51-9766-4dc7-a95f-93f4b9ac9550 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.404464 Jun 25 20:57:54.841524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 728/1641] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:54 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:54.854052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:54.903520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.904279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:54.911229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.911672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.912600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:54.913256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:54.931672 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] HTTP exception thrown: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Request method failure captured: Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 HTTP/1.1 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3YC4dzAtaZIAUkpBWbJPvYL--TOPDdNf-d_XeOJqSim4COxHiHLSHnkRG8spbjCb4cg3z17XRvDl3UtzlU27mNKY5CVY_ZiRnwk9zIX3NkVm_KH6B2ihp0Nm60TJSCrRJir8u6tXDUAxETO4UvUZj1T6JoFB0ZMPl09Sy6KXC_mwPw Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:57:54.931864 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}] Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9a8cd690a02e4b47afb24d9d4dba52b9 Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:54.933830 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ff14b19d-5125-4e28-ba7d-47329c4b0529'} Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:54.934687 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:54.936261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:57:54.937748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Returning 404 to user: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:54.937748 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac9ad1c2-673e-4805-af44-4fd6997bb5cc tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 404 len: 111 microversion: 2.1 time: 0.033914 Jun 25 20:57:54.940504 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 729/1642] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:54 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 20:57:54.947742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7dfc184-72a8-47bc-87a0-f7bfabb1faad tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '.version_select at 0x7f984fd81940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:54.973007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7dfc184-72a8-47bc-87a0-f7bfabb1faad tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984068" status: 202 len: 0 microversion: 2.1 time: 0.030946 Jun 25 20:57:54.973989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 730/1643] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 20:57:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984068 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:57:55.025676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:55.026378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:55.035976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.036779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.037620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.038102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.065654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:55.097466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:55.099423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:55.104715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39135305-2ca0-4add-9b64-70c1fbfbe533 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.319920 Jun 25 20:57:55.105854 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 914/1644] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:54 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:55.195148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:55.213565 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d17efb0-3f02-49d0-9760-d053e55ff96c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1276 microversion: 2.1 time: 0.194015 Jun 25 20:57:55.232662 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 731/1645] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:55 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:55.282974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:55.284366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] [instance: a65be067-d27c-4249-b7dc-e5a5e54d588e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:55.302913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.303880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.305046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.305754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.307853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:55.308498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:55.317439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.317896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.318697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.319139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.341431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] HTTP exception thrown: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Request method failure captured: Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e HTTP/1.1 Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3agPjGNNDEB1hxStFVJXyr4c22jk8uNHWDVKvKJHyZ9UYLkhwjBulSZMSdEqrJD4XbNF4XZw9bSphN40hzmnPnt3WLrCjU6ZDrgYdOUzs3nWriew1naOuWTxeGjC5XUAJ59z_kri0zOiKvRgWM6PNoWfND5I4dGQK0VjPY_vS29OXM Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: cac44a003ea94dfba170af264c2412ed Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TenantUsagesTestJSON-1702363842 Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:55.343480 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/cac44a003ea94dfba170af264c2412ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cac44a003ea94dfba170af264c2412ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_cac44a003ea94dfba170af264c2412ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/cac44a003ea94dfba170af264c2412ed"}]}] Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TenantUsagesTestJSON-1702363842 Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: cac44a003ea94dfba170af264c2412ed Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1702363842 Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TenantUsagesTestJSON-1702363842-project Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ab974f6a346044b39b4e0a9a57ce4dd9 Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TenantUsagesTestJSON-1702363842-project Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. Jun 25 20:57:55.345027 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a65be067-d27c-4249-b7dc-e5a5e54d588e'} Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:55.345803 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. Jun 25 20:57:55.346997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:55.349466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] Returning 404 to user: Instance a65be067-d27c-4249-b7dc-e5a5e54d588e could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:55.350851 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a9e1ca3-544e-4580-a88e-51185ee8b681 tempest-TenantUsagesTestJSON-1702363842 tempest-TenantUsagesTestJSON-1702363842-project] 10.222.0.39 "GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e" status: 404 len: 111 microversion: 2.1 time: 0.072823 Jun 25 20:57:55.356160 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 915/1646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:55 2022] GET /compute/v2.1/servers/a65be067-d27c-4249-b7dc-e5a5e54d588e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:55.367833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:55.779272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:55.787445 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f912956-9db9-41f0-8545-6711ecda7754 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.483460 Jun 25 20:57:55.804334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:55.806259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:55.814005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.814455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.815233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.815666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.819977 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 732/1647] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:55 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:55.859492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:55.861475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:55.869623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.873769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:55.875447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:55.878792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.237362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:56.253365 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ed29adb-c42d-476f-adf5-fb22b28b0df0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.453811 Jun 25 20:57:56.254357 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 916/1648] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:55 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:56.259220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:56.267182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:56.299930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.300614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.301549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.302240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.441086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:56.453553 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db1a0527-391f-4154-8600-8f196896d7c4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.598175 Jun 25 20:57:56.454802 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 733/1649] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:55 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:56.461083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:56.462459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:56.474571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.475469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.476756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.477473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.591478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:56.605955 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27461a52-7793-4cd9-bb87-531c5322fa5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1282 microversion: 2.1 time: 0.146221 Jun 25 20:57:56.608246 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 734/1650] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:56 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1282 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:56.622568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-914dd7b3-b574-4dda-87cc-248fe0902120 req-8470640c-a1e0-4514-9ea7-61e4567321bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "name": "network-vif-unplugged", "status": "completed", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:56.647780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-914dd7b3-b574-4dda-87cc-248fe0902120 req-8470640c-a1e0-4514-9ea7-61e4567321bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.649179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-914dd7b3-b574-4dda-87cc-248fe0902120 req-8470640c-a1e0-4514-9ea7-61e4567321bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.683160 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-914dd7b3-b574-4dda-87cc-248fe0902120 req-8470640c-a1e0-4514-9ea7-61e4567321bf service nova] Creating event network-vif-unplugged:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch1-master-1 Jun 25 20:57:56.689588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-914dd7b3-b574-4dda-87cc-248fe0902120 req-8470640c-a1e0-4514-9ea7-61e4567321bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079604 Jun 25 20:57:56.690857 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 735/1651] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:57:56.807396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:56.808580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:56.816351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.817165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:56.818152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:56.818746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.076366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:57.105306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:57.113260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:57.114815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9bd76c6-c8be-45e5-b775-f5d26d8167e4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.859279 Jun 25 20:57:57.115655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 917/1652] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:56 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:57.272809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:57.273437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:57.285754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.286107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.298519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.298986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.623443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:57.636552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-140cb073-394d-4e83-b170-10c56607ac77 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.369054 Jun 25 20:57:57.645876 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 918/1653] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:57 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:57.669945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:57.670608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:57.678516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:57.690563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.692045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.692951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.693347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.701451 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af80f334-2f56-40cb-8c44-4a3921bdb9ab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.899490 Jun 25 20:57:57.707446 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 736/1654] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:56 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:57.722987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:57.723876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:57.736444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.742868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.745193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:57.746180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:57.888966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=16 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:58.183275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:58.200114 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17205bf6-2f64-44d7-afa4-2c005c6f5322 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.552693 Jun 25 20:57:58.201677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 919/1655] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:57 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:58.215254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:58.215799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:58.228153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.229208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.230292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.230952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.333931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:58.364927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d010b20f-63a0-458b-bd4c-c28887bb221e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 0.655758 Jun 25 20:57:58.365797 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 737/1656] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:57 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:58.552385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:58.562160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:58.564883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:58.564883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bde7402e-e732-423b-9f0d-58d0bc6d24a4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.361699 Jun 25 20:57:58.574994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 920/1657] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:58 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:57:58.658592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:58.659701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:58.666523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-811cd911-3f8d-4619-a4f3-37a4ee574fb9 req-de7e34c8-9138-4062-b27b-aec4a9d2436c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "name": "network-vif-plugged", "status": "completed", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:57:58.674152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.675906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.677356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.679134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.684718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-811cd911-3f8d-4619-a4f3-37a4ee574fb9 req-de7e34c8-9138-4062-b27b-aec4a9d2436c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.685161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-811cd911-3f8d-4619-a4f3-37a4ee574fb9 req-de7e34c8-9138-4062-b27b-aec4a9d2436c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.707099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-811cd911-3f8d-4619-a4f3-37a4ee574fb9 req-de7e34c8-9138-4062-b27b-aec4a9d2436c service nova] Creating event network-vif-plugged:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch2-master-1 Jun 25 20:57:58.717771 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-811cd911-3f8d-4619-a4f3-37a4ee574fb9 req-de7e34c8-9138-4062-b27b-aec4a9d2436c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055056 Jun 25 20:57:58.719891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 921/1658] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:57:58.726428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:58.731866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:58.748733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.749528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:58.750582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:58.751210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.058865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:59.066848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d329626-e2a3-4fac-87e6-edd7500cc8c2 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.345371 Jun 25 20:57:59.082330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 922/1659] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:58 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:59.219490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:59.220122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:59.231472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.240765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.241614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.245907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.512652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:59.529668 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1404edf1-9788-4c35-b171-fd0e35a327a3 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.877936 Jun 25 20:57:59.530402 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 738/1660] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:58 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:57:59.543796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:59.544857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:59.562438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.563147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.564203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.566074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.702604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:57:59.711690 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0da0091c-b7ce-4845-a170-c88130100c16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.496948 Jun 25 20:57:59.729889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 923/1661] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:59 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:57:59.735107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:59.735608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:59.746685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.747130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.747910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.748342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.783392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] HTTP exception thrown: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Request method failure captured: Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 HTTP/1.1 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3YC4dzAtaZIAUkpBWbJPvYL--TOPDdNf-d_XeOJqSim4COxHiHLSHnkRG8spbjCb4cg3z17XRvDl3UtzlU27mNKY5CVY_ZiRnwk9zIX3NkVm_KH6B2ihp0Nm60TJSCrRJir8u6tXDUAxETO4UvUZj1T6JoFB0ZMPl09Sy6KXC_mwPw Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:57:59.788623 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}] Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9a8cd690a02e4b47afb24d9d4dba52b9 Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:59.790747 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ff14b19d-5125-4e28-ba7d-47329c4b0529'} Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:57:59.791614 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:57:59.793048 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:57:59.795879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Returning 404 to user: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:57:59.795879 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5352ec19-de1f-4ba4-bf60-4b5b941db796 tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 404 len: 111 microversion: 2.1 time: 0.055982 Jun 25 20:57:59.795879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 924/1662] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:57:59 2022] DELETE /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:57:59.800309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:57:59.801147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:57:59.821242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.821691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:57:59.822494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:57:59.823412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.059190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:00.070119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:00.076963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:00.078477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5fb5666-1acc-4d2c-9b73-47c0ae4424c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1281 microversion: 2.25 time: 0.290080 Jun 25 20:58:00.088644 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 925/1663] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:57:59 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1281 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:00.093695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:00.094325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] [instance: ff14b19d-5125-4e28-ba7d-47329c4b0529] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:00.112923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.113523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.114374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.114826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.187919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] HTTP exception thrown: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Request method failure captured: Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 HTTP/1.1 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3YC4dzAtaZIAUkpBWbJPvYL--TOPDdNf-d_XeOJqSim4COxHiHLSHnkRG8spbjCb4cg3z17XRvDl3UtzlU27mNKY5CVY_ZiRnwk9zIX3NkVm_KH6B2ihp0Nm60TJSCrRJir8u6tXDUAxETO4UvUZj1T6JoFB0ZMPl09Sy6KXC_mwPw Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:58:00.193160 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c734d57dbb974b2bba1efc21917a7269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c734d57dbb974b2bba1efc21917a7269"}]}] Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c734d57dbb974b2bba1efc21917a7269 Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1691617548 Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9a8cd690a02e4b47afb24d9d4dba52b9 Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1691617548-project Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:58:00.195040 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ff14b19d-5125-4e28-ba7d-47329c4b0529'} Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:58:00.195968 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. Jun 25 20:58:00.197776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:00.204559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] Returning 404 to user: Instance ff14b19d-5125-4e28-ba7d-47329c4b0529 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:58:00.204559 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14280f3b-6d3c-4599-b37f-31a8bf8c538a tempest-AttachSCSIVolumeTestJSON-1691617548 tempest-AttachSCSIVolumeTestJSON-1691617548-project] 10.222.0.39 "GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529" status: 404 len: 111 microversion: 2.1 time: 0.107110 Jun 25 20:58:00.204559 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 926/1664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:00 2022] GET /compute/v2.1/servers/ff14b19d-5125-4e28-ba7d-47329c4b0529 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:58:00.225979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:00.227418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:00.235549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.236012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.237694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.238411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.500595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:00.511822 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-167e968e-e9b6-4898-9e79-2d1b37585466 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 0.976829 Jun 25 20:58:00.518923 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 739/1665] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:57:59 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:00.610053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:00.624471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-464666d3-4f08-4709-9a2f-3cabc7fa297d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.418494 Jun 25 20:58:00.628337 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 927/1666] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:00 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:00.633875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:00.640696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:00.676080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.679489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.680640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.682452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.730067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30d6ff81-94ed-4258-80f7-701f23667af8 tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:00.747796 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30d6ff81-94ed-4258-80f7-701f23667af8 tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.213294 Jun 25 20:58:00.762173 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 740/1667] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:58:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 20:58:00.786369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:00.794525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:00.835615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.839113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:00.842065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:00.843852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.326903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:01.336902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d40ad313-c25f-4900-82e5-18e1a81a43a1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1716 microversion: 2.1 time: 0.707028 Jun 25 20:58:01.349505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 928/1668] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:00 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1716 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:01.358376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8300b48b-63df-4f11-bdb1-afd2bcc1a6d4 req-b3e91315-6c41-4b8d-afec-edd0e6338440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "516f5558-13fe-4160-9e89-2e13e203c75f", "tag": "0ec7118a-7baa-4be7-8278-8974dca91d81"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:01.399783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8300b48b-63df-4f11-bdb1-afd2bcc1a6d4 req-b3e91315-6c41-4b8d-afec-edd0e6338440 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:01.400887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8300b48b-63df-4f11-bdb1-afd2bcc1a6d4 req-b3e91315-6c41-4b8d-afec-edd0e6338440 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.425168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8300b48b-63df-4f11-bdb1-afd2bcc1a6d4 req-b3e91315-6c41-4b8d-afec-edd0e6338440 service nova] Creating event network-changed:0ec7118a-7baa-4be7-8278-8974dca91d81 for instance 516f5558-13fe-4160-9e89-2e13e203c75f on nch1-master-1 Jun 25 20:58:01.431447 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8300b48b-63df-4f11-bdb1-afd2bcc1a6d4 req-b3e91315-6c41-4b8d-afec-edd0e6338440 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080295 Jun 25 20:58:01.432392 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 929/1669] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:01.438332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:01.439466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:01.449251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:01.450210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.451264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:01.451912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.515867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:01.529703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71813085-15ab-4de7-a41f-1ae3983ac5b6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.765384 Jun 25 20:58:01.534489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 741/1670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:00 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:01.553937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:01.559138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:01.576822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:01.580801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.582351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:01.583204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:01.679485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:01.689006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:01.690543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:01.692137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a30567c0-ea25-4ca7-a4a9-ed320fcf7325 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1478 microversion: 2.25 time: 0.258535 Jun 25 20:58:01.693108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 930/1671] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:01 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1478 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:01.761901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1294032698", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9b314a7d-dc10-4b6a-98d0-df7a6e8f20e0"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:01.827620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] validate_networks() for [('9b314a7d-dc10-4b6a-98d0-df7a6e8f20e0', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:02.023130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:02.039604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71234e12-fb1f-42ad-832f-f5b8f1392e94 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 0.502446 Jun 25 20:58:02.041813 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 742/1672] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:01 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:02.047038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:02.047880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:02.058125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.058593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.060027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.060490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.343654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:02.344246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:02.344816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:02.345334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:02.345848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:02.369835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.370619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.371782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.372234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.384881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:02.400065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-321874c2-5de8-4f43-a75c-b5e7303c46b0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.353812 Jun 25 20:58:02.402815 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 743/1673] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:02 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:02.424005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:02.424760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:02.427278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Getting quotas for project ead50a31ce9d4d108bcc8f2d8844ac39. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:02.433786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Getting quotas for user a64a76813475430a9ee6e8d297bb8683 and project ead50a31ce9d4d108bcc8f2d8844ac39. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:02.434738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.435373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.436344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.436997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.452541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:02.456723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Going to run 2 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:02.466435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 54039f32-6352-4d24-afb1-589c6a590ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:02.527472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=54039f32-6352-4d24-afb1-589c6a590ba7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:02.647259 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eaed27bb-8a34-4464-b97a-5f31192e40cb tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.952612 Jun 25 20:58:02.655463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 931/1674] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:02.661510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1533984335", "imageRef": "6e69f836-4bda-431a-9a50-8002e56b8e51", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:02.714072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 61a5abaa-9c65-4734-9aea-302bc97a7e38 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:02.732076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d677549d-7ee3-46fc-bd4c-47ab890e15f2 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1971 microversion: 2.25 time: 0.327465 Jun 25 20:58:02.733273 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 744/1675] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:02 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1971 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:02.751746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:02.752513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:02.756802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:02.760881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.761996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:02.763031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:02.763692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.010043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] Request method failure captured: Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 143 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3bY2q1gE0s_dVHHOvlLbWtPIVj2zhQiFS2KaRu1escsJ4UrsB1EJaf3qs8bbFwx3U13QkhF-P6s9zGiaugffFmHN3wWvivlbcA4jC4WQvAESG5Dt3dvUA6w_UY0QtsbbTC2NU0HF5w-1yo3Ay8QTdgmcMIYa7bo9DqY-a76tZfpWnM Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 3227da8dcf454c74b49bd33a773843f8 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FlavorsV2NegativeTest-925878559 Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:58:03.012390 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3227da8dcf454c74b49bd33a773843f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3227da8dcf454c74b49bd33a773843f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3227da8dcf454c74b49bd33a773843f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3227da8dcf454c74b49bd33a773843f8"}]}] Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FlavorsV2NegativeTest-925878559 Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 3227da8dcf454c74b49bd33a773843f8 Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-925878559 Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FlavorsV2NegativeTest-925878559-project Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d619431eaaa4acdbdcf5e18635f6ce8 Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FlavorsV2NegativeTest-925878559-project Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1533984335", "imageRef": "6e69f836-4bda-431a-9a50-8002e56b8e51", "flavorRef": "452"}} Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:58:03.014045 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor's memory is too small for requested image. Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1533984335', 'imageRef': '6e69f836-4bda-431a-9a50-8002e56b8e51', 'flavorRef': '452'}}} Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:03.017174 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:03.019109 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b467d34-6b8e-47ee-bb8b-211003591fad tempest-FlavorsV2NegativeTest-925878559 tempest-FlavorsV2NegativeTest-925878559-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.357169 Jun 25 20:58:03.021189 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 932/1676] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:58:03.021976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.022632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:03.044302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.045325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.046507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.047114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.217393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:03.230906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7cf26f0e-bfa1-4227-b1af-103d8b6f173c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.214866 Jun 25 20:58:03.242272 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 933/1677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:03.249735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.254849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:03.256502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Searching by: {'deleted': False, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:58:03.282848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.283940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.285300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.285949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.324728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:03.338627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b67070b8-1c9d-4527-9455-6298178825e2 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.094704 Jun 25 20:58:03.339296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 934/1678] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers => generated 677 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:03.349243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1af77f1a-a2ab-40f8-b562-6dbb13b2cc96 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1706 microversion: 2.1 time: 0.614487 Jun 25 20:58:03.353590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 745/1679] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:02 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1706 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:03.354830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.356202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:03.362457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.363599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:03.364118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.364814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.366299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.367357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.379633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.382204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.383266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.383716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.564314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:03.574446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 61a5abaa-9c65-4734-9aea-302bc97a7e38 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:03.596981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:03.612636 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59ade3bd-b08e-4b75-ab5f-e89e254fdc83 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1971 microversion: 2.25 time: 0.261958 Jun 25 20:58:03.613474 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 935/1680] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1971 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:03.618383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dd92db9-852b-42c9-b5e5-550f65594f6e tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.625233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dd92db9-852b-42c9-b5e5-550f65594f6e tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:03.706583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dd92db9-852b-42c9-b5e5-550f65594f6e tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:03.716013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dd92db9-852b-42c9-b5e5-550f65594f6e tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1220 microversion: 2.1 time: 0.101304 Jun 25 20:58:03.726597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 936/1681] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:03.732302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f40968a7-e6f2-4a09-a782-aa272adb0c35 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '.version_select at 0x7f984f913a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.735152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f40968a7-e6f2-4a09-a782-aa272adb0c35 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.735958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f40968a7-e6f2-4a09-a782-aa272adb0c35 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.751326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f40968a7-e6f2-4a09-a782-aa272adb0c35 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.022897 Jun 25 20:58:03.752794 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 937/1682] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:03.764679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:03.766015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:03.774316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.774912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.776026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:03.776763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:03.782588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:04.004234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:04.014669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c07bf430-c987-4e33-99a6-d1b45089b242 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.260600 Jun 25 20:58:04.030021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 938/1683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:04.043272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:04.050255 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:58:04.050255 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:58:04.052582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.053315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.054387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.055060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.086153 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-550ba00a-a062-4e33-97d8-78f2849b1202 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.051551 Jun 25 20:58:04.088090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 939/1684] 10.222.0.39 () {60 vars in 1216 bytes} [Sat Jun 25 20:58:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 20:58:04.096335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:04.097185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:04.113003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.119405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.120563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.121424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.491615 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b73508a8-82d4-480a-8ea0-845f72591f2f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1857 microversion: 2.1 time: 0.402131 Jun 25 20:58:04.500393 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 940/1685] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:04 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1857 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:04.516552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:04.524767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:04.553412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.556011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.557311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.560932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.670520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'flavor' on Instance uuid 61a5abaa-9c65-4734-9aea-302bc97a7e38 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:04.724074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Going to try to live migrate instance to nch1-master-1 {{(pid=137461) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:58:04.854479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:04.870197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1da8c3a9-493a-430a-b654-b7dd8cda958e tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 1.511097 Jun 25 20:58:04.871456 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 746/1686] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:03 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:04.880454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:04.881310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:04.893327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.896161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:04.897254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:04.905165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:05.666866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:05.680542 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4ce2c92-d2bb-4940-b0ac-9977041ad182 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1515 microversion: 2.1 time: 0.804823 Jun 25 20:58:05.688494 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 747/1687] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:04 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1515 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:05.697490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:05.699763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:05.731660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:05.732879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:05.733910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:05.734716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:06.496015 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1245893-525f-446a-9b5f-7d616c0ff11a tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1857 microversion: 2.1 time: 0.810018 Jun 25 20:58:06.497607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 748/1688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:05 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1857 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:06.503145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:06.504172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:06.529523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:06.534580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:06.537337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:06.538638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:06.932626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:06.945023 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-801c8e7a-6f94-47a9-bda5-d82f5fc56610 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1278 microversion: 2.1 time: 0.445935 Jun 25 20:58:06.956273 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 749/1689] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:06 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:06.962056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:06.963204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:06.971840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:06.972460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:06.973395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:06.974081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.015773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:07.450804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ad8bd5d-811e-434f-bc9a-4e8690dc6d68 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38/action" status: 202 len: 0 microversion: 2.25 time: 2.948803 Jun 25 20:58:07.451581 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 941/1690] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 20:58:04 2022] POST /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38/action => generated 0 bytes in 2950 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:07.456461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:07.457191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:07.474274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.474634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.475421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.476473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.503080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:07.522251 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-037a2b8a-ff14-4bcf-bc48-fbd27157c195 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.564043 Jun 25 20:58:07.523549 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 750/1691] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:06 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:07.529960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:07.531572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:07.539071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:07.543303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.544088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.545819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.546627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.685844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lazy-loading 'services' on Instance uuid f3d924f3-73b1-427e-8d6d-423bec6b8fdb {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:07.811788 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17beb484-c9b2-4c7e-a6db-e06acae5d4c7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments/dfb3f3d7-81ce-4d96-93a2-b60490b5cf87" status: 202 len: 0 microversion: 2.1 time: 0.285955 Jun 25 20:58:07.812701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 751/1692] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 20:58:07 2022] DELETE /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments/dfb3f3d7-81ce-4d96-93a2-b60490b5cf87 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:58:07.829348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:07.831294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:07.838672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:07.847287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-74a89e94-5964-4d70-a005-ef90dc180751 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 0.394619 Jun 25 20:58:07.848355 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 942/1693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:07 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:07.850136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.851028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.851905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.853396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.856107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ba077c13-e1f6-41aa-955a-f5baa1afcd1a req-b607a103-2e99-4ac9-9553-97a4c69f2c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516f5558-13fe-4160-9e89-2e13e203c75f", "name": "network-vif-plugged", "status": "completed", "tag": "0ec7118a-7baa-4be7-8278-8974dca91d81"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:07.866513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ba077c13-e1f6-41aa-955a-f5baa1afcd1a req-b607a103-2e99-4ac9-9553-97a4c69f2c74 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.867337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ba077c13-e1f6-41aa-955a-f5baa1afcd1a req-b607a103-2e99-4ac9-9553-97a4c69f2c74 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.884526 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ba077c13-e1f6-41aa-955a-f5baa1afcd1a req-b607a103-2e99-4ac9-9553-97a4c69f2c74 service nova] Creating event network-vif-plugged:0ec7118a-7baa-4be7-8278-8974dca91d81 for instance 516f5558-13fe-4160-9e89-2e13e203c75f on nch1-master-1 Jun 25 20:58:07.890204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ba077c13-e1f6-41aa-955a-f5baa1afcd1a req-b607a103-2e99-4ac9-9553-97a4c69f2c74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039637 Jun 25 20:58:07.891524 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 943/1694] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:07.900454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:07.906655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:07.913919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.915260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:07.916270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:07.917062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.160007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.181979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.192246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.193625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64d92e21-f2f6-4bbe-809f-97eb6d29c130 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.299225 Jun 25 20:58:08.196971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 944/1695] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:07 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:08.207404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:08.208650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:08.216947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.217582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.219069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.220128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.264660 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65eeec7f-3e18-4754-98d1-a37b3730e53a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064474 Jun 25 20:58:08.266469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 945/1696] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:58:08 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:08.273983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:08.274611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:08.281728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.282186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.282960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.283397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.326213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.341183 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e7f3148-8afa-4f97-b89a-70a9dc1b3066 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.527011 Jun 25 20:58:08.341803 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 752/1697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:07 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:08.408194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.420580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64d7a816-9af0-4a3d-b0b2-b3c0d0e625ae tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1278 microversion: 2.1 time: 0.152165 Jun 25 20:58:08.440583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 946/1698] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:08 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:08.539749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:08.541036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:08.549619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.550287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.551233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.551737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.862540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:08.869303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:08.870857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:08.887645 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16e48435-8508-492b-9ce3-81c6fae216ae tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.351724 Jun 25 20:58:08.894379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.894913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:08.901629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:08.903884 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 753/1699] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:08 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:08.904238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.218213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:09.221181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:09.222111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:09.235626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.236344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.237685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.238560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.249580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-acc42923-19b7-4bba-a58d-2b802b0eb980 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1324 microversion: 2.1 time: 0.370727 Jun 25 20:58:09.252169 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 947/1700] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:08 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:09.284357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:09.289990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:09.302206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.302757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.303635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.304277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.345422 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-faae4a2b-e6f5-4a5f-abb1-d014eba5f1e1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070277 Jun 25 20:58:09.357090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 948/1701] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:58:09 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:09.365509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:09.366197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:09.373908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.374356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.375185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.375772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.637954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:09.649951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63bdc6a3-0354-401f-a830-fed526b0534d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.291188 Jun 25 20:58:09.665044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 949/1702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:09 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:09.670927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:09.671786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:09.683456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.683920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.684894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.685340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.935351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:09.945272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-55f7242b-2f78-410e-8fb3-2721a14e9d96 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.277564 Jun 25 20:58:09.947180 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 950/1703] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:09 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:09.952563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:09.953501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:09.962572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.963486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:09.965180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:09.965839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.063456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:10.077947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:10.080661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:10.084877 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-acc40b85-6cb2-4238-a512-7d1b97906971 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.874953 Jun 25 20:58:10.086128 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 754/1704] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:09 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:10.251578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:10.267303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fad27861-58ab-4261-91ae-020995df6b25 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.318659 Jun 25 20:58:10.279654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:10.279654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:10.281897 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 951/1705] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:09 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:10.285554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.287356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.288250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.289965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.294375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f6fdebf9-2a92-4c0b-8f4d-4c704f620b36 req-25a07ed3-af02-480c-9bca-38d4c0386386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c68b4-6ee5-44a9-afd3-8143cce8d29c", "name": "network-vif-unplugged", "status": "completed", "tag": "06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:10.305019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f6fdebf9-2a92-4c0b-8f4d-4c704f620b36 req-25a07ed3-af02-480c-9bca-38d4c0386386 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.305773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f6fdebf9-2a92-4c0b-8f4d-4c704f620b36 req-25a07ed3-af02-480c-9bca-38d4c0386386 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.322766 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f6fdebf9-2a92-4c0b-8f4d-4c704f620b36 req-25a07ed3-af02-480c-9bca-38d4c0386386 service nova] Creating event network-vif-unplugged:06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd for instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c on nch2-master-1 Jun 25 20:58:10.337672 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f6fdebf9-2a92-4c0b-8f4d-4c704f620b36 req-25a07ed3-af02-480c-9bca-38d4c0386386 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049997 Jun 25 20:58:10.338864 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 952/1706] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:10.376090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:10.377786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:10.389577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.390589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.392717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.394262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.441166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7874897a-d6e8-4275-bdad-38ad6a929cd4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087339 Jun 25 20:58:10.449893 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 953/1707] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 20:58:10 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 20:58:10.671805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:10.672588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:10.682889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.684566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:10.684566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:10.684566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.054962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:11.073119 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-adbb8ac4-c9ea-499c-904a-be1f351aa115 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1519 microversion: 2.1 time: 0.805082 Jun 25 20:58:11.075249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 755/1708] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:10 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1519 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:58:11.102678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:11.103082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:11.104857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:11.106938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:11.112112 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce92f636-c60d-4686-8d58-2f529a81c19b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.447950 Jun 25 20:58:11.112747 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 954/1709] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:10 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:58:11.114231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.116054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.116916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.119219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.132155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:11.133238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:11.151800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.152365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.153354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.153802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.640076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:11.658824 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d4ba64fa-3a8b-46bc-866f-22f6a08e56bf tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.581213 Jun 25 20:58:11.661420 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 756/1710] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:11 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:11.684847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:11.685465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:11.700998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.701458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:11.703336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:11.703797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.313171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:12.331131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-244dbffd-19e8-465f-9ee8-5cbfb8dceed1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1519 microversion: 2.1 time: 1.204236 Jun 25 20:58:12.343910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 955/1711] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:11 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1519 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:12.356962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:12.357798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:12.377677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:12.378921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.379658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:12.380144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.531691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:12.546551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:12.556670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:12.558803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88a90050-ca22-4cd1-bf67-921c685ded71 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.896134 Jun 25 20:58:12.570180 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 757/1712] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:11 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:12.575643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-25e95b68-a106-4c41-a330-7bf16b0fa86f req-a14a30fe-9c76-44ab-9ec3-c00f82b1173d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54039f32-6352-4d24-afb1-589c6a590ba7", "tag": "3f632c02-bd45-4257-a728-d1a2c0ccaaf5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:12.603900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25e95b68-a106-4c41-a330-7bf16b0fa86f req-a14a30fe-9c76-44ab-9ec3-c00f82b1173d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:12.605027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25e95b68-a106-4c41-a330-7bf16b0fa86f req-a14a30fe-9c76-44ab-9ec3-c00f82b1173d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.641448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-25e95b68-a106-4c41-a330-7bf16b0fa86f req-a14a30fe-9c76-44ab-9ec3-c00f82b1173d service nova] Creating event network-changed:3f632c02-bd45-4257-a728-d1a2c0ccaaf5 for instance 54039f32-6352-4d24-afb1-589c6a590ba7 on nch2-master-1 Jun 25 20:58:12.659485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-25e95b68-a106-4c41-a330-7bf16b0fa86f req-a14a30fe-9c76-44ab-9ec3-c00f82b1173d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087345 Jun 25 20:58:12.660684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 758/1713] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:12.667935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:12.681638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:12.697820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:12.698277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.699068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:12.704151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:12.977473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:13.005814 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5fe287b-c1a9-4e83-baf6-69223c2e5de5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.655088 Jun 25 20:58:13.018986 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 956/1714] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:12 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:13.033767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2144716557"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:13.035852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:13.046126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.048085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:13.049543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.050120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:13.506086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:13.518245 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-584f40f1-ec98-4e0d-b36a-d97faa33c1e6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.854066 Jun 25 20:58:13.524243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f4d357d8-eb74-4430-bbc6-3aeeb0ae244c tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f/action" status: 202 len: 0 microversion: 2.1 time: 0.502051 Jun 25 20:58:13.529680 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 957/1715] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:58:13 2022] POST /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 20:58:13.530199 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 759/1716] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:12 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:13.534989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:13.535829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:13.546607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.547076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:13.547927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.548370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:13.559246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c38ee615-1bd8-4ac3-a75f-ef49a51b8c5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f984fd818b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:13.711745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=22 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:13.961982 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c38ee615-1bd8-4ac3-a75f-ef49a51b8c5d tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf" status: 204 len: 0 microversion: 2.1 time: 0.428628 Jun 25 20:58:13.963405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 760/1717] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:13 2022] DELETE /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:13.968684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:13.969643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:13.984222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.985570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:13.986580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:13.987329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.065548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:14.099680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.107457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e95aa79d-8947-4179-8e08-9e02aa48ebd0 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.580702 Jun 25 20:58:14.112777 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 958/1718] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:13 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:14.117694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee8c05f8-c993-40b9-bf2b-f09b10e3d609 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f9861ebb670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:14.163745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ee8c05f8-c993-40b9-bf2b-f09b10e3d609 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Image not found. Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee8c05f8-c993-40b9-bf2b-f09b10e3d609 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf HTTP/1.1 Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:58:14.213748 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f76ad4f-985d-4780-a843-030afd4378cf'} Jun 25 20:58:14.215409 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:58:14.216276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5f76ad4f-985d-4780-a843-030afd4378cf Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:58:14.219222 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f76ad4f-985d-4780-a843-030afd4378cf could not be found. Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:58:14.222405 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:58:14.226924 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:14.232748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee8c05f8-c993-40b9-bf2b-f09b10e3d609 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:58:14.233923 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee8c05f8-c993-40b9-bf2b-f09b10e3d609 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf" status: 404 len: 62 microversion: 2.1 time: 0.120039 Jun 25 20:58:14.238327 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 959/1719] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:14 2022] GET /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf => generated 62 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:58:14.245230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:14.245945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:14.246380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.255944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.257782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.259271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61ce24d9-550b-4c40-83df-6ef2911146c1 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.294485 Jun 25 20:58:14.260348 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 761/1720] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:13 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:14.271083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.271083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.271083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.271584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:14.271584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:14.276813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.296311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.297391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.298822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.299549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.543930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.553626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29229e59-6b1c-4094-81ff-3f611a5fc2ca tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1531 microversion: 2.1 time: 0.291973 Jun 25 20:58:14.554611 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 762/1721] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:14 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1531 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:14.559470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0ba5236b-1b28-47e4-a18b-a5678b6563eb req-1f2d0459-96ff-4626-846b-c2fd269ab436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c68b4-6ee5-44a9-afd3-8143cce8d29c", "name": "network-vif-plugged", "status": "completed", "tag": "06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:14.570105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0ba5236b-1b28-47e4-a18b-a5678b6563eb req-1f2d0459-96ff-4626-846b-c2fd269ab436 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.570565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0ba5236b-1b28-47e4-a18b-a5678b6563eb req-1f2d0459-96ff-4626-846b-c2fd269ab436 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.589031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0ba5236b-1b28-47e4-a18b-a5678b6563eb req-1f2d0459-96ff-4626-846b-c2fd269ab436 service nova] Creating event network-vif-plugged:06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd for instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c on nch2-master-1 Jun 25 20:58:14.596277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0ba5236b-1b28-47e4-a18b-a5678b6563eb req-1f2d0459-96ff-4626-846b-c2fd269ab436 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040352 Jun 25 20:58:14.597505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 763/1722] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:14.602912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:14.603929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:14.610896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.611557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.612594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.613258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.725513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.737087 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bffc8c54-e3b7-4bfa-8b47-c2d7acc8e177 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.498619 Jun 25 20:58:14.738383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 960/1723] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:14 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:14.744002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-936230343", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "df01ad33-2d1d-469d-8a83-fe93f2aaff22"}], "block_device_mapping_v2": [{"uuid": "81a43e53-60bb-4296-ad9a-0055b8bdf22f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:14.846016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] validate_networks() for [('df01ad33-2d1d-469d-8a83-fe93f2aaff22', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:14.899912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:14.909438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-617c236d-b10d-40db-9ef4-fca274d23a40 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.310471 Jun 25 20:58:14.910538 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 764/1724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:14 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:14.923049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-30c37468-006c-4b4c-8a89-85cd7eaee504 req-72e8bce8-86aa-4eba-a491-b54d5497d491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6512d792-2249-4474-8af3-cdc61066eac1", "tag": "e3b1cfb7-985f-4029-9308-9be78b5abc28"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:14.931631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-30c37468-006c-4b4c-8a89-85cd7eaee504 req-72e8bce8-86aa-4eba-a491-b54d5497d491 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:14.932094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-30c37468-006c-4b4c-8a89-85cd7eaee504 req-72e8bce8-86aa-4eba-a491-b54d5497d491 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:14.949769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-30c37468-006c-4b4c-8a89-85cd7eaee504 req-72e8bce8-86aa-4eba-a491-b54d5497d491 service nova] Creating event network-changed:e3b1cfb7-985f-4029-9308-9be78b5abc28 for instance 6512d792-2249-4474-8af3-cdc61066eac1 on nch1-master-1 Jun 25 20:58:14.955456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-30c37468-006c-4b4c-8a89-85cd7eaee504 req-72e8bce8-86aa-4eba-a491-b54d5497d491 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043320 Jun 25 20:58:14.959236 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 765/1725] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:15.128087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:15.128961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:15.147206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.148240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.149246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.149886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.432450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:15.442602 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-686743ec-d4ab-4475-bbf0-e2df362cc742 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.319418 Jun 25 20:58:15.443197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 766/1726] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:15 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:15.449733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:15.450747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:15.457654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.458386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.459142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.459584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.673637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:15.682339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:15.685063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:15.686604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51c7078a-19dc-407b-8d31-e8488e566c8a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.241251 Jun 25 20:58:15.687765 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 767/1727] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:15 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:15.693285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:15.694104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:15.702064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.702741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.703524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.704173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.906384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:15.916002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5d710ed-19ae-4c95-a68d-6f8fabf67a9b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1537 microversion: 2.1 time: 0.226820 Jun 25 20:58:15.916939 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 768/1728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:15 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:15.922247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:15.923128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:15.930767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.931343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.932222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:15.932944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:15.974671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:16.295422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:16.295905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:16.296501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:16.296872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:16.297271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:16.331647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.332451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.335320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.335850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.368046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:16.379360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Getting quotas for user e9c6e12528ea4760bed65f994df57783 and project c8850e182ca148cb99d4eb414eb7c08d. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:16.430826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:16.445020 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2c73f87-0d44-4731-997d-a7e97dc8a5e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.526721 Jun 25 20:58:16.446191 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 769/1729] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:15 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:16.451140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:16.454533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:16.477654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.478102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.478882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.479316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.514244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:16.516366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81a43e53-60bb-4296-ad9a-0055b8bdf22f',volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:16.707467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b0071f7-5338-41f6-948d-2f514e9c6406 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967669 Jun 25 20:58:16.714370 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 961/1730] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:16.719862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:16.720784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:16.729157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.729872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.731507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.741472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.786110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:16.800776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f272979c-067b-498c-b4f6-a706380695c3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.349349 Jun 25 20:58:16.801429 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 770/1731] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:16 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:16.823890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:16.830236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:16.844674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.849307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:16.850383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:16.851017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.142627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.145833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.157584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.159855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.161731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e9ec6d4-7543-41b3-a88a-689d99a71bcd tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.348159 Jun 25 20:58:17.162756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a44426c-fbe7-4cb4-896c-053c86f6cf68 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.446917 Jun 25 20:58:17.164434 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 771/1732] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:16 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:17.165917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 962/1733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:16 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:17.175279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-26af1f86-f630-4d6f-8a54-4a10ce718d0b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:17.177629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-26af1f86-f630-4d6f-8a54-4a10ce718d0b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:17.180971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:17.183698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:17.202923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.207553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.208501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.208842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.483020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.493855 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7b2a0be-c050-4021-a367-9849cfe5265b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1537 microversion: 2.1 time: 0.322646 Jun 25 20:58:17.497062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 963/1734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:17 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1537 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:17.507319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:17.507954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:17.521423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.521876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.525322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.525803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.789151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26af1f86-f630-4d6f-8a54-4a10ce718d0b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.798271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-26af1f86-f630-4d6f-8a54-4a10ce718d0b tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1052 microversion: 2.1 time: 0.632583 Jun 25 20:58:17.813361 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 772/1735] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:17 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1052 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:17.837044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:17.841035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:17.862955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.863872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.865516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:17.868191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:17.924909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:17.941631 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21fce1eb-9a56-426b-9365-cd6320ca406a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1497 microversion: 2.1 time: 0.443111 Jun 25 20:58:17.944560 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 964/1736] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:17 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1497 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:18.194399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:18.195450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:18.203625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.204522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.205666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.206324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.418131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:18.431776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc746a93-f4b8-4f1d-8243-6a17ce46f7f5 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1521 microversion: 2.1 time: 0.615907 Jun 25 20:58:18.441829 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 773/1737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:17 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:18.441829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:18.441829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:18.452792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.453441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.454276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.455354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.608320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:18.620348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-afbf24f9-fd62-4af0-bc75-210c56bb2512 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.433884 Jun 25 20:58:18.629840 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 965/1738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:18 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:18.635155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:18.636032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:18.648851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.650416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.656298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.657418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.893044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:18.907376 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-15535743-d8c0-4ac5-b656-ff34fc2f2aeb tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1519 microversion: 2.1 time: 0.281128 Jun 25 20:58:18.908753 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 966/1739] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:18 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1519 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:18.933073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:18.936032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:18.970231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.973459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.975926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:18.985749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:18.987193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:19.006270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:19.010267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:19.014578 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0397306-5ca1-4c7f-9772-36cd052b356f tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.578806 Jun 25 20:58:19.018476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 774/1740] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:18 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:19.029118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:19.032590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:19.047012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.049344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.050438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.053623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.107261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:19.116118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:19.126431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8058211-929a-45de-8cb9-c7326881e6a2 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1168 microversion: 2.1 time: 0.214808 Jun 25 20:58:19.138729 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 967/1741] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:18 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:19.150306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:19.151357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:19.166322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.167123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.168148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.169245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.263006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-322a5781-d425-47da-853d-2f40667fb7e2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 204 len: 0 microversion: 2.1 time: 0.241419 Jun 25 20:58:19.264339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 775/1742] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:58:19 2022] DELETE /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:19.273284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:19.275149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:19.295801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.296309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.297124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.299190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.730247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:19.748086 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-efcff81d-1475-4755-9579-1023e25664aa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1525 microversion: 2.1 time: 0.479428 Jun 25 20:58:19.748750 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 776/1743] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:19 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1525 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:58:19.753685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:19.754692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:19.768860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.769619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:19.781620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:19.782340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.050602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:20.071626 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3f72fc22-3f98-40dd-88fd-600aca41d6f9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 200 len: 1474 microversion: 2.1 time: 0.929928 Jun 25 20:58:20.072281 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 968/1744] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:19 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 1474 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:20.082401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:20.083412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:20.095715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:20.097827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.098573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.126671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.127181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.365765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:20.376089 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-57f082fb-86df-4554-b0ff-efe959793a7e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1506 microversion: 2.1 time: 0.626096 Jun 25 20:58:20.388837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 777/1745] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:19 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:20.408140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-7503f0f8-54d8-4af8-9ef5-7af84936d6ca req-b109cb54-2a7d-41ce-9ce9-1bed786ea835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "name": "network-vif-unplugged", "status": "completed", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:20.440965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7503f0f8-54d8-4af8-9ef5-7af84936d6ca req-b109cb54-2a7d-41ce-9ce9-1bed786ea835 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.454254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7503f0f8-54d8-4af8-9ef5-7af84936d6ca req-b109cb54-2a7d-41ce-9ce9-1bed786ea835 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.491787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-7503f0f8-54d8-4af8-9ef5-7af84936d6ca req-b109cb54-2a7d-41ce-9ce9-1bed786ea835 service nova] Creating event network-vif-unplugged:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch2-master-1 Jun 25 20:58:20.502250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-7503f0f8-54d8-4af8-9ef5-7af84936d6ca req-b109cb54-2a7d-41ce-9ce9-1bed786ea835 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106777 Jun 25 20:58:20.505649 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 778/1746] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:20.510801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:20.512884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:20.513865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:20.524717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d79d4cbd-700e-43f1-a07b-ec23dbe50d20 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.448058 Jun 25 20:58:20.526606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 969/1747] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:20 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:20.529826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.530974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.532057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.534543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.547089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-283bcb5a-59da-4649-9a7b-1f2bfd9c12a2 req-64694743-9dae-4da0-846a-6dec43a17db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54039f32-6352-4d24-afb1-589c6a590ba7", "name": "network-vif-plugged", "status": "completed", "tag": "3f632c02-bd45-4257-a728-d1a2c0ccaaf5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:20.582775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-283bcb5a-59da-4649-9a7b-1f2bfd9c12a2 req-64694743-9dae-4da0-846a-6dec43a17db1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.585188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-283bcb5a-59da-4649-9a7b-1f2bfd9c12a2 req-64694743-9dae-4da0-846a-6dec43a17db1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.640751 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-283bcb5a-59da-4649-9a7b-1f2bfd9c12a2 req-64694743-9dae-4da0-846a-6dec43a17db1 service nova] Creating event network-vif-plugged:3f632c02-bd45-4257-a728-d1a2c0ccaaf5 for instance 54039f32-6352-4d24-afb1-589c6a590ba7 on nch2-master-1 Jun 25 20:58:20.671139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-283bcb5a-59da-4649-9a7b-1f2bfd9c12a2 req-64694743-9dae-4da0-846a-6dec43a17db1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142458 Jun 25 20:58:20.675231 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 970/1748] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:20.709772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-802463371"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:20.722143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:20.757698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.760208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:20.763508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:20.764948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:21.096927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:21.109281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:21.122922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:21.125341 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-81f5576c-f952-4fc2-9886-1979c2320ce3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.617400 Jun 25 20:58:21.126636 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 779/1749] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:20 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:21.133297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:21.134314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:21.158101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:21.158777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:21.160302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:21.160950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:21.177860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:21.235884 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-237bf7ba-1b26-4048-8c55-3f473ad67d85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99/action" status: 202 len: 0 microversion: 2.1 time: 0.557934 Jun 25 20:58:21.241692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 971/1750] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:58:20 2022] POST /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 20:58:21.768119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0036dcc5-0f05-429c-8ff9-9998a67f75c5 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Action: 'create', calling method: .version_select at 0x7f9861f1b5e0>, body: {"pool": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:21.835070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:21.855661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-67a454db-6015-43f4-bbbd-92a3bcf73049 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1198 microversion: 2.1 time: 0.727527 Jun 25 20:58:21.858674 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 780/1751] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:21 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1198 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:21.869635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:21.882794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:21.899178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:21.899913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:21.900996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:21.903820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:22.733261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:22.771258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6526d4c-1c4a-4cd7-a576-10b24319fbc3 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 200 len: 1506 microversion: 2.1 time: 0.905329 Jun 25 20:58:22.791213 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 781/1752] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:21 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 1506 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:22.796831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:22.797857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:22.813215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:22.813673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:22.814479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:22.814908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:22.898598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:22.899159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:22.899493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lazy-loading 'fault' on Instance uuid 516f5558-13fe-4160-9e89-2e13e203c75f {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:23.074932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:23.093354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0a09875-f46c-4ede-948a-c6e8f691b2d5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 200 len: 1314 microversion: 2.1 time: 0.298955 Jun 25 20:58:23.097348 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 782/1753] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:22 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:23.112812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb98a36c-3076-4308-86de-302149084b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd81310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:23.244300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb98a36c-3076-4308-86de-302149084b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.145227 Jun 25 20:58:23.248766 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 783/1754] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:23 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:23.264530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:23.270534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:23.289608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:23.290057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:23.290886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:23.295573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.204352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:24.224744 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ec71f46-ff55-49fd-bfbd-a83f32ccdba9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1320 microversion: 2.1 time: 0.973685 Jun 25 20:58:24.225358 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 784/1755] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:23 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1320 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:24.238616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:24.238842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:24.273122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.273577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.274363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.274957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.492132 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0036dcc5-0f05-429c-8ff9-9998a67f75c5 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.248601 Jun 25 20:58:24.498920 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 972/1756] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:58:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:24.502621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-89ef4c44-9a7b-45f0-b056-1a8acfd836fb req-b885e524-e97a-4c86-a52d-f881030029eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "516f5558-13fe-4160-9e89-2e13e203c75f", "name": "network-vif-deleted", "tag": "0ec7118a-7baa-4be7-8278-8974dca91d81"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:24.514541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-89ef4c44-9a7b-45f0-b056-1a8acfd836fb req-b885e524-e97a-4c86-a52d-f881030029eb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.514802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-89ef4c44-9a7b-45f0-b056-1a8acfd836fb req-b885e524-e97a-4c86-a52d-f881030029eb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.544379 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-89ef4c44-9a7b-45f0-b056-1a8acfd836fb req-b885e524-e97a-4c86-a52d-f881030029eb service nova] Creating event network-vif-deleted:0ec7118a-7baa-4be7-8278-8974dca91d81 for instance 516f5558-13fe-4160-9e89-2e13e203c75f on nch1-master-1 Jun 25 20:58:24.550964 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-89ef4c44-9a7b-45f0-b056-1a8acfd836fb req-b885e524-e97a-4c86-a52d-f881030029eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056450 Jun 25 20:58:24.551834 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 973/1757] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:24.559666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a2b0eb1a-4048-470b-a2e8-05a5acba756b req-b7413d55-d284-4833-bafd-20bd0bd58fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:24.581206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2b0eb1a-4048-470b-a2e8-05a5acba756b req-b7413d55-d284-4833-bafd-20bd0bd58fb9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.582528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2b0eb1a-4048-470b-a2e8-05a5acba756b req-b7413d55-d284-4833-bafd-20bd0bd58fb9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.602787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a2b0eb1a-4048-470b-a2e8-05a5acba756b req-b7413d55-d284-4833-bafd-20bd0bd58fb9 service nova] Creating event network-changed:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch2-master-1 Jun 25 20:58:24.617856 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a2b0eb1a-4048-470b-a2e8-05a5acba756b req-b7413d55-d284-4833-bafd-20bd0bd58fb9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060542 Jun 25 20:58:24.619192 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 974/1758] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:24.634061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:24.634904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:24.664463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.666008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.667071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.667665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.733215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:24.824352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:24.838882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:24.851524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:24.853143 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a9a6c60-57ea-48b6-8971-1f3a78b1e4ac tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.625693 Jun 25 20:58:24.859729 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 785/1759] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:24 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:24.868241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:24.868627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78167cec-6770-4a40-be37-6c7d63cd615c tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 204 len: 0 microversion: 2.1 time: 0.243941 Jun 25 20:58:24.869456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 975/1760] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:58:24 2022] DELETE /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:24.876542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ab419f8a-06d3-4053-8b94-72d760325375 req-a4e6c895-3089-42e7-a11d-ff0a7ca937cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6512d792-2249-4474-8af3-cdc61066eac1", "name": "network-vif-plugged", "status": "completed", "tag": "e3b1cfb7-985f-4029-9308-9be78b5abc28"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:24.876777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:24.895474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ab419f8a-06d3-4053-8b94-72d760325375 req-a4e6c895-3089-42e7-a11d-ff0a7ca937cb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.896219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ab419f8a-06d3-4053-8b94-72d760325375 req-a4e6c895-3089-42e7-a11d-ff0a7ca937cb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.903247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.903247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.911425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.911937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.912262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ab419f8a-06d3-4053-8b94-72d760325375 req-a4e6c895-3089-42e7-a11d-ff0a7ca937cb service nova] Creating event network-vif-plugged:e3b1cfb7-985f-4029-9308-9be78b5abc28 for instance 6512d792-2249-4474-8af3-cdc61066eac1 on nch1-master-1 Jun 25 20:58:24.921225 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ab419f8a-06d3-4053-8b94-72d760325375 req-a4e6c895-3089-42e7-a11d-ff0a7ca937cb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050004 Jun 25 20:58:24.922976 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 976/1761] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:24.929165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:24.930688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:24.941607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.942474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.943853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:24.944991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:24.964685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f HTTP/1.1 Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:58:24.968607 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:58:24.970445 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '516f5558-13fe-4160-9e89-2e13e203c75f'} Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:58:24.971372 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:58:24.973260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:24.976316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:58:24.977466 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-485ca9ae-1dc5-48f4-9d37-6c882be008db tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 404 len: 111 microversion: 2.1 time: 0.053191 Jun 25 20:58:24.978244 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 977/1762] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:24 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:58:24.983199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-074aa4d5-e214-408d-9fdc-30b1b372265b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f9861eaee50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:25.068232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-074aa4d5-e214-408d-9fdc-30b1b372265b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.088201 Jun 25 20:58:25.069442 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 978/1763] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:24 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:25.089974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80a6761e-16f5-43c5-a6f9-59c8682babb2 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Action: 'create', calling method: .version_select at 0x7f984feb7160>, body: {"pool": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:25.359439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:25.375396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:25.386258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3631c4c6-028b-4f25-bf78-f8778404a677 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1198 microversion: 2.1 time: 0.525020 Jun 25 20:58:25.387120 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 786/1764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:24 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1198 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:25.406632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-150847649", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "6c2b5444-8281-4087-89d2-2d927563a53b"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:25.480308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] validate_networks() for [('6c2b5444-8281-4087-89d2-2d927563a53b', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:26.350314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:26.399415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:27.669018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:27.669518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:27.670054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:27.671069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:27.671654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:27.699564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:27.700781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:27.702852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:27.705139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:27.767034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:27.774002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Getting quotas for user cdf4dbb95b6a440fad542fad69b6a5d8 and project 0705a9948d8b49b5a41cde4819c470d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:27.817099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:27.827690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:27.934870 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89312822-11e4-4b03-9caa-5af00d13cbbf tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.533683 Jun 25 20:58:27.942742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 787/1765] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:27.956731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:27.966872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:27.981264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:27.982528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:27.983753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:27.984644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:28.296032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80a6761e-16f5-43c5-a6f9-59c8682babb2 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.224494 Jun 25 20:58:28.297283 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 979/1766] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:58:25 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:28.305345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-328363559", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:28.439812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] validate_networks() for [('5f5ddf21-0e70-4c38-91b7-fe48bd042905', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:29.143176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:29.166013 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4cf2133c-d5d5-4f88-8dc5-2fb8df83203c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 200 len: 1509 microversion: 2.1 time: 1.217799 Jun 25 20:58:29.168694 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 788/1767] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:27 2022] GET /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 1509 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:29.188306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:29.189957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:29.216369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:29.219050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:29.220628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:29.223335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.242943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:30.244401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:30.245118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:30.245707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:30.246711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:30.273862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.276468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.280156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.281506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.368808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:30.382063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Getting quotas for user 662ef2b3df5e4c59b373fccab9c911c2 and project fd2dd16178804914b9afde659428992f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:30.422745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:30.425279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:30.512414 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-085e5283-a70c-4631-867b-62a273a9f88b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.213271 Jun 25 20:58:30.519604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 980/1768] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:30.526083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d21ebc18-8909-4619-834a-f720be40c852 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f9861e93940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:30.640003 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d21ebc18-8909-4619-834a-f720be40c852 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.118773 Jun 25 20:58:30.640725 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 981/1769] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:30 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:30.659059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:30.659702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:30.675385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.678551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.681386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.683258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.702526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:30.725426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:30.727145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:30.728785 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4e49388-e507-450d-b29f-4cd3429f6405 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 1.558475 Jun 25 20:58:30.739112 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 789/1770] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:29 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:30.749172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cb3bacd3-c221-4181-a0e5-13e8ac7bf9c5 req-e38762d1-d98c-4e9c-b83a-60bc2d931e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:30.775397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cb3bacd3-c221-4181-a0e5-13e8ac7bf9c5 req-e38762d1-d98c-4e9c-b83a-60bc2d931e2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.776744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cb3bacd3-c221-4181-a0e5-13e8ac7bf9c5 req-e38762d1-d98c-4e9c-b83a-60bc2d931e2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.824631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cb3bacd3-c221-4181-a0e5-13e8ac7bf9c5 req-e38762d1-d98c-4e9c-b83a-60bc2d931e2c service nova] Creating event network-changed:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:58:30.838722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cb3bacd3-c221-4181-a0e5-13e8ac7bf9c5 req-e38762d1-d98c-4e9c-b83a-60bc2d931e2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097039 Jun 25 20:58:30.839571 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 790/1771] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:30.855688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:30.856994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:30.867640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:30.878859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.880600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:30.881632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:30.884838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:31.201119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:31.210954 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb1f281b-f418-4d43-9876-18413eed45b7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1275 microversion: 2.1 time: 0.364888 Jun 25 20:58:31.216802 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 791/1772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:30 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1275 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:31.223433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63c21cb0-88f7-4b74-83cb-47f108a5f950 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Action: 'create', calling method: .version_select at 0x7f984fe269d0>, body: {"pool": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:31.692758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:31.706036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f75c732-d3b8-4b83-b07b-d92b06f7ea37 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1198 microversion: 2.1 time: 1.054299 Jun 25 20:58:31.708232 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 982/1773] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:30 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1198 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:31.721124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:31.728349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 54039f32-6352-4d24-afb1-589c6a590ba7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:31.742101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:31.742833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:31.745019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:31.747206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:32.193425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:32.205236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eafd00f0-c9f2-45e7-91ea-8be1ca292b52 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/54039f32-6352-4d24-afb1-589c6a590ba7" status: 200 len: 1509 microversion: 2.1 time: 0.493085 Jun 25 20:58:32.209190 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 983/1774] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:31 2022] GET /compute/v2.1/servers/54039f32-6352-4d24-afb1-589c6a590ba7 => generated 1509 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:32.228052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-19a0f99a-3fab-4445-89fb-4d398abeeecd req-f2ce89a7-73d9-4aa0-a8c3-10eaeff91619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7335cff-0cba-4acd-8c67-5ae7c8bdbf99", "name": "network-vif-plugged", "status": "completed", "tag": "01332024-f454-43ee-8562-8a92172352de"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:32.253222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-19a0f99a-3fab-4445-89fb-4d398abeeecd req-f2ce89a7-73d9-4aa0-a8c3-10eaeff91619 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:32.254248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-19a0f99a-3fab-4445-89fb-4d398abeeecd req-f2ce89a7-73d9-4aa0-a8c3-10eaeff91619 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:32.291195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-19a0f99a-3fab-4445-89fb-4d398abeeecd req-f2ce89a7-73d9-4aa0-a8c3-10eaeff91619 service nova] Creating event network-vif-plugged:01332024-f454-43ee-8562-8a92172352de for instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 on nch1-master-1 Jun 25 20:58:32.308975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-19a0f99a-3fab-4445-89fb-4d398abeeecd req-f2ce89a7-73d9-4aa0-a8c3-10eaeff91619 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095984 Jun 25 20:58:32.309941 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 984/1775] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:32.317472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:32.319527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:32.339198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:32.339643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:32.344212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:32.344212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:32.624081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:32.632463 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b01a1fc7-0d37-4131-8319-b518908dade8 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1276 microversion: 2.1 time: 0.320972 Jun 25 20:58:32.648477 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 985/1776] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:32 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1276 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:32.660518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7cb22313-3bc8-4be6-a475-a8a8171230ca tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f9861f11d30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:32.783357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7cb22313-3bc8-4be6-a475-a8a8171230ca tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.131124 Jun 25 20:58:32.783999 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 986/1777] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:32 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:32.798622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:32.799267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:32.829077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:32.833615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:32.834596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:32.835046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:34.000108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:34.024468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:34.030431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:34.041250 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1082cccf-9617-4f0d-b16b-b474743118d3 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 1.253753 Jun 25 20:58:34.043069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 987/1778] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:32 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:34.049541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:34.062100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 54039f32-6352-4d24-afb1-589c6a590ba7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:34.091381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:34.097190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:34.102203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:34.102807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:34.241052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 54039f32-6352-4d24-afb1-589c6a590ba7] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:34.436907 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d3aa20b-4732-4dcb-ac12-640c1c87a773 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "DELETE /compute/v2.1/servers/54039f32-6352-4d24-afb1-589c6a590ba7" status: 204 len: 0 microversion: 2.1 time: 0.389141 Jun 25 20:58:34.437780 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 988/1779] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:58:34 2022] DELETE /compute/v2.1/servers/54039f32-6352-4d24-afb1-589c6a590ba7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:34.457558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:34.460992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:34.485538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:34.487808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:34.489303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:34.496507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:34.985297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:35.013132 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf82748c-edab-42d6-bbcf-3be768350d23 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.569157 Jun 25 20:58:35.027961 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 989/1780] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:34 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:35.037072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:35.037982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:35.063116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:35.064295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:35.069467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:35.069927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:35.394869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:35.404545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0adc3596-8b02-46c0-83ae-35bb8b50f136 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1198 microversion: 2.1 time: 0.374811 Jun 25 20:58:35.418810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 990/1781] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:35 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1198 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:35.423979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144c68b4-6ee5-44a9-afd3-8143cce8d29c", "name": "network-vif-deleted", "tag": "06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd"}, {"server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "name": "network-vif-unplugged", "status": "completed", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:35.451328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:35.452072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:35.497583 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] Creating event network-vif-deleted:06abc2dd-b5f8-4edd-bc2c-da3cc20a02fd for instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c on nch2-master-1 Jun 25 20:58:35.498393 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] Creating event network-vif-unplugged:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch2-master-1 Jun 25 20:58:35.515067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-31b9ffd9-2518-4ab8-91a3-42827fe3d2d9 req-13a40f77-f041-4676-bfa7-665c609cb162 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.094561 Jun 25 20:58:35.517938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 991/1782] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:35.541829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:35.543035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:35.571824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:35.572282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:35.573104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:35.573547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:36.042248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:36.056995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a6e82f7f-56b2-4549-b17e-87a2a741c8a5 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.537007 Jun 25 20:58:36.067967 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 992/1783] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:35 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:36.080409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35f0aad-37f0-4f38-a1d6-83d2344fcf3f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984efca040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:36.180322 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a35f0aad-37f0-4f38-a1d6-83d2344fcf3f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.109577 Jun 25 20:58:36.191897 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 993/1784] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:36 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:36.224473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:36.225883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:36.236889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:36.238007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:36.240497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:36.241536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:36.342636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 6512d792-2249-4474-8af3-cdc61066eac1] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:36.450555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:36.604282 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c46e4a74-3dae-44be-b050-f6602f10d81a tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1" status: 204 len: 0 microversion: 2.1 time: 0.409061 Jun 25 20:58:36.605401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 994/1785] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:58:36 2022] DELETE /compute/v2.1/servers/6512d792-2249-4474-8af3-cdc61066eac1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:36.616072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-96a474e3-6e63-4f6f-b0aa-a03da4b90e37 req-af033f4c-6ef4-4b3a-801b-98294f2c22ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "name": "network-vif-plugged", "status": "completed", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:36.649830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-96a474e3-6e63-4f6f-b0aa-a03da4b90e37 req-af033f4c-6ef4-4b3a-801b-98294f2c22ca service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:36.650340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-96a474e3-6e63-4f6f-b0aa-a03da4b90e37 req-af033f4c-6ef4-4b3a-801b-98294f2c22ca service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:36.697969 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-96a474e3-6e63-4f6f-b0aa-a03da4b90e37 req-af033f4c-6ef4-4b3a-801b-98294f2c22ca service nova] Creating event network-vif-plugged:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:58:36.720482 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-96a474e3-6e63-4f6f-b0aa-a03da4b90e37 req-af033f4c-6ef4-4b3a-801b-98294f2c22ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109870 Jun 25 20:58:36.723050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 995/1786] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:36.748531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:36.750062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:36.767495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:36.768283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:36.769162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:36.770300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:37.036696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:37.049947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:37.064549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:37.066485 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51b7e40b-adba-44ab-a965-7bf2eee1157c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1488 microversion: 2.25 time: 0.337810 Jun 25 20:58:37.067307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 996/1787] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:36 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1488 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:37.080968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:37.081919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:37.098657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:37.099502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:37.100535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:37.101142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:37.511613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:37.530063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0db3809c-b651-4511-a47c-63ea2f5ee7dc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.459169 Jun 25 20:58:37.532222 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 997/1788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:37 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:37.544722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:37.547112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:37.569864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:37.570781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:37.571981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:37.574606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:37.744143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:37.801836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:37.996740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:38.009005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ddf50ee6-823f-44de-969b-ffcc2062c599 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1198 microversion: 2.1 time: 0.475273 Jun 25 20:58:38.009922 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 998/1789] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:37 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1198 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:38.017479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1726949225", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9b314a7d-dc10-4b6a-98d0-df7a6e8f20e0"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:38.155048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] validate_networks() for [('9b314a7d-dc10-4b6a-98d0-df7a6e8f20e0', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:39.017986 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63c21cb0-88f7-4b74-83cb-47f108a5f950 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.799765 Jun 25 20:58:39.027615 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 792/1790] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:58:31 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:39.039640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:39.045132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:39.098269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.101381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.102309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.108009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.262153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:39.262636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:39.263039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:39.263753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:39.264168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:39.284076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.284571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.286536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.287341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.368080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Getting quotas for project ead50a31ce9d4d108bcc8f2d8844ac39. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:39.385399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Getting quotas for user a64a76813475430a9ee6e8d297bb8683 and project ead50a31ce9d4d108bcc8f2d8844ac39. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:39.429214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Going to run 2 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:39.441588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:39.530630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=d6510c04-1595-4aa3-a25c-dd96ed7d3dd5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:39.558764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:39.568801 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e2689a32-f5a5-46d0-8a8c-8605d8cd51fa tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.538299 Jun 25 20:58:39.589452 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 793/1791] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:39 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:39.594548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-56a18d9f-be9b-4c66-96a2-85198a7ba600 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd8e820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:39.699068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ab3338d-4c96-4bff-adbc-e40b011e6593 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.687438 Jun 25 20:58:39.704876 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 999/1792] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:38 2022] POST /compute/v2.1/servers => generated 32 bytes in 1694 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jun 25 20:58:39.715722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:39.717775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:39.734191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3,nova_api:INSERT=9 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:39.764063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.767000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.773355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.778492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.798200 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-56a18d9f-be9b-4c66-96a2-85198a7ba600 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.207429 Jun 25 20:58:39.801681 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 794/1793] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:39 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:39.842132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c96e4506-04ea-4c29-8ddd-c10eab166504 req-e2909cfb-7882-4864-a8f1-ef56408101c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e17bbe0-4781-4297-b66e-e14efff8ff89", "tag": "7d9656a5-de3a-4d66-ae87-64e3194f668d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:39.876284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c96e4506-04ea-4c29-8ddd-c10eab166504 req-e2909cfb-7882-4864-a8f1-ef56408101c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:39.881718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c96e4506-04ea-4c29-8ddd-c10eab166504 req-e2909cfb-7882-4864-a8f1-ef56408101c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:39.898915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c96e4506-04ea-4c29-8ddd-c10eab166504 req-e2909cfb-7882-4864-a8f1-ef56408101c0 service nova] Creating event network-changed:7d9656a5-de3a-4d66-ae87-64e3194f668d for instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 on nch1-master-1 Jun 25 20:58:39.928206 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c96e4506-04ea-4c29-8ddd-c10eab166504 req-e2909cfb-7882-4864-a8f1-ef56408101c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115290 Jun 25 20:58:39.937866 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 795/1794] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:40.003436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:40.008017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:40.069032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:40.070175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:40.074953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:40.075827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:40.795863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:40.826898 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95076d52-dd32-416b-94ca-fa7fd49ba76e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.885048 Jun 25 20:58:40.838575 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 796/1795] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:39 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:41.465986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:41.487737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:41.497957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:41.499575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbcbbe83-87c9-4584-8bcc-8fbc39cb5abe tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1478 microversion: 2.25 time: 1.793540 Jun 25 20:58:41.502180 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1000/1796] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:39 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1478 bytes in 1797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:41.530249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99bc0b2a-4b4e-4c73-9acd-53ba750d3fa3 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Action: 'create', calling method: .version_select at 0x7f984ef8b5e0>, body: {"pool": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:41.561237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:41.562366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:41.581951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:41.590800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:41.609156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:41.612372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:42.381864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:42.402521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc01cf09-5aa8-4141-ba12-070049e9aca5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1381 microversion: 2.1 time: 1.551366 Jun 25 20:58:42.403475 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 797/1797] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:40 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1381 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:42.408586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:42.412072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:42.425317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Searching by: {'deleted': False, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 20:58:42.442281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:42.443045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:42.444086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:42.444822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:42.505745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 20:58:42.588730 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5be87e08-aa12-4f06-9950-dcd5173d4ffd tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 1005 microversion: 2.1 time: 0.182734 Jun 25 20:58:42.591755 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 798/1798] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 20:58:42 2022] GET /compute/v2.1/servers => generated 1005 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:42.615454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-495e692d-5b05-46ef-97a7-722942219238 req-1a96a05b-eddc-4f2e-b763-a7d84343ab72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54039f32-6352-4d24-afb1-589c6a590ba7", "name": "network-vif-deleted", "tag": "3f632c02-bd45-4257-a728-d1a2c0ccaaf5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:42.641775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-495e692d-5b05-46ef-97a7-722942219238 req-1a96a05b-eddc-4f2e-b763-a7d84343ab72 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:42.642468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-495e692d-5b05-46ef-97a7-722942219238 req-1a96a05b-eddc-4f2e-b763-a7d84343ab72 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:42.681753 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-495e692d-5b05-46ef-97a7-722942219238 req-1a96a05b-eddc-4f2e-b763-a7d84343ab72 service nova] Creating event network-vif-deleted:3f632c02-bd45-4257-a728-d1a2c0ccaaf5 for instance 54039f32-6352-4d24-afb1-589c6a590ba7 on nch2-master-1 Jun 25 20:58:42.698194 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-495e692d-5b05-46ef-97a7-722942219238 req-1a96a05b-eddc-4f2e-b763-a7d84343ab72 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104315 Jun 25 20:58:42.700851 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 799/1799] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:42.709871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:42.711162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:42.723213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:42.726755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:42.728249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:42.729009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.036960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:43.046197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b368f77-9b22-48e8-85e0-dd6c0d913437 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.343349 Jun 25 20:58:43.050042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 800/1800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:42 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:43.066555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f17975a1-e4ad-4c04-bc97-c325ea217223 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd7c940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.166318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f17975a1-e4ad-4c04-bc97-c325ea217223 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.113415 Jun 25 20:58:43.174011 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 801/1801] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:43.183181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7814476-be37-4357-bbff-5dea928096c9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '.version_select at 0x7f984fd4db80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.187038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7814476-be37-4357-bbff-5dea928096c9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.187582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7814476-be37-4357-bbff-5dea928096c9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.205382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7814476-be37-4357-bbff-5dea928096c9 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 2956 microversion: 2.25 time: 0.028281 Jun 25 20:58:43.214727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 802/1802] 10.222.0.39 () {60 vars in 1183 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/os-migrations => generated 2956 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:43.224117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.224709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:43.234593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.235301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.236310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.237182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.462167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:43.476020 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a6a614f2-690b-455f-a99a-93c721325164 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.258858 Jun 25 20:58:43.478599 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 803/1803] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:43.483660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.484577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:43.491811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.492546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.493509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.494099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.658191 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba89cf8d-f1ac-4207-b8ed-dc5ba1d1995f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1532 microversion: 2.1 time: 0.178067 Jun 25 20:58:43.673916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 804/1804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1532 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:43.681614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.682958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:43.704248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.705207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.706437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.707317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.813086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:43.827489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0636d9d1-4f53-40c2-b250-b00b3df37672 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1270 microversion: 2.1 time: 0.151548 Jun 25 20:58:43.828100 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 805/1805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:43.834545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:43.835169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:43.843002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.843841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:43.845027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:43.845747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.037880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] Lazy-loading 'services' on Instance uuid 61a5abaa-9c65-4734-9aea-302bc97a7e38 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:44.055614 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f7628ba-e49a-4011-8750-4466e741dba5 tempest-LiveAutoBlockMigrationV225Test-1157528900 tempest-LiveAutoBlockMigrationV225Test-1157528900-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1971 microversion: 2.25 time: 0.225713 Jun 25 20:58:44.059841 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 806/1806] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:43 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1971 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:44.066426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:44.067043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:44.079021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.079590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.081857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.082296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.269110 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6578694e-826c-403a-90dd-f484a2959b86 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1532 microversion: 2.1 time: 0.206639 Jun 25 20:58:44.270508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 807/1807] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:44 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1532 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:44.277385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:44.278206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:44.288104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.288611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.289744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.290264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.656793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:44.672070 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7af33799-86b0-4869-858a-be223eb1e482 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.400199 Jun 25 20:58:44.674000 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 808/1808] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:44 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:44.679393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:44.680548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:44.688593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.689376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.690674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:44.691621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:44.735803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:44.750853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:44.850559 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99bc0b2a-4b4e-4c73-9acd-53ba750d3fa3 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.346197 Jun 25 20:58:44.851848 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1001/1809] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:58:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:44.869679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3d38257-4328-42f2-88e2-c8e0b7a3dd8a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984efd9b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:44.985269 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3d38257-4328-42f2-88e2-c8e0b7a3dd8a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.124468 Jun 25 20:58:44.995806 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1002/1810] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:44 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:44.996268 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8567d062-63c4-4d6c-b0cd-9bc03a05b9df tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 204 len: 0 microversion: 2.25 time: 0.320219 Jun 25 20:58:45.002210 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 809/1811] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 20:58:44 2022] DELETE /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:58:45.010055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:45.013651 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:58:45.013651 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 20:58:45.016920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:45.022763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:45.025216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:45.026821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:45.027813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:45.028708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:45.074431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:45.074771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:45.084107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:45.089250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:45.113715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11e588ae-86aa-4961-9b76-e1189824ec0d tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.112938 Jun 25 20:58:45.116562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1003/1812] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 20:58:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:45.129027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d01da1-fc87-48cb-8184-6b7cc48ad324", "tag": "479699ea-d4da-497b-a54c-4eafce081ef1"}, {"server_uuid": "6512d792-2249-4474-8af3-cdc61066eac1", "name": "network-vif-deleted", "tag": "e3b1cfb7-985f-4029-9308-9be78b5abc28"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:45.157709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:45.162554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:45.219377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] Creating event network-changed:479699ea-d4da-497b-a54c-4eafce081ef1 for instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 on nch2-master-1 Jun 25 20:58:45.224486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] Creating event network-vif-deleted:e3b1cfb7-985f-4029-9308-9be78b5abc28 for instance 6512d792-2249-4474-8af3-cdc61066eac1 on nch1-master-1 Jun 25 20:58:45.276558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fd6985f6-06ed-4c8c-b42a-f7172e9b34fd req-5d8d8f9d-52d6-4407-9126-9a5adae1a960 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139248 Jun 25 20:58:45.277878 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1004/1813] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:45.416891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-133409048", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "5441c203-76d7-4c33-bb38-eafe7bc56559"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:45.517064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] validate_networks() for [('5441c203-76d7-4c33-bb38-eafe7bc56559', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:46.632583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:46.648316 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cb84388-cf3f-42db-8df7-73554805ded4 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 1.646724 Jun 25 20:58:46.659690 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 810/1814] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:44 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:46.663918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:46.664609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:46.681895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:46.682357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:46.683157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:46.683598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:46.893486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:46.910084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44779b4a-11a8-497a-85e5-c99b608ccffc tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1276 microversion: 2.1 time: 0.252627 Jun 25 20:58:46.911181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 811/1815] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:46 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:46.929375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a057253-8c5c-4eee-a9a5-f4995d1cb4da tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f984fd81040>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:47.348490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:47.349485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:47.350153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:47.350737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:47.351311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:47.389353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.389843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.390652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.391093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.465013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Getting quotas for project ffbad622c26749aebba510fde1cb72c0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:47.479518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Getting quotas for user da55b52fd3b54e549d9de4b92b76f6ee and project ffbad622c26749aebba510fde1cb72c0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:47.518240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:47.526778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:47.552831 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a057253-8c5c-4eee-a9a5-f4995d1cb4da tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/e82251c4-a41c-4d2f-b68d-adaff3cb1672" status: 200 len: 141 microversion: 2.1 time: 0.639486 Jun 25 20:58:47.553836 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 812/1816] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 20:58:46 2022] GET /compute/v2.1/os-floating-ips/e82251c4-a41c-4d2f-b68d-adaff3cb1672 => generated 141 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:47.559451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:47.560225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:47.578229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.578844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.581377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.582222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.639337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af25485f-ad38-460e-a139-8ae0f698b474 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.359739 Jun 25 20:58:47.641559 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1005/1817] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:47.660862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:47.665897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:47.691660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.692124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.694446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:47.694921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:47.779963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lazy-loading 'flavor' on Instance uuid f9a3fd41-9a61-4147-a35a-e0ec27de1364 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:58:47.819959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Going to try to live migrate instance to nch2-master-1 {{(pid=137461) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 20:58:48.339830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:48.368152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:48.387306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:48.390264 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6fad6937-1495-4599-85a0-2b2a73df633a tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 200 len: 1442 microversion: 2.25 time: 0.835346 Jun 25 20:58:48.400527 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 813/1818] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:47 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 1442 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:48.422456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:48.423374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:48.445591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:48.446311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:48.467943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:48.470170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:49.717560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:49.732732 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-813dcfd0-061f-460e-92e8-4b21d4285a5a tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 1.326592 Jun 25 20:58:49.743154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 814/1819] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:48 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:49.756864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-80d7170d-6230-441e-889f-eacbbfb450f0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd4d160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:49.870797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-80d7170d-6230-441e-889f-eacbbfb450f0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1411 microversion: 2.1 time: 0.124709 Jun 25 20:58:49.872020 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 815/1820] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:49 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:49.877584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0c13ca12-7de0-4c32-bc6d-09c5591ff5e5 req-408ff51e-c7a6-46e0-a521-8466f4d44608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a5abaa-9c65-4734-9aea-302bc97a7e38", "name": "network-vif-deleted", "tag": "47ada0f9-32f5-4d2f-9cf3-b8f93390df34"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:49.889206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0c13ca12-7de0-4c32-bc6d-09c5591ff5e5 req-408ff51e-c7a6-46e0-a521-8466f4d44608 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:49.890334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0c13ca12-7de0-4c32-bc6d-09c5591ff5e5 req-408ff51e-c7a6-46e0-a521-8466f4d44608 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:49.908162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0c13ca12-7de0-4c32-bc6d-09c5591ff5e5 req-408ff51e-c7a6-46e0-a521-8466f4d44608 service nova] Creating event network-vif-deleted:47ada0f9-32f5-4d2f-9cf3-b8f93390df34 for instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 on nch1-master-1 Jun 25 20:58:49.921980 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0c13ca12-7de0-4c32-bc6d-09c5591ff5e5 req-408ff51e-c7a6-46e0-a521-8466f4d44608 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047118 Jun 25 20:58:49.929342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 816/1821] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:49.936355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebb3d183-16f2-4c78-82de-0be599549754 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f984fda7160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:51.098389 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5efc11bc-d8dd-4987-8e81-a614a2bb47e6 tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364/action" status: 202 len: 0 microversion: 2.1 time: 3.455025 Jun 25 20:58:51.099931 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1006/1822] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:58:47 2022] POST /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364/action => generated 0 bytes in 3457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:58:51.108169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:51.110389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:51.134349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.136489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.137523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.141622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.373387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:51.387134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3320279-f09f-46f1-a942-f54aa200353d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.285007 Jun 25 20:58:51.388692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1007/1823] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:51 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:51.394900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:51.395940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:51.406437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.407617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.409181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.409917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.690272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:51.701230 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f625d7d-0464-4fc4-9993-442f6837cd16 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.311275 Jun 25 20:58:51.702181 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1008/1824] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:51 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:51.707583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:51.708391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:51.716884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.717377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.718469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:51.718891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:51.986999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:52.009530 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f80c6a8c-65f6-4467-8fe4-6f4b241bd4e3 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.300320 Jun 25 20:58:52.010707 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1009/1825] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:51 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:52.017843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2308d34f-5a07-4e2a-ba82-ce798e0403ee req-54d0536e-a7ae-443f-b8d1-ce4c70ad2993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e17bbe0-4781-4297-b66e-e14efff8ff89", "name": "network-vif-plugged", "status": "completed", "tag": "7d9656a5-de3a-4d66-ae87-64e3194f668d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:52.033546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2308d34f-5a07-4e2a-ba82-ce798e0403ee req-54d0536e-a7ae-443f-b8d1-ce4c70ad2993 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.034049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2308d34f-5a07-4e2a-ba82-ce798e0403ee req-54d0536e-a7ae-443f-b8d1-ce4c70ad2993 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.067138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2308d34f-5a07-4e2a-ba82-ce798e0403ee req-54d0536e-a7ae-443f-b8d1-ce4c70ad2993 service nova] Creating event network-vif-plugged:7d9656a5-de3a-4d66-ae87-64e3194f668d for instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 on nch1-master-1 Jun 25 20:58:52.077329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2308d34f-5a07-4e2a-ba82-ce798e0403ee req-54d0536e-a7ae-443f-b8d1-ce4c70ad2993 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064954 Jun 25 20:58:52.080027 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1010/1826] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:52.092178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:52.093321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 61a5abaa-9c65-4734-9aea-302bc97a7e38] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:52.109663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.111119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.114706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.115927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.162802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] HTTP exception thrown: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Request method failure captured: Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 HTTP/1.1 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WSQIuxZx9hQl8GLo9Xud5T5hLPSGSnUo6_jj2gejkqMbO6wpI7qU-E95jabWZZoFmy18y1WMT21c4a5th5vXMS2Gj4rh1FEvR9akt95XCzIv2sT8AyWsK-grfBrjBPTVqKx6CsppCO3AggWO5AwuJCDQx-5Jx7HS9W2vr6QJqPBsI Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.25 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:58:52.165161 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}] Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39e82edaa30d418d96ea37f942d62755 Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. Jun 25 20:58:52.166814 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '61a5abaa-9c65-4734-9aea-302bc97a7e38'} Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:58:52.167712 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. Jun 25 20:58:52.169190 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:58:52.170498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Returning 404 to user: Instance 61a5abaa-9c65-4734-9aea-302bc97a7e38 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:58:52.170498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b70e5c4-8b02-456d-a5d8-194be557a256 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38" status: 404 len: 111 microversion: 2.25 time: 0.082361 Jun 25 20:58:52.170498 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1011/1827] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:52 2022] GET /compute/v2.1/servers/61a5abaa-9c65-4734-9aea-302bc97a7e38 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:58:52.201877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:52.202500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:52.214418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.215047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.215831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.216384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.474862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:52.587251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:52.604313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-31a6ec48-41f6-4801-90e4-614e4b754be2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.434671 Jun 25 20:58:52.610710 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1012/1828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:52 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:52.621334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e8865d9-a0cd-4701-882a-c5b31f0cbdd3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef891f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:52.718445 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e8865d9-a0cd-4701-882a-c5b31f0cbdd3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1420 microversion: 2.1 time: 0.105614 Jun 25 20:58:52.719467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1013/1829] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:52 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:52.739110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:52.739742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:52.754745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.755185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:52.757677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:52.760860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.072841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:53.085248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2c893e7-9671-485b-ab3b-f654cab5629e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.364624 Jun 25 20:58:53.086594 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1014/1830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:52 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:53.093798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.094846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:53.104717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.105589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.107642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.109371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.298449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:53.303574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:53.308916 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-877ee093-dbca-4a94-8796-1e12b5bb3f8f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.220969 Jun 25 20:58:53.309525 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1015/1831] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:53 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:53.330078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8139a402-a656-438e-bc22-8500f2d6700f req-6fc990c9-8fd3-4911-9a96-cfc71de7b9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:53.338603 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ebb3d183-16f2-4c78-82de-0be599549754 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/e82251c4-a41c-4d2f-b68d-adaff3cb1672" status: 202 len: 0 microversion: 2.1 time: 3.405936 Jun 25 20:58:53.339229 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 817/1832] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:58:49 2022] DELETE /compute/v2.1/os-floating-ips/e82251c4-a41c-4d2f-b68d-adaff3cb1672 => generated 0 bytes in 3408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:58:53.348168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8139a402-a656-438e-bc22-8500f2d6700f req-6fc990c9-8fd3-4911-9a96-cfc71de7b9c9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.348742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8139a402-a656-438e-bc22-8500f2d6700f req-6fc990c9-8fd3-4911-9a96-cfc71de7b9c9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.349703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.350488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:53.363631 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8139a402-a656-438e-bc22-8500f2d6700f req-6fc990c9-8fd3-4911-9a96-cfc71de7b9c9 service nova] Creating event network-changed:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 20:58:53.366206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.366927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.368012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.369115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.369981 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8139a402-a656-438e-bc22-8500f2d6700f req-6fc990c9-8fd3-4911-9a96-cfc71de7b9c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043598 Jun 25 20:58:53.372600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1016/1833] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:53.385043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9768e902-76ef-4e88-8ebd-ddb1cc974220 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef89310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.444348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9768e902-76ef-4e88-8ebd-ddb1cc974220 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 200 len: 1420 microversion: 2.1 time: 0.065645 Jun 25 20:58:53.447225 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1017/1834] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:58:53 2022] GET /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:53.452665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.453699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:53.460746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.461506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.463550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.464213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.624828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:53.632621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f063cd5f-c96a-411f-9510-81961e728da1 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.184246 Jun 25 20:58:53.633237 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1018/1835] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:53 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:53.637720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9c0ecd09-bba0-498c-b1ef-bae55955b21e req-7029bcf2-2f9f-44f1-8142-31e988d1c129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6510c04-1595-4aa3-a25c-dd96ed7d3dd5", "tag": "060f4897-1004-418b-a057-202e9b75c7a8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:53.646281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9c0ecd09-bba0-498c-b1ef-bae55955b21e req-7029bcf2-2f9f-44f1-8142-31e988d1c129 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.646565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9c0ecd09-bba0-498c-b1ef-bae55955b21e req-7029bcf2-2f9f-44f1-8142-31e988d1c129 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.658245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9c0ecd09-bba0-498c-b1ef-bae55955b21e req-7029bcf2-2f9f-44f1-8142-31e988d1c129 service nova] Creating event network-changed:060f4897-1004-418b-a057-202e9b75c7a8 for instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 on nch2-master-1 Jun 25 20:58:53.664715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9c0ecd09-bba0-498c-b1ef-bae55955b21e req-7029bcf2-2f9f-44f1-8142-31e988d1c129 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029243 Jun 25 20:58:53.666931 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1019/1836] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:53.673350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f7a5867-66e2-4df9-91eb-452021a11c28 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f9861ea7ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.832176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:53.843960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65458cc8-bc89-49e0-a606-59b3005a06db tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1317 microversion: 2.1 time: 0.498815 Jun 25 20:58:53.846293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 818/1837] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:53 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:53.852758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a2cbe8d-f015-4327-b9db-4fcabe704ea6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fe59a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.891279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f7a5867-66e2-4df9-91eb-452021a11c28 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.221836 Jun 25 20:58:53.897288 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1020/1838] 10.222.0.39 () {58 vars in 1163 bytes} [Sat Jun 25 20:58:53 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:58:53.900929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:53.901600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:53.916784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.918391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.919551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:53.920124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:53.961969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:54.105466 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a16c3d25-591a-4cc1-bb9c-bf7c3e00064c tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 204 len: 0 microversion: 2.25 time: 0.210175 Jun 25 20:58:54.106317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1021/1839] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 20:58:53 2022] DELETE /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:58:54.113423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.114126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:54.125355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.125810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.127044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.127044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.347089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:54.367158 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59ed3fa6-de76-4b8a-ad06-25f5b74d7ca2 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.259417 Jun 25 20:58:54.367782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1022/1840] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:54.378535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9863706-7028-4690-88fb-7ebf899246b4 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f9861ec3430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.518971 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a2cbe8d-f015-4327-b9db-4fcabe704ea6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 204 len: 0 microversion: 2.1 time: 0.670588 Jun 25 20:58:54.519602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 819/1841] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:53 2022] DELETE /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:54.524091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2a394441-eb74-44d7-bdd3-0f84524a26eb req-d15ad8c3-1d71-4c40-96bb-c31d0eb18927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d01da1-fc87-48cb-8184-6b7cc48ad324", "name": "network-vif-plugged", "status": "completed", "tag": "479699ea-d4da-497b-a54c-4eafce081ef1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:54.537982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2a394441-eb74-44d7-bdd3-0f84524a26eb req-d15ad8c3-1d71-4c40-96bb-c31d0eb18927 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.538722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2a394441-eb74-44d7-bdd3-0f84524a26eb req-d15ad8c3-1d71-4c40-96bb-c31d0eb18927 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.559135 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2a394441-eb74-44d7-bdd3-0f84524a26eb req-d15ad8c3-1d71-4c40-96bb-c31d0eb18927 service nova] Creating event network-vif-plugged:479699ea-d4da-497b-a54c-4eafce081ef1 for instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 on nch2-master-1 Jun 25 20:58:54.566994 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2a394441-eb74-44d7-bdd3-0f84524a26eb req-d15ad8c3-1d71-4c40-96bb-c31d0eb18927 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045781 Jun 25 20:58:54.567930 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 820/1842] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:54.574173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.575116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:54.582078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.582535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.583320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.583759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.648363 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9863706-7028-4690-88fb-7ebf899246b4 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.276375 Jun 25 20:58:54.649591 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1023/1843] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:54.654958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.655609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:54.662973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.663432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.664246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.664759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.728637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:54.736766 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6f039ef-1625-43f6-82cb-f0ba061d41aa tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.167307 Jun 25 20:58:54.742766 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 821/1844] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:54.748319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.749160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:54.757727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.760626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.763496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.764142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.837340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:54.846562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:54.848241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:54.849569 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e33141ee-f610-4ef1-82e2-c60f9dfeb75d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1733 microversion: 2.25 time: 0.198865 Jun 25 20:58:54.850750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1024/1845] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:54.856508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.857292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:54.864692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.865150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.866116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:54.866557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:54.895651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:58:54.992565 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68ba2862-ea68-4022-8d98-74275749c716 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 204 len: 0 microversion: 2.1 time: 0.139952 Jun 25 20:58:54.993312 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1025/1846] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:58:54 2022] DELETE /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:58:54.998712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:54.999562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:55.017663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.018126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.018929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.019402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.020693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:55.029196 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-302606b5-5755-42ae-b939-e71045dbcb6b tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.285133 Jun 25 20:58:55.029881 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 822/1847] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:55.037667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e82a9c4c-ad12-4549-b1e4-10d7486d2250 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f984fd0cee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:55.186196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:55.194217 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f7963c11-8eda-410b-90e2-09316def0162 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.199720 Jun 25 20:58:55.194804 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1026/1848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:54 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:55.204056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:55.204709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:55.214438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.214894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.215684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.216556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.347816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:55.355798 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b5ee51f-5b05-4e10-9aaf-db805b38d1c6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1506 microversion: 2.1 time: 0.160015 Jun 25 20:58:55.356383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1027/1849] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:55 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:55.361083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1653037845", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "3c6cf7a6-2345-4f61-9904-003c4d5dc289"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:55.414193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] validate_networks() for [('3c6cf7a6-2345-4f61-9904-003c4d5dc289', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:58:55.788508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:58:55.788934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:58:55.789410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:58:55.789863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:58:55.790263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:58:55.799856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.800305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.801029 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e82a9c4c-ad12-4549-b1e4-10d7486d2250 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/1cbb724c-9486-42d8-a2f6-25a014695a97" status: 202 len: 0 microversion: 2.1 time: 0.769243 Jun 25 20:58:55.801197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.801678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 823/1850] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:58:55 2022] DELETE /compute/v2.1/os-floating-ips/1cbb724c-9486-42d8-a2f6-25a014695a97 => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:58:55.801796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.807606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:55.808817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:55.819593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.820221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:58:55.820379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.821169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.821615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.825015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for user dbd8d82d694941b58fa2d18311ea5785 and project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:58:55.836513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:58:55.839271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:58:55.884579 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f10fe47-52b1-4fcb-b724-ddd74ce160b6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527001 Jun 25 20:58:55.885535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1028/1851] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:58:55.895509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:55.896126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:55.906649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.907845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.908727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.909261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.959709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:55.968112 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf6e1d2f-bbbc-4c15-bdfc-f8570d3b950a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1506 microversion: 2.1 time: 0.165435 Jun 25 20:58:55.968807 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 824/1852] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:55 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:55.977588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dbf77332-187b-49de-a6a6-9fdb8e8a112c req-ae23f8a8-d480-4fac-97bc-ff08bfac5870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05eb5d50-12e0-4e26-a88f-36ca018ca9cf", "tag": "04d59076-9d40-4949-95e4-ed6a4845724f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:55.986499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dbf77332-187b-49de-a6a6-9fdb8e8a112c req-ae23f8a8-d480-4fac-97bc-ff08bfac5870 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:55.987203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dbf77332-187b-49de-a6a6-9fdb8e8a112c req-ae23f8a8-d480-4fac-97bc-ff08bfac5870 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:55.998701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dbf77332-187b-49de-a6a6-9fdb8e8a112c req-ae23f8a8-d480-4fac-97bc-ff08bfac5870 service nova] Creating event network-changed:04d59076-9d40-4949-95e4-ed6a4845724f for instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf on nch2-master-1 Jun 25 20:58:56.003741 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dbf77332-187b-49de-a6a6-9fdb8e8a112c req-ae23f8a8-d480-4fac-97bc-ff08bfac5870 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033516 Jun 25 20:58:56.004891 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 825/1853] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:56.011560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:56.012296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:56.018944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.019317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.020088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.020547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.063864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.071495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0f9d3ef-ac5b-4094-8d0c-5d793dc150c3 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.181937 Jun 25 20:58:56.072410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1029/1854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:55 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:56.086710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dacf2731-fe69-4c57-bb09-e682b3b0df64 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f984efcaaf0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:56.165783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.173657 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb7eed27-0f68-4836-a4f0-256b5c68be97 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.167402 Jun 25 20:58:56.183174 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 826/1855] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:56 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:56.183174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:56.183174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:56.186557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.187012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.188461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.188893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.358215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.367422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.369757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.371180 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1089627-a753-49dc-a819-9fc8fdb4e0de tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1733 microversion: 2.25 time: 0.195670 Jun 25 20:58:56.371954 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 827/1856] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:56 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:56.387771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:56.388500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:56.395327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.395869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.396766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.397276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.474754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:56.492155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6af1a4f4-dadb-4083-9087-0a0e4bdbbf67 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1212 microversion: 2.1 time: 0.107854 Jun 25 20:58:56.493500 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 828/1857] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:56 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1212 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:56.510932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:56.514307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:56.527061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.527961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.529031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.529634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.695169 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c38f453-5d76-4ece-b907-482c82c6c22d tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "PUT /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1078 microversion: 2.1 time: 0.193283 Jun 25 20:58:56.695840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 829/1858] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 20:58:56 2022] PUT /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1078 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:56.705302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:56.707364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:56.718184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.719161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.720011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:56.720475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:56.754817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:57.717268 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dacf2731-fe69-4c57-bb09-e682b3b0df64 tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/1b179240-c3ba-4659-afbc-d680fabf8f56" status: 202 len: 0 microversion: 2.1 time: 1.635842 Jun 25 20:58:57.727935 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1030/1859] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:58:56 2022] DELETE /compute/v2.1/os-floating-ips/1b179240-c3ba-4659-afbc-d680fabf8f56 => generated 0 bytes in 1652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:58:57.735152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:57.736554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:57.746785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:57.752188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:57.753185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:57.753688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:57.987494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:57.999055 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a4cc4736-38fc-4a51-973d-0f1205b7e37e tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 1.301342 Jun 25 20:58:58.000238 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 830/1860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:56 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:58.005868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-588e3870-c81a-472e-8a34-b76e9b4aee96 req-1767337e-de63-4100-b19e-11218aeffaec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7335cff-0cba-4acd-8c67-5ae7c8bdbf99", "name": "network-vif-unplugged", "status": "completed", "tag": "01332024-f454-43ee-8562-8a92172352de"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:58.016047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-588e3870-c81a-472e-8a34-b76e9b4aee96 req-1767337e-de63-4100-b19e-11218aeffaec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.017461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-588e3870-c81a-472e-8a34-b76e9b4aee96 req-1767337e-de63-4100-b19e-11218aeffaec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.033409 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-588e3870-c81a-472e-8a34-b76e9b4aee96 req-1767337e-de63-4100-b19e-11218aeffaec service nova] Creating event network-vif-unplugged:01332024-f454-43ee-8562-8a92172352de for instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 on nch1-master-1 Jun 25 20:58:58.039838 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-588e3870-c81a-472e-8a34-b76e9b4aee96 req-1767337e-de63-4100-b19e-11218aeffaec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038167 Jun 25 20:58:58.041242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 831/1861] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:58.048886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.049798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:58.058140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.059141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.060035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.060602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.073975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.087045 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9829d930-3cbf-486d-b931-296cfe9eb6ac tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.356648 Jun 25 20:58:58.088758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1031/1862] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:57 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:58.095340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.096195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:58.104000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.104904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.105973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.106632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.353710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.374553 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41b4a228-eb53-498a-94ef-274431865d96 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.284271 Jun 25 20:58:58.375510 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1032/1863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:58 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:58.392100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.398402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:58.405624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.406321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.407373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.408137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.412362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.425313 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2092560d-69df-4140-be77-9e8e758ee9f0 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1504 microversion: 2.1 time: 0.382618 Jun 25 20:58:58.426390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 832/1864] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:58 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1504 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:58.431370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.432248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:58.438712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.439470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.440533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.441315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.644967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.659938 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-27f80ba6-05a3-4bfb-ab77-d85333a7e8af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.283067 Jun 25 20:58:58.661422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1033/1865] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:58 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:58.668961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.670257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:58.678090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.678602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.679452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:58.680104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:58.753566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.764830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.766993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.768529 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1fa26b3d-9fba-4e3a-9304-ad8e513efe11 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1733 microversion: 2.25 time: 0.340913 Jun 25 20:58:58.781698 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 833/1866] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:58:58 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1733 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:58:58.788655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53011219-7cc0-4dce-81ba-a78e8645a2cc tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] Calling method '.version_select at 0x7f984fd0c9d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:58.975123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:58.984279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af5275c4-d7db-4268-9622-ebfae53908fc tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.320826 Jun 25 20:58:58.994255 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1034/1867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:58 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:59.002031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9cae21ec-4e27-4950-9f22-40d5534ea40f req-1962f971-7536-4747-b709-a4950f3ce76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7335cff-0cba-4acd-8c67-5ae7c8bdbf99", "name": "network-vif-deleted", "tag": "01332024-f454-43ee-8562-8a92172352de"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:59.021062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:59.026650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9cae21ec-4e27-4950-9f22-40d5534ea40f req-1962f971-7536-4747-b709-a4950f3ce76c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.027265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9cae21ec-4e27-4950-9f22-40d5534ea40f req-1962f971-7536-4747-b709-a4950f3ce76c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.042151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:58:59.044713 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9cae21ec-4e27-4950-9f22-40d5534ea40f req-1962f971-7536-4747-b709-a4950f3ce76c service nova] Creating event network-vif-deleted:01332024-f454-43ee-8562-8a92172352de for instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 on nch1-master-1 Jun 25 20:58:59.051509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9cae21ec-4e27-4950-9f22-40d5534ea40f req-1962f971-7536-4747-b709-a4950f3ce76c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064903 Jun 25 20:58:59.052736 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1035/1868] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:58:59.059266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:59.060208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:59.074603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.075160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.076069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.077044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.218059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:59.227506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25eb5a78-fb3f-44b0-82f0-c2391fa7f039 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1504 microversion: 2.1 time: 0.173510 Jun 25 20:58:59.228173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1036/1869] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:59 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:59.232776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:59.233387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:59.239927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.240377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.241215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.241663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.393587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:59.401864 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c28d4caf-906c-4c50-bba0-0add35a10cbc tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.172610 Jun 25 20:58:59.402819 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1037/1870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:59 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:59.409430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:59.410724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:59.418033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.418899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.419850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.420388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.701099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:58:59.712312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-675e8401-a8ab-4296-b8e3-ab36fbdd6452 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.307922 Jun 25 20:58:59.712766 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1038/1871] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:59 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:59.727719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:58:59.729282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:59.738556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.739297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.740477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.741122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.845521 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c729b602-a424-4e7c-9310-cedac0df3bfc tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "PUT /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1080 microversion: 2.1 time: 0.121944 Jun 25 20:58:59.856141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1039/1872] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 20:58:59 2022] PUT /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1080 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:58:59.861828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:58:59.862796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:58:59.869775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.870446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:58:59.871447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:58:59.872057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.091121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.099514 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21765081-5d08-4bcb-b73e-8fc9109c2d65 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.241782 Jun 25 20:59:00.109694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1040/1873] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:58:59 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:00.109694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-508c2755-408e-4a56-8c76-0038c4120e44 req-a9c639d5-0ddb-416b-bbde-d045d7ef6671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17998ec5-9b8b-407d-b3c2-b9357a37d6a3", "name": "network-vif-deleted", "tag": "9b660271-3a00-4972-bc1f-8e297b598be6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:00.118713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-508c2755-408e-4a56-8c76-0038c4120e44 req-a9c639d5-0ddb-416b-bbde-d045d7ef6671 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.119172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-508c2755-408e-4a56-8c76-0038c4120e44 req-a9c639d5-0ddb-416b-bbde-d045d7ef6671 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.122905 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53011219-7cc0-4dce-81ba-a78e8645a2cc tempest-FloatingIPDetailsTestJSON-435933518 tempest-FloatingIPDetailsTestJSON-435933518-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/da0949c8-0358-434d-af8f-3640ffc71b6f" status: 202 len: 0 microversion: 2.1 time: 1.339740 Jun 25 20:59:00.124243 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 834/1874] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 20:58:58 2022] DELETE /compute/v2.1/os-floating-ips/da0949c8-0358-434d-af8f-3640ffc71b6f => generated 0 bytes in 1341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:00.128756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.129447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.137906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-508c2755-408e-4a56-8c76-0038c4120e44 req-a9c639d5-0ddb-416b-bbde-d045d7ef6671 service nova] Creating event network-vif-deleted:9b660271-3a00-4972-bc1f-8e297b598be6 for instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 on nch2-master-1 Jun 25 20:59:00.143181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.143353 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-508c2755-408e-4a56-8c76-0038c4120e44 req-a9c639d5-0ddb-416b-bbde-d045d7ef6671 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Jun 25 20:59:00.143780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.144376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1041/1875] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:00.144823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.145323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.150147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.151915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.160574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.161093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.161887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.162332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.272463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.282820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.293196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.295073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aef15e9d-0a67-43cc-a0c2-b0b38381d621 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1665 microversion: 2.25 time: 0.149465 Jun 25 20:59:00.296113 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1042/1876] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:59:00.308789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.311910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.328797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.331969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.336279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.338933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.457613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.466005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-535ed855-594f-4d2b-bf10-223944a1d818 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.340926 Jun 25 20:59:00.478462 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 835/1877] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:00.486893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.487609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.504749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.505696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.506687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.507172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.626306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.642557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2457159b-973a-41dd-adac-c569ee9c6b06 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1506 microversion: 2.1 time: 0.344484 Jun 25 20:59:00.644246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1043/1878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1506 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:00.649205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6510c04-1595-4aa3-a25c-dd96ed7d3dd5", "name": "network-vif-plugged", "status": "completed", "tag": "060f4897-1004-418b-a057-202e9b75c7a8"}, {"server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "name": "network-vif-plugged", "status": "completed", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:00.665870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.667936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.687673 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] Creating event network-vif-plugged:060f4897-1004-418b-a057-202e9b75c7a8 for instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 on nch2-master-1 Jun 25 20:59:00.688240 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] Creating event network-vif-plugged:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 20:59:00.699255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ccaaf690-4d71-4181-a940-4837821d75ad req-5a6fd1d5-22e2-46a3-bf4d-8b5280d47ea6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053586 Jun 25 20:59:00.700211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1044/1879] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:00.707622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.708608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.716730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.718382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.719455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.722032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.753246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.762709 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-80d05545-7257-4943-8536-e4246ca38b5e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.290148 Jun 25 20:59:00.768317 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 836/1880] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:00.786580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.787437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.813914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.814390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.824249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.824937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.907947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:00.921193 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99219189-d003-425b-86c0-5642a29376e3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.219341 Jun 25 20:59:00.922090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1045/1881] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:00.927410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:00.928267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:00.936985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.937750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:00.938771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:00.939379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.101825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.115589 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-842620e7-135e-45e6-865a-43cb4cd32bea tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.192178 Jun 25 20:59:01.116230 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1046/1882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:01.123411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2bd05501-8716-4dac-8af6-fcaccb81deb8 req-a51ed1f1-29a8-4cff-b95f-75af85c86f4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71042147-6277-4f59-a301-a2164d61048f", "tag": "9e8c7b4e-7970-4bc3-a805-1c6a00bc2287"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:01.132078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2bd05501-8716-4dac-8af6-fcaccb81deb8 req-a51ed1f1-29a8-4cff-b95f-75af85c86f4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.132524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2bd05501-8716-4dac-8af6-fcaccb81deb8 req-a51ed1f1-29a8-4cff-b95f-75af85c86f4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.144582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2bd05501-8716-4dac-8af6-fcaccb81deb8 req-a51ed1f1-29a8-4cff-b95f-75af85c86f4e service nova] Creating event network-changed:9e8c7b4e-7970-4bc3-a805-1c6a00bc2287 for instance 71042147-6277-4f59-a301-a2164d61048f on nch2-master-1 Jun 25 20:59:01.150012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2bd05501-8716-4dac-8af6-fcaccb81deb8 req-a51ed1f1-29a8-4cff-b95f-75af85c86f4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030075 Jun 25 20:59:01.150898 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1047/1883] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:01.156541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.166378 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-970834ac-9911-4ce1-b535-bc4b714b0f3e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1506 microversion: 2.1 time: 0.393588 Jun 25 20:59:01.166704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.176504 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 837/1884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:00 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:01.176705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.176705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.176705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.176705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.177143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.186089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.186956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.193518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:01.200181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.200800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.202053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.202855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.240305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:01.316462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.325107 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe1d75a8-bb74-41fa-9745-ab2b11fedcef tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1324 microversion: 2.1 time: 0.172786 Jun 25 20:59:01.326308 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1048/1885] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:01 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:01.331568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.332609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.339764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.340204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.341600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.342339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.369506 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-330eace0-3718-4308-a2c3-cf0098ed52cb tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 204 len: 0 microversion: 2.1 time: 0.188757 Jun 25 20:59:01.370403 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 838/1886] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:01 2022] DELETE /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:01.380998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.381896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.389942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.390406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.391407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.392012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.419412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.424962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:01.429501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.431107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.432497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c41c151e-c214-43fa-abca-014a5e379ec4 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 200 len: 1665 microversion: 2.25 time: 0.105140 Jun 25 20:59:01.433365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1049/1887] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:01 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 1665 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:59:01.473897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Instance is already in deleting state, ignoring this request Jun 25 20:59:01.474731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50ad72a5-8fa6-4c86-8bd8-be02466b9a2a tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 204 len: 0 microversion: 2.1 time: 0.098471 Jun 25 20:59:01.475300 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 839/1888] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:01 2022] DELETE /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:01.484102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.484798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.486744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.487918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.491946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.492497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.493428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.493923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.497219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.497219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.497922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.498365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.637299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:01.644572 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e34664a-b74e-434e-966f-8232d8886438 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1512 microversion: 2.1 time: 0.163314 Jun 25 20:59:01.645313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1050/1889] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:01 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:01.793390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:01.795893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:01.803185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.803846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:01.805039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:01.805596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.038866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.047127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93aedcbd-d977-43da-9781-790173691e85 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.265292 Jun 25 20:59:02.047730 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1051/1890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:01 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:02.052494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.053113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.060926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.061468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.062350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.062868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.203085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.227423 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-318c433c-fb41-4e53-a847-9a0fa7516da5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.746604 Jun 25 20:59:02.228244 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 840/1891] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:01 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:02.242542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.243217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.249626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.250086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.250860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.251305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.278119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.288172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1fc7f353-3494-4c31-9770-56d5a56bb5d5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1323 microversion: 2.1 time: 0.239223 Jun 25 20:59:02.298389 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1052/1892] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:02.352385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.353203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.365420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.366332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.367391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.368459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.718940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.729221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:02.731784 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3821465d-ac94-422e-9fac-e47fad8921ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1519 microversion: 2.1 time: 0.383197 Jun 25 20:59:02.732927 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1053/1893] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:02.738172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.739518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: 17998ec5-9b8b-407d-b3c2-b9357a37d6a3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.752857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.754208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.754753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.755433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.772783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] HTTP exception thrown: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Request method failure captured: Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 HTTP/1.1 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WSQIuxZx9hQl8GLo9Xud5T5hLPSGSnUo6_jj2gejkqMbO6wpI7qU-E95jabWZZoFmy18y1WMT21c4a5th5vXMS2Gj4rh1FEvR9akt95XCzIv2sT8AyWsK-grfBrjBPTVqKx6CsppCO3AggWO5AwuJCDQx-5Jx7HS9W2vr6QJqPBsI Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.25 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:02.774863 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}] Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39e82edaa30d418d96ea37f942d62755 Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. Jun 25 20:59:02.776829 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '17998ec5-9b8b-407d-b3c2-b9357a37d6a3'} Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:02.781292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. Jun 25 20:59:02.783019 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:02.784531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Returning 404 to user: Instance 17998ec5-9b8b-407d-b3c2-b9357a37d6a3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:02.784531 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0faeeb2-9cee-4083-a739-8bc821dad86b tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3" status: 404 len: 111 microversion: 2.25 time: 0.042446 Jun 25 20:59:02.784531 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1054/1894] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/17998ec5-9b8b-407d-b3c2-b9357a37d6a3 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:02.784531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.784531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.789233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.789682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.790441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.790875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.820140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.830322 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35f539f0-329e-4b57-b0cf-95e4cd0eaa7b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.593764 Jun 25 20:59:02.834794 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 841/1895] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:02.847318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.848028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:02.854964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.855782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.856984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:02.857413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:02.883846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:02.979352 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30025159-d4c2-413e-a734-21fa7912f495 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 204 len: 0 microversion: 2.1 time: 0.141717 Jun 25 20:59:02.981358 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 842/1896] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:02 2022] DELETE /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:02.986291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:02.988967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a45de9a2-1fbf-4b43-945d-95900070c6da tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '.version_select at 0x7f984fd97280>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:02.998326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0aa22a6e-c5b0-46d1-beb1-c5e26b5525f7 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1512 microversion: 2.1 time: 0.219694 Jun 25 20:59:02.999870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1055/1897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:03.004549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:03.005189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:03.013433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.013889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.014671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.015111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.045077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a45de9a2-1fbf-4b43-945d-95900070c6da tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269717586" status: 204 len: 0 microversion: 2.25 time: 0.061782 Jun 25 20:59:03.046846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 843/1898] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 20:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1269717586 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:59:03.065728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:03.067162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:03.075112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.075876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.077166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.078462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.506640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:03.515350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32e954cc-1454-4b3a-86b1-9c5a1f3b7dc1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.455115 Jun 25 20:59:03.526188 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 844/1899] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:03 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:03.526188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:03.526188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:03.532679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.533432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.535047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.535047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.541930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:03.779500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:03.793238 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0344175b-df63-4621-96ee-4224bf0f94ec tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1525 microversion: 2.1 time: 0.792237 Jun 25 20:59:03.793987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1056/1900] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:02 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1525 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:03.798507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:03.799118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:03.818374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.819074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.820041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:03.820663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:03.960599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:03.971759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ec15ea2-af25-421f-83f4-79e7d45681d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.453789 Jun 25 20:59:03.982765 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 845/1901] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:03 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:03.992380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3aa66102-ae4e-428f-8e4e-7ddbd5cca521 req-a63a941d-44ef-47c8-a34e-9224e1cc976c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "name": "network-vif-unplugged", "status": "completed", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:04.009113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3aa66102-ae4e-428f-8e4e-7ddbd5cca521 req-a63a941d-44ef-47c8-a34e-9224e1cc976c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.010731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3aa66102-ae4e-428f-8e4e-7ddbd5cca521 req-a63a941d-44ef-47c8-a34e-9224e1cc976c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.028450 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3aa66102-ae4e-428f-8e4e-7ddbd5cca521 req-a63a941d-44ef-47c8-a34e-9224e1cc976c service nova] Creating event network-vif-unplugged:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:59:04.039328 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3aa66102-ae4e-428f-8e4e-7ddbd5cca521 req-a63a941d-44ef-47c8-a34e-9224e1cc976c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055159 Jun 25 20:59:04.040778 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 846/1902] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:04.049774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:04.051057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:04.060681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.061383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.062728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.063346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.239598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:04.247979 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2d0dab3-8662-4b20-8499-cf380e3a9eab tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1519 microversion: 2.1 time: 0.452951 Jun 25 20:59:04.248942 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1057/1903] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:03 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1519 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:04.253569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:04.254430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:04.271607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.272019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.283314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.283778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.431597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:04.439962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fdecac5d-c64f-40dc-91ff-d8c486cb038b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.394969 Jun 25 20:59:04.450310 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 847/1904] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:04 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:04.457504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-57c89310-2c5f-435a-bd8a-c03894dd5483 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'create', calling method: .version_select at 0x7f984fd99550>, body: {"pool": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:04.756719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdf4dbb95b6a440fad542fad69b6a5d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0705a9948d8b49b5a41cde4819c470d0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:04.792737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-12d0bf22-a60e-4919-8fc9-5420fd758d2b tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 200 len: 1512 microversion: 2.1 time: 0.538061 Jun 25 20:59:04.797426 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1058/1905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:04 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 1512 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:04.812519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:04.818354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:04.845579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.853757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:04.856870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:04.857762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:05.482285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:05.495487 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7aec7738-f50e-4de7-9746-0ade55d25712 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.696496 Jun 25 20:59:05.496750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1059/1906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:04 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:05.501767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:05.505379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:05.524845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:05.525529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:05.526717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:05.527353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:05.782561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:05.795148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e41b886-6ff8-465a-9b13-e1db87fd9f0b tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1525 microversion: 2.1 time: 0.296882 Jun 25 20:59:05.796640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1060/1907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:05 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1525 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:05.802437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:05.803410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:05.811486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:05.814828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:05.815536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:05.816613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:05.817907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:05.850148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=24 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:06.199566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:06.216777 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ef33aa97-d8c4-48b6-a6de-6a0344124ab4 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.418689 Jun 25 20:59:06.217704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1061/1908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:05 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:06.222976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:06.223732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:06.234554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.235103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.235959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.236639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.269019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:06.426120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2206909-77d1-41e9-9d88-cd190a8c3bfa tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 204 len: 0 microversion: 2.25 time: 0.206142 Jun 25 20:59:06.427309 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1062/1909] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 20:59:06 2022] DELETE /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 20:59:06.437184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:06.438111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:06.445474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.446110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.446973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.447506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.657156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-57c89310-2c5f-435a-bd8a-c03894dd5483 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.204899 Jun 25 20:59:06.659205 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 848/1910] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 20:59:04 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:06.673572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:06.689676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d405f898-864e-4ae3-b9a9-9a1ef22c8474 req-526c226f-a3ee-438f-bd12-3c2009adf12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05eb5d50-12e0-4e26-a88f-36ca018ca9cf", "name": "network-vif-plugged", "status": "completed", "tag": "04d59076-9d40-4949-95e4-ed6a4845724f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:06.698244 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4dfa68ed-6dd4-4ee0-a30c-b5c0a6cd6225 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.269196 Jun 25 20:59:06.700497 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1063/1911] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:06 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:06.722482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:06.729987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d405f898-864e-4ae3-b9a9-9a1ef22c8474 req-526c226f-a3ee-438f-bd12-3c2009adf12e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.730363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 8e17bbe0-4781-4297-b66e-e14efff8ff89] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:06.732622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d405f898-864e-4ae3-b9a9-9a1ef22c8474 req-526c226f-a3ee-438f-bd12-3c2009adf12e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.745358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.745882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.746770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.747206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.759198 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d405f898-864e-4ae3-b9a9-9a1ef22c8474 req-526c226f-a3ee-438f-bd12-3c2009adf12e service nova] Creating event network-vif-plugged:04d59076-9d40-4949-95e4-ed6a4845724f for instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf on nch2-master-1 Jun 25 20:59:06.775732 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d405f898-864e-4ae3-b9a9-9a1ef22c8474 req-526c226f-a3ee-438f-bd12-3c2009adf12e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114787 Jun 25 20:59:06.782721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] HTTP exception thrown: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. Jun 25 20:59:06.784531 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 849/1912] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:06.790946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}, {"server_uuid": "8e17bbe0-4781-4297-b66e-e14efff8ff89", "name": "network-vif-deleted", "tag": "7d9656a5-de3a-4d66-ae87-64e3194f668d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Request method failure captured: Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 HTTP/1.1 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ZRSnDU52aOdVwR1t9Afm3MayA9yF0t5LDvD0S13i-LiHN_RG2HHncVcNpii8kxNrana77zQ0ecJl381I2eQ9NqOGU9XyEB322SJX_WNuLwn0YDQZiKAM7cyKgrJKyIUCBSK-JYJnxat1w98zWO2jrAt_xNmbP_Pu1yTYJF8GEdPWI Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:06.794915 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}] Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cdf4dbb95b6a440fad542fad69b6a5d8 Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. Jun 25 20:59:06.797107 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8e17bbe0-4781-4297-b66e-e14efff8ff89'} Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:06.798022 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. Jun 25 20:59:06.800154 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:06.801651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Returning 404 to user: Instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:06.801651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-469979b2-104d-42b8-ade9-d9984595231e tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89" status: 404 len: 111 microversion: 2.1 time: 0.080715 Jun 25 20:59:06.801651 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1064/1913] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:06 2022] GET /compute/v2.1/servers/8e17bbe0-4781-4297-b66e-e14efff8ff89 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:06.817467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.817917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.820068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:06.820741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:06.841747 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] Creating event network-changed:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:59:06.842370 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] Creating event network-vif-deleted:7d9656a5-de3a-4d66-ae87-64e3194f668d for instance 8e17bbe0-4781-4297-b66e-e14efff8ff89 on nch1-master-1 Jun 25 20:59:06.845712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.846177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.847010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.847474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.865863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-70f58dc8-fe39-4841-abf0-09749d4919f4 req-5e6fc394-75e1-45fe-a044-aa96d069ea1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.079780 Jun 25 20:59:06.867112 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 850/1914] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:06.876893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:06.877845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:06.892631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.893363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:06.894466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:06.895066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.260400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:07.275449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:07.280927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:07.282780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e20fb788-a7b0-4331-8af7-d3f1b19282c9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1548 microversion: 2.25 time: 0.478708 Jun 25 20:59:07.286959 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1065/1915] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:06 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1548 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:59:07.324992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1684707379", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "5441c203-76d7-4c33-bb38-eafe7bc56559"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:07.423781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] validate_networks() for [('5441c203-76d7-4c33-bb38-eafe7bc56559', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:59:07.425152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:07.444307 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b870442-75ca-400e-b7dd-d114e29a0907 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.573820 Jun 25 20:59:07.457117 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 851/1916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:06 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:07.462571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:07.463718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:07.471582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.472319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.473481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.474087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.494378 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] HTTP exception thrown: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Request method failure captured: Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c HTTP/1.1 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ZRSnDU52aOdVwR1t9Afm3MayA9yF0t5LDvD0S13i-LiHN_RG2HHncVcNpii8kxNrana77zQ0ecJl381I2eQ9NqOGU9XyEB322SJX_WNuLwn0YDQZiKAM7cyKgrJKyIUCBSK-JYJnxat1w98zWO2jrAt_xNmbP_Pu1yTYJF8GEdPWI Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:07.497173 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}] Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cdf4dbb95b6a440fad542fad69b6a5d8 Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:07.499066 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '144c68b4-6ee5-44a9-afd3-8143cce8d29c'} Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:07.500052 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:07.501487 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:07.503905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Returning 404 to user: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:07.504994 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af223038-3507-4ff6-92cf-77381c1c2aad tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 404 len: 111 microversion: 2.1 time: 0.046382 Jun 25 20:59:07.506071 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 852/1917] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:07 2022] DELETE /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:07.511151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:07.512008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:07.519671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.520385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.522624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.522868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.971164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:07.982225 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f568b3ff-ba9f-42e5-b985-7c88814b4708 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1525 microversion: 2.1 time: 0.474680 Jun 25 20:59:07.983216 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 853/1918] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:07 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1525 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:07.988350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:07.989202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:07.995525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.996221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:07.997301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:07.998025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.368178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:08.382652 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69e66a2f-1577-4eae-95c3-06eac7d77c91 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.398012 Jun 25 20:59:08.383847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 854/1919] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:07 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:08.390554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:08.391370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: 144c68b4-6ee5-44a9-afd3-8143cce8d29c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:08.404945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.405591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.406385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.406879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.435399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] HTTP exception thrown: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Request method failure captured: Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c HTTP/1.1 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ZRSnDU52aOdVwR1t9Afm3MayA9yF0t5LDvD0S13i-LiHN_RG2HHncVcNpii8kxNrana77zQ0ecJl381I2eQ9NqOGU9XyEB322SJX_WNuLwn0YDQZiKAM7cyKgrJKyIUCBSK-JYJnxat1w98zWO2jrAt_xNmbP_Pu1yTYJF8GEdPWI Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:08.441883 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}] Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cdf4dbb95b6a440fad542fad69b6a5d8 Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:08.444022 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '144c68b4-6ee5-44a9-afd3-8143cce8d29c'} Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:08.445509 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. Jun 25 20:59:08.449414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.456147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Returning 404 to user: Instance 144c68b4-6ee5-44a9-afd3-8143cce8d29c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:08.456147 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-91b784b2-08af-4d45-81f3-2154acd5a834 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c" status: 404 len: 111 microversion: 2.1 time: 0.064295 Jun 25 20:59:08.456147 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 855/1920] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:08 2022] GET /compute/v2.1/servers/144c68b4-6ee5-44a9-afd3-8143cce8d29c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:08.459634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:08.461283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:08.478669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.479475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.481157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.483076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.704108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:08.714163 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d59a135-5880-418f-a443-e7d51d27365c tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.262330 Jun 25 20:59:08.724375 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 856/1921] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:08 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:08.730793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:08.731364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:08.739919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.740712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.741592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.742242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.783621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.784286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.785034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lazy-loading 'fault' on Instance uuid c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:59:08.845544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:08.855124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:08.858104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:08.859390 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32f470c0-c633-473e-b9f7-f5b031a68949 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 200 len: 1351 microversion: 2.25 time: 0.133586 Jun 25 20:59:08.860060 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 857/1922] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:08 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:59:08.865434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:08.866675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:08.881701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.882525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.883692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.884555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.903576 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] HTTP exception thrown: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Request method failure captured: Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 HTTP/1.1 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ZRSnDU52aOdVwR1t9Afm3MayA9yF0t5LDvD0S13i-LiHN_RG2HHncVcNpii8kxNrana77zQ0ecJl381I2eQ9NqOGU9XyEB322SJX_WNuLwn0YDQZiKAM7cyKgrJKyIUCBSK-JYJnxat1w98zWO2jrAt_xNmbP_Pu1yTYJF8GEdPWI Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:08.905663 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}] Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cdf4dbb95b6a440fad542fad69b6a5d8 Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:08.907197 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'da9b59ef-7ca9-4fea-b49d-66fe34e9c813'} Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:08.908170 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:08.909584 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:08.912787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Returning 404 to user: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:08.914002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d753d79b-9734-46cc-9eec-a97997daa0ff tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "DELETE /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 404 len: 111 microversion: 2.1 time: 0.052918 Jun 25 20:59:08.915163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 858/1923] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:08 2022] DELETE /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:08.921839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:08.923130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:08.930391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.931341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:08.932322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:08.933230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.098917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:59:09.099503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:59:09.099809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:59:09.100219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:59:09.100698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:59:09.113444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.113909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.114764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.115252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.136479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:09.141201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Getting quotas for project ffbad622c26749aebba510fde1cb72c0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:09.145764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Getting quotas for user da55b52fd3b54e549d9de4b92b76f6ee and project ffbad622c26749aebba510fde1cb72c0. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:09.149943 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8256f99-a989-4500-9b03-a16be4fd8af0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.233343 Jun 25 20:59:09.150882 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 859/1924] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:08 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:09.158507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d01da1-fc87-48cb-8184-6b7cc48ad324", "name": "network-vif-deleted", "tag": "479699ea-d4da-497b-a54c-4eafce081ef1"}, {"server_uuid": "c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5", "name": "network-vif-deleted", "tag": "88d0a34f-d827-4a2b-8970-88cedbb6c6a8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:09.169019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:59:09.169248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.169520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.171969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:59:09.189342 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] Creating event network-vif-deleted:479699ea-d4da-497b-a54c-4eafce081ef1 for instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 on nch2-master-1 Jun 25 20:59:09.189805 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] Creating event network-vif-deleted:88d0a34f-d827-4a2b-8970-88cedbb6c6a8 for instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 on nch1-master-1 Jun 25 20:59:09.202224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-93058435-c91d-4351-864f-9c6a96acb835 req-225c54a8-e4d9-4eea-a342-06cd5c5b7c86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049685 Jun 25 20:59:09.202939 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 860/1925] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:09.208682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.209482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] [instance: da9b59ef-7ca9-4fea-b49d-66fe34e9c813] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.217494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.218284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.219231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.219965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.222140 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bae495f-bffa-47ac-a1b8-468f8a7970d7 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.933705 Jun 25 20:59:09.227749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1066/1926] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:59:09.231786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.232463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.235594 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] HTTP exception thrown: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Request method failure captured: Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 HTTP/1.1 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ZRSnDU52aOdVwR1t9Afm3MayA9yF0t5LDvD0S13i-LiHN_RG2HHncVcNpii8kxNrana77zQ0ecJl381I2eQ9NqOGU9XyEB322SJX_WNuLwn0YDQZiKAM7cyKgrJKyIUCBSK-JYJnxat1w98zWO2jrAt_xNmbP_Pu1yTYJF8GEdPWI Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:09.237233 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0705a9948d8b49b5a41cde4819c470d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0705a9948d8b49b5a41cde4819c470d0"}]}] Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0705a9948d8b49b5a41cde4819c470d0 Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1919841849 Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cdf4dbb95b6a440fad542fad69b6a5d8 Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiskConfigTestJSON-1919841849-project Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:09.238791 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'da9b59ef-7ca9-4fea-b49d-66fe34e9c813'} Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:09.239817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. Jun 25 20:59:09.241195 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.242422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] Returning 404 to user: Instance da9b59ef-7ca9-4fea-b49d-66fe34e9c813 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:09.242422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a92aaf86-27c6-4030-8afb-7f6f3276f9a6 tempest-ServerDiskConfigTestJSON-1919841849 tempest-ServerDiskConfigTestJSON-1919841849-project] 10.222.0.39 "GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813" status: 404 len: 111 microversion: 2.1 time: 0.034773 Jun 25 20:59:09.242422 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 861/1927] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/da9b59ef-7ca9-4fea-b49d-66fe34e9c813 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:09.244271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f98fb7c-c0dc-4fd5-a8a7-df9746282edd tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.244908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6f98fb7c-c0dc-4fd5-a8a7-df9746282edd tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.248658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.249412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.250918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.252225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.290075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.290790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.291489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lazy-loading 'fault' on Instance uuid 58d01da1-fc87-48cb-8184-6b7cc48ad324 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:59:09.380491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '662ef2b3df5e4c59b373fccab9c911c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd2dd16178804914b9afde659428992f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:09.388925 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f276aaef-404e-4224-bed6-ebd2d24e5578 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 200 len: 1314 microversion: 2.1 time: 0.164605 Jun 25 20:59:09.400296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1067/1928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:09.405673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.406501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.413402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.414326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.415425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.416019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.427471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6f98fb7c-c0dc-4fd5-a8a7-df9746282edd tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:09.437501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f98fb7c-c0dc-4fd5-a8a7-df9746282edd tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1224 microversion: 2.1 time: 0.197132 Jun 25 20:59:09.444886 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 862/1929] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1224 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:09.723852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:09.732266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.733045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.739811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7e76d0d-2e08-4863-afc0-d51737177448 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.337601 Jun 25 20:59:09.742261 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1068/1930] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:09.742964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.743642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.744653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.745329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.879019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.879805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.891569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.892132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.893003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.893449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.920088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] HTTP exception thrown: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Request method failure captured: Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 HTTP/1.1 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WSQIuxZx9hQl8GLo9Xud5T5hLPSGSnUo6_jj2gejkqMbO6wpI7qU-E95jabWZZoFmy18y1WMT21c4a5th5vXMS2Gj4rh1FEvR9akt95XCzIv2sT8AyWsK-grfBrjBPTVqKx6CsppCO3AggWO5AwuJCDQx-5Jx7HS9W2vr6QJqPBsI Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.25 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:09.921936 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}] Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39e82edaa30d418d96ea37f942d62755 Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. Jun 25 20:59:09.923791 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5'} Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:09.924768 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. Jun 25 20:59:09.926358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:09.929322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Returning 404 to user: Instance c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:09.930362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d832942c-54b8-4a81-93a5-d6af9a058b0d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5" status: 404 len: 111 microversion: 2.25 time: 0.056321 Jun 25 20:59:09.931119 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1069/1931] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/c6a2e5f9-3c24-4e1d-9527-998f3cbd21d5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:09.939251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:09.939747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:09.946265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.946735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:09.947534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:09.947970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.002304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:10.051197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:10.064247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.074243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63a9fe2e-6322-4db0-b70a-71b93d87f455 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1318 microversion: 2.1 time: 0.346452 Jun 25 20:59:10.074865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 863/1932] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:09 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:10.129919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9da4c4a0-3ef2-43a6-8ee1-11b2e4496255 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 204 len: 0 microversion: 2.25 time: 0.194238 Jun 25 20:59:10.131889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1070/1933] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 20:59:09 2022] DELETE /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 25 20:59:10.140451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.141087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.149318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.150561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.151669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.152540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.170601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.172657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.180189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:10.185662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.189195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.190296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.190730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.387289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.389705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.398221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.398459 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d777d67-b50b-4610-9176-3557487fa9a5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.235023 Jun 25 20:59:10.400304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.401905 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3cd3276-28af-4aef-a90e-fc4cf57c41b9 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1564 microversion: 2.25 time: 0.265970 Jun 25 20:59:10.409768 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1071/1934] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:10.412671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 864/1935] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1564 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 20:59:10.416248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.417144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 58d01da1-fc87-48cb-8184-6b7cc48ad324] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.427436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.428493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.429310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.429864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.447437 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 HTTP/1.1 Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:10.449776 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. Jun 25 20:59:10.451374 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '58d01da1-fc87-48cb-8184-6b7cc48ad324'} Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:10.452367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. Jun 25 20:59:10.454002 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.456124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance 58d01da1-fc87-48cb-8184-6b7cc48ad324 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:10.457323 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bcb15f9f-7659-4942-983e-ad64e100a352 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324" status: 404 len: 111 microversion: 2.1 time: 0.046306 Jun 25 20:59:10.458913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.460110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.461668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1072/1936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/58d01da1-fc87-48cb-8184-6b7cc48ad324 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:10.467082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6cbf879-55ce-47ce-bd7d-462ff3c02f27 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f9861ea7040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.470290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.471104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.472232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.472926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.532848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d6cbf879-55ce-47ce-bd7d-462ff3c02f27 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Image not found. Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6cbf879-55ce-47ce-bd7d-462ff3c02f27 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf HTTP/1.1 Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:10.535647 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5f76ad4f-985d-4780-a843-030afd4378cf'} Jun 25 20:59:10.537244 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5f76ad4f-985d-4780-a843-030afd4378cf to delete Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.538276 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5f76ad4f-985d-4780-a843-030afd4378cf could not be found. Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:10.539953 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6cbf879-55ce-47ce-bd7d-462ff3c02f27 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:10.542065 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6cbf879-55ce-47ce-bd7d-462ff3c02f27 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf" status: 404 len: 62 microversion: 2.1 time: 0.074629 Jun 25 20:59:10.543471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1073/1937] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] DELETE /compute/v2.1/images/5f76ad4f-985d-4780-a843-030afd4378cf => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:10.548896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.550060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.558661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.559361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.560611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.561142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.582453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:10.588533 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f HTTP/1.1 Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:10.590339 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.591943 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '516f5558-13fe-4160-9e89-2e13e203c75f'} Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:10.592943 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.595351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.598522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:10.598522 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80a81bbe-88f2-4cb1-a1ad-0a15f25c25c0 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 404 len: 111 microversion: 2.1 time: 0.048653 Jun 25 20:59:10.598522 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1074/1938] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:10 2022] DELETE /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:10.601093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94a95641-515c-45bb-a56b-97beee94bdc4 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1276 microversion: 2.1 time: 0.148524 Jun 25 20:59:10.601572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.602204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: 516f5558-13fe-4160-9e89-2e13e203c75f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.609459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.610152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.611392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.612189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.613700 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 865/1939] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:10.630277 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f HTTP/1.1 Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:10.634976 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.636528 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '516f5558-13fe-4160-9e89-2e13e203c75f'} Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:10.640899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. Jun 25 20:59:10.642344 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:10.644790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance 516f5558-13fe-4160-9e89-2e13e203c75f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:10.644790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35d8cb4d-0519-4a6b-a55a-349dfd661e39 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f" status: 404 len: 111 microversion: 2.1 time: 0.039529 Jun 25 20:59:10.644790 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1075/1940] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/516f5558-13fe-4160-9e89-2e13e203c75f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:10.647917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2cda12b2-8eda-4d1a-a99f-fc9c561f5824 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f984fd15700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.670129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2cda12b2-8eda-4d1a-a99f-fc9c561f5824 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718623343" status: 202 len: 0 microversion: 2.1 time: 0.028324 Jun 25 20:59:10.674413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 866/1941] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 20:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718623343 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:10.759446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:10.760229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:10.773063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.773837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:10.775107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:10.775556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.271912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75391aac-b61b-4770-a45e-bb186dbcc25e tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.266129 Jun 25 20:59:11.272929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 867/1942] 10.222.0.39 () {58 vars in 1127 bytes} [Sat Jun 25 20:59:11 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 20:59:11.282248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-59fb2774-a212-4230-bbb7-b2c17c51f8ea req-f9cb973f-2c76-442a-85f5-8c7a1a57f676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71042147-6277-4f59-a301-a2164d61048f", "name": "network-vif-plugged", "status": "completed", "tag": "9e8c7b4e-7970-4bc3-a805-1c6a00bc2287"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:11.304617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-59fb2774-a212-4230-bbb7-b2c17c51f8ea req-f9cb973f-2c76-442a-85f5-8c7a1a57f676 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:11.305212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-59fb2774-a212-4230-bbb7-b2c17c51f8ea req-f9cb973f-2c76-442a-85f5-8c7a1a57f676 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.335542 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-59fb2774-a212-4230-bbb7-b2c17c51f8ea req-f9cb973f-2c76-442a-85f5-8c7a1a57f676 service nova] Creating event network-vif-plugged:9e8c7b4e-7970-4bc3-a805-1c6a00bc2287 for instance 71042147-6277-4f59-a301-a2164d61048f on nch2-master-1 Jun 25 20:59:11.342722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-59fb2774-a212-4230-bbb7-b2c17c51f8ea req-f9cb973f-2c76-442a-85f5-8c7a1a57f676 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068302 Jun 25 20:59:11.348806 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 868/1943] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:11.374495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:11.375972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:11.385821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:11.386686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.387745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:11.388447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.519990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:11.532546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-071e57ec-824b-4284-ba29-75bd508fac25 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.777375 Jun 25 20:59:11.538453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1076/1944] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:10 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:11.543420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-108cb7a7-a1c1-4597-a228-a5b9041384a4 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Calling method '.version_select at 0x7f984ef4e280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:11.579479 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-108cb7a7-a1c1-4597-a228-a5b9041384a4 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] HTTP exception thrown: Image not found. Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-108cb7a7-a1c1-4597-a228-a5b9041384a4 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Request method failure captured: Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ce6dKRkbKy62g88Ts0PSLhmHbh-YPHG8Jwzh3zA7lkP_ITN0EZvS2ic3chwbi2L4ILnAKilGEug-xKbGoi2aGzF10cOxgg-DSSOrdjy8Rn-54FtoR2MpGKFk1ik4nDLhy9ZsEKnlbNrCXD0FfszM6PVXC8dFCMerTfgenWTrbp5pY Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:11.581345 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}] Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 4ab6f09ea5354ac8b0f7db4a22f9471e Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '-1'} Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:11.583423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.589588 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:11.591394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-108cb7a7-a1c1-4597-a228-a5b9041384a4 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-108cb7a7-a1c1-4597-a228-a5b9041384a4 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.043394 Jun 25 20:59:11.593080 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1077/1945] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 20:59:11 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:11.600103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:11.601203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:11.614737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:11.615436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.616356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:11.617138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:11.977846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:11.988053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fbd8eaec-be2e-4deb-91c8-5fa7507addb1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.402928 Jun 25 20:59:11.989448 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1078/1946] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:11 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:12.001023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.002332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:12.010235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.011017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.012046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.013967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.043647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.056031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f09ece2d-4c9d-4567-8207-e5a1ba81867f tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 200 len: 1506 microversion: 2.1 time: 0.702857 Jun 25 20:59:12.056657 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 869/1947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:11 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:12.062754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7e00160-9b40-460f-b87f-f97097e5c8be tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Calling method '.version_select at 0x7f984fdac1f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.092891 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e7e00160-9b40-460f-b87f-f97097e5c8be tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] HTTP exception thrown: Image not found. Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7e00160-9b40-460f-b87f-f97097e5c8be tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Request method failure captured: Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/images/6756dc92-49da-4bc6-b4fd-015e8a51f1dj HTTP/1.1 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ce6dKRkbKy62g88Ts0PSLhmHbh-YPHG8Jwzh3zA7lkP_ITN0EZvS2ic3chwbi2L4ILnAKilGEug-xKbGoi2aGzF10cOxgg-DSSOrdjy8Rn-54FtoR2MpGKFk1ik4nDLhy9ZsEKnlbNrCXD0FfszM6PVXC8dFCMerTfgenWTrbp5pY Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:12.099330 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}] Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 4ab6f09ea5354ac8b0f7db4a22f9471e Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6756dc92-49da-4bc6-b4fd-015e8a51f1dj'} Jun 25 20:59:12.101521 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6756dc92-49da-4bc6-b4fd-015e8a51f1dj to delete Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.102402 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6756dc92-49da-4bc6-b4fd-015e8a51f1dj could not be found. Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.104165 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7e00160-9b40-460f-b87f-f97097e5c8be tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.107648 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7e00160-9b40-460f-b87f-f97097e5c8be tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/6756dc92-49da-4bc6-b4fd-015e8a51f1dj" status: 404 len: 62 microversion: 2.1 time: 0.044218 Jun 25 20:59:12.112336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 870/1948] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/images/6756dc92-49da-4bc6-b4fd-015e8a51f1dj => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:12.114435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.114435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:12.127501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.128471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.129847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.130519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.276603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.289842 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-634bf0ad-84b8-417f-86bb-c14f2253793a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1282 microversion: 2.1 time: 0.184357 Jun 25 20:59:12.291083 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 871/1949] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:12.306107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.307396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:12.317167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.318388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.320099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.320900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.323819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.337697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.340896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39e82edaa30d418d96ea37f942d62755', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2d8b5c82f44807b9d01252ea17cff9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.354820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:12.359872 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a101a5c-fd0d-47fc-ac0d-7532accc549d tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 200 len: 1564 microversion: 2.25 time: 0.355366 Jun 25 20:59:12.364796 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1079/1950] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:11 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 1564 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 20:59:12.378556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-669ce54c-58a2-4976-a444-5c86742565d7 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Calling method '.version_select at 0x7f984ef53820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.405243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-669ce54c-58a2-4976-a444-5c86742565d7 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] HTTP exception thrown: Image not found. Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-669ce54c-58a2-4976-a444-5c86742565d7 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Request method failure captured: Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/a9f29c29-1f28-4f1b-b9ae-05824e0405491 HTTP/1.1 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ce6dKRkbKy62g88Ts0PSLhmHbh-YPHG8Jwzh3zA7lkP_ITN0EZvS2ic3chwbi2L4ILnAKilGEug-xKbGoi2aGzF10cOxgg-DSSOrdjy8Rn-54FtoR2MpGKFk1ik4nDLhy9ZsEKnlbNrCXD0FfszM6PVXC8dFCMerTfgenWTrbp5pY Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:12.407769 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}] Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 4ab6f09ea5354ac8b0f7db4a22f9471e Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a9f29c29-1f28-4f1b-b9ae-05824e0405491'} Jun 25 20:59:12.410321 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a9f29c29-1f28-4f1b-b9ae-05824e0405491 to delete Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.411543 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a9f29c29-1f28-4f1b-b9ae-05824e0405491 could not be found. Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.413714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.415240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-669ce54c-58a2-4976-a444-5c86742565d7 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.416886 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-669ce54c-58a2-4976-a444-5c86742565d7 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/a9f29c29-1f28-4f1b-b9ae-05824e0405491" status: 404 len: 62 microversion: 2.1 time: 0.047009 Jun 25 20:59:12.426783 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1080/1951] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/images/a9f29c29-1f28-4f1b-b9ae-05824e0405491 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:12.435455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9512c977-6b45-4012-8354-5345b90d64e8 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Calling method '.version_select at 0x7f984ef4eee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.485049 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9512c977-6b45-4012-8354-5345b90d64e8 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] HTTP exception thrown: Image not found. Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9512c977-6b45-4012-8354-5345b90d64e8 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Request method failure captured: Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/tempest-invalid-1558408572 HTTP/1.1 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ce6dKRkbKy62g88Ts0PSLhmHbh-YPHG8Jwzh3zA7lkP_ITN0EZvS2ic3chwbi2L4ILnAKilGEug-xKbGoi2aGzF10cOxgg-DSSOrdjy8Rn-54FtoR2MpGKFk1ik4nDLhy9ZsEKnlbNrCXD0FfszM6PVXC8dFCMerTfgenWTrbp5pY Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:12.487034 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}] Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 4ab6f09ea5354ac8b0f7db4a22f9471e Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'tempest-invalid-1558408572'} Jun 25 20:59:12.489915 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1558408572 to delete Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.491449 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1558408572 could not be found. Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.494764 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9512c977-6b45-4012-8354-5345b90d64e8 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.498197 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9512c977-6b45-4012-8354-5345b90d64e8 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/tempest-invalid-1558408572" status: 404 len: 62 microversion: 2.1 time: 0.060392 Jun 25 20:59:12.502556 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1081/1952] 10.222.0.39 () {58 vars in 1205 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/images/tempest-invalid-1558408572 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:12.512471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d4c88ebb-542f-4705-a01f-a7fc3eaabfc4 req-6bb86597-4d0a-4543-a561-0a79c7156e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c74f7943-2aa3-4657-a9a3-3da9ad4fa189", "name": "network-vif-deleted", "tag": "44d3b4c6-859c-4819-a517-8f12bf6298f5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:12.522593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d4c88ebb-542f-4705-a01f-a7fc3eaabfc4 req-6bb86597-4d0a-4543-a561-0a79c7156e65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.524071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d4c88ebb-542f-4705-a01f-a7fc3eaabfc4 req-6bb86597-4d0a-4543-a561-0a79c7156e65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.540537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d4c88ebb-542f-4705-a01f-a7fc3eaabfc4 req-6bb86597-4d0a-4543-a561-0a79c7156e65 service nova] Creating event network-vif-deleted:44d3b4c6-859c-4819-a517-8f12bf6298f5 for instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 on nch1-master-1 Jun 25 20:59:12.549263 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d4c88ebb-542f-4705-a01f-a7fc3eaabfc4 req-6bb86597-4d0a-4543-a561-0a79c7156e65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044217 Jun 25 20:59:12.550493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1082/1953] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:12.558938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bc1a2b0-9d83-420c-a170-e31b9795eab1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '.version_select at 0x7f9861ea7310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.590398 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7bc1a2b0-9d83-420c-a170-e31b9795eab1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Image not found. Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bc1a2b0-9d83-420c-a170-e31b9795eab1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/eaf07941-cf99-4467-9138-c87f339a45d4 HTTP/1.1 Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:12.593030 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'eaf07941-cf99-4467-9138-c87f339a45d4'} Jun 25 20:59:12.594701 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eaf07941-cf99-4467-9138-c87f339a45d4 to delete Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.595563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eaf07941-cf99-4467-9138-c87f339a45d4 could not be found. Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.597558 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:12.599750 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.602541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bc1a2b0-9d83-420c-a170-e31b9795eab1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.604409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bc1a2b0-9d83-420c-a170-e31b9795eab1 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/images/eaf07941-cf99-4467-9138-c87f339a45d4" status: 404 len: 62 microversion: 2.1 time: 0.052560 Jun 25 20:59:12.605575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1083/1954] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/images/eaf07941-cf99-4467-9138-c87f339a45d4 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:12.615783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f925fe1-a963-4f7b-9c45-b62d13199d21 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Calling method '.version_select at 0x7f984ef53e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.662765 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1f925fe1-a963-4f7b-9c45-b62d13199d21 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] HTTP exception thrown: Image not found. Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f925fe1-a963-4f7b-9c45-b62d13199d21 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Request method failure captured: Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713 HTTP/1.1 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ce6dKRkbKy62g88Ts0PSLhmHbh-YPHG8Jwzh3zA7lkP_ITN0EZvS2ic3chwbi2L4ILnAKilGEug-xKbGoi2aGzF10cOxgg-DSSOrdjy8Rn-54FtoR2MpGKFk1ik4nDLhy9ZsEKnlbNrCXD0FfszM6PVXC8dFCMerTfgenWTrbp5pY Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:12.668080 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c460eddfd96a45808e9b4e174f3cf7a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c460eddfd96a45808e9b4e174f3cf7a2"}]}] Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c460eddfd96a45808e9b4e174f3cf7a2 Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862 Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 4ab6f09ea5354ac8b0f7db4a22f9471e Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1186613862-project Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713'} Jun 25 20:59:12.669572 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713 to delete Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.670874 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713 could not be found. Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.672135 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f925fe1-a963-4f7b-9c45-b62d13199d21 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.677962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1f925fe1-a963-4f7b-9c45-b62d13199d21 tempest-ImagesDeleteNegativeTestJSON-1186613862 tempest-ImagesDeleteNegativeTestJSON-1186613862-project] 10.222.0.39 "DELETE /compute/v2.1/images/7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713" status: 404 len: 62 microversion: 2.1 time: 0.059735 Jun 25 20:59:12.681298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1084/1955] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/images/7b4e5f4c-e3af-4d5b-a4b2-825a3b1eb713 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:12.681298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.681298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:12.698421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.699187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.700806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.701521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.813791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.827192 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f71976d1-6ecf-433a-8e14-b874f49d2e5b tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 200 len: 1507 microversion: 2.1 time: 0.534642 Jun 25 20:59:12.844614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 872/1956] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:12.854240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:12.854893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:12.864436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.864894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.865676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.866102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.886960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a HTTP/1.1 Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:12.888578 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:12.890796 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a'} Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:12.891772 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:12.895183 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:12.900609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:12.902071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8dcac451-397a-4008-988b-bf79ab865228 tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 404 len: 111 microversion: 2.1 time: 0.055397 Jun 25 20:59:12.902916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 873/1957] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:12.914563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ccd5ffdf-2560-4e60-92b5-24eeed84f28b req-9420dd3b-c8d1-47d1-acbb-8ffd9726897a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "name": "network-vif-unplugged", "status": "completed", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:12.941380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ccd5ffdf-2560-4e60-92b5-24eeed84f28b req-9420dd3b-c8d1-47d1-acbb-8ffd9726897a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:12.942475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ccd5ffdf-2560-4e60-92b5-24eeed84f28b req-9420dd3b-c8d1-47d1-acbb-8ffd9726897a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:12.966214 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ccd5ffdf-2560-4e60-92b5-24eeed84f28b req-9420dd3b-c8d1-47d1-acbb-8ffd9726897a service nova] Creating event network-vif-unplugged:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:59:12.966784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:12.979199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ccd5ffdf-2560-4e60-92b5-24eeed84f28b req-9420dd3b-c8d1-47d1-acbb-8ffd9726897a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073924 Jun 25 20:59:12.982332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 874/1958] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:12.991761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8671b07-57f1-48bc-ac90-2bf5f5339bfd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.317017 Jun 25 20:59:12.993466 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1085/1959] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:13.005661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.006631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.007554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.008173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] [instance: d91bd66b-2391-4c6c-a25b-679179fdbc1a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.017368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.017982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.020972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.022299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.023775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.024455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.025548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.026160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.051244 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] HTTP exception thrown: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Request method failure captured: Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a HTTP/1.1 Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3aoocOefupCsf4rsPdxon0KH0UzN3IDgrMiPHocug20-iRDqI6pkZBNtOi-Kznj5EOPHh_kv-iHUNY_tLyhWU_xyPBaY0dhB6Ct1Brik1UkUGpQjKrEvWVYZM2sTaKJc8GhWWlPTNfL1TxdeJfhoSwJMELgCenwteAbQOhoiQUIu9A Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:13.063197 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fd2dd16178804914b9afde659428992f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fd2dd16178804914b9afde659428992f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fd2dd16178804914b9afde659428992f"}]}] Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fd2dd16178804914b9afde659428992f Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046 Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 662ef2b3df5e4c59b373fccab9c911c2 Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1249712046-project Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:13.065531 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd91bd66b-2391-4c6c-a25b-679179fdbc1a'} Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:13.066863 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. Jun 25 20:59:13.072615 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.075019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] Returning 404 to user: Instance d91bd66b-2391-4c6c-a25b-679179fdbc1a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:13.075019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94f2b8be-97dd-4fb5-b8c4-a95ff48bd6ba tempest-ImagesOneServerNegativeTestJSON-1249712046 tempest-ImagesOneServerNegativeTestJSON-1249712046-project] 10.222.0.39 "GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a" status: 404 len: 111 microversion: 2.1 time: 0.062935 Jun 25 20:59:13.075019 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1086/1960] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:12 2022] GET /compute/v2.1/servers/d91bd66b-2391-4c6c-a25b-679179fdbc1a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:13.081611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.091464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.113659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:13.116209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.116722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.117631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.118222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.318321 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc2c6245-cb97-4501-8b59-3d8747d6f0ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 204 len: 0 microversion: 2.1 time: 0.332538 Jun 25 20:59:13.320458 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 875/1961] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:12 2022] DELETE /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:13.328968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.329078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.339372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.339838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.340694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.341128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.508253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:13.520295 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8cb4120-de38-4acc-bed4-e4e75e36bb8c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1308 microversion: 2.1 time: 0.451824 Jun 25 20:59:13.521723 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1087/1962] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:13 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1308 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:13.527976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.529329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.537789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.538660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.539749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.540374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.589713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:13.625945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:13.641793 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b658c18a-78b7-4a55-afa1-c670ab766264 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1282 microversion: 2.1 time: 0.319267 Jun 25 20:59:13.642495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 876/1963] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:13 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1282 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:13.656004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-11d85d95-01d0-47d6-9745-d958cc3c7178 req-b90a09be-fb48-4edd-825a-c1c183c63b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "name": "network-vif-unplugged", "status": "completed", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:13.672981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-11d85d95-01d0-47d6-9745-d958cc3c7178 req-b90a09be-fb48-4edd-825a-c1c183c63b4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.673735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-11d85d95-01d0-47d6-9745-d958cc3c7178 req-b90a09be-fb48-4edd-825a-c1c183c63b4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.785144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79d4ef1d-e6be-4c09-98d9-0e0376dec901 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "DELETE /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 204 len: 0 microversion: 2.1 time: 0.260806 Jun 25 20:59:13.789347 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1088/1964] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:13 2022] DELETE /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:13.797367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.798572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] [instance: c74f7943-2aa3-4657-a9a3-3da9ad4fa189] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.812295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.813281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.815223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.816178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.839363 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] HTTP exception thrown: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Request method failure captured: Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 HTTP/1.1 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3WSQIuxZx9hQl8GLo9Xud5T5hLPSGSnUo6_jj2gejkqMbO6wpI7qU-E95jabWZZoFmy18y1WMT21c4a5th5vXMS2Gj4rh1FEvR9akt95XCzIv2sT8AyWsK-grfBrjBPTVqKx6CsppCO3AggWO5AwuJCDQx-5Jx7HS9W2vr6QJqPBsI Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.25 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:13.842486 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6a2d8b5c82f44807b9d01252ea17cff9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6a2d8b5c82f44807b9d01252ea17cff9"}]}] Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 6a2d8b5c82f44807b9d01252ea17cff9 Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932 Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39e82edaa30d418d96ea37f942d62755 Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1642564932-project Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. Jun 25 20:59:13.844326 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c74f7943-2aa3-4657-a9a3-3da9ad4fa189'} Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:13.845556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. Jun 25 20:59:13.848703 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:13.852196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] Returning 404 to user: Instance c74f7943-2aa3-4657-a9a3-3da9ad4fa189 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:13.853650 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4aa88245-c3d9-49de-8a24-8b480e8a4129 tempest-LiveAutoBlockMigrationV225Test-1642564932 tempest-LiveAutoBlockMigrationV225Test-1642564932-project] 10.222.0.39 "GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189" status: 404 len: 111 microversion: 2.25 time: 0.062921 Jun 25 20:59:13.854468 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1089/1965] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 20:59:13 2022] GET /compute/v2.1/servers/c74f7943-2aa3-4657-a9a3-3da9ad4fa189 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:13.860753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:13.861757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:13.874436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.875997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:13.878000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:13.879091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.094263 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-11d85d95-01d0-47d6-9745-d958cc3c7178 req-b90a09be-fb48-4edd-825a-c1c183c63b4e service nova] Creating event network-vif-unplugged:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch1-master-1 Jun 25 20:59:14.100111 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-11d85d95-01d0-47d6-9745-d958cc3c7178 req-b90a09be-fb48-4edd-825a-c1c183c63b4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.456082 Jun 25 20:59:14.101631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 877/1966] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:14.108394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:14.109533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:14.111861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:14.119478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.127989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.129766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.130512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.304164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:14.315977 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-650e375f-a256-49ac-ad96-a354e9f845a9 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 200 len: 1513 microversion: 2.1 time: 0.459107 Jun 25 20:59:14.317707 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1090/1967] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:13 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 1513 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:14.541727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:14.542784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:14.556025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.556355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.559028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.559509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.583036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:14.593213 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be963661-1cd6-4035-92ed-d6ab96bdb6af tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.489924 Jun 25 20:59:14.594329 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 878/1968] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:14 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:14.676563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:14.677873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:14.689270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.690081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.691231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.691988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.849717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:14.854876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9aa41ab4-e0e0-49f3-99b6-6fcde260bd19 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1488 microversion: 2.1 time: 0.320486 Jun 25 20:59:14.858699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1091/1969] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:14 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1488 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:14.875122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:14.875962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:14.893053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.893526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.901316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:14.901927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:14.960886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lazy-loading 'flavor' on Instance uuid 71042147-6277-4f59-a301-a2164d61048f {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:59:15.137701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:15.155968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a4e01c3-079f-4c4c-a5f3-b3e430c6eda6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f/action" status: 202 len: 0 microversion: 2.1 time: 0.286555 Jun 25 20:59:15.160472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1092/1970] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:14 2022] POST /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:15.166664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:15.174872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:15.188573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.193524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.194926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.195559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.477960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:15.503180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bdea92c3-c1c5-4eb9-acb7-7bb1c6d2989f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1496 microversion: 2.1 time: 0.339502 Jun 25 20:59:15.513857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1093/1971] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:15 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:15.519554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:15.520393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:15.528978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.529626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.531395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.531949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.649828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:15.667586 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2dcfc55c-f5c5-4221-823b-7685d86f7a47 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 1.011308 Jun 25 20:59:15.669032 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 879/1972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:14 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:15.682906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:15.683917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:15.693813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.694495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.695617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:15.696330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:15.838791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:15.847885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57b1b992-908a-4318-b14f-5ad34ef954ad tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 200 len: 1513 microversion: 2.1 time: 0.332565 Jun 25 20:59:15.848507 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1094/1973] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:15 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:16.349088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:16.367993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce9bf6f4-1e6b-44cd-ad79-adf5405102bd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.697605 Jun 25 20:59:16.379122 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 880/1974] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:15 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:16.521300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:16.522438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:16.539942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:16.540713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:16.541745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:16.543529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:16.686890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:16.688392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:16.701775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:16.704406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:16.706966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:16.708874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:16.991359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:17.002305 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-49b525c5-efb9-4ab9-bba6-ad5459688b04 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1496 microversion: 2.1 time: 0.484862 Jun 25 20:59:17.003753 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1095/1975] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:16 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1496 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:17.009323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:17.009940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:17.017177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:17.018251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:17.019276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:17.019907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:17.337602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:17.346009 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71f422a9-738e-4a5f-9ab7-6589a3a01988 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 200 len: 1513 microversion: 2.1 time: 0.340634 Jun 25 20:59:17.355401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1096/1976] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:17 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 1513 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:17.524823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-918998a4-e21a-4350-83b5-59d1ac287abc tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984efa3820>, body: {"keypair": {"name": "tempest-keypair-1797848858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECHq0Q5qiY46nKoS79cen7d7VArlMx4euIBxGMnR9k+eUEKy9px8CXlFZDggy3EtujBJhiuORRvvYF3c3ePJqyIg+4yCPF3CU7pTESozmz16cnCXD10VPXPDfwoowc2Yw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:17.548692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-918998a4-e21a-4350-83b5-59d1ac287abc tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:17.554496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-918998a4-e21a-4350-83b5-59d1ac287abc tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:17.581538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-918998a4-e21a-4350-83b5-59d1ac287abc tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.224826 Jun 25 20:59:17.582336 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1097/1977] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:17.589488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:17.590647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:17.600681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:17.601535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:17.602655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:17.603283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:17.624416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:17.648786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-196ef05a-144b-4889-b506-bf6e6e736e31 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 0.964524 Jun 25 20:59:17.652064 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 881/1978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:16 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:17.661783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f40c29a-d9e7-493e-a8c3-7c4d7d7a77c9 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fd8e4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:17.692142 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f40c29a-d9e7-493e-a8c3-7c4d7d7a77c9 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1797848858" status: 200 len: 497 microversion: 2.1 time: 0.038524 Jun 25 20:59:17.699334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 882/1979] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 20:59:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1797848858 => generated 497 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:17.708718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a31d173d-bd40-46c0-9fab-fdb44ddb7458 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fd0c4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:17.734399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a31d173d-bd40-46c0-9fab-fdb44ddb7458 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797848858" status: 202 len: 0 microversion: 2.1 time: 0.033949 Jun 25 20:59:17.734997 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 883/1980] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 20:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797848858 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:17.750069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfa47816-eea8-425d-b677-8ab029cb304a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984fd9c160>, body: {"keypair": {"name": "tempest-keypair-1234117425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzfeee9IbQNBg8ZvNtq6bzjjCEH+NiNyy0vshvr0QkHWKKKRhSXUnwcCn6Pon2p09kVNZfr9QxL2SX5BX3YQDmP8kJ43cy4X24h0p/x0SopXORO1LlOGUyCyc+1oBv0Fw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:17.770441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-cfa47816-eea8-425d-b677-8ab029cb304a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:17.783790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-cfa47816-eea8-425d-b677-8ab029cb304a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:17.837482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfa47816-eea8-425d-b677-8ab029cb304a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091313 Jun 25 20:59:17.839165 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 884/1981] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:17.850427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-928291f3-0a57-48e5-b570-ebd315fc15ea tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fd97670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:17.899571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-928291f3-0a57-48e5-b570-ebd315fc15ea tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234117425" status: 202 len: 0 microversion: 2.1 time: 0.053098 Jun 25 20:59:17.902162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 885/1982] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 20:59:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234117425 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:17.925823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd0925f8-1734-428b-9918-7788578fff86 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984fd494c0>, body: {"keypair": {"name": "tempest-keypair-817280676", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:17.952206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fd0925f8-1734-428b-9918-7788578fff86 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:17.957738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fd0925f8-1734-428b-9918-7788578fff86 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:17.997514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd0925f8-1734-428b-9918-7788578fff86 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.088259 Jun 25 20:59:17.998931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 886/1983] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:17 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:18.014425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc0a4673-8d05-47a8-a63e-0516a03e80bb tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fd8e1f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:18.045581 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc0a4673-8d05-47a8-a63e-0516a03e80bb tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817280676" status: 202 len: 0 microversion: 2.1 time: 0.034561 Jun 25 20:59:18.047106 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 887/1984] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 20:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817280676 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:18.077585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:18.078640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:18.098977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.100765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.101822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.102385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.447116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:18.457246 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb3ac66d-2632-49b4-b25d-ca95a9979db0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.873222 Jun 25 20:59:18.458694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1098/1985] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:17 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:18.479325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bce77da-41b6-4377-8c3c-c99556b4f42e tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984ef77a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1466082031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfxVE2rzH7LjMpkK4/c3osgZbN0++UcXwAiTUHYmz8Uj5leZxaiw5rweyQart0Gu5ExB+8MAXVd/Zih+xS+ueQVjuqyDwQNGdomdCSP0fgf333ZflVZs8wDAzloWzw4Dw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:18.504197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0bce77da-41b6-4377-8c3c-c99556b4f42e tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:18.534310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-0bce77da-41b6-4377-8c3c-c99556b4f42e tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:18.586664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bce77da-41b6-4377-8c3c-c99556b4f42e tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.126499 Jun 25 20:59:18.587437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1099/1986] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:18.595269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3dc0bc1c-c17e-4abe-a8df-216b73117465 req-b26f470e-2d48-477b-8d18-1b28f9ae32d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05eb5d50-12e0-4e26-a88f-36ca018ca9cf", "name": "network-vif-deleted", "tag": "04d59076-9d40-4949-95e4-ed6a4845724f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:18.614910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3dc0bc1c-c17e-4abe-a8df-216b73117465 req-b26f470e-2d48-477b-8d18-1b28f9ae32d5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.615701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3dc0bc1c-c17e-4abe-a8df-216b73117465 req-b26f470e-2d48-477b-8d18-1b28f9ae32d5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.629448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3dc0bc1c-c17e-4abe-a8df-216b73117465 req-b26f470e-2d48-477b-8d18-1b28f9ae32d5 service nova] Creating event network-vif-deleted:04d59076-9d40-4949-95e4-ed6a4845724f for instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf on nch2-master-1 Jun 25 20:59:18.644328 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3dc0bc1c-c17e-4abe-a8df-216b73117465 req-b26f470e-2d48-477b-8d18-1b28f9ae32d5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051545 Jun 25 20:59:18.646275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1100/1987] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:18.655795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:18.656885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:18.668635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.669738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.673210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.674367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.808249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a64a76813475430a9ee6e8d297bb8683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ead50a31ce9d4d108bcc8f2d8844ac39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:18.821628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83a8e1dc-83f7-498f-9d4c-e008d4539a11 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 200 len: 1471 microversion: 2.1 time: 0.172657 Jun 25 20:59:18.831222 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1101/1988] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:18 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:18.838753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec5f0c6f-2c7d-4021-a8b6-e2f6afe310e0 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984ef534c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-23216015", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS/2P4ndmIzo2XKPLFoLAQeUxsnBYtKiadKu83zZcsfWo6tKj1gTWOQyIWRWMQyJQv+1XMDfyMmL68EgOXjLyvkKMDaK2kXTCcEyXDhnz3RmtmcC/NW/zC89gCQ6hloYg=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:18.890847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ec5f0c6f-2c7d-4021-a8b6-e2f6afe310e0 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:18.896244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ec5f0c6f-2c7d-4021-a8b6-e2f6afe310e0 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:18.946320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec5f0c6f-2c7d-4021-a8b6-e2f6afe310e0 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.113018 Jun 25 20:59:18.951390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1102/1989] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:18 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:18.963899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:18.965265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:18.980458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.981397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:18.983125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:18.983574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:19.070584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:19.084459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e48fc136-07ea-4ad0-aca6-f6bc80c9c7b1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 200 len: 1479 microversion: 2.1 time: 1.033264 Jun 25 20:59:19.085623 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 888/1990] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:18 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 1479 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:19.104932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95c6c2f1-ae77-40fa-9580-f4491102aa1a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Action: 'create', calling method: .version_select at 0x7f984fd99820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-2000853364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2Jtc0XaWo8iqp4mEuVcAU7IECUIeuoudEz1PsaKNDE/FxhSweK9tFioyzwlcNf/M5ReDiqqFFHnta+f4swX76ZQInEvDjJUYbrsvHTK4EZpwvQgxKst3o6hkQ7ClYRGQ=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:19.130092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:19.189571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-95c6c2f1-ae77-40fa-9580-f4491102aa1a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:19.196122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-95c6c2f1-ae77-40fa-9580-f4491102aa1a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Getting quotas for user 20d4b62df7dc491a9598c5c14f8278ac and project 93a8fd73df2a4456a59bee4c7dbcfd51. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:19.227190 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95c6c2f1-ae77-40fa-9580-f4491102aa1a tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.139580 Jun 25 20:59:19.228338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 889/1991] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:19.237867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-736745061"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:19.239803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:19.249622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:19.250452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:19.251617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:19.252553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:19.837353 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aab59784-8c43-4d80-bcf8-34b26907dbd8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f/action" status: 202 len: 0 microversion: 2.1 time: 0.602782 Jun 25 20:59:19.838099 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 890/1992] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:19 2022] POST /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 20:59:19.861807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1afe8422-ced2-4d80-9b17-8c8a75f3dabb req-2f58194d-ed85-4a5e-8d25-c9d99559e15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6510c04-1595-4aa3-a25c-dd96ed7d3dd5", "name": "network-vif-deleted", "tag": "060f4897-1004-418b-a057-202e9b75c7a8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:19.886896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1afe8422-ced2-4d80-9b17-8c8a75f3dabb req-2f58194d-ed85-4a5e-8d25-c9d99559e15f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:19.892689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1afe8422-ced2-4d80-9b17-8c8a75f3dabb req-2f58194d-ed85-4a5e-8d25-c9d99559e15f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:19.929388 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1afe8422-ced2-4d80-9b17-8c8a75f3dabb req-2f58194d-ed85-4a5e-8d25-c9d99559e15f service nova] Creating event network-vif-deleted:060f4897-1004-418b-a057-202e9b75c7a8 for instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 on nch2-master-1 Jun 25 20:59:19.941879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1afe8422-ced2-4d80-9b17-8c8a75f3dabb req-2f58194d-ed85-4a5e-8d25-c9d99559e15f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098294 Jun 25 20:59:19.942821 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 891/1993] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:19.957700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e8f02aaa-b750-48fe-a623-933e88ff4f43 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fd99430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:19.964987 ncdv-master-1 devstack@n-api.service[137462]: WARNING oslo_db.sqlalchemy.utils [None req-e8f02aaa-b750-48fe-a623-933e88ff4f43 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 20:59:19.979670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e8f02aaa-b750-48fe-a623-933e88ff4f43 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.031767 Jun 25 20:59:19.981037 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 892/1994] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 20:59:19 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:19.986703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:19.987806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:19.996086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:19.997035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:19.998111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:19.998836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:20.263432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:20.273699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a377061-36ce-4483-8906-3e8cc3e5706f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 1.319570 Jun 25 20:59:20.274894 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1103/1995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:18 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:20.280239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.281289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: d6510c04-1595-4aa3-a25c-dd96ed7d3dd5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:20.291253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:20.292105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:20.293213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:20.293945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:20.311194 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] HTTP exception thrown: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Request method failure captured: Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 HTTP/1.1 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3bZUFituLTDKLrCudr2FLbDFKBBIALiGAiQu-iBXF1u7v1StDSpx7jOaukAmSUbUrY5zdCVlE-tpb25h2I1tT81u3vIo1wJqxBV9Dk7R37Qmkj1aWs-jX9Byayx-L0FTZm12KBGS1mgIcXskmju8w-eHQ7j246wBie3uGLp6xiC5DU Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ead50a31ce9d4d108bcc8f2d8844ac39 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:20.314142 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ead50a31ce9d4d108bcc8f2d8844ac39"}]}] Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ead50a31ce9d4d108bcc8f2d8844ac39 Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateTestJSON-1527820776-project Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a64a76813475430a9ee6e8d297bb8683 Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateTestJSON-1527820776-project Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. Jun 25 20:59:20.315945 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd6510c04-1595-4aa3-a25c-dd96ed7d3dd5'} Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:20.317073 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. Jun 25 20:59:20.320822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.324767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Returning 404 to user: Instance d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:20.327136 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abc05a4c-b7cc-4bfb-b60f-76c5ec89c5b6 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5" status: 404 len: 111 microversion: 2.1 time: 0.050927 Jun 25 20:59:20.332001 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1104/1996] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:20 2022] GET /compute/v2.1/servers/d6510c04-1595-4aa3-a25c-dd96ed7d3dd5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:20.337769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec1a6130-6947-4575-a5bc-060582701d60 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984efbdca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.402163 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec1a6130-6947-4575-a5bc-060582701d60 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.068796 Jun 25 20:59:20.403632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1105/1997] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:20 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:20.408759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f5067ba-713b-40e9-98e8-9b334d3e9447 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984ef77e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.444613 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f5067ba-713b-40e9-98e8-9b334d3e9447 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2000853364" status: 202 len: 0 microversion: 2.1 time: 0.039599 Jun 25 20:59:20.449364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1106/1998] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 20:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-2000853364 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:20.456532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.458478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] [instance: 05eb5d50-12e0-4e26-a88f-36ca018ca9cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:20.467835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:20.469245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:20.470516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:20.471342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:20.496085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:20.506436 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] HTTP exception thrown: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Request method failure captured: Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf HTTP/1.1 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3bZUFituLTDKLrCudr2FLbDFKBBIALiGAiQu-iBXF1u7v1StDSpx7jOaukAmSUbUrY5zdCVlE-tpb25h2I1tT81u3vIo1wJqxBV9Dk7R37Qmkj1aWs-jX9Byayx-L0FTZm12KBGS1mgIcXskmju8w-eHQ7j246wBie3uGLp6xiC5DU Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ead50a31ce9d4d108bcc8f2d8844ac39 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:20.509492 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ead50a31ce9d4d108bcc8f2d8844ac39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ead50a31ce9d4d108bcc8f2d8844ac39"}]}] Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ead50a31ce9d4d108bcc8f2d8844ac39 Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1527820776 Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateTestJSON-1527820776-project Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a64a76813475430a9ee6e8d297bb8683 Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateTestJSON-1527820776-project Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. Jun 25 20:59:20.510987 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '05eb5d50-12e0-4e26-a88f-36ca018ca9cf'} Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:20.511832 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. Jun 25 20:59:20.513357 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:20.515171 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53e69388-65de-479b-be48-337d92504ba8 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1391 microversion: 2.1 time: 0.529742 Jun 25 20:59:20.516109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 893/1999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:19 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1391 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:20.526294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] Returning 404 to user: Instance 05eb5d50-12e0-4e26-a88f-36ca018ca9cf could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:20.526294 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a3c5552-06e3-4154-8cb3-7902a1537c40 tempest-MultipleCreateTestJSON-1527820776 tempest-MultipleCreateTestJSON-1527820776-project] 10.222.0.39 "GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf" status: 404 len: 111 microversion: 2.1 time: 0.068061 Jun 25 20:59:20.526294 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1107/2000] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:20 2022] GET /compute/v2.1/servers/05eb5d50-12e0-4e26-a88f-36ca018ca9cf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:20.528943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24c1c83e-0155-4911-8c35-72d4703b7cce tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984ef1e5e0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.545994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:20.562876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24c1c83e-0155-4911-8c35-72d4703b7cce tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-23216015" status: 202 len: 0 microversion: 2.1 time: 0.038471 Jun 25 20:59:20.567210 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1108/2001] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 20:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-23216015 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:20.573128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5e33226-4dc0-4af3-a424-08ddd74c72b5 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] Calling method '.version_select at 0x7f984fe26280>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:20.607200 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5e33226-4dc0-4af3-a424-08ddd74c72b5 tempest-KeyPairsV2TestJSON-610463517 tempest-KeyPairsV2TestJSON-610463517-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1466082031" status: 202 len: 0 microversion: 2.1 time: 0.038377 Jun 25 20:59:20.608486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 894/2002] 10.222.0.39 () {58 vars in 1277 bytes} [Sat Jun 25 20:59:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1466082031 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:21.293914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:21.294663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:21.318754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:21.319620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:21.320674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:21.321797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:21.421749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5f9bc58-407c-4546-b52e-5e4f8703eb02 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd0c1f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:21.544740 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5f9bc58-407c-4546-b52e-5e4f8703eb02 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.132441 Jun 25 20:59:21.547956 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 895/2003] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:21 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:21.562204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:21.568680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:21.592717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:21.596159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:21.599523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:21.600914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:22.088689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:22.104292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47671400-9a25-4cfd-a352-00c052dea58a tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1381 microversion: 2.1 time: 0.553548 Jun 25 20:59:22.105812 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 896/2004] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:21 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1381 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:22.112610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-800972eb-49c4-4a1b-9203-266c1922c804 req-4d82fb5c-8e41-41f7-9647-66ec5a8d91ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf", "tag": "52eeede4-25e2-4847-961d-1017aebea2be"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:22.133930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-800972eb-49c4-4a1b-9203-266c1922c804 req-4d82fb5c-8e41-41f7-9647-66ec5a8d91ce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:22.134394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-800972eb-49c4-4a1b-9203-266c1922c804 req-4d82fb5c-8e41-41f7-9647-66ec5a8d91ce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:22.148535 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-800972eb-49c4-4a1b-9203-266c1922c804 req-4d82fb5c-8e41-41f7-9647-66ec5a8d91ce service nova] Creating event network-changed:52eeede4-25e2-4847-961d-1017aebea2be for instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf on nch1-master-1 Jun 25 20:59:22.156199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-800972eb-49c4-4a1b-9203-266c1922c804 req-4d82fb5c-8e41-41f7-9647-66ec5a8d91ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048462 Jun 25 20:59:22.157539 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 897/2005] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:22.165388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3984a9d2-d57c-4390-9857-e7c43a97bdad tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '.version_select at 0x7f984fd8e280>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:22.181796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3984a9d2-d57c-4390-9857-e7c43a97bdad tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:22.182815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3984a9d2-d57c-4390-9857-e7c43a97bdad tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:22.185809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:22.208038 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3984a9d2-d57c-4390-9857-e7c43a97bdad tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.048435 Jun 25 20:59:22.211836 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 898/2006] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:59:22 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:22.224998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:22.227169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:22.231292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3216ccd-6d2e-4736-b452-70c7531c4b2f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 0.943557 Jun 25 20:59:22.234039 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1109/2007] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:21 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:22.255219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:22.255889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:22.256785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:22.257319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:22.560255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3bc4532-de1e-47eb-982e-76f4896a6f3e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984efa3700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:22.649317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3bc4532-de1e-47eb-982e-76f4896a6f3e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.092976 Jun 25 20:59:22.650576 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1110/2008] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:22 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:23.251361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:23.252354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:23.282057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:23.282810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:23.284105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:23.286025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:23.834575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2453b9d7-b209-4654-aa8d-2d7a2c78672f tempest-LiveMigrationTest-1661695200 tempest-LiveMigrationTest-1661695200-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1532 microversion: 2.1 time: 1.614937 Jun 25 20:59:23.845303 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 899/2009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:22 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1532 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:23.869695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e84dc19-07e2-441a-a970-735681a7bd0d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fe26820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:23.919584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:23.941403 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5399420-7b55-4099-910f-9e83e97ed1c5 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 0.695870 Jun 25 20:59:23.944885 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1111/2010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:23 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:23.982019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:23.983005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:24.001224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e84dc19-07e2-441a-a970-735681a7bd0d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.154280 Jun 25 20:59:24.001825 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 900/2011] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:23 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:24.024230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.027765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.032325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.035071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.152515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:24.354932 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3b94a4f-947f-4f00-a307-78307cd1c91e tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 204 len: 0 microversion: 2.1 time: 0.394233 Jun 25 20:59:24.374070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1112/2012] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:23 2022] DELETE /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:24.375859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:24.376955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:24.396725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.397429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.400107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.402523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.421567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:24.822939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:24.836162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1055d5b-01e5-49d5-ad86-1e0c7d370d93 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1387 microversion: 2.1 time: 0.465299 Jun 25 20:59:24.838639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 901/2013] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:24 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1387 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:24.865232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-991f7718-8ef3-4945-893f-92d7c7316d37 req-7f918903-586e-41b5-961b-86c63bd43325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf", "name": "network-vif-plugged", "status": "completed", "tag": "52eeede4-25e2-4847-961d-1017aebea2be"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:24.901373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-991f7718-8ef3-4945-893f-92d7c7316d37 req-7f918903-586e-41b5-961b-86c63bd43325 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.904249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-991f7718-8ef3-4945-893f-92d7c7316d37 req-7f918903-586e-41b5-961b-86c63bd43325 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.935144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-991f7718-8ef3-4945-893f-92d7c7316d37 req-7f918903-586e-41b5-961b-86c63bd43325 service nova] Creating event network-vif-plugged:52eeede4-25e2-4847-961d-1017aebea2be for instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf on nch1-master-1 Jun 25 20:59:24.943679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-991f7718-8ef3-4945-893f-92d7c7316d37 req-7f918903-586e-41b5-961b-86c63bd43325 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084496 Jun 25 20:59:24.951002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1113/2014] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:24.967138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:24.967760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:24.979540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.985029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:24.986408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:24.987669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:25.016241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c576a4f5-fa25-463f-a611-7984f07bb89a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef36ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:25.095138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c576a4f5-fa25-463f-a611-7984f07bb89a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.083420 Jun 25 20:59:25.101412 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1114/2015] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:25 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:25.693147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5250e2a2-27ba-477e-ac58-3eeb6d2580f9 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984ef1fee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQSw3Pnofk+RjnZ1hBFIE9gUcK/q6Tlo/DDm4ivXAaLByYWA4yQ9GBjIRSJvjuenOLd8VC1KxBEPPhp48ukabQCKssHTl8X3KIhUnYNzToGTQdaEJv3+EkVgHBdO7pCoA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:25.701529 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5250e2a2-27ba-477e-ac58-3eeb6d2580f9 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5250e2a2-27ba-477e-ac58-3eeb6d2580f9 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 257 Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:25.707808 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQSw3Pnofk+RjnZ1hBFIE9gUcK/q6Tlo/DDm4ivXAaLByYWA4yQ9GBjIRSJvjuenOLd8VC1KxBEPPhp48ukabQCKssHTl8X3KIhUnYNzToGTQdaEJv3+EkVgHBdO7pCoA=="}} Jun 25 20:59:25.709621 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQSw3Pnofk+RjnZ1hBFIE9gUcK/q6Tlo/DDm4ivXAaLByYWA4yQ9GBjIRSJvjuenOLd8VC1KxBEPPhp48ukabQCKssHTl8X3KIhUnYNzToGTQdaEJv3+EkVgHBdO7pCoA=='}}} Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jun 25 20:59:25.710798 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 25 20:59:25.712080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jun 25 20:59:25.713983 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.715915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5250e2a2-27ba-477e-ac58-3eeb6d2580f9 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:25.717020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5250e2a2-27ba-477e-ac58-3eeb6d2580f9 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.326515 Jun 25 20:59:25.718291 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1115/2016] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 328 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 20:59:25.750745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:25.761352 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8cc44248-0291-44df-8e5e-3b4677cf493d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 0.799950 Jun 25 20:59:25.769094 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 902/2017] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:24 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:25.791973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984fd8e940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-396422790", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:25.851982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:25.865662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for user cb8c8eecfff4448fa28c5d12aca9cc86 and project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:25.914758 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 2166 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-396422790", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:59:25.927961 ncdv-master-1 devstack@n-api.service[137462]: exception: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-396422790', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:25.930758 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:25.937839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:25.944642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:25.948120 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2bdd9bff-8e70-4edd-ac12-2664a8ffb384 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.173851 Jun 25 20:59:25.949333 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 903/2018] 10.222.0.39 () {60 vars in 1159 bytes} [Sat Jun 25 20:59:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:25.955079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:25.955943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:25.965891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:25.966678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:25.967696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:25.968334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:26.067243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2e72ac3-dcca-4790-b3fe-41ada7e85318 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] Calling method '.version_select at 0x7f984ef36550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.150494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2e72ac3-dcca-4790-b3fe-41ada7e85318 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] 10.222.0.39 "GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795" status: 200 len: 784 microversion: 2.1 time: 0.430840 Jun 25 20:59:26.151107 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1116/2019] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:25 2022] GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795 => generated 784 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:26.163085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa5fdd14-a9f1-43d2-a3b4-baf1daa615ef tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984eec4e50>, body: {"keypair": {"name": "tempest-keypair-1230793509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPBiyiuYGqY+19ASk4hlvTB9Sr/rR+n13TtgaeGxvbuMupwfA/REhfBrzqLa8zxDEoKPRZx8tZlV7sUC95hz6zHWNSWOZKMMGlAmV+8gIbAsmi6Pp7MvaWxavRb1QIO4Q=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.211013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fa5fdd14-a9f1-43d2-a3b4-baf1daa615ef tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:26.217572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fa5fdd14-a9f1-43d2-a3b4-baf1daa615ef tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for user cb8c8eecfff4448fa28c5d12aca9cc86 and project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:26.263239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa5fdd14-a9f1-43d2-a3b4-baf1daa615ef tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108880 Jun 25 20:59:26.263843 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1117/2020] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:26.278991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b94c5f8d-85de-4539-885d-c2d06cce1591 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984eed09d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.332598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b94c5f8d-85de-4539-885d-c2d06cce1591 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.067422 Jun 25 20:59:26.334580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1118/2021] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:26 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:26.344523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea3df5c8-3257-473d-abc2-0deff189bed1 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] Calling method '.version_select at 0x7f984eec44c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.453797 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea3df5c8-3257-473d-abc2-0deff189bed1 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] 10.222.0.39 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.117892 Jun 25 20:59:26.455323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1119/2022] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 20:59:26 2022] GET /compute/v2.1/images => generated 445 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:26.462117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984ef36b80>, body: {"keypair": {"name": "tempest-keypair-1230793509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ525kOotuJpycGlQEBzlzH9y/cnMOUXucM12lhrVXArvumhfLMaGf19xbdeVHDWAUOYrVDODKUB9O8Ql4LmjwWhtb4VWpZU1CzlqocII//Zr3dMTh5ShUvVZ+Oj2kIQw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.486536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:26.495782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:26.497037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1423e83b-b11e-43b2-be5f-4b83e7240ee1 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1387 microversion: 2.1 time: 0.546309 Jun 25 20:59:26.500752 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 904/2023] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:25 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1387 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:26.511306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-263a53eb-04a2-477a-baf9-0cce0d047787 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] Calling method '.version_select at 0x7f984fd998b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.512629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for user cb8c8eecfff4448fa28c5d12aca9cc86 and project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:26.555373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Key pair 'tempest-keypair-1230793509' already exists. Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 273 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: {"keypair": {"name": "tempest-keypair-1230793509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ525kOotuJpycGlQEBzlzH9y/cnMOUXucM12lhrVXArvumhfLMaGf19xbdeVHDWAUOYrVDODKUB9O8Ql4LmjwWhtb4VWpZU1CzlqocII//Zr3dMTh5ShUvVZ+Oj2kIQw=="}} Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: exception: Key pair 'tempest-keypair-1230793509' already exists. Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1230793509', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ525kOotuJpycGlQEBzlzH9y/cnMOUXucM12lhrVXArvumhfLMaGf19xbdeVHDWAUOYrVDODKUB9O8Ql4LmjwWhtb4VWpZU1CzlqocII//Zr3dMTh5ShUvVZ+Oj2kIQw=='}}} Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'cb8c8eecfff4448fa28c5d12aca9cc86-tempest-keypair-1230793509' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 25 20:59:26.569523 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi session.flush() Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._flush(objects) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi compat.raise_( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi flush_context.execute() Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi rec.execute(self) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = self._query(query) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi conn.query(q) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result.read() Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jun 25 20:59:26.573855 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'cb8c8eecfff4448fa28c5d12aca9cc86-tempest-keypair-1230793509' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 6, 25, 20, 59, 26, 538476), 'updated_at': None, 'name': 'tempest-keypair-1230793509', 'user_id': 'cb8c8eecfff4448fa28c5d12aca9cc86', 'fingerprint': '4e:34:48:b8:c2:4a:fb:36:26:fb:0e:1b:a4:e3:52:c1', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZ525kOotuJpycGlQEBzlzH9y/cnMOUXucM12lhrVXArvumhfLMaGf19xbdeVHDWAUOYrVDODKUB9O8Ql4LmjwWhtb4VWpZU1CzlqocII//Zr3dMTh5ShUvVZ+Oj2kIQw==', 'type': 'ssh'}] Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair.create() Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._create() Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1230793509' already exists. Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jun 25 20:59:26.580820 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1230793509' already exists. Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1230793509' already exists. Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 409 to user: Key pair 'tempest-keypair-1230793509' already exists. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64432c3e-cd74-44c3-a871-5a1c85abd0fb tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.116784 Jun 25 20:59:26.591761 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1120/2024] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:26.592990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-263a53eb-04a2-477a-baf9-0cce0d047787 tempest-ListImagesTestJSON-1539074750 tempest-ListImagesTestJSON-1539074750-project] 10.222.0.39 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.082064 Jun 25 20:59:26.592990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 905/2025] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 20:59:26 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:26.607690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4fe6af8-b772-4396-9abe-d891fac67ff1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Calling method '.version_select at 0x7f984ef369d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.649952 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4fe6af8-b772-4396-9abe-d891fac67ff1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230793509" status: 202 len: 0 microversion: 2.1 time: 0.067415 Jun 25 20:59:26.651911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1121/2026] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 20:59:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1230793509 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:26.668945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eac528a1-e875-4876-94d9-66907a0e112b tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984fd0c1f0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClj++aBSMvvjW7yIFUvV5H6OKwvwloSCptH5KHv7uVgN4jYy/d7X6zOsMGLfBs/M96VU9WBASSRqcdow12R8R6SNnDO+lAseV02WbAmZluXImSKq1kZZk+tgt/DZ8Y2Zw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eac528a1-e875-4876-94d9-66907a0e112b tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 247 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClj++aBSMvvjW7yIFUvV5H6OKwvwloSCptH5KHv7uVgN4jYy/d7X6zOsMGLfBs/M96VU9WBASSRqcdow12R8R6SNnDO+lAseV02WbAmZluXImSKq1kZZk+tgt/DZ8Y2Zw=="}} Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClj++aBSMvvjW7yIFUvV5H6OKwvwloSCptH5KHv7uVgN4jYy/d7X6zOsMGLfBs/M96VU9WBASSRqcdow12R8R6SNnDO+lAseV02WbAmZluXImSKq1kZZk+tgt/DZ8Y2Zw=='}}} Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '' Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:26.672710 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eac528a1-e875-4876-94d9-66907a0e112b tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:26.678847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eac528a1-e875-4876-94d9-66907a0e112b tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013644 Jun 25 20:59:26.682561 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 906/2027] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 20:59:26.695548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984eec4ee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-507384505", "public_key": " "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.728469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:26.735362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for user cb8c8eecfff4448fa28c5d12aca9cc86 and project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:26.769308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.781641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:26.782873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 94 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-507384505", "public_key": " "}} Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: exception: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-507384505', 'public_key': ' '}}} Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.790709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.802235 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.809112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:26.812353 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18d412ab-10fb-4cfc-aca7-cdb0f9e3ec12 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.122286 Jun 25 20:59:26.821935 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1122/2028] 10.222.0.39 () {60 vars in 1157 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:26.822079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:26.822079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:26.822079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:26.822079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:26.835359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b549cad-0682-42c0-8bb8-2a8b2aed9fe1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984eedee50>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyCsWhkbpFjzn8LHH5y+NIoE0fzLDwzA2eWrkYo1XqbWxsMcgJFWo8hMC4R2Y3UyI0Rn8OC7uEwHsajN/f5YrLhV32KcunAX1v52925rsfZnLTiIAf2ptD+uhT6TtPK9w=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b549cad-0682-42c0-8bb8-2a8b2aed9fe1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 507 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyCsWhkbpFjzn8LHH5y+NIoE0fzLDwzA2eWrkYo1XqbWxsMcgJFWo8hMC4R2Y3UyI0Rn8OC7uEwHsajN/f5YrLhV32KcunAX1v52925rsfZnLTiIAf2ptD+uhT6TtPK9w=="}} Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNyCsWhkbpFjzn8LHH5y+NIoE0fzLDwzA2eWrkYo1XqbWxsMcgJFWo8hMC4R2Y3UyI0Rn8OC7uEwHsajN/f5YrLhV32KcunAX1v52925rsfZnLTiIAf2ptD+uhT6TtPK9w=='}}} Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jun 25 20:59:26.852416 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b549cad-0682-42c0-8bb8-2a8b2aed9fe1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:26.856671 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b549cad-0682-42c0-8bb8-2a8b2aed9fe1 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.031235 Jun 25 20:59:26.863848 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1123/2029] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:26.878412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Action: 'create', calling method: .version_select at 0x7f984eede1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1536157324", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:26.931724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:26.944037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Getting quotas for user cb8c8eecfff4448fa28c5d12aca9cc86 and project acec722fe2034ddca7c8c5f836222b7e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:26.979805 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 118 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1536157324", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: exception: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1536157324', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jun 25 20:59:26.982473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jun 25 20:59:26.987150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:26.994765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:26.996214 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dfed84d5-6a10-4635-94fe-0d1a0959a488 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.131388 Jun 25 20:59:26.997388 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1124/2030] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 20:59:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:27.025318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8351da23-2d03-4de4-aae1-05432d411320 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Calling method '.version_select at 0x7f984eed0430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:27.047705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8351da23-2d03-4de4-aae1-05432d411320 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8351da23-2d03-4de4-aae1-05432d411320 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Request method failure captured: Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-297907061 HTTP/1.1 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ctJ7-JLRyujoZzbq9pCiLP4u9jb7mZl1QTIK8WZNIv5TyEzLlar56aniRJGMD7ZeRxytRBj8u7q_GSQ20J0DCbd1_M0VGOecWmSMwlDiu_Ebke24tvMxsbqftFeou6XF5F9s-e-6v7GIDVWAgqDe3KrR3ULP6yZOWAluD7vQjlVxY Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_acec722fe2034ddca7c8c5f836222b7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/acec722fe2034ddca7c8c5f836222b7e"}]}] Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: acec722fe2034ddca7c8c5f836222b7e Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1874865701 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1874865701-project Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: exception: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'tempest-keypair-non-existent-297907061'} Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.force_reraise() Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise self.value Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:27.053698 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8351da23-2d03-4de4-aae1-05432d411320 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] Returning 404 to user: Keypair tempest-keypair-non-existent-297907061 not found for user cb8c8eecfff4448fa28c5d12aca9cc86 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8351da23-2d03-4de4-aae1-05432d411320 tempest-KeyPairsNegativeTestJSON-1874865701 tempest-KeyPairsNegativeTestJSON-1874865701-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-297907061" status: 404 len: 144 microversion: 2.1 time: 0.047005 Jun 25 20:59:27.062037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1125/2031] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 20:59:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-297907061 => generated 144 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:27.069768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3481bec1-8568-4e8b-abb7-517dd0fde1cc req-2a83ab4c-4a6b-4384-b853-5b354c9acfbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71042147-6277-4f59-a301-a2164d61048f", "name": "network-vif-plugged", "status": "completed", "tag": "9e8c7b4e-7970-4bc3-a805-1c6a00bc2287"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:27.097241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3481bec1-8568-4e8b-abb7-517dd0fde1cc req-2a83ab4c-4a6b-4384-b853-5b354c9acfbd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:27.097714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3481bec1-8568-4e8b-abb7-517dd0fde1cc req-2a83ab4c-4a6b-4384-b853-5b354c9acfbd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:27.160055 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3481bec1-8568-4e8b-abb7-517dd0fde1cc req-2a83ab4c-4a6b-4384-b853-5b354c9acfbd service nova] Creating event network-vif-plugged:9e8c7b4e-7970-4bc3-a805-1c6a00bc2287 for instance 71042147-6277-4f59-a301-a2164d61048f on nch2-master-1 Jun 25 20:59:27.172034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3481bec1-8568-4e8b-abb7-517dd0fde1cc req-2a83ab4c-4a6b-4384-b853-5b354c9acfbd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111771 Jun 25 20:59:27.176971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1126/2032] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:27.351115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a823a0e4-266a-4398-b927-e78c1acb0186 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984eed0ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:27.449129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a823a0e4-266a-4398-b927-e78c1acb0186 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.104657 Jun 25 20:59:27.457560 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1127/2033] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:27 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:27.521032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:27.521912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:27.546991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:27.548227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:27.549520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:27.550238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:27.837623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:27.856052 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7edca3d0-00ff-4382-9cc5-ac360b4364a3 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1324 microversion: 2.1 time: 1.080598 Jun 25 20:59:27.862738 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 907/2034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:26 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1324 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:27.875052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1a8beecd-eca4-42ef-b4f2-9eebc687c842 req-c0ffaa9b-77e6-4fcf-a282-637135166fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9a3fd41-9a61-4147-a35a-e0ec27de1364", "name": "network-vif-deleted", "tag": "cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:27.905892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1a8beecd-eca4-42ef-b4f2-9eebc687c842 req-c0ffaa9b-77e6-4fcf-a282-637135166fb1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:27.909452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1a8beecd-eca4-42ef-b4f2-9eebc687c842 req-c0ffaa9b-77e6-4fcf-a282-637135166fb1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:27.934433 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1a8beecd-eca4-42ef-b4f2-9eebc687c842 req-c0ffaa9b-77e6-4fcf-a282-637135166fb1 service nova] Creating event network-vif-deleted:cf8042d9-e6fc-44c7-bd9a-76411cbdf3c2 for instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 on nch2-master-1 Jun 25 20:59:27.950532 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1a8beecd-eca4-42ef-b4f2-9eebc687c842 req-c0ffaa9b-77e6-4fcf-a282-637135166fb1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083854 Jun 25 20:59:27.951481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 908/2035] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:27.994340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:28.005795 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0a7acd0-c26e-45e9-b503-9541adf1f230 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 200 len: 1183 microversion: 2.1 time: 0.494812 Jun 25 20:59:28.009381 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1128/2036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:27 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 1183 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:28.464762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4246393e-86eb-49b9-8861-670702f870bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fdc1d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:28.557731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4246393e-86eb-49b9-8861-670702f870bb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.098682 Jun 25 20:59:28.558930 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 909/2037] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:28 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:28.880204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:28.881529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:28.889374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:28.890195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:28.891301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:28.891960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:29.028531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:29.029423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f9a3fd41-9a61-4147-a35a-e0ec27de1364] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:29.045018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:29.045949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:29.047277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:29.048023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:29.073510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] HTTP exception thrown: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Request method failure captured: Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 HTTP/1.1 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W-0kn1gpusFP63Y6IcaXPTCmXjsz0_OTGhegSonC_jS6tYZW5Z8GOXGNjwIVorTn82P5wAH6MUyeu80bX_iW9qu1f6iSjHoCjiTGxt50a8-PazDYl4sqbg5fyaylExYdZKdOx_nEYNUuJSeV5LUIim8nuR8Lg-d1kseVmM75sDU8c Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}] Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-LiveMigrationTest-185531048 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e9c6e12528ea4760bed65f994df57783 Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f9a3fd41-9a61-4147-a35a-e0ec27de1364'} Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:29.075855 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. Jun 25 20:59:29.085600 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:29.088932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Returning 404 to user: Instance f9a3fd41-9a61-4147-a35a-e0ec27de1364 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:29.090054 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c2f356d-ad0e-4ee9-83e5-1a28cce84b40 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364" status: 404 len: 111 microversion: 2.1 time: 0.067535 Jun 25 20:59:29.091343 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 910/2038] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:29 2022] GET /compute/v2.1/servers/f9a3fd41-9a61-4147-a35a-e0ec27de1364 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:29.572713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9ee481b-0467-4d12-bc7a-da91405d298f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fdc13a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:29.663296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e9ee481b-0467-4d12-bc7a-da91405d298f tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.093308 Jun 25 20:59:29.675069 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 911/2039] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:29 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:29.960614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:29.979241 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26e0b2fa-3009-4929-a8f9-a98a7ea99558 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 200 len: 1521 microversion: 2.1 time: 1.101627 Jun 25 20:59:29.979857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1129/2040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:28 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 1521 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:30.002942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.208"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:30.005442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:30.019160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:30.040222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.042385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:30.043859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.045893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:30.083488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Acquired lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:59:30.311635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:30.312528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:30.325067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.328472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:30.329511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.330126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:30.383697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:30.467045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:30.590714 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3f522078-ec7e-4093-8756-44a9e0ff25db tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 204 len: 0 microversion: 2.1 time: 0.283211 Jun 25 20:59:30.595755 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1130/2041] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:30 2022] DELETE /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:30.602903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:30.603613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:30.626188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.627104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:30.627922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:30.628463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:31.041430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:31.054993 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bf43b1b-5ed2-4941-a7d9-2b3bccfc6cbd tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1666 microversion: 2.1 time: 0.457780 Jun 25 20:59:31.055620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1131/2042] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:30 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1666 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:31.079805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5857ed78-f1c4-4e98-a16b-25c270a037e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef77550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:31.180482 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5857ed78-f1c4-4e98-a16b-25c270a037e6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.110332 Jun 25 20:59:31.188447 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1132/2043] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:31 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:32.076932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:32.084277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:32.107323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:32.108964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:32.113924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:32.114698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:32.821280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:32.836650 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5962ff1e-f855-4efa-a115-62837b590041 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1666 microversion: 2.1 time: 0.758798 Jun 25 20:59:32.848391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1133/2044] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:32 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1666 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:32.858926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-050f27d9-0c5a-4d4b-9021-3afab2f0a81d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef4ad30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:32.981001 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-050f27d9-0c5a-4d4b-9021-3afab2f0a81d tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.139616 Jun 25 20:59:32.981859 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1134/2045] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:32 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:34.155608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8892b28c-31ec-477a-bc1e-f0b96072ab5f tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-274313763", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:34.158823 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8892b28c-31ec-477a-bc1e-f0b96072ab5f tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] HTTP exception thrown: min_count must be <= max_count Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8892b28c-31ec-477a-bc1e-f0b96072ab5f tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Request method failure captured: Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 183 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3c0LoS8mjJVLFumaJ3PB8u9IpliDq18_FdfiVkWaPj7xYbKTqcvFJTHMj2tZErehHVAfKApiNrB7wvw768wm_y6mQGZBGh_3iRxX4twwpDNpAFClHzBVTUPF6sGzsOnQJyotFIYAQo07O8aLf80wSYgkFhJGxN09SFP2MlpVBYJtxg Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}] Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1c2fbc5cb7934f25bfa96539a603a20f Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-274313763", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: exception: min_count must be <= max_count Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-274313763', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jun 25 20:59:34.162538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:34.168834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8892b28c-31ec-477a-bc1e-f0b96072ab5f tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Returning 400 to user: min_count must be <= max_count {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:34.168834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8892b28c-31ec-477a-bc1e-f0b96072ab5f tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 1.181503 Jun 25 20:59:34.182677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1135/2046] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:32 2022] POST /compute/v2.1/servers => generated 74 bytes in 1200 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 20:59:34.191933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:34.193419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:34.203666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:34.204119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:34.205049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:34.205545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:34.556319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:34.568152 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-571290c6-95b6-4140-81a1-cfc073c6d07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1666 microversion: 2.1 time: 0.383955 Jun 25 20:59:34.570004 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1136/2047] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:34 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1666 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:34.588687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c87b205-f114-496a-922d-9c34223fcc3c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef1e3a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:34.678231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c87b205-f114-496a-922d-9c34223fcc3c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.106405 Jun 25 20:59:34.684459 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1137/2048] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:34 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:34.981802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:34.985198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:34.986706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:34.988484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:34.991903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:35.055902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b0b6bf8d-d5c3-4be9-bf6b-b3ef8234520b tempest-AZV2TestJSON-164850541 tempest-AZV2TestJSON-164850541-project] 10.222.0.39 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.370229 Jun 25 20:59:35.065162 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1138/2049] 10.222.0.39 () {58 vars in 1163 bytes} [Sat Jun 25 20:59:34 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 20:59:35.078712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26bbee5c-5ed0-4bff-bc79-d62c5a48a407 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-506011559", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "max_count": 0}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26bbee5c-5ed0-4bff-bc79-d62c5a48a407 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Request method failure captured: Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 167 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3c0LoS8mjJVLFumaJ3PB8u9IpliDq18_FdfiVkWaPj7xYbKTqcvFJTHMj2tZErehHVAfKApiNrB7wvw768wm_y6mQGZBGh_3iRxX4twwpDNpAFClHzBVTUPF6sGzsOnQJyotFIYAQo07O8aLf80wSYgkFhJGxN09SFP2MlpVBYJtxg Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}] Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1c2fbc5cb7934f25bfa96539a603a20f Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-506011559", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "max_count": 0}} Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-506011559', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'max_count': 0}}} Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 0 Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:35.088311 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:35.094351 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:35.098362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26bbee5c-5ed0-4bff-bc79-d62c5a48a407 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:35.098362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26bbee5c-5ed0-4bff-bc79-d62c5a48a407 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.030766 Jun 25 20:59:35.101492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1139/2050] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:35 2022] POST /compute/v2.1/servers => generated 130 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:35.600846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:35.601497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:35.630343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:35.630815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:35.631617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:35.632064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:35.880749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=18 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:36.549628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:36.568959 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a430736d-0db9-4252-80d9-7f1a89a6c07d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1598 microversion: 2.1 time: 0.977306 Jun 25 20:59:36.570379 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1140/2051] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:35 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1598 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:36.575578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f899afdd-947e-47e1-9a4c-655111edcfc6 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-952708781", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "max_count": 2.5}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f899afdd-947e-47e1-9a4c-655111edcfc6 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Request method failure captured: Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 169 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3c0LoS8mjJVLFumaJ3PB8u9IpliDq18_FdfiVkWaPj7xYbKTqcvFJTHMj2tZErehHVAfKApiNrB7wvw768wm_y6mQGZBGh_3iRxX4twwpDNpAFClHzBVTUPF6sGzsOnQJyotFIYAQo07O8aLf80wSYgkFhJGxN09SFP2MlpVBYJtxg Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}] Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1c2fbc5cb7934f25bfa96539a603a20f Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-952708781", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "max_count": 2.5}} Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-952708781', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'max_count': 2.5}}} Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 2.5 Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:36.586676 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.592632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.596028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f899afdd-947e-47e1-9a4c-655111edcfc6 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:36.597284 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f899afdd-947e-47e1-9a4c-655111edcfc6 tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025536 Jun 25 20:59:36.598145 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1141/2052] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:36.604177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ac43dbc-5fca-44d5-b308-c2047dc11bd7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef1fd30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:36.673480 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ac43dbc-5fca-44d5-b308-c2047dc11bd7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.074039 Jun 25 20:59:36.675025 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1142/2053] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:36 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:36.799876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e118bf44-db90-4063-ad1b-d10b181e3fed tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-293592512", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 0}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e118bf44-db90-4063-ad1b-d10b181e3fed tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Request method failure captured: Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 167 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3c0LoS8mjJVLFumaJ3PB8u9IpliDq18_FdfiVkWaPj7xYbKTqcvFJTHMj2tZErehHVAfKApiNrB7wvw768wm_y6mQGZBGh_3iRxX4twwpDNpAFClHzBVTUPF6sGzsOnQJyotFIYAQo07O8aLf80wSYgkFhJGxN09SFP2MlpVBYJtxg Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}] Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1c2fbc5cb7934f25bfa96539a603a20f Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-293592512", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 0}} Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-293592512', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'min_count': 0}}} Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 0 Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:36.806690 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jun 25 20:59:36.811849 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.814968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e118bf44-db90-4063-ad1b-d10b181e3fed tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:36.814968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e118bf44-db90-4063-ad1b-d10b181e3fed tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021699 Jun 25 20:59:36.822049 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1143/2054] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:36 2022] POST /compute/v2.1/servers => generated 130 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 20:59:36.914748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b939b1fd-ccd7-43e8-bda9-7c259422d30e tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-278213941", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 2.5}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b939b1fd-ccd7-43e8-bda9-7c259422d30e tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Request method failure captured: Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 169 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3c0LoS8mjJVLFumaJ3PB8u9IpliDq18_FdfiVkWaPj7xYbKTqcvFJTHMj2tZErehHVAfKApiNrB7wvw768wm_y6mQGZBGh_3iRxX4twwpDNpAFClHzBVTUPF6sGzsOnQJyotFIYAQo07O8aLf80wSYgkFhJGxN09SFP2MlpVBYJtxg Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5bc003f45965400d8bc55f9c1ed4cb34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5bc003f45965400d8bc55f9c1ed4cb34"}]}] Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5bc003f45965400d8bc55f9c1ed4cb34 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-455454148 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1c2fbc5cb7934f25bfa96539a603a20f Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-455454148-project Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-278213941", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "min_count": 2.5}} Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-278213941', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'min_count': 2.5}}} Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 2.5 Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 20:59:36.919113 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jun 25 20:59:36.925161 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:36.932051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b939b1fd-ccd7-43e8-bda9-7c259422d30e tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:36.936265 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b939b1fd-ccd7-43e8-bda9-7c259422d30e tempest-MultipleCreateNegativeTestJSON-455454148 tempest-MultipleCreateNegativeTestJSON-455454148-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026161 Jun 25 20:59:36.937053 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1144/2055] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:36 2022] POST /compute/v2.1/servers => generated 139 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 20:59:37.584643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=34 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:37.590752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:37.591862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:37.616138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:37.617090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:37.627772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:37.632403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:38.272192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:38.282825 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72ca86b8-f17a-4f8d-af93-5ab77bca89ff tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1598 microversion: 2.1 time: 0.699166 Jun 25 20:59:38.287285 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1145/2056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:37 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1598 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:38.293140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a901941-ab0a-492e-aae7-17504b4a722e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984eede280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:38.389787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a901941-ab0a-492e-aae7-17504b4a722e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.100377 Jun 25 20:59:38.390654 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1146/2057] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:38 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:38.395551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d83fc8f7-a925-4093-97fe-cad95d7a8986 req-683ef102-df4b-4f49-98e4-4497a288dda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d924f3-73b1-427e-8d6d-423bec6b8fdb", "name": "network-vif-deleted", "tag": "dd9f246d-0a80-4771-9796-53c229e626fb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:38.421655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d83fc8f7-a925-4093-97fe-cad95d7a8986 req-683ef102-df4b-4f49-98e4-4497a288dda8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:38.422103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d83fc8f7-a925-4093-97fe-cad95d7a8986 req-683ef102-df4b-4f49-98e4-4497a288dda8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:38.443794 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d83fc8f7-a925-4093-97fe-cad95d7a8986 req-683ef102-df4b-4f49-98e4-4497a288dda8 service nova] Creating event network-vif-deleted:dd9f246d-0a80-4771-9796-53c229e626fb for instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb on nch2-master-1 Jun 25 20:59:38.469269 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d83fc8f7-a925-4093-97fe-cad95d7a8986 req-683ef102-df4b-4f49-98e4-4497a288dda8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077142 Jun 25 20:59:38.485916 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1147/2058] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:39.010937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Building network info cache for instance {{(pid=137462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:59:39.306901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:39.308268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:39.323850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:39.327975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:39.329131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:39.329878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:39.452204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:39.457000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:39.467339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lazy-loading 'fault' on Instance uuid f3d924f3-73b1-427e-8d6d-423bec6b8fdb {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 20:59:39.688483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:39.707626 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eedc31ca-64f0-4b40-9866-a205b0602ba0 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 200 len: 1324 microversion: 2.1 time: 0.407759 Jun 25 20:59:39.711347 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1148/2059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:39 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:39.751823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a55197df-88c9-4dde-bd87-ba3d2abee510 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984eef8c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:39.893109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a55197df-88c9-4dde-bd87-ba3d2abee510 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.180344 Jun 25 20:59:39.894510 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1149/2060] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:39 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:40.051413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:40.726645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:40.727743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: f3d924f3-73b1-427e-8d6d-423bec6b8fdb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:40.731399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:40.744157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:40.752178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:40.753151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:40.753618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:40.798842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] HTTP exception thrown: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Request method failure captured: Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb HTTP/1.1 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W-0kn1gpusFP63Y6IcaXPTCmXjsz0_OTGhegSonC_jS6tYZW5Z8GOXGNjwIVorTn82P5wAH6MUyeu80bX_iW9qu1f6iSjHoCjiTGxt50a8-PazDYl4sqbg5fyaylExYdZKdOx_nEYNUuJSeV5LUIim8nuR8Lg-d1kseVmM75sDU8c Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}] Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveMigrationTest-185531048 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e9c6e12528ea4760bed65f994df57783 Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'f3d924f3-73b1-427e-8d6d-423bec6b8fdb'} Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:40.800852 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Returning 404 to user: Instance f3d924f3-73b1-427e-8d6d-423bec6b8fdb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24f8fb59-3773-4fc1-805a-18428224aa1d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb" status: 404 len: 111 microversion: 2.1 time: 0.080850 Jun 25 20:59:40.809547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1150/2061] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:40 2022] GET /compute/v2.1/servers/f3d924f3-73b1-427e-8d6d-423bec6b8fdb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:40.822160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-19f77750-16a8-49d5-b861-290869bae243 req-28bd8689-33c4-49d1-a299-2eea8b7cf4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:40.853300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-19f77750-16a8-49d5-b861-290869bae243 req-28bd8689-33c4-49d1-a299-2eea8b7cf4a3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:40.854027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-19f77750-16a8-49d5-b861-290869bae243 req-28bd8689-33c4-49d1-a299-2eea8b7cf4a3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:40.886832 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-19f77750-16a8-49d5-b861-290869bae243 req-28bd8689-33c4-49d1-a299-2eea8b7cf4a3 service nova] Creating event network-changed:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 20:59:40.904443 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-19f77750-16a8-49d5-b861-290869bae243 req-28bd8689-33c4-49d1-a299-2eea8b7cf4a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092430 Jun 25 20:59:40.909189 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1151/2062] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:40.922605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fbb44e9-af1e-4a22-8137-3fe428caaa49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '.version_select at 0x7f984eede8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:40.987814 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fbb44e9-af1e-4a22-8137-3fe428caaa49 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471838632" status: 202 len: 0 microversion: 2.1 time: 0.074571 Jun 25 20:59:40.989062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1152/2063] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 20:59:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471838632 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 20:59:41.005147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9fd4fb4-8921-41ad-81dd-b911a6901919 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984eef8f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:41.129908 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9fd4fb4-8921-41ad-81dd-b911a6901919 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.139756 Jun 25 20:59:41.135798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1153/2064] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:40 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:42.023201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1115364713", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "406a7e99-9a2c-484e-9a1d-bf376b2f2625"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:42.169882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] validate_networks() for [('406a7e99-9a2c-484e-9a1d-bf376b2f2625', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 20:59:44.426805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 20:59:44.427416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 20:59:44.427683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 20:59:44.428142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 20:59:44.428743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 20:59:44.442990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:44.443443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:44.444243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:44.444956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:44.496317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Getting quotas for project 9fe2cfca1b434e0ca5e91e22cb9da9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 20:59:44.501518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Getting quotas for user 78f952da089344fcbff6d88ab464e50a and project 9fe2cfca1b434e0ca5e91e22cb9da9e2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 20:59:44.539644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 20:59:44.542787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 20:59:44.641148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f258233-b0ca-4852-ac93-1e819965e7f1 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.508534 Jun 25 20:59:44.643991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1154/2065] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 20:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 20:59:44.653934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c89e8bcd-bb3c-4237-a206-d25ce6425e5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef4daf0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:44.740885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c89e8bcd-bb3c-4237-a206-d25ce6425e5c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.091094 Jun 25 20:59:44.742647 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1155/2066] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:44 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:44.766318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:44.777202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:44.802374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:44.805458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:44.806455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:44.809091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:44.917265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:45.078934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Updating instance_info_cache with network_info: [{"id": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1", "address": "fa:16:3e:52:11:b5", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcd34c9-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:59:45.105636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Releasing lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:59:45.106529 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-41235422-0dfb-4622-bdad-45bc578ee3d8 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action" status: 202 len: 0 microversion: 2.1 time: 15.110678 Jun 25 20:59:45.122802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c0f4d10-fa06-43ec-8a1f-8918c9c76f12 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 204 len: 0 microversion: 2.1 time: 0.374698 Jun 25 20:59:45.123397 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 912/2067] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:29 2022] POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action => generated 0 bytes in 15128 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 20:59:45.124203 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1156/2068] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:44 2022] DELETE /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:45.130797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.208"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:45.134812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:45.148600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a5d3571-15a6-40e1-86fd-18e083c50303 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:45.149007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a5d3571-15a6-40e1-86fd-18e083c50303 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:45.157684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:45.158375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:45.159735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:45.162602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:45.257333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Acquired lock "refresh_cache-fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:59:45.722712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a5d3571-15a6-40e1-86fd-18e083c50303 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:45.735806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a5d3571-15a6-40e1-86fd-18e083c50303 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1217 microversion: 2.1 time: 0.611171 Jun 25 20:59:45.748907 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 913/2069] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:45 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1217 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:45.764108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:45.780850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:45.812455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:45.813295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:45.813572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:45.828229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:47.055448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:47.071384 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-359734ed-8e8e-483f-8c97-a12bc5f69b8d tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1485 microversion: 2.1 time: 1.316047 Jun 25 20:59:47.091684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 914/2070] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:45 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1485 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:47.109627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-891baea7-618a-4dd6-8ade-769344ffb039 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fde10d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:47.205691 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-891baea7-618a-4dd6-8ade-769344ffb039 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.112549 Jun 25 20:59:47.212287 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 915/2071] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:47 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:47.226267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:47.226907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:47.258056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:47.260913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:47.261906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:47.270637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:47.824561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:47.840007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfa921a1-a4ac-4f17-9e08-be95956c3d39 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1275 microversion: 2.1 time: 0.626421 Jun 25 20:59:47.847345 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 916/2072] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:47 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1275 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:48.091858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:48.094194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:48.109615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:48.111736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:48.115044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:48.115713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:48.513406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:48.528112 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-73a28777-3715-4461-9869-1ace5c2a016f tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1485 microversion: 2.1 time: 0.440757 Jun 25 20:59:48.529605 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 917/2073] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:48 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1485 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:48.542258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c57f9ed9-7a52-438c-8578-c0170c169619 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd33310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:48.668378 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c57f9ed9-7a52-438c-8578-c0170c169619 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.136087 Jun 25 20:59:48.677744 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 918/2074] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:48 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:48.867189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:48.868865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:48.885635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:48.886389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:48.891907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:48.892761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:49.684448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:49.701637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb80fb75-500b-4704-9233-93e031401dab tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1275 microversion: 2.1 time: 0.840592 Jun 25 20:59:49.717347 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 919/2075] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:48 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1275 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 20:59:49.728666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:49.738910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:49.753991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:49.755477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:49.756645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:49.757273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:51.144474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.neutron [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] re-assign floating IP 172.35.3.208 from instance a90dd5d1-4632-4953-801d-264d2ed15d9c Jun 25 20:59:51.271358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:59:51.439680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:51.462318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44df6536-dea0-4ed6-91fa-caad2c8b5ece tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1485 microversion: 2.1 time: 1.743398 Jun 25 20:59:51.465037 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 920/2076] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:49 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1485 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:51.470902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f4148d9e-5fc5-4ed0-8c01-631f90341856 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd7cf70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:51.606458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4148d9e-5fc5-4ed0-8c01-631f90341856 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.136794 Jun 25 20:59:51.612547 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 921/2077] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:51 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:51.634586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:51.635222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:51.682693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:51.686584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:51.714191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:51.717092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:52.568206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Updating instance_info_cache with network_info: [{"id": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1", "address": "fa:16:3e:52:11:b5", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcd34c9-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:59:52.595744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:59:54.221939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:54.236056 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1cb6670c-c796-4a40-bc3c-fd633df4feff tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 2.625576 Jun 25 20:59:54.242606 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 922/2078] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:51 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 2633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:54.261648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9f6e0697-89ad-484d-9e4c-4fcfaa10b8c4 req-9c016d36-1178-49e2-8f93-e1213f44f77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:54.288149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9f6e0697-89ad-484d-9e4c-4fcfaa10b8c4 req-9c016d36-1178-49e2-8f93-e1213f44f77a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:54.293399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9f6e0697-89ad-484d-9e4c-4fcfaa10b8c4 req-9c016d36-1178-49e2-8f93-e1213f44f77a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:54.328209 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9f6e0697-89ad-484d-9e4c-4fcfaa10b8c4 req-9c016d36-1178-49e2-8f93-e1213f44f77a service nova] Creating event network-changed:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 20:59:54.357443 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9f6e0697-89ad-484d-9e4c-4fcfaa10b8c4 req-9c016d36-1178-49e2-8f93-e1213f44f77a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109656 Jun 25 20:59:54.358902 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 923/2079] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:54.374785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:54.379745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:54.395444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:54.399819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:54.401176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:54.403305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:54.464843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:54.528962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:55.151200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:55.606285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Updating instance_info_cache with network_info: [{"id": "52eeede4-25e2-4847-961d-1017aebea2be", "address": "fa:16:3e:95:aa:f8", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52eeede4-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:59:55.615455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:55.629408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Releasing lock "refresh_cache-fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:59:55.630590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=77,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:55.630830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b36264e-734c-40db-946f-b7b945a6c477 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf/action" status: 202 len: 0 microversion: 2.1 time: 10.504926 Jun 25 20:59:55.632441 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1157/2080] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:45 2022] POST /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf/action => generated 0 bytes in 10507 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 20:59:55.643601 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-41565b78-28ac-4416-9741-040ca4c1fec5 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 200 len: 1443 microversion: 2.1 time: 1.276755 Jun 25 20:59:55.644268 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 924/2081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:54 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 1443 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:55.644689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-539be614-bd6b-4851-a32d-7867f6462640 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ef1e550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:55.685665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:55.699421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:55.733284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:55.757843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:55.759571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:55.762756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:55.765444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:55.814061 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-539be614-bd6b-4851-a32d-7867f6462640 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1437 microversion: 2.1 time: 0.165835 Jun 25 20:59:55.827857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1158/2082] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:55 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1437 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:55.846536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.208"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:56.178871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:56.186933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:56.187672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:56.189992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:56.190904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:56.577719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] HTTP exception thrown: Floating IP 172.35.3.208 is not associated with instance a90dd5d1-4632-4953-801d-264d2ed15d9c. Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Request method failure captured: Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action HTTP/1.1 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 49 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3cExZipG4Dabe2oEvI_jV2xqmAgIe3GvBRPapDH1epGyCG4puyWdsdukUtz-V4S3c-dQOeBZOQglvbPsYKjGi3IECrLJc4uiPEFwJEABlakPYIcbO8G-8FHLBcLZRI2scLyfUWEz_c_xN3-qQ_ZW9wDD1Er1vj5DSUfdWfl5fmqO48 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}] Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: da55b52fd3b54e549d9de4b92b76f6ee Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: {"removeFloatingIp": {"address": "172.35.3.208"}} Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP 172.35.3.208 is not associated with instance a90dd5d1-4632-4953-801d-264d2ed15d9c. Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a90dd5d1-4632-4953-801d-264d2ed15d9c', 'body': {'removeFloatingIp': {'address': '172.35.3.208'}}} Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.3.208 is not associated with instance a90dd5d1-4632-4953-801d-264d2ed15d9c. Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.3.208 is not associated with instance a90dd5d1-4632-4953-801d-264d2ed15d9c. Jun 25 20:59:56.581362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 20:59:56.591630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Returning 409 to user: Floating IP 172.35.3.208 is not associated with instance a90dd5d1-4632-4953-801d-264d2ed15d9c. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:56.594460 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d526f21d-556e-41f1-83f0-5e7b9b12fb09 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action" status: 409 len: 146 microversion: 2.1 time: 0.764323 Jun 25 20:59:56.595895 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1159/2083] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:55 2022] POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action => generated 146 bytes in 767 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 20:59:56.605618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-48e61ded-a23e-4268-b9d4-89755aa71a31 req-e381185b-b4aa-4174-b509-3507898f97bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fd558bb-dd8d-4580-a36a-dfb7c3a925e2", "name": "network-vif-deleted", "tag": "37233d0b-7bf1-4f6f-9bb3-f89df3089ce0"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:56.641132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-48e61ded-a23e-4268-b9d4-89755aa71a31 req-e381185b-b4aa-4174-b509-3507898f97bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:56.647187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-48e61ded-a23e-4268-b9d4-89755aa71a31 req-e381185b-b4aa-4174-b509-3507898f97bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:56.680238 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-48e61ded-a23e-4268-b9d4-89755aa71a31 req-e381185b-b4aa-4174-b509-3507898f97bf service nova] Creating event network-vif-deleted:37233d0b-7bf1-4f6f-9bb3-f89df3089ce0 for instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 on nch2-master-1 Jun 25 20:59:56.693529 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-48e61ded-a23e-4268-b9d4-89755aa71a31 req-e381185b-b4aa-4174-b509-3507898f97bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092057 Jun 25 20:59:56.695855 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1160/2084] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:56.725026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4417c428-4851-4ddd-a7c7-3dca1fcfb226 req-14a50d79-fdd5-4c86-a40e-ccedc55f03c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf", "tag": "52eeede4-25e2-4847-961d-1017aebea2be"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:56.762189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4417c428-4851-4ddd-a7c7-3dca1fcfb226 req-14a50d79-fdd5-4c86-a40e-ccedc55f03c6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:56.762634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4417c428-4851-4ddd-a7c7-3dca1fcfb226 req-14a50d79-fdd5-4c86-a40e-ccedc55f03c6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:56.771697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:59:56.796043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4417c428-4851-4ddd-a7c7-3dca1fcfb226 req-14a50d79-fdd5-4c86-a40e-ccedc55f03c6 service nova] Creating event network-changed:52eeede4-25e2-4847-961d-1017aebea2be for instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf on nch1-master-1 Jun 25 20:59:56.810520 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4417c428-4851-4ddd-a7c7-3dca1fcfb226 req-14a50d79-fdd5-4c86-a40e-ccedc55f03c6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110072 Jun 25 20:59:56.812071 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1161/2085] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 20:59:56.820392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.208"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:57.140560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:57.140753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:57.148728 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f3e29f1-cd12-4ced-933f-af58568864fa tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 1.503278 Jun 25 20:59:57.149312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 925/2086] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:55 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:57.151028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.151763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.153322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.153989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.164145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:57.164954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:57.180931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.181388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.182255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.187521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.204662 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] HTTP exception thrown: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Request method failure captured: Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 HTTP/1.1 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3W-0kn1gpusFP63Y6IcaXPTCmXjsz0_OTGhegSonC_jS6tYZW5Z8GOXGNjwIVorTn82P5wAH6MUyeu80bX_iW9qu1f6iSjHoCjiTGxt50a8-PazDYl4sqbg5fyaylExYdZKdOx_nEYNUuJSeV5LUIim8nuR8Lg-d1kseVmM75sDU8c Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}] Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-LiveMigrationTest-185531048 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-LiveMigrationTest-185531048 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e9c6e12528ea4760bed65f994df57783 Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-LiveMigrationTest-185531048-project Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '3fd558bb-dd8d-4580-a36a-dfb7c3a925e2'} Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:57.205986 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Returning 404 to user: Instance 3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d95ef2a-c774-4774-bd4f-04a385084ce7 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2" status: 404 len: 111 microversion: 2.1 time: 0.054535 Jun 25 20:59:57.212649 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 926/2087] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:57 2022] GET /compute/v2.1/servers/3fd558bb-dd8d-4580-a36a-dfb7c3a925e2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 20:59:57.216000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-09f8c9aa-b615-4254-b0e9-85793376e7d6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fe164c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:57.262737 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-09f8c9aa-b615-4254-b0e9-85793376e7d6 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1446 microversion: 2.1 time: 0.050685 Jun 25 20:59:57.263618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 927/2088] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:57 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1446 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:57.268415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:57.269186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:57.275802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.276252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.277044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.277477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.305785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 20:59:57.395535 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d9a8d9a-1eed-4837-afb6-3365331932d9 tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "DELETE /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 204 len: 0 microversion: 2.1 time: 0.130429 Jun 25 20:59:57.396670 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 928/2089] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 20:59:57 2022] DELETE /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:57.402993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92f7b5dd-9302-4a7d-ab39-c92c8fc98b93 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd49670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:57.444133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Acquired lock "refresh_cache-fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 20:59:57.455631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92f7b5dd-9302-4a7d-ab39-c92c8fc98b93 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 200 len: 1446 microversion: 2.1 time: 0.057586 Jun 25 20:59:57.456262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 929/2090] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 20:59:57 2022] GET /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 1446 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:57.466593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:57.467474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:57.478203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.478456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:57.479262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:57.479758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:58.704058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c6e12528ea4760bed65f994df57783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8850e182ca148cb99d4eb414eb7c08d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 20:59:58.718461 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a77662e1-6322-4530-8dda-9d2329b6e10c tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 200 len: 1498 microversion: 2.1 time: 1.254866 Jun 25 20:59:58.719871 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 930/2091] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:57 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 1498 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 20:59:58.754021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac7a6494-b413-4e10-9b30-1d9c420488e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd0c4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:58.799946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 20:59:59.802004 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac7a6494-b413-4e10-9b30-1d9c420488e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 204 len: 0 microversion: 2.1 time: 1.079174 Jun 25 20:59:59.802527 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 931/2092] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:58 2022] DELETE /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 0 bytes in 1081 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 20:59:59.811849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 20:59:59.812693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 20:59:59.840080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:59.840962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:59.843799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:59.844465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:59.911314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Updating instance_info_cache with network_info: [{"id": "52eeede4-25e2-4847-961d-1017aebea2be", "address": "fa:16:3e:95:aa:f8", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap52eeede4-25", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 20:59:59.942003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Releasing lock "refresh_cache-fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 20:59:59.943470 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abc18efb-828a-438f-b458-192f4500c9ef tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf/action" status: 202 len: 0 microversion: 2.1 time: 3.129947 Jun 25 20:59:59.947704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1162/2093] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 20:59:56 2022] POST /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf/action => generated 0 bytes in 3135 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 20:59:59.955305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f9bfa8-8b21-4b45-a5d5-c926cf8622a0", "name": "network-vif-deleted", "tag": "30c76000-8cc7-4ee6-99ef-200f1895b315"}, {"name": "network-changed", "server_uuid": "fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf", "tag": "52eeede4-25e2-4847-961d-1017aebea2be"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 20:59:59.970597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 20:59:59.971034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 20:59:59.997006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] Creating event network-vif-deleted:30c76000-8cc7-4ee6-99ef-200f1895b315 for instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 on nch1-master-1 Jun 25 20:59:59.997508 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] Creating event network-changed:52eeede4-25e2-4847-961d-1017aebea2be for instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf on nch1-master-1 Jun 25 21:00:00.012354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8666cc49-6902-47b4-88d6-78a9f7174bf3 req-1978f741-097c-4a60-ae37-370f11c1895e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062778 Jun 25 21:00:00.013089 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1163/2094] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 20:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:00.023132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:00.024084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] [instance: 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:00.031430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.032168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.032978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.033407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.047694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] HTTP exception thrown: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Request method failure captured: Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 HTTP/1.1 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3W-0kn1gpusFP63Y6IcaXPTCmXjsz0_OTGhegSonC_jS6tYZW5Z8GOXGNjwIVorTn82P5wAH6MUyeu80bX_iW9qu1f6iSjHoCjiTGxt50a8-PazDYl4sqbg5fyaylExYdZKdOx_nEYNUuJSeV5LUIim8nuR8Lg-d1kseVmM75sDU8c Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveMigrationTest-185531048 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c8850e182ca148cb99d4eb414eb7c08d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c8850e182ca148cb99d4eb414eb7c08d"}]}] Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveMigrationTest-185531048 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c8850e182ca148cb99d4eb414eb7c08d Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveMigrationTest-185531048 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveMigrationTest-185531048-project Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e9c6e12528ea4760bed65f994df57783 Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveMigrationTest-185531048-project Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '77f9bfa8-8b21-4b45-a5d5-c926cf8622a0'} Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:00.049538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. Jun 25 21:00:00.055267 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:00.058488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] Returning 404 to user: Instance 77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:00.059692 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c95d5db1-b2fb-47bb-98eb-21b06a1850bf tempest-LiveMigrationTest-185531048 tempest-LiveMigrationTest-185531048-project] 10.222.0.39 "GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0" status: 404 len: 111 microversion: 2.1 time: 0.043586 Jun 25 21:00:00.060798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1164/2095] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:00 2022] GET /compute/v2.1/servers/77f9bfa8-8b21-4b45-a5d5-c926cf8622a0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:00.071626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:00.072399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:00.079698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.080324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.081719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.082312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.143762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:00.293852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75f9216b-d65d-4727-9d46-e5790ff330b5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 204 len: 0 microversion: 2.1 time: 0.231401 Jun 25 21:00:00.297840 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1165/2096] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:00 2022] DELETE /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:00.321641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:00.322572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:00.337469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.338198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.339809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.340742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.381816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:00.505853 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-182917a1-48fb-409f-9eff-736f7cc39545 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 204 len: 0 microversion: 2.1 time: 0.208250 Jun 25 21:00:00.507107 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1166/2097] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:00 2022] DELETE /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:00.516177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-994507565", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "3c6cf7a6-2345-4f61-9904-003c4d5dc289"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:00.581485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] validate_networks() for [('3c6cf7a6-2345-4f61-9904-003c4d5dc289', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:00.722077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:00.733223 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ed88e6d4-4911-4f1e-b062-8fb4d5800908 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.925251 Jun 25 21:00:00.735736 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 932/2098] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 20:59:59 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:00.754864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.208"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:00.758828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:00.792493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.795222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.796747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:00.797421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:00.880264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Acquired lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 21:00:02.297233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:02.298522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:02.299185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:02.299998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:02.301214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:02.320644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.330175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:02.331551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.332926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:02.386101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:02.396392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Getting quotas for user dbd8d82d694941b58fa2d18311ea5785 and project ca77764a1f5e436db2f6436a02b2fc24. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:02.428690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:02.441381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:02.524994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d50ca07a-5855-44a8-abb1-6d4564c1487b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.015764 Jun 25 21:00:02.525978 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1167/2099] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:02.530866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-944189ab-59d8-4b34-b20c-b3695d471574 req-7ef693ec-0fd5-4e8e-8ca2-b85689c51f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71042147-6277-4f59-a301-a2164d61048f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e8c7b4e-7970-4bc3-a805-1c6a00bc2287"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:02.544941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-944189ab-59d8-4b34-b20c-b3695d471574 req-7ef693ec-0fd5-4e8e-8ca2-b85689c51f8d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.546003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-944189ab-59d8-4b34-b20c-b3695d471574 req-7ef693ec-0fd5-4e8e-8ca2-b85689c51f8d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:02.559502 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-944189ab-59d8-4b34-b20c-b3695d471574 req-7ef693ec-0fd5-4e8e-8ca2-b85689c51f8d service nova] Creating event network-vif-unplugged:9e8c7b4e-7970-4bc3-a805-1c6a00bc2287 for instance 71042147-6277-4f59-a301-a2164d61048f on nch2-master-1 Jun 25 21:00:02.565035 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-944189ab-59d8-4b34-b20c-b3695d471574 req-7ef693ec-0fd5-4e8e-8ca2-b85689c51f8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037627 Jun 25 21:00:02.572185 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1168/2100] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:02.587227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-220d032a-fd55-4088-933d-0988d82a1876 req-26bf66de-b24c-45be-a7a2-d49a1e86a64e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f6aaaa-a714-44bc-b1f4-92fccd671d57", "tag": "7b41a1fc-4f0c-4d48-9aee-052ed8f7edec"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:02.611482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-220d032a-fd55-4088-933d-0988d82a1876 req-26bf66de-b24c-45be-a7a2-d49a1e86a64e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.615047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-220d032a-fd55-4088-933d-0988d82a1876 req-26bf66de-b24c-45be-a7a2-d49a1e86a64e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:02.641453 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-220d032a-fd55-4088-933d-0988d82a1876 req-26bf66de-b24c-45be-a7a2-d49a1e86a64e service nova] Creating event network-changed:7b41a1fc-4f0c-4d48-9aee-052ed8f7edec for instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 on nch2-master-1 Jun 25 21:00:02.655505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-220d032a-fd55-4088-933d-0988d82a1876 req-26bf66de-b24c-45be-a7a2-d49a1e86a64e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075878 Jun 25 21:00:02.656508 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1169/2101] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:02.671027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:02.675482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:02.694697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.695307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:02.696949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:02.697515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:03.352199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:03.366747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01afab8f-062a-49f9-8acd-7adb56ae46f8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.707734 Jun 25 21:00:03.368137 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1170/2102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:02 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:03.643584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-27597095", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:03.753615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:04.907890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:04.909267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:04.910015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:04.911675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:04.912654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:04.929132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:04.929906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:04.930990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:04.931511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:04.952774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Getting quotas for project efa91ea7b5594fdb9700999e51c0a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:04.958993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Getting quotas for user d2012ddfbcf1467f94cdd03f70dc8e79 and project efa91ea7b5594fdb9700999e51c0a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:04.975508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:04.980627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:05.056864 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea219368-162e-4ec4-b9ee-6029e9df237e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.685902 Jun 25 21:00:05.058855 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1171/2103] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:05.077594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:05.078233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:05.098014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:05.098697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:05.099703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:05.100310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:05.438294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:05.447038 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f78dfc1-7572-4b5a-abeb-1db01857837b tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1265 microversion: 2.1 time: 0.387022 Jun 25 21:00:05.461927 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1172/2104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:05 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1265 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:05.471409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:05.473348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:05.488444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:05.490024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:05.492265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:05.493855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:06.742966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:06.752068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-928dc1e9-e13f-44c2-9258-89ebe7af9c1b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 1.288901 Jun 25 21:00:06.756696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1173/2105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:05 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:06.769482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:06.770427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:06.781368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:06.782010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:06.785403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:06.785855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:06.914383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Building network info cache for instance {{(pid=137462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 21:00:07.415006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:07.428439 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3dd3a533-965d-49e5-b79c-d1fa499db72c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1269 microversion: 2.1 time: 0.670374 Jun 25 21:00:07.429538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1174/2106] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:06 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1269 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:07.436228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-26a586fe-2d72-4ba5-a705-3e6b203a82b6 req-5d8c78f2-0f82-44de-bcf7-9e0746706af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71042147-6277-4f59-a301-a2164d61048f", "name": "network-vif-deleted", "tag": "9e8c7b4e-7970-4bc3-a805-1c6a00bc2287"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:07.460233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-26a586fe-2d72-4ba5-a705-3e6b203a82b6 req-5d8c78f2-0f82-44de-bcf7-9e0746706af3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:07.464250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-26a586fe-2d72-4ba5-a705-3e6b203a82b6 req-5d8c78f2-0f82-44de-bcf7-9e0746706af3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:07.486807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-26a586fe-2d72-4ba5-a705-3e6b203a82b6 req-5d8c78f2-0f82-44de-bcf7-9e0746706af3 service nova] Creating event network-vif-deleted:9e8c7b4e-7970-4bc3-a805-1c6a00bc2287 for instance 71042147-6277-4f59-a301-a2164d61048f on nch2-master-1 Jun 25 21:00:07.502267 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-26a586fe-2d72-4ba5-a705-3e6b203a82b6 req-5d8c78f2-0f82-44de-bcf7-9e0746706af3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071162 Jun 25 21:00:07.503318 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1175/2107] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:07.514128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:07.519166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:07.534204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:07.534700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:07.535508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:07.535953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:07.674054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:07.689512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c2cea856-b01d-4c05-9649-3718fccbe4a7 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1265 microversion: 2.1 time: 0.184927 Jun 25 21:00:07.699677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1176/2108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:07 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:07.757838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Updating instance_info_cache with network_info: [{"id": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1", "address": "fa:16:3e:52:11:b5", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcd34c9-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:00:07.775540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Releasing lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 21:00:07.777326 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a6769803-5118-4458-80d7-edee8fdae867 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action" status: 202 len: 0 microversion: 2.1 time: 7.037557 Jun 25 21:00:07.778304 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 933/2109] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:00:00 2022] POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action => generated 0 bytes in 7039 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 21:00:07.784917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:07.786171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:07.793924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:07.794687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:07.795703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:07.796559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:07.813020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4094142-6daa-4fa0-bbb1-570e1adb694a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: .version_select at 0x7f984eede8b0>, body: {"keypair": {"name": "tempest-keypair-884589205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdOpe3l7A5NRnDOo9XstblEbGwv0MesJ87a3EMJKflhrB3iiEQn79xDWlcP+l7R4ux1jgkucadc1WMxHLCSaY2nJmX0VUYMaSjii0b00M1byBuzdt5wHXnNGpYtAyV+lw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:07.836248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b4094142-6daa-4fa0-bbb1-570e1adb694a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:07.841067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b4094142-6daa-4fa0-bbb1-570e1adb694a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:07.872280 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4094142-6daa-4fa0-bbb1-570e1adb694a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170994 Jun 25 21:00:07.879886 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1177/2110] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:00:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:07.885689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccde90b4-88eb-431d-9f7a-9fe671547756 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '.version_select at 0x7f984ef77e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:08.031103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:08.042711 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb7baef9-1039-4c67-89f0-57b824cab95a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.260829 Jun 25 21:00:08.044050 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 934/2111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:07 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:08.447238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:08.448390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:08.462275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:08.462729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:08.466867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:08.469845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:08.653820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:08.672471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b30eff6-ac92-4bc9-abd3-464f044252a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1269 microversion: 2.1 time: 0.229710 Jun 25 21:00:08.676940 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 935/2112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:08 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1269 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:08.683835 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccde90b4-88eb-431d-9f7a-9fe671547756 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips/94420512-4d56-4169-90e3-51bbffd5ca2a" status: 200 len: 184 microversion: 2.1 time: 0.802521 Jun 25 21:00:08.685034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1178/2113] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:07 2022] GET /compute/v2.1/os-floating-ips/94420512-4d56-4169-90e3-51bbffd5ca2a => generated 184 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:08.697594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Action: 'action', calling method: .version_select at 0x7f985f20db80>, body: {"removeFloatingIp": {"address": "172.35.3.208"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:08.713263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:08.718088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:08.750012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:08.750776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:08.751814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:08.752834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:09.183578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:09.191466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:09.191926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:09.195832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:09.198516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:09.300960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:09.318172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-366f705b-f6c2-4679-939f-afe76948ee84 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1265 microversion: 2.1 time: 0.614613 Jun 25 21:00:09.319381 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1179/2114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:08 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1265 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:09.338050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:09.339097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:09.356847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:09.357898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:09.358988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:09.359831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:10.341528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:10.362138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-149a8b81-cdb8-482d-bd7a-732beac68af3 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 1.040343 Jun 25 21:00:10.363099 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1180/2115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:09 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:10.375794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:10.376924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:10.391515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:10.397712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:10.399557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:10.401004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:10.490068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:10.521139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Acquired lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 21:00:10.634671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:10.645790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51cec88c-f24d-45d1-a101-1351cf5b12f9 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1275 microversion: 2.1 time: 0.277122 Jun 25 21:00:10.654385 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1181/2116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:10 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1275 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:10.672933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf", "name": "network-vif-deleted", "tag": "52eeede4-25e2-4847-961d-1017aebea2be"}, {"name": "network-changed", "server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:10.689284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:10.689902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:10.717076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] Creating event network-vif-deleted:52eeede4-25e2-4847-961d-1017aebea2be for instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf on nch1-master-1 Jun 25 21:00:10.718142 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] Creating event network-changed:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 21:00:10.734400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2774dafa-20eb-4629-8fa7-175a6906c77b req-f2506695-a262-48fc-94a5-27af2109b707 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076563 Jun 25 21:00:10.735549 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1182/2117] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:10.770522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:10.773133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:10.796572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:10.797606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:10.799215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:10.800321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:11.240029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:11.257971 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f9c9904-cc8a-43c5-888c-91cd28ae05c3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.496324 Jun 25 21:00:11.258676 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1183/2118] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:10 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:11.376163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1635844364", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:11.385967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:11.518706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] validate_networks() for [('9adafde3-7f17-430a-8f22-32a079eb2807', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:13.910884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:13.911419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:13.911772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:13.912179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:13.912619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:13.935267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:13.935720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:13.936606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:13.937026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:14.013148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Getting quotas for project 27b6256b931e4f67bd0795961bb29b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:14.024540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Getting quotas for user 7e42634d85d14429b9779efa8bb84f8f and project 27b6256b931e4f67bd0795961bb29b4e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:14.047956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:14.052126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:14.164730 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb63bfe4-9bb6-4035-98e0-e730f2b351f7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.903856 Jun 25 21:00:14.165951 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1184/2119] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:14.172624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:14.175317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:14.188029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:14.188386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:14.190307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:14.191253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:14.508811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:14.527678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23c46793-ee63-450a-b4f5-51d9509bea37 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.359915 Jun 25 21:00:14.538792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1185/2120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:14 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:14.546779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:14.547765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:14.554789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:14.555565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:14.556588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:14.557240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:14.653279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Building network info cache for instance {{(pid=137462) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 21:00:14.808623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:14.826581 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0e1a8a6c-8326-4b8d-9898-9a09483a2ae4 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.285341 Jun 25 21:00:14.833765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1186/2121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:14 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:14.935189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1044601780", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:15.006215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:16.618330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Updating instance_info_cache with network_info: [{"id": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1", "address": "fa:16:3e:52:11:b5", "network": {"id": "5441c203-76d7-4c33-bb38-eafe7bc56559", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1084284335-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "ffbad622c26749aebba510fde1cb72c0", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcd34c9-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:00:16.649257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Releasing lock "refresh_cache-a90dd5d1-4632-4953-801d-264d2ed15d9c" {{(pid=137462) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 21:00:16.650439 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-72593905-c9e7-4878-ae3a-4ee7cd3a3c2d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action" status: 202 len: 0 microversion: 2.1 time: 7.958286 Jun 25 21:00:16.653604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 936/2122] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:00:08 2022] POST /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c/action => generated 0 bytes in 7963 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 21:00:16.663353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:16.664182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:16.666470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:16.679052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:16.679460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:16.680269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:16.680732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.160517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:17.174353 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1c5556d-b225-4277-9ff2-b2f83ceff747 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.515096 Jun 25 21:00:17.178919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 937/2123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:16 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:17.193138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2ad6d7c1-9406-46e9-ae39-99b4adca0716 req-3659a055-af88-45ea-a45e-c443b2997e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd3e9e2a-3b95-4eed-b1b0-686e91342a93", "tag": "d99bbefb-8855-4932-9772-fd509890d945"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:17.207684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2ad6d7c1-9406-46e9-ae39-99b4adca0716 req-3659a055-af88-45ea-a45e-c443b2997e65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.208203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2ad6d7c1-9406-46e9-ae39-99b4adca0716 req-3659a055-af88-45ea-a45e-c443b2997e65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.229247 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2ad6d7c1-9406-46e9-ae39-99b4adca0716 req-3659a055-af88-45ea-a45e-c443b2997e65 service nova] Creating event network-changed:d99bbefb-8855-4932-9772-fd509890d945 for instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 on nch1-master-1 Jun 25 21:00:17.240497 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2ad6d7c1-9406-46e9-ae39-99b4adca0716 req-3659a055-af88-45ea-a45e-c443b2997e65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059465 Jun 25 21:00:17.241718 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 938/2124] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:17.247534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d5375676-be25-4daa-87e2-dbbe4198048a req-dcaa00fe-7ac2-4d4f-9a6d-856cb1d78887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f6aaaa-a714-44bc-b1f4-92fccd671d57", "name": "network-vif-plugged", "status": "completed", "tag": "7b41a1fc-4f0c-4d48-9aee-052ed8f7edec"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:17.264745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d5375676-be25-4daa-87e2-dbbe4198048a req-dcaa00fe-7ac2-4d4f-9a6d-856cb1d78887 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.265544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d5375676-be25-4daa-87e2-dbbe4198048a req-dcaa00fe-7ac2-4d4f-9a6d-856cb1d78887 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.288499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d5375676-be25-4daa-87e2-dbbe4198048a req-dcaa00fe-7ac2-4d4f-9a6d-856cb1d78887 service nova] Creating event network-vif-plugged:7b41a1fc-4f0c-4d48-9aee-052ed8f7edec for instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 on nch2-master-1 Jun 25 21:00:17.294787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d5375676-be25-4daa-87e2-dbbe4198048a req-dcaa00fe-7ac2-4d4f-9a6d-856cb1d78887 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051334 Jun 25 21:00:17.295953 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 939/2125] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:17.303854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:17.305126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:17.314121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.315201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.316995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.317661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.395398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:17.396024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:17.396300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:17.396745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:17.397165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:17.410923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.411618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.412643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.413243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.435193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:17.443390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:17.469111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:17.472030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:17.481660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:17.488746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f3fd382-2af2-40fd-8789-4febf24552c0 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1282 microversion: 2.1 time: 0.189609 Jun 25 21:00:17.489904 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 940/2126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:17 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:17.505199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-07e0ff98-8146-4003-982e-508bbf207020 req-74b70d29-4246-445b-aee4-ee2ce7840c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:17.533630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-07e0ff98-8146-4003-982e-508bbf207020 req-74b70d29-4246-445b-aee4-ee2ce7840c9f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.535391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-07e0ff98-8146-4003-982e-508bbf207020 req-74b70d29-4246-445b-aee4-ee2ce7840c9f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.568052 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-07e0ff98-8146-4003-982e-508bbf207020 req-74b70d29-4246-445b-aee4-ee2ce7840c9f service nova] Creating event network-changed:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 21:00:17.584084 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-925d7552-7020-440f-bff0-dc645da4da24 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.747930 Jun 25 21:00:17.584373 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-07e0ff98-8146-4003-982e-508bbf207020 req-74b70d29-4246-445b-aee4-ee2ce7840c9f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086995 Jun 25 21:00:17.585480 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 941/2127] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:17.593563 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1187/2128] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:17.594499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:17.595218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:17.605550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:17.607680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:17.609868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.610469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.621684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.622218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.631698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.632336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:17.633293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:17.633905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.123844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:18.133582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9676c28f-69d2-4ec7-9b52-d7de40c68954 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.538620 Jun 25 21:00:18.134185 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1188/2129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:17 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:18.161025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1819076052", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca"}], "security_groups": [{"name": "tempest-securitygroup--1833014720"}], "key_name": "tempest-keypair-884589205", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:18.384263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:18.392190 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb4d015c-35f5-45fa-b0f0-e83434f05d6c tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.805356 Jun 25 21:00:18.393131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 942/2130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:17 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:18.407859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:18.408581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:18.415393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.416101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.417077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.417659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.434054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] validate_networks() for [('4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:18.440727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] HTTP exception thrown: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Request method failure captured: Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf HTTP/1.1 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3cExZipG4Dabe2oEvI_jV2xqmAgIe3GvBRPapDH1epGyCG4puyWdsdukUtz-V4S3c-dQOeBZOQglvbPsYKjGi3IECrLJc4uiPEFwJEABlakPYIcbO8G-8FHLBcLZRI2scLyfUWEz_c_xN3-qQ_ZW9wDD1Er1vj5DSUfdWfl5fmqO48 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}] Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: da55b52fd3b54e549d9de4b92b76f6ee Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf'} Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:18.447324 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:18.450862 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:18.452306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Returning 404 to user: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:18.453371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e5c1664-5f36-423a-85ad-868ce36eb576 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 404 len: 111 microversion: 2.1 time: 0.050325 Jun 25 21:00:18.454440 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 943/2131] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:18 2022] DELETE /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:18.465576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:18.469469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:18.479057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.479518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.490049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.490518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.515043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:18.659510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:18.674537 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52e273e3-9fb3-4087-b0b0-60178a92c7af tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1219 microversion: 2.1 time: 0.217912 Jun 25 21:00:18.675146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 944/2132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:18 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:18.680352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:18.689620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:18.701682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.702096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:18.707892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:18.708685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.061209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:19.077560 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93314ce9-26f9-416a-aa9e-56891d8256a4 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.400843 Jun 25 21:00:19.088590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 945/2133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:18 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:19.093905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:19.094516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:19.102480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.102930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.103920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.104352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.120842 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] HTTP exception thrown: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Request method failure captured: Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf HTTP/1.1 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3cExZipG4Dabe2oEvI_jV2xqmAgIe3GvBRPapDH1epGyCG4puyWdsdukUtz-V4S3c-dQOeBZOQglvbPsYKjGi3IECrLJc4uiPEFwJEABlakPYIcbO8G-8FHLBcLZRI2scLyfUWEz_c_xN3-qQ_ZW9wDD1Er1vj5DSUfdWfl5fmqO48 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}] Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: da55b52fd3b54e549d9de4b92b76f6ee Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf'} Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:19.122654 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. Jun 25 21:00:19.125519 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:19.129033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Returning 404 to user: Instance fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:19.129912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd853df1-85cf-4520-b973-bff00c5cd9f2 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf" status: 404 len: 111 microversion: 2.1 time: 0.039778 Jun 25 21:00:19.133687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 946/2134] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:19 2022] GET /compute/v2.1/servers/fdf00dce-7c7c-49c2-b7cf-f7a9d706bcaf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:19.138971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:19.139827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:19.148539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.148987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.154575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.155218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.340585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:19.349062 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5394522-5257-4737-b039-fe9e314b2b56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.214101 Jun 25 21:00:19.349867 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 947/2135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:19 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:19.357176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4312a28a-704e-40b4-a7cd-59980162cd10 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '.version_select at 0x7f984fd990d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:19.434777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:19.436170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:19.437499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:19.438429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:19.439034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:19.450940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.451709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.452886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.454487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.490852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:19.495833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:19.518723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:19.521893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:19.630181 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca3acbf5-587a-4d94-b5c8-ec47903e159a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.492627 Jun 25 21:00:19.636030 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1189/2136] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:19.641871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:19.645518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:19.666664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.667454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:19.668416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:19.670126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:20.529967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:20.568463 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-267997f6-7f49-4397-8382-e5b6c11fb5e6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.935761 Jun 25 21:00:20.576964 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1190/2137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:19 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:20.605789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:20.613816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:20.626169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:20.643586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:20.644626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:20.645086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.154343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4312a28a-704e-40b4-a7cd-59980162cd10 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/94420512-4d56-4169-90e3-51bbffd5ca2a" status: 202 len: 0 microversion: 2.1 time: 1.803232 Jun 25 21:00:21.155357 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 948/2138] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:00:19 2022] DELETE /compute/v2.1/os-floating-ips/94420512-4d56-4169-90e3-51bbffd5ca2a => generated 0 bytes in 1805 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:00:21.173033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:21.173682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:21.185593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.186325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.187391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.188044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.222452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:21.231477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-499ccb27-5afd-4eba-a94f-9ac051a634e8 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1317 microversion: 2.1 time: 0.650041 Jun 25 21:00:21.241217 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1191/2139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:20 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1317 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:21.246785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:21.247733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:21.267435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.267895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.274335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.274854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.288820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:21.298637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6238fe84-9f01-4ba0-a783-b54772d9627b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1234 microversion: 2.1 time: 0.140413 Jun 25 21:00:21.301021 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 949/2140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:21 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1234 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:21.306552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ff555910-1070-4aaa-8322-054ba11108e6 req-97782b04-3f96-42fb-baa8-b7e3de380aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81a9bed-6545-4585-8446-6340cff7fd36", "tag": "e52fd42e-bb0c-4680-8ddd-1c831de710ed"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:21.316646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ff555910-1070-4aaa-8322-054ba11108e6 req-97782b04-3f96-42fb-baa8-b7e3de380aec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.317309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ff555910-1070-4aaa-8322-054ba11108e6 req-97782b04-3f96-42fb-baa8-b7e3de380aec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.340196 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ff555910-1070-4aaa-8322-054ba11108e6 req-97782b04-3f96-42fb-baa8-b7e3de380aec service nova] Creating event network-changed:e52fd42e-bb0c-4680-8ddd-1c831de710ed for instance b81a9bed-6545-4585-8446-6340cff7fd36 on nch2-master-1 Jun 25 21:00:21.346136 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ff555910-1070-4aaa-8322-054ba11108e6 req-97782b04-3f96-42fb-baa8-b7e3de380aec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043698 Jun 25 21:00:21.347549 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 950/2141] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:21.360597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:21.361543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:21.387027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.387747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.388716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.390225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.463367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:21.473089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23e723b6-248f-4f1c-bbbc-2bf9ddfc9181 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1267 microversion: 2.1 time: 0.230325 Jun 25 21:00:21.473707 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1192/2142] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:21 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:21.497381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:21.498235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:21.508897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.517284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.518252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.518965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.864611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:21.879961 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08538793-a044-4205-9c02-4b39deb3a5ea tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.386214 Jun 25 21:00:21.881493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1193/2143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:21 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:21.897409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9ed38253-d50c-460d-987b-1b19f2e6b432 req-6dcbd4c6-af08-4dd4-89ec-ca59ee97f816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3e9e2a-3b95-4eed-b1b0-686e91342a93", "name": "network-vif-plugged", "status": "completed", "tag": "d99bbefb-8855-4932-9772-fd509890d945"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:21.926628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9ed38253-d50c-460d-987b-1b19f2e6b432 req-6dcbd4c6-af08-4dd4-89ec-ca59ee97f816 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.928671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9ed38253-d50c-460d-987b-1b19f2e6b432 req-6dcbd4c6-af08-4dd4-89ec-ca59ee97f816 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:21.946561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:21.960580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-032a3d77-5f23-4176-9ab4-40846bfe00e1 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.602262 Jun 25 21:00:21.964284 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 951/2144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:21 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:21.972473 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9ed38253-d50c-460d-987b-1b19f2e6b432 req-6dcbd4c6-af08-4dd4-89ec-ca59ee97f816 service nova] Creating event network-vif-plugged:d99bbefb-8855-4932-9772-fd509890d945 for instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 on nch1-master-1 Jun 25 21:00:21.974348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b9161a0e-fb61-480c-a01a-517a9ab96a12 req-142affe9-4f23-4402-8b4f-77cc080cc2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c4d4140-90f3-495f-a33d-b158abeb632b", "tag": "4b118888-0f29-4c16-9f04-8f3332b745f2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:21.991036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9ed38253-d50c-460d-987b-1b19f2e6b432 req-6dcbd4c6-af08-4dd4-89ec-ca59ee97f816 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104442 Jun 25 21:00:21.991712 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1194/2145] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:21.997549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b9161a0e-fb61-480c-a01a-517a9ab96a12 req-142affe9-4f23-4402-8b4f-77cc080cc2ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:21.998183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b9161a0e-fb61-480c-a01a-517a9ab96a12 req-142affe9-4f23-4402-8b4f-77cc080cc2ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.001705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.007031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.028214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.028783 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b9161a0e-fb61-480c-a01a-517a9ab96a12 req-142affe9-4f23-4402-8b4f-77cc080cc2ac service nova] Creating event network-changed:4b118888-0f29-4c16-9f04-8f3332b745f2 for instance 6c4d4140-90f3-495f-a33d-b158abeb632b on nch1-master-1 Jun 25 21:00:22.032032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.033039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.034255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.038516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b9161a0e-fb61-480c-a01a-517a9ab96a12 req-142affe9-4f23-4402-8b4f-77cc080cc2ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072481 Jun 25 21:00:22.041228 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 952/2146] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:22.053424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.055318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.072288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.073191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.075167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.075754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.104159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:22.246412 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a26d7728-bc9b-4b73-abe3-6677abdccd95 tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 204 len: 0 microversion: 2.1 time: 0.248990 Jun 25 21:00:22.252969 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1195/2147] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:21 2022] DELETE /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:22.261253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.261983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.269029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.269324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.270034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.270476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.449689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:22.458640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88a99940-f515-4ad3-a3c5-0ed2605ff7ba tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.414741 Jun 25 21:00:22.460566 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 953/2148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:22.466434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.467285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.474113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.474861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.475977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.476760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.645975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:22.668458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bff46689-a820-4578-8c06-4cb9039819d4 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1506 microversion: 2.1 time: 0.412425 Jun 25 21:00:22.670423 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1196/2149] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:22.675435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.677533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.685254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.686051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.687334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.687904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.822376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:22.828943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:22.833025 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3a472ac-dff0-4aab-a15e-a0f699ee2d9f tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1525 microversion: 2.1 time: 0.371112 Jun 25 21:00:22.833627 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 954/2150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1525 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:22.838620 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab31b4e0-04eb-4207-8e58-71f509648b71 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1296 microversion: 2.1 time: 0.166895 Jun 25 21:00:22.843065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.843830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.850250 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1197/2151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1296 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:22.855459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.855958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.856208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.856888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.857854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.858422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.863280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.863867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.865212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.865212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.892789 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44de5738-2ff0-424a-91c6-fb703c859a6b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips" status: 200 len: 109 microversion: 2.1 time: 0.041088 Jun 25 21:00:22.893765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1198/2152] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips => generated 109 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:22.905326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.905987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:22.913199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.913783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.914664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:22.915210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:22.976522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:22.984685 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a03cc707-39c9-4998-9d72-3b913f064247 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1273 microversion: 2.1 time: 0.146574 Jun 25 21:00:22.985979 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 955/2153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:22.994284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:22.995042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.002836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.003292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.005744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.005744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.032387 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-494ac3ab-957d-4721-a934-405b94d40006 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips" status: 200 len: 109 microversion: 2.1 time: 0.044713 Jun 25 21:00:23.033396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 956/2154] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips => generated 109 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:23.038622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.040458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.047027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.047706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.048708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.049318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.230250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:23.236571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:23.247333 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e2c8bfc-e262-40ff-a720-5b707fbacaa2 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.345409 Jun 25 21:00:23.248207 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1199/2155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:22 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:23.255676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.256618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.265670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.266489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.267639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.268338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.313208 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a536483-1d50-4eb3-8010-e25d7cfc4a3e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips/tempest-ServerAddressesTestJSON-1464780673-network" status: 200 len: 94 microversion: 2.1 time: 0.063166 Jun 25 21:00:23.318152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:23.324333 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1200/2156] 10.222.0.39 () {58 vars in 1400 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57/ips/tempest-ServerAddressesTestJSON-1464780673-network => generated 94 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:23.330293 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d396c58-a260-4247-bdf5-e870820d2f7c tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.295411 Jun 25 21:00:23.331550 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 957/2157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:23.360007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.360007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.368260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.368260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.369208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.369666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.412750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:23.477808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.486628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.499552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.500060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.501051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.501493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.542975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7962f09b-1a66-47cc-86aa-80ba0743ab9a tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 204 len: 0 microversion: 2.1 time: 0.216798 Jun 25 21:00:23.543663 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1201/2158] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:23 2022] DELETE /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:23.553504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.553504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.559410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.559955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.560841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.561342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.664547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:23.672765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7284bc31-c519-404a-9c9f-178733d70d35 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.199965 Jun 25 21:00:23.673618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 958/2159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:23.804128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:23.813032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ef68aee-a4df-481b-aa44-bd236340e679 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1512 microversion: 2.1 time: 0.265004 Jun 25 21:00:23.813837 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1202/2160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:23.852023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.852848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.857788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:23.859184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:23.862168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.862850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.864027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.864824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.866702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.867135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:23.877142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:23.877794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.138596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:24.155103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e81e9b9-3c1d-4dbe-bf37-231b80cd676a tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1525 microversion: 2.1 time: 0.307049 Jun 25 21:00:24.156193 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 959/2161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1525 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:24.161339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:24.168084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:24.189229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.193591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.195437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.196137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.481358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:24.490697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b8f9fb5-a148-450f-9fcc-5a07bd1219f7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.333189 Jun 25 21:00:24.491399 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 960/2162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:24 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:24.501454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6852973b-32f7-493e-87de-93872ad5032d req-b057fe3a-4987-4d94-9fc1-899be490f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81a9bed-6545-4585-8446-6340cff7fd36", "name": "network-vif-plugged", "status": "completed", "tag": "e52fd42e-bb0c-4680-8ddd-1c831de710ed"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:24.503082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:24.510051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6852973b-32f7-493e-87de-93872ad5032d req-b057fe3a-4987-4d94-9fc1-899be490f078 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.510499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6852973b-32f7-493e-87de-93872ad5032d req-b057fe3a-4987-4d94-9fc1-899be490f078 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.512354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2aa6bea-5534-4a4b-9300-03feea9cfea4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.658381 Jun 25 21:00:24.515971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1203/2163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:23 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:24.518040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:24.518785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:24.525187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.525715 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6852973b-32f7-493e-87de-93872ad5032d req-b057fe3a-4987-4d94-9fc1-899be490f078 service nova] Creating event network-vif-plugged:e52fd42e-bb0c-4680-8ddd-1c831de710ed for instance b81a9bed-6545-4585-8446-6340cff7fd36 on nch2-master-1 Jun 25 21:00:24.525817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.526689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.527216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.530850 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6852973b-32f7-493e-87de-93872ad5032d req-b057fe3a-4987-4d94-9fc1-899be490f078 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034694 Jun 25 21:00:24.531780 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 961/2164] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:24.537883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:24.538581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:24.545347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.545818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.547384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.547973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.942806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:24.952186 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4d8844a7-3c79-496a-b771-fce67988b764 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.437679 Jun 25 21:00:24.961289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1204/2165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:24 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:24.967121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:24.967866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:24.986011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.986462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:24.987393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:24.987830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.112382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:25.130854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-81efe5e4-7700-4e3c-a8de-5dfa8f6214e9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1307 microversion: 2.1 time: 0.593421 Jun 25 21:00:25.133090 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 962/2166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:24 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1307 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:25.145839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:25.148664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:25.163733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.164363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.165775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.173673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.472965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:25.486264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3342975c-a9e1-4055-8f96-091537b227f2 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1317 microversion: 2.1 time: 0.523633 Jun 25 21:00:25.487284 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1205/2167] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:24 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:25.491972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:25.492627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:25.498069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:25.499628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.500094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.500896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.501337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.855301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da55b52fd3b54e549d9de4b92b76f6ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbad622c26749aebba510fde1cb72c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:25.863464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e28f30e-0b5e-4607-8bf1-a6cbd21e047d tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 200 len: 1525 microversion: 2.1 time: 0.374898 Jun 25 21:00:25.873987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1206/2168] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:25 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 1525 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:25.879716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:25.880728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:25.888134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.888910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:25.889890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:25.890547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.129975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:26.156199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eda90700-bdaf-4797-81b8-2f379b5d8f2e tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1512 microversion: 2.1 time: 1.021431 Jun 25 21:00:26.162755 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 963/2169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:25 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1512 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:26.172622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:26.177279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:26.190809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.193371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.197804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.198613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.215402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:26.228135 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-82dfa77e-e051-457d-8b74-651fc2590d4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.352544 Jun 25 21:00:26.229020 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1207/2170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:25 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:26.236706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:26.242912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:26.255400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.258058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.259063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.260947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.535322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:26.545944 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65d84662-300e-4341-ad15-55a17131036b tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.315678 Jun 25 21:00:26.548400 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1208/2171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:26 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:26.559662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ea01f4ef-ad4d-4335-869d-ddff2b77e314 req-95c74ba2-9d9b-4305-ac4a-7511bc46e0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a90dd5d1-4632-4953-801d-264d2ed15d9c", "name": "network-vif-deleted", "tag": "9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:26.576950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ea01f4ef-ad4d-4335-869d-ddff2b77e314 req-95c74ba2-9d9b-4305-ac4a-7511bc46e0fd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.585622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ea01f4ef-ad4d-4335-869d-ddff2b77e314 req-95c74ba2-9d9b-4305-ac4a-7511bc46e0fd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.615947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ea01f4ef-ad4d-4335-869d-ddff2b77e314 req-95c74ba2-9d9b-4305-ac4a-7511bc46e0fd service nova] Creating event network-vif-deleted:9bcd34c9-2ff6-4f4e-8db0-c2f809dceca1 for instance a90dd5d1-4632-4953-801d-264d2ed15d9c on nch1-master-1 Jun 25 21:00:26.630490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ea01f4ef-ad4d-4335-869d-ddff2b77e314 req-95c74ba2-9d9b-4305-ac4a-7511bc46e0fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078846 Jun 25 21:00:26.643583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1209/2172] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:26.650235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:26.653620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:26.666910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.676693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.677706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.678445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.941376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:26.952919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0e5ed7ee-728b-4d13-bb01-90315e860fba tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1487 microversion: 2.1 time: 0.307547 Jun 25 21:00:26.965790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:26.966821 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1210/2173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:26 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1487 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:26.972691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:26.973565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:26.981614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.982769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.983800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:26.984393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:26.986706 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-717f6efc-a8e3-40b9-bf81-b481f35c1cfc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.822326 Jun 25 21:00:26.987758 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 964/2174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:26 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:27.001638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:27.005609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] [instance: a90dd5d1-4632-4953-801d-264d2ed15d9c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:27.027661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.028411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.031132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.031585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.046021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:27.070989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] HTTP exception thrown: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Request method failure captured: Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c HTTP/1.1 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3cExZipG4Dabe2oEvI_jV2xqmAgIe3GvBRPapDH1epGyCG4puyWdsdukUtz-V4S3c-dQOeBZOQglvbPsYKjGi3IECrLJc4uiPEFwJEABlakPYIcbO8G-8FHLBcLZRI2scLyfUWEz_c_xN3-qQ_ZW9wDD1Er1vj5DSUfdWfl5fmqO48 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffbad622c26749aebba510fde1cb72c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffbad622c26749aebba510fde1cb72c0"}]}] Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ffbad622c26749aebba510fde1cb72c0 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-2038232230 Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: da55b52fd3b54e549d9de4b92b76f6ee Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-2038232230-project Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a90dd5d1-4632-4953-801d-264d2ed15d9c'} Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:27.073271 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] Returning 404 to user: Instance a90dd5d1-4632-4953-801d-264d2ed15d9c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:27.077239 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a947a7b1-b889-4936-b5c2-f221dd6480ce tempest-FloatingIPsAssociationTestJSON-2038232230 tempest-FloatingIPsAssociationTestJSON-2038232230-project] 10.222.0.39 "GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c" status: 404 len: 111 microversion: 2.1 time: 0.083112 Jun 25 21:00:27.079252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 965/2175] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:26 2022] GET /compute/v2.1/servers/a90dd5d1-4632-4953-801d-264d2ed15d9c => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:27.085384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-76c099ec-19fd-4e4b-9a54-c6621798a3ef req-287359cb-9d8d-47b6-a0ec-d28aac287d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d4140-90f3-495f-a33d-b158abeb632b", "name": "network-vif-plugged", "status": "completed", "tag": "4b118888-0f29-4c16-9f04-8f3332b745f2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:27.095763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-76c099ec-19fd-4e4b-9a54-c6621798a3ef req-287359cb-9d8d-47b6-a0ec-d28aac287d24 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.096264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-76c099ec-19fd-4e4b-9a54-c6621798a3ef req-287359cb-9d8d-47b6-a0ec-d28aac287d24 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.116484 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-76c099ec-19fd-4e4b-9a54-c6621798a3ef req-287359cb-9d8d-47b6-a0ec-d28aac287d24 service nova] Creating event network-vif-plugged:4b118888-0f29-4c16-9f04-8f3332b745f2 for instance 6c4d4140-90f3-495f-a33d-b158abeb632b on nch1-master-1 Jun 25 21:00:27.124616 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-76c099ec-19fd-4e4b-9a54-c6621798a3ef req-287359cb-9d8d-47b6-a0ec-d28aac287d24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043402 Jun 25 21:00:27.126133 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 966/2176] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:27.133793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-717482144"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:27.135095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:27.141990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.142655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.144120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.144889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.573621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:27.583137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43f8b3f7-4169-4771-bda8-132536b8d896 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1467 microversion: 2.1 time: 0.614905 Jun 25 21:00:27.584325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1211/2177] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:26 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1467 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:27.590953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:27.591751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:27.599518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.600303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.601470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.602076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.686907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17378521-3bae-4630-940f-18328bc44fda tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "POST /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93/action" status: 202 len: 0 microversion: 2.1 time: 0.557475 Jun 25 21:00:27.692756 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 967/2178] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:00:27 2022] POST /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:00:27.701405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:27.704193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:27.712998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.714342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.715311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.715971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.851953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:27.867067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc7f30d2-d1fb-443b-b3e5-3d464e8f6e11 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1302 microversion: 2.1 time: 0.278354 Jun 25 21:00:27.868391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1212/2179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:27 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1302 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:27.876209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-84f61983-1368-4c4d-bebe-d0ace706f6c6 req-d7ebe75a-116d-4039-bc73-a696bcf8ecc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f6aaaa-a714-44bc-b1f4-92fccd671d57", "name": "network-vif-deleted", "tag": "7b41a1fc-4f0c-4d48-9aee-052ed8f7edec"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:27.885810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-84f61983-1368-4c4d-bebe-d0ace706f6c6 req-d7ebe75a-116d-4039-bc73-a696bcf8ecc5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.886493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-84f61983-1368-4c4d-bebe-d0ace706f6c6 req-d7ebe75a-116d-4039-bc73-a696bcf8ecc5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.901162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:27.907018 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-84f61983-1368-4c4d-bebe-d0ace706f6c6 req-d7ebe75a-116d-4039-bc73-a696bcf8ecc5 service nova] Creating event network-vif-deleted:7b41a1fc-4f0c-4d48-9aee-052ed8f7edec for instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 on nch2-master-1 Jun 25 21:00:27.913378 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-602eadd4-1038-4f72-8d2c-faf6462edbb8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.218919 Jun 25 21:00:27.914286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-84f61983-1368-4c4d-bebe-d0ace706f6c6 req-d7ebe75a-116d-4039-bc73-a696bcf8ecc5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043784 Jun 25 21:00:27.916290 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 968/2180] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:27 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:27.918283 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1213/2181] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:27.928505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:27.930704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:27.949340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.950039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:27.951004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:27.951589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.163517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:28.175049 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4056ca38-3d6f-4916-96a5-25ac55b93ec4 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1324 microversion: 2.1 time: 0.253625 Jun 25 21:00:28.181233 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 969/2182] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:27 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:28.186581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-448321223", "block_migration": true, "disk_over_commit": false}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:28.187288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f107ab6a-3604-4883-9844-a04bf5d80f16 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fe16b80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.188031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:28.195426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.196063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.197287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.198386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.235912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lazy-loading 'flavor' on Instance uuid b81a9bed-6545-4585-8446-6340cff7fd36 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:00:28.238310 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f107ab6a-3604-4883-9844-a04bf5d80f16 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409" status: 200 len: 1411 microversion: 2.1 time: 0.055607 Jun 25 21:00:28.239533 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 970/2183] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:28.248308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.249624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:28.261561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Going to try to live migrate instance to tempest-host-448321223 {{(pid=137461) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 21:00:28.261737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.262216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.263084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.263517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.271603 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] HTTP exception thrown: Compute host tempest-host-448321223 could not be found. Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Request method failure captured: Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36/action HTTP/1.1 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 106 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dR3njppMZrX4p9DPzeOk_YtZi9R-wAqLpKbkrRy4R3Rj_lXAqzQIktuFK-Xa2KynFJ7fd4TsDH2t_cCU4oGIHvCkQ-o1sTvv8n5EQlsgkZahmRrtIYZfrCRHCjfpJxxg8mwm9Ho9Wko0pajSbffrTviok8qLQxoTW0dun-7QLP07w Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 9951e5af52644ec6bc296071f6716cce Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9951e5af52644ec6bc296071f6716cce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9951e5af52644ec6bc296071f6716cce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9951e5af52644ec6bc296071f6716cce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9951e5af52644ec6bc296071f6716cce"}]}] Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 9951e5af52644ec6bc296071f6716cce Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveMigrationNegativeTest-245727804-project-admin Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6729f8099957469f9d8dec848c138208 Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveMigrationNegativeTest-245727804-project-admin Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: {"os-migrateLive": {"host": "tempest-host-448321223", "block_migration": true, "disk_over_commit": false}} Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: exception: Compute host tempest-host-448321223 could not be found. Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b81a9bed-6545-4585-8446-6340cff7fd36', 'body': {'os-migrateLive': {'host': 'tempest-host-448321223', 'block_migration': True, 'disk_over_commit': False}}} Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jun 25 21:00:28.282980 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-448321223 could not be found. Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-448321223 could not be found. Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-448321223 could not be found. Jun 25 21:00:28.285996 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.289423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Returning 400 to user: Compute host tempest-host-448321223 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:28.290354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4aeab56-91a6-43a3-a241-ef0b1409299c tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36/action" status: 400 len: 99 microversion: 2.1 time: 0.370045 Jun 25 21:00:28.291780 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1214/2184] 10.222.0.39 () {60 vars in 1278 bytes} [Sat Jun 25 21:00:27 2022] POST /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36/action => generated 99 bytes in 372 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 21:00:28.309718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-acadce20-7978-4001-8eab-b964f812d398 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ee531f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.369644 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-acadce20-7978-4001-8eab-b964f812d398 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409" status: 200 len: 1411 microversion: 2.1 time: 0.076792 Jun 25 21:00:28.376645 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1215/2185] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 => generated 1411 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:28.381898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.382745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:28.389458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.390015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.390863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.391377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.449094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:28.457827 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5cf5f79d-3b62-45f5-839e-38e0da85efae tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.216677 Jun 25 21:00:28.467546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 971/2186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:28.467546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d72a86b5-5791-4036-8324-b47b8d759cc8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fde10d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.608382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d72a86b5-5791-4036-8324-b47b8d759cc8 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409" status: 204 len: 0 microversion: 2.1 time: 0.148547 Jun 25 21:00:28.609005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 972/2187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:28 2022] DELETE /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:28.618099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88841e47-4095-4f36-bd81-6927a8fed825 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984fd49c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.640398 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-88841e47-4095-4f36-bd81-6927a8fed825 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Image not found. Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88841e47-4095-4f36-bd81-6927a8fed825 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 HTTP/1.1 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '037f1abc-c539-44fc-b716-577ccef49409'} Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 037f1abc-c539-44fc-b716-577ccef49409 Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:28.642592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 037f1abc-c539-44fc-b716-577ccef49409 could not be found. Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:28.646145 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:28.650447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88841e47-4095-4f36-bd81-6927a8fed825 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:28.651995 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88841e47-4095-4f36-bd81-6927a8fed825 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409" status: 404 len: 62 microversion: 2.1 time: 0.037998 Jun 25 21:00:28.653290 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 973/2188] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 25 21:00:28.662207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.663098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:28.672060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.672800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.673745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.674463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.694595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:28.710329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb957436-8ea3-4ce9-8175-6a90f4df5a7e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1467 microversion: 2.1 time: 0.331727 Jun 25 21:00:28.726292 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1216/2189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1467 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:28.744274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9d922cf9-8750-47bb-9a16-fd5dbd3f5974 req-9320319a-a83b-42ba-ae6c-9eeec4fa3675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:28.772646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9d922cf9-8750-47bb-9a16-fd5dbd3f5974 req-9320319a-a83b-42ba-ae6c-9eeec4fa3675 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.773348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9d922cf9-8750-47bb-9a16-fd5dbd3f5974 req-9320319a-a83b-42ba-ae6c-9eeec4fa3675 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.777698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:28.860469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9d922cf9-8750-47bb-9a16-fd5dbd3f5974 req-9320319a-a83b-42ba-ae6c-9eeec4fa3675 service nova] Creating event network-changed:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:00:28.884583 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9d922cf9-8750-47bb-9a16-fd5dbd3f5974 req-9320319a-a83b-42ba-ae6c-9eeec4fa3675 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154560 Jun 25 21:00:28.890603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1217/2190] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:28.905207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:28.906151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:28.924931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.928387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:28.931763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:28.933619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.018620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.019071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.019527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lazy-loading 'fault' on Instance uuid 34f6aaaa-a714-44bc-b1f4-92fccd671d57 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:00:29.093883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:29.114233 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6ad8f55d-a70f-4a24-95d8-a72660f0140a tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1499 microversion: 2.1 time: 0.456610 Jun 25 21:00:29.114862 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 974/2191] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1499 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:29.123936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:29.124861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:29.124987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78f952da089344fcbff6d88ab464e50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fe2cfca1b434e0ca5e91e22cb9da9e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:29.135917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ef9a7fb-99ea-42d0-83fc-3f91176b037b tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 200 len: 1307 microversion: 2.1 time: 0.242733 Jun 25 21:00:29.142386 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1218/2192] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:28 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:29.146956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.147433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.148222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.148698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.155347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1065760926", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:29.228875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:29.350430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:29.364742 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4f3b4d38-5100-48f2-9842-88a1a6d2e083 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.246897 Jun 25 21:00:29.366413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 975/2193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:29 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:29.372532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:29.373543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:29.381845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.382740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.384066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.384725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.468007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:29.506898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=34 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:29.554866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:29.567851 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-246d4bb6-b778-4794-92d3-484a2f408113 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1521 microversion: 2.1 time: 0.198399 Jun 25 21:00:29.569274 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 976/2194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:29 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:29.583257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:29.584206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:29.598559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.599223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.600165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.600808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.635939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:29.637404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:29.638689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:29.639163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:29.640968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:29.680305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.681757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.687323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:29.689062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:29.758110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Getting quotas for project efa91ea7b5594fdb9700999e51c0a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:29.776317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Getting quotas for user d2012ddfbcf1467f94cdd03f70dc8e79 and project efa91ea7b5594fdb9700999e51c0a3e3. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:29.807862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:29.810988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:29.890450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b12f690a-3f81-4a23-83dd-e6e3271f0862 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744445 Jun 25 21:00:29.891196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1219/2195] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:29.918824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee4c5c58-0715-4df0-8bf0-289a5bf8389a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-150164345", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee4c5c58-0715-4df0-8bf0-289a5bf8389a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 242 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-150164345", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-150164345', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '9adafde3-7f17-430a-8f22-32a079eb2807'}]}}} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:29.932792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:29.936573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:29.939143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee4c5c58-0715-4df0-8bf0-289a5bf8389a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:29.940218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee4c5c58-0715-4df0-8bf0-289a5bf8389a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.045466 Jun 25 21:00:29.941502 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1220/2196] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:29 2022] POST /compute/v2.1/servers => generated 175 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:00:29.948898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5215f19d-2d28-4a30-a2a6-64c1d6dd7a34 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:29.952503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5215f19d-2d28-4a30-a2a6-64c1d6dd7a34 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:30.105547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:30.120283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f17006cd-0193-462f-877a-95a2eced9b94 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.548589 Jun 25 21:00:30.126526 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 977/2197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:29 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:30.139642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ed721723-2fca-4cce-857a-3677bb04db72 req-1ed698ff-702d-4a4a-9908-56039df99d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86255422-6b4c-4316-add7-40685858aba3", "tag": "a2c4a26d-b960-4603-a78b-9d85b5d6dc5a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:30.177847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed721723-2fca-4cce-857a-3677bb04db72 req-1ed698ff-702d-4a4a-9908-56039df99d30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.178310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed721723-2fca-4cce-857a-3677bb04db72 req-1ed698ff-702d-4a4a-9908-56039df99d30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.206859 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ed721723-2fca-4cce-857a-3677bb04db72 req-1ed698ff-702d-4a4a-9908-56039df99d30 service nova] Creating event network-changed:a2c4a26d-b960-4603-a78b-9d85b5d6dc5a for instance 86255422-6b4c-4316-add7-40685858aba3 on nch2-master-1 Jun 25 21:00:30.213604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ed721723-2fca-4cce-857a-3677bb04db72 req-1ed698ff-702d-4a4a-9908-56039df99d30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077656 Jun 25 21:00:30.216293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 978/2198] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:30.235719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:30.236125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5215f19d-2d28-4a30-a2a6-64c1d6dd7a34 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:30.237467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 2c60b609-dc44-4962-aa3b-41bc51bf94fb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:30.245300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] HTTP exception thrown: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. Jun 25 21:00:30.248571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5215f19d-2d28-4a30-a2a6-64c1d6dd7a34 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1219 microversion: 2.1 time: 0.305344 Jun 25 21:00:30.255248 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1221/2199] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:29 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1219 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/2c60b609-dc44-4962-aa3b-41bc51bf94fb/metadata HTTP/1.1 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '2c60b609-dc44-4962-aa3b-41bc51bf94fb'} Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.264887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 404 to user: Instance 2c60b609-dc44-4962-aa3b-41bc51bf94fb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:30.269077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c50850b5-8715-47c5-97c5-e392e0279bbc tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/2c60b609-dc44-4962-aa3b-41bc51bf94fb/metadata" status: 404 len: 111 microversion: 2.1 time: 0.035947 Jun 25 21:00:30.284768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:30.285343 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 979/2200] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:00:30 2022] GET /compute/v2.1/servers/2c60b609-dc44-4962-aa3b-41bc51bf94fb/metadata => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:30.302671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:30.303696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] [instance: 34f6aaaa-a714-44bc-b1f4-92fccd671d57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:30.305402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:30.319259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.321726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.322733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.323711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.327292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.330734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.331691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.332566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.364114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] HTTP exception thrown: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Request method failure captured: Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 HTTP/1.1 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3c86RCQTfcxiWiBQbN4KVXC2oaKe6_6noEhfIa3LOG7dYX3g_C4JpbnehGqnEVKM5mXH0_waeNak_P0hqfUOBBy-CvMnOEJYnNOMEwXsOF6BVgh-STPVlnrJKM7F5IEzkCrFBk_d39OcrDf1y5oSxDGCxfid4iUpAnYOEwIAEPYayE Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9fe2cfca1b434e0ca5e91e22cb9da9e2 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerAddressesTestJSON-1217225874 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9fe2cfca1b434e0ca5e91e22cb9da9e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9fe2cfca1b434e0ca5e91e22cb9da9e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9fe2cfca1b434e0ca5e91e22cb9da9e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9fe2cfca1b434e0ca5e91e22cb9da9e2"}]}] Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerAddressesTestJSON-1217225874 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9fe2cfca1b434e0ca5e91e22cb9da9e2 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1217225874 Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerAddressesTestJSON-1217225874-project Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 78f952da089344fcbff6d88ab464e50a Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerAddressesTestJSON-1217225874-project Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '34f6aaaa-a714-44bc-b1f4-92fccd671d57'} Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.368322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. Jun 25 21:00:30.371563 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.376237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] Returning 404 to user: Instance 34f6aaaa-a714-44bc-b1f4-92fccd671d57 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:30.377598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3e2ab56-3b6d-43f0-9d79-21cfdc9c8a49 tempest-ServerAddressesTestJSON-1217225874 tempest-ServerAddressesTestJSON-1217225874-project] 10.222.0.39 "GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57" status: 404 len: 111 microversion: 2.1 time: 0.090660 Jun 25 21:00:30.382287 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 980/2201] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:30 2022] GET /compute/v2.1/servers/34f6aaaa-a714-44bc-b1f4-92fccd671d57 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:30.391450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:30.394812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:30.410068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.413197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.414304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:30.421203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:30.696441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:30.713027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a39b7ff-b8ab-4ace-87c4-067dc05e9f5f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.329336 Jun 25 21:00:30.714554 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 981/2202] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:30 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:30.719513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9fbebcfd-8fb7-4a1c-b124-e24ae824c2c7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-305158903", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9fbebcfd-8fb7-4a1c-b124-e24ae824c2c7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 498 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-305158903", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-305158903', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9adafde3-7f17-430a-8f22-32a079eb2807'}]}}} Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 21:00:30.722693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.725564 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.732080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9fbebcfd-8fb7-4a1c-b124-e24ae824c2c7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:30.733229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9fbebcfd-8fb7-4a1c-b124-e24ae824c2c7 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.017594 Jun 25 21:00:30.735874 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 982/2203] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:30 2022] POST /compute/v2.1/servers => generated 687 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:00:30.852715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:30.877918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dab485b-d83b-43e5-a4a9-266450a67847 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1505 microversion: 2.1 time: 0.604092 Jun 25 21:00:30.881735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1222/2204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:30 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:30.956709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60a435c0-117c-4010-8317-0c1986acb224 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-332167073", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60a435c0-117c-4010-8317-0c1986acb224 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 499 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-332167073", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-332167073', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9adafde3-7f17-430a-8f22-32a079eb2807'}]}}} Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 21:00:30.963206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60a435c0-117c-4010-8317-0c1986acb224 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:30.966453 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60a435c0-117c-4010-8317-0c1986acb224 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016906 Jun 25 21:00:30.970929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 983/2205] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:30 2022] POST /compute/v2.1/servers => generated 689 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:00:31.144792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:31.145875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:31.181940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.192461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:31.197256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.200722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:31.252135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-848c1a11-3e00-42a1-92b9-9e8ebae3180a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-873397965", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-848c1a11-3e00-42a1-92b9-9e8ebae3180a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 753 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-873397965", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-873397965', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9adafde3-7f17-430a-8f22-32a079eb2807'}]}}} Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:00:31.256414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:00:31.258956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:00:31.262680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.262680 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.264878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-848c1a11-3e00-42a1-92b9-9e8ebae3180a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:31.270368 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-848c1a11-3e00-42a1-92b9-9e8ebae3180a tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.023249 Jun 25 21:00:31.280377 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 984/2206] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:31 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Jun 25 21:00:31.517677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5ad29a0-961b-432e-86e5-2ecbb86f9dae tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] Calling method '.version_select at 0x7f984fe5e700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:31.519348 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:00:31.519348 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:00:31.538880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5ad29a0-961b-432e-86e5-2ecbb86f9dae tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.256742 Jun 25 21:00:31.540381 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 985/2207] 10.222.0.39 () {60 vars in 1225 bytes} [Sat Jun 25 21:00:31 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:00:31.546719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:31.547970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:31.562594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.563512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:31.568456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.569318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:31.615867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:31.623679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79eae3cd-61b7-4cbe-ab91-bbbabc173acc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.484917 Jun 25 21:00:31.624279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1223/2208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:31 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:31.642289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91bc4b62-b38e-43c6-9f0e-9fc1933c6fdd tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-949432788", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91bc4b62-b38e-43c6-9f0e-9fc1933c6fdd tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 1265 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-949432788", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "9adafde3-7f17-430a-8f22-32a079eb2807"}]}} Jun 25 21:00:31.645564 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-949432788', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '9adafde3-7f17-430a-8f22-32a079eb2807'}]}}} Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.647329 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:00:31.648292 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:00:31.651538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jun 25 21:00:31.651538 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.651538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91bc4b62-b38e-43c6-9f0e-9fc1933c6fdd tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:31.651538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91bc4b62-b38e-43c6-9f0e-9fc1933c6fdd tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.009167 Jun 25 21:00:31.657184 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1224/2209] 10.222.0.39 () {60 vars in 1147 bytes} [Sat Jun 25 21:00:31 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jun 25 21:00:31.667238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efa217d5-2bab-448f-8000-8f6676be5ca8 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] Action: 'update', calling method: .version_select at 0x7f984edbbe50>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:31.673783 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:00:31.673783 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:00:31.742809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:31.751675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7862ba7-aa6e-4014-8a55-50905abd782f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1271 microversion: 2.1 time: 0.209990 Jun 25 21:00:31.755319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 986/2210] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:31 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1271 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:31.764101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:31.768763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: bee87546-1b8c-4349-b6d3-9f3c2dc30e10] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:31.786635 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] HTTP exception thrown: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/bee87546-1b8c-4349-b6d3-9f3c2dc30e10/metadata/test2 HTTP/1.1 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': 'bee87546-1b8c-4349-b6d3-9f3c2dc30e10', 'id': 'test2'} Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:31.788229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 404 to user: Instance bee87546-1b8c-4349-b6d3-9f3c2dc30e10 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4dca4a5-8ec9-4f2d-8656-5ee5fdce4ec8 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/bee87546-1b8c-4349-b6d3-9f3c2dc30e10/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.032360 Jun 25 21:00:31.792199 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 987/2211] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 21:00:31 2022] GET /compute/v2.1/servers/bee87546-1b8c-4349-b6d3-9f3c2dc30e10/metadata/test2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:31.795961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:31.796602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:31.829792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.830277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:31.832755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:31.834678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.025815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-efa217d5-2bab-448f-8000-8f6676be5ca8 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.366943 Jun 25 21:00:32.026419 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1225/2212] 10.222.0.39 () {62 vars in 1246 bytes} [Sat Jun 25 21:00:31 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:00:32.040929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.041455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.049537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.050027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.050806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.051247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.081363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:32.169020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c80b5a0-a13d-4b56-b5f4-0dfc7b6e2c56 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 204 len: 0 microversion: 2.1 time: 0.132233 Jun 25 21:00:32.173171 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1226/2213] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:32 2022] DELETE /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:32.179038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.179962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.189335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.190019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.190971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.191751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.227442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:32.240102 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7e57032-0acd-4d55-aeeb-cd45a7d00784 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.448407 Jun 25 21:00:32.244079 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 988/2214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:31 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:32.257514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d15eef8-ce72-470b-a4ba-d2cf101e7bd4 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] Calling method '.version_select at 0x7f984fcabee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.258434 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:00:32.258434 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:00:32.294831 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d15eef8-ce72-470b-a4ba-d2cf101e7bd4 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.049126 Jun 25 21:00:32.295443 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 989/2215] 10.222.0.39 () {60 vars in 1225 bytes} [Sat Jun 25 21:00:32 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:00:32.315195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.315831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.331315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.331803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.332671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.333120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.513060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:32.523089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3432c1b-eb99-4b30-a98c-078d29dc2f24 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1487 microversion: 2.1 time: 0.348383 Jun 25 21:00:32.523896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1227/2216] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:32 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1487 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:32.528991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca59b817-6ba8-4f0d-b9e7-5a6e9cfe0aa1 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] Action: 'update', calling method: .version_select at 0x7f984ed544c0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:32.530493 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:00:32.530493 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:00:32.573160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=10,nova_api:UPDATE=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:32.651975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:32.665425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94405d66-2c5a-4a97-ae9f-c489c57dec43 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1527 microversion: 2.1 time: 0.364582 Jun 25 21:00:32.667410 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 990/2217] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:32 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1527 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:32.673906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca59b817-6ba8-4f0d-b9e7-5a6e9cfe0aa1 tempest-QuotaClassesAdmin257Test-1849558213 tempest-QuotaClassesAdmin257Test-1849558213-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.148929 Jun 25 21:00:32.674874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1228/2218] 10.222.0.39 () {62 vars in 1246 bytes} [Sat Jun 25 21:00:32 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:00:32.683461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.683461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.689742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.690832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.692022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.692796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.694415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.696590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.710240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.711337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.712451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.716002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.762235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:32.889166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:32.942276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:32.962147 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e5ee422-e04f-49c5-ae0f-fa8956bdfd14 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 204 len: 0 microversion: 2.1 time: 0.293379 Jun 25 21:00:32.969535 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 991/2219] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:32 2022] DELETE /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:32.975942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:32.977798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:32.990036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.991014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:32.992157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:32.992979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.126612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:33.134731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d75566b3-c424-4ab8-8fd5-8c6faac38f3d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1277 microversion: 2.1 time: 0.163535 Jun 25 21:00:33.144849 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 992/2220] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:32 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:33.164336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-514f31eb-77f3-4a63-8c3a-63e395ac04cb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ff3e700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:33.227732 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-514f31eb-77f3-4a63-8c3a-63e395ac04cb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Image not found. Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-514f31eb-77f3-4a63-8c3a-63e395ac04cb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 HTTP/1.1 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '037f1abc-c539-44fc-b716-577ccef49409'} Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 037f1abc-c539-44fc-b716-577ccef49409 to delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 037f1abc-c539-44fc-b716-577ccef49409 could not be found. Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.229925 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-514f31eb-77f3-4a63-8c3a-63e395ac04cb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-514f31eb-77f3-4a63-8c3a-63e395ac04cb tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409" status: 404 len: 62 microversion: 2.1 time: 0.086180 Jun 25 21:00:33.233464 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 993/2221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:33 2022] DELETE /compute/v2.1/images/037f1abc-c539-44fc-b716-577ccef49409 => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:33.240964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9412f402-390f-4885-9097-296ff1d7786b req-7621a11c-44af-4075-974a-b45cb2f861f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3e9e2a-3b95-4eed-b1b0-686e91342a93", "name": "network-vif-plugged", "status": "completed", "tag": "d99bbefb-8855-4932-9772-fd509890d945"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:33.267737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9412f402-390f-4885-9097-296ff1d7786b req-7621a11c-44af-4075-974a-b45cb2f861f7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.268534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9412f402-390f-4885-9097-296ff1d7786b req-7621a11c-44af-4075-974a-b45cb2f861f7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.285642 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9412f402-390f-4885-9097-296ff1d7786b req-7621a11c-44af-4075-974a-b45cb2f861f7 service nova] Creating event network-vif-plugged:d99bbefb-8855-4932-9772-fd509890d945 for instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 on nch1-master-1 Jun 25 21:00:33.307676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9412f402-390f-4885-9097-296ff1d7786b req-7621a11c-44af-4075-974a-b45cb2f861f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070208 Jun 25 21:00:33.308536 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 994/2222] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:33.319851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:33.320925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:33.330765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.331546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.332602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.333580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.401915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:33.514350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Instance is already in deleting state, ignoring this request Jun 25 21:00:33.516548 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf030561-3716-4588-b2d5-0fc4cde376df tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 204 len: 0 microversion: 2.1 time: 0.202692 Jun 25 21:00:33.518931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 995/2223] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:33 2022] DELETE /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:33.524026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:33.524692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:33.535669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.536381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.537402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.538163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.619308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:33.630393 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0150d433-53c8-4397-b9ac-27442b6e3375 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.941278 Jun 25 21:00:33.642205 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1229/2224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:32 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:33.649482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:33.653639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:33.664452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.665263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.667492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:33.668242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:33.974318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:33.987148 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c68eaed-b767-40fa-9465-faa72617d86c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.466920 Jun 25 21:00:33.988994 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 996/2225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:33 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:33.995032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:33.995896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:34.006419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.007152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:34.008413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.009036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:34.086447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:34.099974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6990e863-6587-4d97-bd13-71f6083e2c90 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1493 microversion: 2.1 time: 0.456029 Jun 25 21:00:34.103891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1230/2226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:33 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1493 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:34.151956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:34.152840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:34.167561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.168401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:34.170073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.172392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:34.436291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:34.447393 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfae685b-93f5-42de-a651-661a31f2dd38 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1527 microversion: 2.1 time: 0.457058 Jun 25 21:00:34.453279 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 997/2227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:33 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1527 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:34.622694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:34.633313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54d38560-6123-4645-9f48-fb17e46d9c86 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.485908 Jun 25 21:00:34.634900 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1231/2228] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:34 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:34.653691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:34.654322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:34.667596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.668227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:34.669487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:34.670071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.005271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:35.005954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:35.019374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.024360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.025485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.026090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.085685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:35.100622 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ce299c2-9b44-42d2-870c-486ad778565e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.452030 Jun 25 21:00:35.104757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 998/2229] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:34 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:35.119736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:35.120947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:35.132365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.132862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.136902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.137371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.595027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:35.612835 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-270a3628-2b1a-424e-aaf5-697e32feb11d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.607740 Jun 25 21:00:35.613719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1232/2230] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:34 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:35.619316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5743fd65-b6d6-4a82-9e55-70d0afde8c53 req-8995d894-ff2f-4260-9fbf-542deff9d191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:35.640391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5743fd65-b6d6-4a82-9e55-70d0afde8c53 req-8995d894-ff2f-4260-9fbf-542deff9d191 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.641594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5743fd65-b6d6-4a82-9e55-70d0afde8c53 req-8995d894-ff2f-4260-9fbf-542deff9d191 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.672127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5743fd65-b6d6-4a82-9e55-70d0afde8c53 req-8995d894-ff2f-4260-9fbf-542deff9d191 service nova] Creating event network-vif-plugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:00:35.683255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5743fd65-b6d6-4a82-9e55-70d0afde8c53 req-8995d894-ff2f-4260-9fbf-542deff9d191 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065202 Jun 25 21:00:35.686597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1233/2231] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:35.692185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:35.705601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:35.719451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.720170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.721256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.721883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.842123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:35.857644 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa35eeff-08c4-4fe6-9214-6210ef220b83 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1493 microversion: 2.1 time: 0.743918 Jun 25 21:00:35.863512 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 999/2232] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:35 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1493 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:35.878215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:35.883004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:35.897602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.898049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:35.898824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:35.899258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.001678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e42634d85d14429b9779efa8bb84f8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b6256b931e4f67bd0795961bb29b4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:36.017211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7ef40d2-440d-4ff8-babf-bc9ac4fbfe05 tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 200 len: 1527 microversion: 2.1 time: 0.329139 Jun 25 21:00:36.027039 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1234/2233] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:35 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 1527 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:36.119298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:36.119806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:36.133624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.134171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.135045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.135692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.520637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:36.528841 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1f4a687-e4c3-4682-a861-7454f99b9832 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.413429 Jun 25 21:00:36.540897 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1235/2234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:36 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:36.546020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-92c75fc1-91f5-4e7e-9a44-0389d8417831 req-f4f3948b-df35-4a0b-9b96-adfe6b003060 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c4d4140-90f3-495f-a33d-b158abeb632b", "name": "network-vif-deleted", "tag": "4b118888-0f29-4c16-9f04-8f3332b745f2"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:36.572110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-92c75fc1-91f5-4e7e-9a44-0389d8417831 req-f4f3948b-df35-4a0b-9b96-adfe6b003060 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.579825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:36.583817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-92c75fc1-91f5-4e7e-9a44-0389d8417831 req-f4f3948b-df35-4a0b-9b96-adfe6b003060 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.597425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7950db8f-de33-4e8a-b578-dd42b6d6572f tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.728868 Jun 25 21:00:36.600751 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1000/2235] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:35 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:36.611257 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-92c75fc1-91f5-4e7e-9a44-0389d8417831 req-f4f3948b-df35-4a0b-9b96-adfe6b003060 service nova] Creating event network-vif-deleted:4b118888-0f29-4c16-9f04-8f3332b745f2 for instance 6c4d4140-90f3-495f-a33d-b158abeb632b on nch1-master-1 Jun 25 21:00:36.618154 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-92c75fc1-91f5-4e7e-9a44-0389d8417831 req-f4f3948b-df35-4a0b-9b96-adfe6b003060 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075742 Jun 25 21:00:36.619303 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1236/2236] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:36.634237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:36.636144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:36.659695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.661654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.666132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.668613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.884206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:36.885687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:36.903275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.905881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:36.908417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:36.911315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.183050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:37.197653 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f8eeff3-a343-4408-b55a-acdab1e27a87 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1493 microversion: 2.1 time: 0.320869 Jun 25 21:00:37.214610 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1237/2237] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:36 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1493 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:37.223746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:37.225465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] [instance: 6c4d4140-90f3-495f-a33d-b158abeb632b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:37.235692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.236746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.237962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.239437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.265372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] HTTP exception thrown: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Request method failure captured: Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b HTTP/1.1 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3davjGBuzixNUDozXzK7m5htDdSkrmzjUPnUdp9FX_qkmpeK7k5K0hUG6rpHxnqh6tldxwNR1zzFs8uRbISy21cvW9s4Hpa73XquSiM9FAEfdGvivzFMMEvjZv4OfaTFaICR8HQPsgRusURaMzoQSo6JEXRNjNw6zv9l9RA7ev_5o8 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27b6256b931e4f67bd0795961bb29b4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27b6256b931e4f67bd0795961bb29b4e"}]}] Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 27b6256b931e4f67bd0795961bb29b4e Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1908559537 Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 7e42634d85d14429b9779efa8bb84f8f Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1908559537-project Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6c4d4140-90f3-495f-a33d-b158abeb632b'} Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:37.267602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. Jun 25 21:00:37.270865 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:37.274909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] Returning 404 to user: Instance 6c4d4140-90f3-495f-a33d-b158abeb632b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:37.276465 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f0a2b30-ea1f-4338-ac10-713cb6f0ab6c tempest-ServerMetadataNegativeTestJSON-1908559537 tempest-ServerMetadataNegativeTestJSON-1908559537-project] 10.222.0.39 "GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b" status: 404 len: 111 microversion: 2.1 time: 0.060114 Jun 25 21:00:37.277754 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1238/2238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:37 2022] GET /compute/v2.1/servers/6c4d4140-90f3-495f-a33d-b158abeb632b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:37.329499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:37.340676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf5712ce-2f34-4253-9dcc-552aa5b33c21 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.713881 Jun 25 21:00:37.350547 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1001/2239] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:36 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:37.547333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:37.548123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:37.566745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.567446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.568370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.569002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.619507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:37.620259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:37.649423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.650090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:37.650965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:37.654708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.144018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:38.153963 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-48f1ad80-7d25-4003-ac73-bfe5a7cd1f18 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1364 microversion: 2.1 time: 0.611621 Jun 25 21:00:38.166254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1239/2240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:37 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1364 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:38.173630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-040b1823-9bab-466a-9e0b-a69407b299d7 req-8685ce10-cedf-482e-bd52-b13277abd1ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3e9e2a-3b95-4eed-b1b0-686e91342a93", "name": "network-vif-deleted", "tag": "d99bbefb-8855-4932-9772-fd509890d945"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:38.187300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-040b1823-9bab-466a-9e0b-a69407b299d7 req-8685ce10-cedf-482e-bd52-b13277abd1ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.188050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-040b1823-9bab-466a-9e0b-a69407b299d7 req-8685ce10-cedf-482e-bd52-b13277abd1ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.199264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:38.201865 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-040b1823-9bab-466a-9e0b-a69407b299d7 req-8685ce10-cedf-482e-bd52-b13277abd1ec service nova] Creating event network-vif-deleted:d99bbefb-8855-4932-9772-fd509890d945 for instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 on nch1-master-1 Jun 25 21:00:38.207783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-040b1823-9bab-466a-9e0b-a69407b299d7 req-8685ce10-cedf-482e-bd52-b13277abd1ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039808 Jun 25 21:00:38.210078 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1240/2241] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:38.218092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd3e9e2a-3b95-4eed-b1b0-686e91342a93", "name": "network-vif-unplugged", "status": "completed", "tag": "d99bbefb-8855-4932-9772-fd509890d945"}, {"server_uuid": "86255422-6b4c-4316-add7-40685858aba3", "name": "network-vif-plugged", "status": "completed", "tag": "a2c4a26d-b960-4603-a78b-9d85b5d6dc5a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:38.231758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.232523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.251165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] Creating event network-vif-unplugged:d99bbefb-8855-4932-9772-fd509890d945 for instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 on nch1-master-1 Jun 25 21:00:38.252287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] Creating event network-vif-plugged:a2c4a26d-b960-4603-a78b-9d85b5d6dc5a for instance 86255422-6b4c-4316-add7-40685858aba3 on nch2-master-1 Jun 25 21:00:38.267960 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2e658d3d-6668-4152-bb3e-093c303242df req-c2bbab1e-37ce-4847-9f9d-69e6c7cdc5dd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056046 Jun 25 21:00:38.268980 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1241/2242] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:38.278394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.279695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:38.302299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.303611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.309807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.315452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.409950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.410409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.413279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lazy-loading 'fault' on Instance uuid fd3e9e2a-3b95-4eed-b1b0-686e91342a93 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:00:38.490743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd8d82d694941b58fa2d18311ea5785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca77764a1f5e436db2f6436a02b2fc24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:38.504803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22637be5-3543-4f72-b6da-b752660f30d0 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 200 len: 1297 microversion: 2.1 time: 0.234202 Jun 25 21:00:38.514467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1242/2243] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 1297 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:38.719490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fad05dcf-c4fe-44f0-bfcd-a952da1e273c tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.730362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fad05dcf-c4fe-44f0-bfcd-a952da1e273c tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.212049 Jun 25 21:00:38.731371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1243/2244] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:38.736378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.737433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:38.755652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.757113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.758242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:38.758908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:38.778869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:38.792557 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af60548f-1314-4c5f-95eb-ea6cf5853517 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 1.178982 Jun 25 21:00:38.793513 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1002/2245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:37 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:38.805700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3259e9c8-9f40-4982-a2d9-3a828bfb5090 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.838199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3259e9c8-9f40-4982-a2d9-3a828bfb5090 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.041717 Jun 25 21:00:38.846364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1003/2246] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:38.855832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89c540ec-8aed-4c67-bec5-6f87d59be8b6 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.866168 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89c540ec-8aed-4c67-bec5-6f87d59be8b6 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016078 Jun 25 21:00:38.867179 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1004/2247] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:00:38.888580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07d6744f-e830-4676-84b6-9eb95c8cf8f4 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.899105 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07d6744f-e830-4676-84b6-9eb95c8cf8f4 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021223 Jun 25 21:00:38.899805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1005/2248] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:38.925576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8c34b48-e01a-460b-8578-3dd71bb1a4e1 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:38.980514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8c34b48-e01a-460b-8578-3dd71bb1a4e1 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.073518 Jun 25 21:00:38.990845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1006/2249] 10.222.0.39 () {58 vars in 1164 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:38.995776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31b1e7b3-4f72-40d8-89af-65af93c969b0 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.001030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:39.004819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31b1e7b3-4f72-40d8-89af-65af93c969b0 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012742 Jun 25 21:00:39.011796 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1007/2250] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:39.013147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d255ff5-b1e8-4edb-94de-cf68eeee77b8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1315 microversion: 2.1 time: 0.280364 Jun 25 21:00:39.013947 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1244/2251] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:38 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:39.017264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e2eaa34c-4360-4ad9-9e2c-32a919851492 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f984ff3e940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.028941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d7f2a296-acfb-41a5-85bf-7ff6e30b237f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.058653 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d7f2a296-acfb-41a5-85bf-7ff6e30b237f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.041079 Jun 25 21:00:39.067472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1245/2252] 10.222.0.39 () {58 vars in 1168 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:39.075282 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e2eaa34c-4360-4ad9-9e2c-32a919851492 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74" status: 200 len: 637 microversion: 2.1 time: 0.062279 Jun 25 21:00:39.076014 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1008/2253] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74 => generated 637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:39.088601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c75f07a6-5791-4562-844b-4af5b83b60c3 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.100038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0badff7a-8758-4621-8223-3bf57064b700 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f985c5d5670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:39.114317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c75f07a6-5791-4562-844b-4af5b83b60c3 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.029553 Jun 25 21:00:39.115361 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1246/2254] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:39.128180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61a87157-31cf-45fc-b976-188bef7d9231 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.138556 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-61a87157-31cf-45fc-b976-188bef7d9231 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014718 Jun 25 21:00:39.145163 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1247/2255] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:39.155403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c87c494-2ffe-4bb1-8a5f-6fc0ba7c565b tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.162590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0badff7a-8758-4621-8223-3bf57064b700 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:39.173846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0badff7a-8758-4621-8223-3bf57064b700 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:39.195099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c87c494-2ffe-4bb1-8a5f-6fc0ba7c565b tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.044258 Jun 25 21:00:39.196027 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1248/2256] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:39.200967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.201567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:39.208412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.209104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.209870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.210470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.421691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:39.439432 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73acf881-2f4d-4dc5-99a7-c5d075323549 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1550 microversion: 2.1 time: 0.242218 Jun 25 21:00:39.440974 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1249/2257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1550 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:39.447642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c828a9a9-c220-452d-9a7f-4001807dea64 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.470025 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c828a9a9-c220-452d-9a7f-4001807dea64 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026832 Jun 25 21:00:39.471372 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1250/2258] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:39.478213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.480128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:39.498292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.499051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.500062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.501391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.608858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0badff7a-8758-4621-8223-3bf57064b700 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.512811 Jun 25 21:00:39.614781 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1009/2259] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:39 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:39.620304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa4140e0-a3a2-44fb-a5cb-69fa5c283c9b tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.685751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa4140e0-a3a2-44fb-a5cb-69fa5c283c9b tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.069610 Jun 25 21:00:39.686760 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1010/2260] 10.222.0.39 () {58 vars in 1143 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:39.693653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.694678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: fd3e9e2a-3b95-4eed-b1b0-686e91342a93] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:39.701704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.702734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.703782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:39.704557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:39.730929 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 HTTP/1.1 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'fd3e9e2a-3b95-4eed-b1b0-686e91342a93'} Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:39.736135 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. Jun 25 21:00:39.739705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:39.746410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance fd3e9e2a-3b95-4eed-b1b0-686e91342a93 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:39.747548 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e0dcd3a-71bc-436a-918a-b8f57a2ffeab tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93" status: 404 len: 111 microversion: 2.1 time: 0.059582 Jun 25 21:00:39.748363 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1011/2261] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/servers/fd3e9e2a-3b95-4eed-b1b0-686e91342a93 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:39.753476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6dce73ef-e015-4c2b-9aa1-45203eed4d72 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f985c035160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:39.952811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:40.206535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ea04121-bd6a-4df4-a229-c9e46012dd93 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.733630 Jun 25 21:00:40.215629 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1251/2262] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:00:39 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/os-interface => generated 284 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:40.233011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbe81ad3-85dd-4f4d-82e4-988fef6b76ea tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.263965 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbe81ad3-85dd-4f4d-82e4-988fef6b76ea tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034883 Jun 25 21:00:40.270155 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1252/2263] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:40.277599 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6dce73ef-e015-4c2b-9aa1-45203eed4d72 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "DELETE /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.527836 Jun 25 21:00:40.281904 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1012/2264] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 21:00:39 2022] DELETE /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_version => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:40.282042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efaff874-052d-4aca-a2e7-db4a9a6df532 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f984ed691f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.287819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.289062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:40.308736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.309446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.312786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.313517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.317602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-efaff874-052d-4aca-a2e7-db4a9a6df532 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Image not found. Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efaff874-052d-4aca-a2e7-db4a9a6df532 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 HTTP/1.1 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '133d0eef-e5ad-46d4-911a-31bdd2098e14'} Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 133d0eef-e5ad-46d4-911a-31bdd2098e14 to delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 133d0eef-e5ad-46d4-911a-31bdd2098e14 could not be found. Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.320120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:40.323777 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.326321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efaff874-052d-4aca-a2e7-db4a9a6df532 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:40.327597 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-efaff874-052d-4aca-a2e7-db4a9a6df532 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14" status: 404 len: 62 microversion: 2.1 time: 0.056382 Jun 25 21:00:40.328784 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1253/2265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:40 2022] DELETE /compute/v2.1/images/133d0eef-e5ad-46d4-911a-31bdd2098e14 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:40.368904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.371583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:40.402218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.402938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.404057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.404949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.575658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:40.586097 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fe443f13-3c55-462e-bffe-1b5b3191c5b6 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.305396 Jun 25 21:00:40.586892 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1013/2266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:40.593624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2745b443-06f3-4db2-b29c-5e9acf701181 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.618931 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2745b443-06f3-4db2-b29c-5e9acf701181 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030711 Jun 25 21:00:40.619868 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1014/2267] 10.222.0.39 () {58 vars in 1147 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:40.624394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b64ee32-e129-481a-ad37-10b24af8c5c1 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f984ff3e430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.674778 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b64ee32-e129-481a-ad37-10b24af8c5c1 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 37 microversion: 2.1 time: 0.053485 Jun 25 21:00:40.676327 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1015/2268] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 37 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:40.682328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.683140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:40.691078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.691864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.693012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.693716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.726648 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f HTTP/1.1 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '71042147-6277-4f59-a301-a2164d61048f'} Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:40.729705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.732897 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.735254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:40.741771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:40.748927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-42a7ac86-f091-4d9c-926d-8b00702cb04e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 404 len: 111 microversion: 2.1 time: 0.058768 Jun 25 21:00:40.749953 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1016/2269] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:40 2022] DELETE /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:40.752508 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e0231f8-6021-4eef-bf5e-aecaf25bf7d4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1502 microversion: 2.1 time: 0.420039 Jun 25 21:00:40.762780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-78d014e8-eb7d-40e2-8182-687d3010b3ef req-e6d249de-639c-4900-a5dd-66a22fab49ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa987a9c-ea81-4b09-b4d7-b7fac791d7ba", "tag": "cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:40.763268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1254/2270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:40.779674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f942bbe0-0690-4e05-9db1-e28e9b222858 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.781743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-78d014e8-eb7d-40e2-8182-687d3010b3ef req-e6d249de-639c-4900-a5dd-66a22fab49ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.782504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-78d014e8-eb7d-40e2-8182-687d3010b3ef req-e6d249de-639c-4900-a5dd-66a22fab49ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.807743 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f942bbe0-0690-4e05-9db1-e28e9b222858 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.026147 Jun 25 21:00:40.808751 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1255/2271] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:40.812705 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-78d014e8-eb7d-40e2-8182-687d3010b3ef req-e6d249de-639c-4900-a5dd-66a22fab49ac service nova] Creating event network-changed:cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d for instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba on nch1-master-1 Jun 25 21:00:40.818118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4c1eb38-7b5a-452e-8cf1-e10d1d415efe tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f984ed50e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:40.822144 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-78d014e8-eb7d-40e2-8182-687d3010b3ef req-e6d249de-639c-4900-a5dd-66a22fab49ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070723 Jun 25 21:00:40.827490 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1017/2272] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:40.842330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.843266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 71042147-6277-4f59-a301-a2164d61048f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:40.856310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.863669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.865021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.865669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.899965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d4c1eb38-7b5a-452e-8cf1-e10d1d415efe tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:40.908949 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f HTTP/1.1 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '71042147-6277-4f59-a301-a2164d61048f'} Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.917199 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. Jun 25 21:00:40.920415 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:40.920917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d4c1eb38-7b5a-452e-8cf1-e10d1d415efe tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:40.925424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance 71042147-6277-4f59-a301-a2164d61048f could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:40.926666 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd99df21-4ea4-4d74-9fba-a17d1b71cda5 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f" status: 404 len: 111 microversion: 2.1 time: 0.096990 Jun 25 21:00:40.927593 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1018/2273] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:40 2022] GET /compute/v2.1/servers/71042147-6277-4f59-a301-a2164d61048f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:40.936462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:40.937576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:40.967275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.970442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:40.972810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:40.988344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.040595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:41.227136 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bded6e5a-640e-4102-bdb1-adec0117586a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 204 len: 0 microversion: 2.1 time: 0.297968 Jun 25 21:00:41.228503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1019/2274] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:40 2022] DELETE /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:41.238570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-73c8dab1-9bb8-4a9c-bcd9-00645c8a020f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.292523 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-73c8dab1-9bb8-4a9c-bcd9-00645c8a020f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.055693 Jun 25 21:00:41.299676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1020/2275] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:41.306372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2d1181f-8b04-4fa6-a43b-a821284862d9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c035d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.367278 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a2d1181f-8b04-4fa6-a43b-a821284862d9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Image not found. Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2d1181f-8b04-4fa6-a43b-a821284862d9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 HTTP/1.1 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'be3f1d7a-22df-491c-b0da-1223419bbfd9'} Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image be3f1d7a-22df-491c-b0da-1223419bbfd9 to delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image be3f1d7a-22df-491c-b0da-1223419bbfd9 could not be found. Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.369407 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2d1181f-8b04-4fa6-a43b-a821284862d9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:41.373253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2d1181f-8b04-4fa6-a43b-a821284862d9 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9" status: 404 len: 62 microversion: 2.1 time: 0.074888 Jun 25 21:00:41.377094 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1021/2276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:41 2022] DELETE /compute/v2.1/images/be3f1d7a-22df-491c-b0da-1223419bbfd9 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:41.401248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.403557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:41.421917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.422396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.425114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.429955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.435246 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4c1eb38-7b5a-452e-8cf1-e10d1d415efe tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.625280 Jun 25 21:00:41.439878 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1256/2277] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:40 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:41.441696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08ddf64f-0311-4f48-8b6a-59d902d2388f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.497248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08ddf64f-0311-4f48-8b6a-59d902d2388f tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.060121 Jun 25 21:00:41.499275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1257/2278] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:41.508279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:41.519278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.520482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:41.538848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.539621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.545739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.545913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.576031 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 HTTP/1.1 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b7335cff-0cba-4acd-8c67-5ae7c8bdbf99'} Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:41.582234 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.585647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:41.588354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94a02219-8271-4271-8003-4aa1ed983b8e tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 404 len: 111 microversion: 2.1 time: 0.078999 Jun 25 21:00:41.588354 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1258/2279] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:41 2022] DELETE /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:41.597682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42d79248-bb56-4d3a-a678-f089cf87ad21 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f984ed54b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.649161 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42d79248-bb56-4d3a-a678-f089cf87ad21 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.058694 Jun 25 21:00:41.651245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1259/2280] 10.222.0.39 () {58 vars in 1289 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_distro => generated 33 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:41.661478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3422be6e-1b55-4f53-aac9-36af2d1f0ea5 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.688139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3422be6e-1b55-4f53-aac9-36af2d1f0ea5 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034809 Jun 25 21:00:41.689262 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1260/2281] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:41.695856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.696856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: b7335cff-0cba-4acd-8c67-5ae7c8bdbf99] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:41.705581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.706438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.707847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.708619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.726625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 HTTP/1.1 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b7335cff-0cba-4acd-8c67-5ae7c8bdbf99'} Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.728778 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. Jun 25 21:00:41.732011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:41.734309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:41.735416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e181aca4-64a4-4ac5-b88b-da0dc4d9f966 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99" status: 404 len: 111 microversion: 2.1 time: 0.044913 Jun 25 21:00:41.739704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1261/2282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/servers/b7335cff-0cba-4acd-8c67-5ae7c8bdbf99 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:41.745529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:41.746558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:41.754259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.755046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.756043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:41.756867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:41.881630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:41.892753 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca1025d1-9fca-437e-a47c-8ce007fcefa0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1508 microversion: 2.1 time: 0.514482 Jun 25 21:00:41.894160 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1022/2283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1508 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:41.900112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3796904d-5784-437d-a25e-e31b9a2094cb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f984ffd0310>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:41.966762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3796904d-5784-437d-a25e-e31b9a2094cb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:41.972729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3796904d-5784-437d-a25e-e31b9a2094cb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:42.282213 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3796904d-5784-437d-a25e-e31b9a2094cb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.386708 Jun 25 21:00:42.282964 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1023/2284] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:41 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:42.289472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d9abba8b-f034-4719-b115-40dc8ccef858 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.301243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d9abba8b-f034-4719-b115-40dc8ccef858 tempest-FlavorsV2TestJSON-847531393 tempest-FlavorsV2TestJSON-847531393-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017148 Jun 25 21:00:42.309587 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1024/2285] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:00:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:42.315589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20dd81ae-8ca2-47ca-8a70-d48313822838 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '.version_select at 0x7f985c087f70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.340986 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-20dd81ae-8ca2-47ca-8a70-d48313822838 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Image not found. Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20dd81ae-8ca2-47ca-8a70-d48313822838 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce HTTP/1.1 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'bfa32199-be3f-4f16-aae5-8c8f167383ce'} Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bfa32199-be3f-4f16-aae5-8c8f167383ce to delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bfa32199-be3f-4f16-aae5-8c8f167383ce could not be found. Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.351592 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20dd81ae-8ca2-47ca-8a70-d48313822838 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:42.355311 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20dd81ae-8ca2-47ca-8a70-d48313822838 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce" status: 404 len: 62 microversion: 2.1 time: 0.043697 Jun 25 21:00:42.358869 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1025/2286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:42 2022] DELETE /compute/v2.1/images/bfa32199-be3f-4f16-aae5-8c8f167383ce => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:42.362541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c1eff89-022b-46ba-86bc-075749f0b639 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f985c066ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.422066 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c1eff89-022b-46ba-86bc-075749f0b639 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.064339 Jun 25 21:00:42.422671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1026/2287] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:42 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:42.430029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.430858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:42.438147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.438880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:42.439878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.440509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:42.457085 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 HTTP/1.1 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '006b6ab3-0114-493d-9b7d-380d2d564df7'} Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:42.459028 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.462338 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.464872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:42.465914 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d77bcae-da1e-43f2-9bda-f8674cba33ff tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "DELETE /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 404 len: 111 microversion: 2.1 time: 0.040483 Jun 25 21:00:42.466680 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1027/2288] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:42 2022] DELETE /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:42.472737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1234135b-a5de-4d7a-9f68-1c44e5fda4e3 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f985c043d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:42.526914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1234135b-a5de-4d7a-9f68-1c44e5fda4e3 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:42.531965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1234135b-a5de-4d7a-9f68-1c44e5fda4e3 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:42.538772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:42.551413 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0dbaaf5-a096-4e86-b2e6-432dd32ab1a3 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.810292 Jun 25 21:00:42.552212 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1262/2289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:41 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:42.558446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.559137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] [instance: 006b6ab3-0114-493d-9b7d-380d2d564df7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:42.582653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.583161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:42.591531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.592657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:42.630147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] HTTP exception thrown: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Request method failure captured: Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 HTTP/1.1 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3Z1e-izRNxa2ju859LSYHgNyXNgarWOt1k73PHk1J1iXRerTglO5A84oqkHTZorswO9-LI_NFXlqdpSZPIdbAbqRjxF8Luk8C-lilRN3IBpsrjWSbnSshwtcD8zL2jZW6ANYVUM8fB3BHZfTbw2yuIjUWv_WfPbnenRn0vVV09RnEo Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca77764a1f5e436db2f6436a02b2fc24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca77764a1f5e436db2f6436a02b2fc24"}]}] Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ca77764a1f5e436db2f6436a02b2fc24 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesTestJSON-118672819 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: dbd8d82d694941b58fa2d18311ea5785 Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesTestJSON-118672819-project Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '006b6ab3-0114-493d-9b7d-380d2d564df7'} Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.633081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. Jun 25 21:00:42.636570 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:42.642836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] Returning 404 to user: Instance 006b6ab3-0114-493d-9b7d-380d2d564df7 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:42.643702 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5634fb5d-6133-4781-9bd9-3b9b099421b3 tempest-ImagesTestJSON-118672819 tempest-ImagesTestJSON-118672819-project] 10.222.0.39 "GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7" status: 404 len: 111 microversion: 2.1 time: 0.090669 Jun 25 21:00:42.652535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1263/2290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:42 2022] GET /compute/v2.1/servers/006b6ab3-0114-493d-9b7d-380d2d564df7 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:42.912477 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1234135b-a5de-4d7a-9f68-1c44e5fda4e3 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.444499 Jun 25 21:00:42.914195 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1028/2291] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:42 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:42.921321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:42.923515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:42.925226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29f96a6c-9fea-41fd-bd38-0aca544aaa44 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f985c0daf70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:42.933686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.934429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:42.935451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:42.937008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:43.009186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-29f96a6c-9fea-41fd-bd38-0aca544aaa44 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:43.020290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-29f96a6c-9fea-41fd-bd38-0aca544aaa44 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:43.461178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29f96a6c-9fea-41fd-bd38-0aca544aaa44 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 64 microversion: 2.1 time: 0.541989 Jun 25 21:00:43.466118 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1029/2292] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:42 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 64 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:00:43.468439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:43.483485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1c6ca388-ecf1-4fcc-b3b3-8d3e17d39f13 req-6a477fd6-55fa-45a6-8cb3-386e0bbefee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa987a9c-ea81-4b09-b4d7-b7fac791d7ba", "name": "network-vif-plugged", "status": "completed", "tag": "cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:43.486411 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c245adbd-d290-4645-9744-edaa6c833e93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1508 microversion: 2.1 time: 0.571695 Jun 25 21:00:43.487278 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1264/2293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:42 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:43.500890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4afc6aa-7bcd-4af5-b2fe-1149fb08f43e tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f984ed5d040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:43.507837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1c6ca388-ecf1-4fcc-b3b3-8d3e17d39f13 req-6a477fd6-55fa-45a6-8cb3-386e0bbefee6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:43.508361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1c6ca388-ecf1-4fcc-b3b3-8d3e17d39f13 req-6a477fd6-55fa-45a6-8cb3-386e0bbefee6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:43.521939 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1c6ca388-ecf1-4fcc-b3b3-8d3e17d39f13 req-6a477fd6-55fa-45a6-8cb3-386e0bbefee6 service nova] Creating event network-vif-plugged:cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d for instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba on nch1-master-1 Jun 25 21:00:43.528706 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1c6ca388-ecf1-4fcc-b3b3-8d3e17d39f13 req-6a477fd6-55fa-45a6-8cb3-386e0bbefee6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059947 Jun 25 21:00:43.530412 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1030/2294] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:43.581617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4afc6aa-7bcd-4af5-b2fe-1149fb08f43e tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 64 microversion: 2.1 time: 0.091110 Jun 25 21:00:43.582313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:43.582967 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1265/2295] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:43 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 64 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:43.592120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:43.596212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99dddcae-5421-4ba0-9914-a886114d6a41 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f984ed5da60>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:43.610031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:43.610637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:43.613541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:43.614066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:43.671996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-99dddcae-5421-4ba0-9914-a886114d6a41 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:43.678010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-99dddcae-5421-4ba0-9914-a886114d6a41 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:44.033405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:44.047105 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53408879-c11c-491a-81bc-fc9bb75e7638 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.482508 Jun 25 21:00:44.047721 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1031/2296] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:43 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:44.072369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6cff4f9e-ec46-4341-9a61-3f9c7ed2146c req-5ef4cf53-c6b6-41e6-b842-72398c8acf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:44.096916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6cff4f9e-ec46-4341-9a61-3f9c7ed2146c req-5ef4cf53-c6b6-41e6-b842-72398c8acf46 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:44.097619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6cff4f9e-ec46-4341-9a61-3f9c7ed2146c req-5ef4cf53-c6b6-41e6-b842-72398c8acf46 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:44.116260 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6cff4f9e-ec46-4341-9a61-3f9c7ed2146c req-5ef4cf53-c6b6-41e6-b842-72398c8acf46 service nova] Creating event network-changed:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:00:44.126290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99dddcae-5421-4ba0-9914-a886114d6a41 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.531928 Jun 25 21:00:44.129591 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1266/2297] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:43 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:00:44.156721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62dbddb4-2621-4ca4-84f6-28c9e567616d tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update', calling method: .version_select at 0x7f984ed54430>, body: {"meta": {"os_version": "alt"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:44.161679 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6cff4f9e-ec46-4341-9a61-3f9c7ed2146c req-5ef4cf53-c6b6-41e6-b842-72398c8acf46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095713 Jun 25 21:00:44.167423 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1032/2298] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:44.235680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-62dbddb4-2621-4ca4-84f6-28c9e567616d tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:44.243484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:UPDATE=5,nova_api:SELECT=95 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:44.251789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-62dbddb4-2621-4ca4-84f6-28c9e567616d tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:44.496796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fffcce45-7a70-417c-a4d8-4d1245913bb9 req-a271d2c6-475a-4487-9183-4533af996787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86255422-6b4c-4316-add7-40685858aba3", "name": "network-vif-deleted", "tag": "a2c4a26d-b960-4603-a78b-9d85b5d6dc5a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:44.519781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:44.522230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fffcce45-7a70-417c-a4d8-4d1245913bb9 req-a271d2c6-475a-4487-9183-4533af996787 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:44.522931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fffcce45-7a70-417c-a4d8-4d1245913bb9 req-a271d2c6-475a-4487-9183-4533af996787 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:44.554479 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fffcce45-7a70-417c-a4d8-4d1245913bb9 req-a271d2c6-475a-4487-9183-4533af996787 service nova] Creating event network-vif-deleted:a2c4a26d-b960-4603-a78b-9d85b5d6dc5a for instance 86255422-6b4c-4316-add7-40685858aba3 on nch2-master-1 Jun 25 21:00:44.575768 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fffcce45-7a70-417c-a4d8-4d1245913bb9 req-a271d2c6-475a-4487-9183-4533af996787 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081887 Jun 25 21:00:44.577660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1033/2299] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:44.594919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:44.597699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:44.615647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:44.618465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:44.620705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:44.621050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:44.851221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:44.860392 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c206c17e-c2e3-493f-83de-c265bf7c8993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 200 len: 1300 microversion: 2.1 time: 0.280412 Jun 25 21:00:44.864990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1034/2300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:44 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 1300 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:44.930815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62dbddb4-2621-4ca4-84f6-28c9e567616d tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.794650 Jun 25 21:00:44.931557 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1267/2301] 10.222.0.39 () {60 vars in 1312 bytes} [Sat Jun 25 21:00:44 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata/os_version => generated 31 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:00:44.942398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8678f04-399b-43df-8c2c-4d0af2a0c2c4 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f985c0da0d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:45.015046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8678f04-399b-43df-8c2c-4d0af2a0c2c4 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 58 microversion: 2.1 time: 0.077436 Jun 25 21:00:45.015668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1035/2302] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:44 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 58 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:45.042426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44fe451f-4caa-46f6-ab8b-77cb0c1b41eb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'update_all', calling method: .version_select at 0x7f984ee7b940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:45.068634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:45.074111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:45.084479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:45.084941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:45.085727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:45.100549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:45.164551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-44fe451f-4caa-46f6-ab8b-77cb0c1b41eb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:45.188027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-44fe451f-4caa-46f6-ab8b-77cb0c1b41eb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:45.664756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:45.682201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20e87286-8592-41c6-9cbf-2cf3bc66472c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1319 microversion: 2.1 time: 0.621562 Jun 25 21:00:45.682814 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1036/2303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:45 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1319 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:45.808123 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44fe451f-4caa-46f6-ab8b-77cb0c1b41eb tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 61 microversion: 2.1 time: 0.782228 Jun 25 21:00:45.809992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1268/2304] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:45 2022] PUT /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 61 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:45.819164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf66c742-19cf-41a2-bc3e-00a827e6339a tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Action: 'create', calling method: .version_select at 0x7f984ed5d4c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:45.906018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cf66c742-19cf-41a2-bc3e-00a827e6339a tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:45.918373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cf66c742-19cf-41a2-bc3e-00a827e6339a tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Getting quotas for user 809740815755475dbba764e4fd0166ab and project aafb900b1c204df0901e23985c6106b4. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:45.952323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3789dc5-404a-4e38-94ff-19de4a654173 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Calling method '.version_select at 0x7f985c0668b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:45.995285 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-b3789dc5-404a-4e38-94ff-19de4a654173 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3789dc5-404a-4e38-94ff-19de4a654173 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/images/6abd31b5-faf2-45cd-81ce-b5b3850ec91c/metadata/os_distro HTTP/1.1 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'image_id': '6abd31b5-faf2-45cd-81ce-b5b3850ec91c', 'id': 'os_distro'} Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6abd31b5-faf2-45cd-81ce-b5b3850ec91c Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.003322 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6abd31b5-faf2-45cd-81ce-b5b3850ec91c could not be found. Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3789dc5-404a-4e38-94ff-19de4a654173 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.008011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3789dc5-404a-4e38-94ff-19de4a654173 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "DELETE /compute/v2.1/images/6abd31b5-faf2-45cd-81ce-b5b3850ec91c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.321164 Jun 25 21:00:46.012352 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1037/2305] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:00:45 2022] DELETE /compute/v2.1/images/6abd31b5-faf2-45cd-81ce-b5b3850ec91c/metadata/os_distro => generated 62 bytes in 327 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.021999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:46.034442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:46.066129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:46.070141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:46.071177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:46.076365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:46.099447 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 HTTP/1.1 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '86255422-6b4c-4316-add7-40685858aba3'} Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.102035 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:00:46.105304 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.107313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.109219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdcc6715-10d7-47dc-848a-7c334cfcc4da tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 404 len: 111 microversion: 2.1 time: 0.098051 Jun 25 21:00:46.121558 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1038/2306] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:46 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:46.149724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2c191f6-6960-4a36-be2a-c6878d4c2975 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Calling method '.version_select at 0x7f985c0351f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:46.206795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a2c191f6-6960-4a36-be2a-c6878d4c2975 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2c191f6-6960-4a36-be2a-c6878d4c2975 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/images/6a0ce3e4-e7ab-4001-b5c6-7232fec2c287/metadata/os_version HTTP/1.1 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'image_id': '6a0ce3e4-e7ab-4001-b5c6-7232fec2c287', 'id': 'os_version'} Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6a0ce3e4-e7ab-4001-b5c6-7232fec2c287 Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.214473 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a0ce3e4-e7ab-4001-b5c6-7232fec2c287 could not be found. Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.218481 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.222720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2c191f6-6960-4a36-be2a-c6878d4c2975 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.223610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2c191f6-6960-4a36-be2a-c6878d4c2975 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "GET /compute/v2.1/images/6a0ce3e4-e7ab-4001-b5c6-7232fec2c287/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.100994 Jun 25 21:00:46.228510 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1039/2307] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:00:46 2022] GET /compute/v2.1/images/6a0ce3e4-e7ab-4001-b5c6-7232fec2c287/metadata/os_version => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.248926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3435643-df9f-4b7b-a6d7-9a27f49b2478 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Calling method '.version_select at 0x7f985c035b80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:46.295629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e3435643-df9f-4b7b-a6d7-9a27f49b2478 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3435643-df9f-4b7b-a6d7-9a27f49b2478 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/images/4e598d15-b06a-4198-9279-321501439cb8/metadata HTTP/1.1 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'image_id': '4e598d15-b06a-4198-9279-321501439cb8'} Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4e598d15-b06a-4198-9279-321501439cb8 Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.297868 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4e598d15-b06a-4198-9279-321501439cb8 could not be found. Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3435643-df9f-4b7b-a6d7-9a27f49b2478 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e3435643-df9f-4b7b-a6d7-9a27f49b2478 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "GET /compute/v2.1/images/4e598d15-b06a-4198-9279-321501439cb8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.070114 Jun 25 21:00:46.303239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1040/2308] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:46 2022] GET /compute/v2.1/images/4e598d15-b06a-4198-9279-321501439cb8/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.320011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebef5dab-878c-4703-847a-86f9d31d86f1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Action: 'update_all', calling method: .version_select at 0x7f985c035670>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:46.377410 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ebef5dab-878c-4703-847a-86f9d31d86f1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebef5dab-878c-4703-847a-86f9d31d86f1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/images/e1ea364a-e523-41a5-8195-4de7255b069e/metadata HTTP/1.1 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 57 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'image_id': 'e1ea364a-e523-41a5-8195-4de7255b069e', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e1ea364a-e523-41a5-8195-4de7255b069e Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.380348 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e1ea364a-e523-41a5-8195-4de7255b069e could not be found. Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.383629 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.392452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebef5dab-878c-4703-847a-86f9d31d86f1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.392452 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ebef5dab-878c-4703-847a-86f9d31d86f1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "PUT /compute/v2.1/images/e1ea364a-e523-41a5-8195-4de7255b069e/metadata" status: 404 len: 62 microversion: 2.1 time: 0.084903 Jun 25 21:00:46.392452 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1041/2309] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:00:46 2022] PUT /compute/v2.1/images/e1ea364a-e523-41a5-8195-4de7255b069e/metadata => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.406922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1865741599", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:46.490047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:46.608697 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf66c742-19cf-41a2-bc3e-00a827e6339a tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "POST /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 85 microversion: 2.1 time: 0.793666 Jun 25 21:00:46.614570 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1269/2310] 10.222.0.39 () {60 vars in 1280 bytes} [Sat Jun 25 21:00:45 2022] POST /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 85 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:00:46.620370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35a493e-d30f-4657-b21d-f92d62cd1da1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Action: 'update', calling method: .version_select at 0x7f984eed0160>, body: {"meta": {"os_distro": "alt"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:46.666962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a35a493e-d30f-4657-b21d-f92d62cd1da1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35a493e-d30f-4657-b21d-f92d62cd1da1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/images/6593cf02-2bcf-4231-814f-af04678e04f8/metadata/os_distro HTTP/1.1 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 30 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: {"meta": {"os_distro": "alt"}} Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'image_id': '6593cf02-2bcf-4231-814f-af04678e04f8', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6593cf02-2bcf-4231-814f-af04678e04f8 Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.669780 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6593cf02-2bcf-4231-814f-af04678e04f8 could not be found. Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.674836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a35a493e-d30f-4657-b21d-f92d62cd1da1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.680044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a35a493e-d30f-4657-b21d-f92d62cd1da1 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "PUT /compute/v2.1/images/6593cf02-2bcf-4231-814f-af04678e04f8/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.060843 Jun 25 21:00:46.680521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1270/2311] 10.222.0.39 () {60 vars in 1309 bytes} [Sat Jun 25 21:00:46 2022] PUT /compute/v2.1/images/6593cf02-2bcf-4231-814f-af04678e04f8/metadata/os_distro => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.692361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-05bd426f-2851-4aa5-8a39-1a2c8bfa5341 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] Calling method '.version_select at 0x7f984eed05e0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:46.760036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-05bd426f-2851-4aa5-8a39-1a2c8bfa5341 tempest-ImagesMetadataTestJSON-544885723 tempest-ImagesMetadataTestJSON-544885723-project] 10.222.0.39 "GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata" status: 200 len: 85 microversion: 2.1 time: 0.077978 Jun 25 21:00:46.760914 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1271/2312] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:00:46 2022] GET /compute/v2.1/images/902f0ded-77fb-4cc1-b00b-926fc4ac2f74/metadata => generated 85 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:00:46.777370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa004ddf-259f-44e5-9a4d-ee3f08a65a51 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Action: 'create', calling method: .version_select at 0x7f984eebb280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:46.832813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-fa004ddf-259f-44e5-9a4d-ee3f08a65a51 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] HTTP exception thrown: Image not found. Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa004ddf-259f-44e5-9a4d-ee3f08a65a51 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Request method failure captured: Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/images/b65e9404-20cc-4a5a-a06a-125d61701221/metadata HTTP/1.1 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 57 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3d925UwE6iyFVitsyWPyD7lr0RLWRv0hmlvFXfYMMveexryeRLHJzeUeGE-z2VUHVusFqM4I8OMkKwUtQeGApUwdAkC2H8x4bAm7jKzR94L8uomClVK9DpXlAcNcBiMkYe9yTS1OZiMURApCq6SVlJUvVc_LgmNL6c7X0ugdz05GjY Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24229e7471a5460390be1ff110c3135a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24229e7471a5460390be1ff110c3135a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24229e7471a5460390be1ff110c3135a"}]}] Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 24229e7471a5460390be1ff110c3135a Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: db5eee4a92a04af99fd16cbbdfe15e6a Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1621242500-project Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'image_id': 'b65e9404-20cc-4a5a-a06a-125d61701221', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b65e9404-20cc-4a5a-a06a-125d61701221 Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:00:46.836188 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b65e9404-20cc-4a5a-a06a-125d61701221 could not be found. Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:00:46.841791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:46.845503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa004ddf-259f-44e5-9a4d-ee3f08a65a51 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:46.847778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa004ddf-259f-44e5-9a4d-ee3f08a65a51 tempest-ImagesMetadataNegativeTestJSON-1621242500 tempest-ImagesMetadataNegativeTestJSON-1621242500-project] 10.222.0.39 "POST /compute/v2.1/images/b65e9404-20cc-4a5a-a06a-125d61701221/metadata" status: 404 len: 62 microversion: 2.1 time: 0.080298 Jun 25 21:00:46.848907 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1272/2313] 10.222.0.39 () {60 vars in 1280 bytes} [Sat Jun 25 21:00:46 2022] POST /compute/v2.1/images/b65e9404-20cc-4a5a-a06a-125d61701221/metadata => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:46.854374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:46.855223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:46.866313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:46.870410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:46.871398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:46.875187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:47.750487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:47.751090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:47.751443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:47.751922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:47.752770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:47.776720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:47.777180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:47.780972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:47.782213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:47.797131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:47.810950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:47.824258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:47.826200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d6a6da9-9506-4a6a-94ef-16a66dbf9907 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1469 microversion: 2.1 time: 0.976016 Jun 25 21:00:47.832387 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1273/2314] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:46 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1469 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:47.848734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:47.849015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:47.849758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:47.851867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:47.867407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:47.867854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:47.868705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:47.869146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:47.902770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lazy-loading 'flavor' on Instance uuid aa987a9c-ea81-4b09-b4d7-b7fac791d7ba {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:00:47.932861 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-683b135a-ad13-4dbb-bebc-6503d83bf64f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.534505 Jun 25 21:00:47.933607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1042/2315] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:47.946057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cea838e8-2a1c-46e4-b81d-288c4a426d05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:47.946963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cea838e8-2a1c-46e4-b81d-288c4a426d05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:48.016415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cea838e8-2a1c-46e4-b81d-288c4a426d05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:48.037810 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cea838e8-2a1c-46e4-b81d-288c4a426d05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1215 microversion: 2.1 time: 0.082591 Jun 25 21:00:48.039047 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1043/2316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:47 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:48.069706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-03429c30-caf5-4892-83e4-93b6044f8c06 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba/action" status: 202 len: 0 microversion: 2.1 time: 0.224494 Jun 25 21:00:48.073638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1274/2317] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:00:47 2022] POST /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:00:48.081650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:48.082275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:48.098478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:48.098929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:48.099724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:48.100160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:48.348167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:48.359763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ebaf2c7-fab6-44b2-ba81-2f9099fdb5ca tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1477 microversion: 2.1 time: 0.282371 Jun 25 21:00:48.363058 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1044/2318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:48 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:49.056820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:49.058165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:49.065877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.066632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:49.067619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.068268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:49.381276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:49.382918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:49.394400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.399072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:49.400214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.400874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:49.453801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:49.470554 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ada4200b-5160-4f26-994c-62c526f7cb1b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1267 microversion: 2.1 time: 0.418009 Jun 25 21:00:49.485608 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1275/2319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:49 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1267 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:49.830297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:49.840587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-267008c4-2366-4efa-abed-fd9ac207d7cb tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1460 microversion: 2.1 time: 0.467169 Jun 25 21:00:49.841806 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1045/2320] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:49 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1460 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:49.857862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:49.858955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:49.870522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.871319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:49.873763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:49.875777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:50.494889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:50.501244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:50.518721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:50.520535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:50.521360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:50.521801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:50.684112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:50.696178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f195976-d08f-4df7-aeaa-cfc35e9ad3c4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1273 microversion: 2.1 time: 0.210604 Jun 25 21:00:50.698208 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1046/2321] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:50 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1273 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:50.992614 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7190c92e-8117-48e6-a031-8dd4fd0396fc tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1611 microversion: 2.1 time: 1.138401 Jun 25 21:00:50.996148 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1276/2322] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:49 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1611 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:51.017638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:51.019321 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:00:51.019321 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:00:51.020815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.021625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.023939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.024618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.117906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-348b0e3f-61a1-4a0a-b265-aa003a58e082 tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.104227 Jun 25 21:00:51.118428 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1277/2323] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 21:00:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:00:51.133575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:51.135026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:51.152522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.153335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.154360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.156059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.238459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Lazy-loading 'flavor' on Instance uuid aa987a9c-ea81-4b09-b4d7-b7fac791d7ba {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:00:51.268530 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba while it is in vm_state suspended Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Request method failure captured: Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba/action HTTP/1.1 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 97 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dR3njppMZrX4p9DPzeOk_YtZi9R-wAqLpKbkrRy4R3Rj_lXAqzQIktuFK-Xa2KynFJ7fd4TsDH2t_cCU4oGIHvCkQ-o1sTvv8n5EQlsgkZahmRrtIYZfrCRHCjfpJxxg8mwm9Ho9Wko0pajSbffrTviok8qLQxoTW0dun-7QLP07w Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 9951e5af52644ec6bc296071f6716cce Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9951e5af52644ec6bc296071f6716cce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9951e5af52644ec6bc296071f6716cce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9951e5af52644ec6bc296071f6716cce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9951e5af52644ec6bc296071f6716cce"}]}] Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 9951e5af52644ec6bc296071f6716cce Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-245727804 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-LiveMigrationNegativeTest-245727804-project-admin Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6729f8099957469f9d8dec848c138208 Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-LiveMigrationNegativeTest-245727804-project-admin Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'os-migrateLive' instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba while it is in vm_state suspended Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'aa987a9c-ea81-4b09-b4d7-b7fac791d7ba', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba in vm_state suspended. Cannot live_migrate while the instance is in this state. Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:51.270706 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba while it is in vm_state suspended Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba while it is in vm_state suspended Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba while it is in vm_state suspended {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7b4685b-d86b-4f88-8895-932cdd5d38df tempest-LiveMigrationNegativeTest-245727804 tempest-LiveMigrationNegativeTest-245727804-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba/action" status: 409 len: 155 microversion: 2.1 time: 0.145504 Jun 25 21:00:51.281285 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1278/2324] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:00:51 2022] POST /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba/action => generated 155 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:00:51.298797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:51.299401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:51.317818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.318294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.319086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.321818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.342916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-2005138734", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:51.389970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:51.422687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:51.450742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:00:51.548370 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c93f23b-467a-49dc-87ce-557a8c08cdac tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 204 len: 0 microversion: 2.1 time: 0.251905 Jun 25 21:00:51.549408 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1279/2325] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:51 2022] DELETE /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:51.561979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:51.566672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:51.587057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.590945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.593116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.593731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.936884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:00:51.937393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:00:51.937856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:00:51.938330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:00:51.939660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:00:51.977043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.980136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:51.983960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:51.986362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:52.018451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Getting quotas for project aa04ed2c6ea14438b506a2b7f4e3f377. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:52.023663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Getting quotas for user 5a80f9c350664a839bdada41c1973b1e and project aa04ed2c6ea14438b506a2b7f4e3f377. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:52.036897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:00:52.039296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:00:52.137573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:52.146031 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c82fc7b5-954b-4e6a-b0e6-afc071030207 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1466 microversion: 2.1 time: 0.591672 Jun 25 21:00:52.151718 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1280/2326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:51 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1466 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:52.167374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:52.175185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:52.193005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:52.193597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:52.200124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:52.200755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:52.230448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1ab3a13-2fac-4329-a6ae-07e4427a1c59 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.354053 Jun 25 21:00:52.233725 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1047/2327] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:00:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:00:52.422365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a2854ed-90d6-4fbb-883a-a66f61327ae4 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f985c0431f0>, body: {"keypair": {"name": "tempest-keypair-2111099515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJqXwt5uPUs6jgEuTZxfQCFhtde+5tY1Wpoxk6CZeBgABA7q7Hew3Ti+r+dp1Bojj+Gh6M3ROELS6t6qtBjjn4NCO22w/ZqVmiFZE61VFpAaUhHKbALaRDwZuTcDf5cJA=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:52.450249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-4a2854ed-90d6-4fbb-883a-a66f61327ae4 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:52.482367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-4a2854ed-90d6-4fbb-883a-a66f61327ae4 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:52.546412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a2854ed-90d6-4fbb-883a-a66f61327ae4 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.311355 Jun 25 21:00:52.547200 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1048/2328] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 25 21:00:52.566742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-7e83eba1-932b-4896-b9d9-84d3bdf7e789 req-1b662ed8-5cca-4a05-af97-54956cb573d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f130496-e0ba-47fb-a347-f26f1100ec2c", "tag": "bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:52.658384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7e83eba1-932b-4896-b9d9-84d3bdf7e789 req-1b662ed8-5cca-4a05-af97-54956cb573d2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:52.664551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7e83eba1-932b-4896-b9d9-84d3bdf7e789 req-1b662ed8-5cca-4a05-af97-54956cb573d2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:52.704331 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-7e83eba1-932b-4896-b9d9-84d3bdf7e789 req-1b662ed8-5cca-4a05-af97-54956cb573d2 service nova] Creating event network-changed:bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8 for instance 4f130496-e0ba-47fb-a347-f26f1100ec2c on nch1-master-1 Jun 25 21:00:52.722260 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-7e83eba1-932b-4896-b9d9-84d3bdf7e789 req-1b662ed8-5cca-4a05-af97-54956cb573d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165999 Jun 25 21:00:52.725381 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1049/2329] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:52.738580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9eb25ec5-6b9e-4c82-89ed-5166d3b0112f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:52.739929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9eb25ec5-6b9e-4c82-89ed-5166d3b0112f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:53.114548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9eb25ec5-6b9e-4c82-89ed-5166d3b0112f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:53.126588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9eb25ec5-6b9e-4c82-89ed-5166d3b0112f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1217 microversion: 2.1 time: 0.399628 Jun 25 21:00:53.129072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1050/2330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:52 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1217 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:53.141520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4db1e779-6da4-4ccf-bd19-82073fed4f24 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f985c070670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:53.160372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4db1e779-6da4-4ccf-bd19-82073fed4f24 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-2111099515" status: 200 len: 513 microversion: 2.2 time: 0.028332 Jun 25 21:00:53.166736 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1051/2331] 10.222.0.39 () {60 vars in 1257 bytes} [Sat Jun 25 21:00:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2111099515 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:53.183076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:53.186898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:53.187565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:53.197584 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-517512de-c277-45f8-be37-0cca44fc7c93 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1315 microversion: 2.1 time: 1.035953 Jun 25 21:00:53.198452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1281/2332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:52 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1315 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:53.209289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3b6dff0-cdf0-4503-873d-736ff51d14bb tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ee7b9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:53.218550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:53.219414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:53.220821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:53.223908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:53.255344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3b6dff0-cdf0-4503-873d-736ff51d14bb tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111099515" status: 204 len: 0 microversion: 2.2 time: 0.054551 Jun 25 21:00:53.256186 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1282/2333] 10.222.0.39 () {60 vars in 1260 bytes} [Sat Jun 25 21:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111099515 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:53.268808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7eac6c9f-8148-4f76-9ee4-90c6dc85a117 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f984ee04af0>, body: {"keypair": {"name": "tempest-keypair-413376929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMU2PuEi2vfOC6CjqN2qE0111jvTjRvcTymLUmLkHrgaaCyqoqIPSIfv1u0vcgzAbh7+M25N6/vgwAdneTL4Lg8r2cpih53dGrKS4v1f60nS4vUT3puB7bIu411LevixQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:53.306023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7eac6c9f-8148-4f76-9ee4-90c6dc85a117 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:53.314485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7eac6c9f-8148-4f76-9ee4-90c6dc85a117 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:53.367755 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7eac6c9f-8148-4f76-9ee4-90c6dc85a117 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.103468 Jun 25 21:00:53.368765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1283/2334] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 105 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 25 21:00:53.378917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16963fb1-9352-420d-a87c-1e3b12aeea7a tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984eed0b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:53.410357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16963fb1-9352-420d-a87c-1e3b12aeea7a tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413376929" status: 204 len: 0 microversion: 2.2 time: 0.035118 Jun 25 21:00:53.411452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1284/2335] 10.222.0.39 () {60 vars in 1257 bytes} [Sat Jun 25 21:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413376929 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:00:53.428785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b30524e4-1a9d-46f5-a877-ca5304989c64 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f984ed763a0>, body: {"keypair": {"name": "tempest-keypair-1624763856", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:53.478172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b30524e4-1a9d-46f5-a877-ca5304989c64 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:53.493296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b30524e4-1a9d-46f5-a877-ca5304989c64 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:53.547158 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b30524e4-1a9d-46f5-a877-ca5304989c64 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.130097 Jun 25 21:00:53.553070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1285/2336] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 25 21:00:53.559385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fd99bb6e-b011-401f-8bf5-f4e7278fd80e tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ee083a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:53.585431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fd99bb6e-b011-401f-8bf5-f4e7278fd80e tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624763856" status: 204 len: 0 microversion: 2.2 time: 0.030140 Jun 25 21:00:53.586240 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1286/2337] 10.222.0.39 () {60 vars in 1260 bytes} [Sat Jun 25 21:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624763856 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:53.605862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90953b96-968c-4c38-a1e7-6590bcf5e175 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f984ef23dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1174600966", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVLEx1EiVc3ghH0HqTasBNXf+tacLuPQYhIkbea4/etqh9fRYfdCd5YIXHZB8dwJ7eKqqV0c6goa66w0FCzUSK4gPCJ+sm3zdx9DuQEBnW5g/4SOB1Y4QSPbhvtexxUvQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:53.673806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-90953b96-968c-4c38-a1e7-6590bcf5e175 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:53.683111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-90953b96-968c-4c38-a1e7-6590bcf5e175 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:53.725826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90953b96-968c-4c38-a1e7-6590bcf5e175 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.130094 Jun 25 21:00:53.727172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1287/2338] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 132 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 25 21:00:53.742303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7db54e78-e1b0-4d2d-b6b8-5810e31f9cd2 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f984ef23670>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1189076867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKIkxwrJ14KYbfNzleciPLoYgWXmV/iiQ60JxVRyarHLyvxxNFIGmC9k5OJ+22m1NosjAMyJePY4/iT/fb1bUXEKMFxGOCBG2AAzloaCQkDxRnpv1GKXRLiMeBiWpN5vQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:53.825557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7db54e78-e1b0-4d2d-b6b8-5810e31f9cd2 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:53.837708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:53.851663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7db54e78-e1b0-4d2d-b6b8-5810e31f9cd2 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:53.901967 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7db54e78-e1b0-4d2d-b6b8-5810e31f9cd2 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.164587 Jun 25 21:00:53.903513 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1288/2339] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jun 25 21:00:53.918692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57c321d9-5898-4bf7-a659-11e3096e3387 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f984eebbca0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1838421891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvdPA347TZbeTztIce6MxilC+4bTylhLRlgdaeQJmdH8NK3u/0m6ucoawD+cn9p/viyFR4nQsIZ4h8WUa3B+Arx7NE1NbhQRU+2JNdXn/6ygH3anvQzfP9KSX8GRXnJ8A=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:53.957264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-57c321d9-5898-4bf7-a659-11e3096e3387 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:53.971606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-57c321d9-5898-4bf7-a659-11e3096e3387 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:54.041405 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57c321d9-5898-4bf7-a659-11e3096e3387 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.115530 Jun 25 21:00:54.048352 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1289/2340] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:53 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 25 21:00:54.066986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e66c6ba-d60a-486e-8bbf-deffd96715bf tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ed76550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.075480 ncdv-master-1 devstack@n-api.service[137461]: WARNING oslo_db.sqlalchemy.utils [None req-7e66c6ba-d60a-486e-8bbf-deffd96715bf tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 21:00:54.086139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e66c6ba-d60a-486e-8bbf-deffd96715bf tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.032631 Jun 25 21:00:54.087198 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1290/2341] 10.222.0.39 () {60 vars in 1176 bytes} [Sat Jun 25 21:00:54 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:54.130283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-66265fcc-7b91-477f-867d-431cff6d1756 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ed76700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.237885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-66265fcc-7b91-477f-867d-431cff6d1756 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1838421891" status: 204 len: 0 microversion: 2.2 time: 0.143906 Jun 25 21:00:54.254290 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1291/2342] 10.222.0.39 () {60 vars in 1320 bytes} [Sat Jun 25 21:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1838421891 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:54.268373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.269058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:54.290152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:54.290675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:54.293278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:54.293784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:54.424630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:54.435535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-804d74fa-b6ca-4755-9714-04da3d5a05de tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1275 microversion: 2.1 time: 0.179847 Jun 25 21:00:54.437337 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1292/2343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:54 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1275 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:54.451670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.453154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:54.461717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:54.462456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:54.463944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:54.465393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:54.609860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:54.628064 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bff4aeaf-708a-47e7-87b5-0e2d0ea33ca0 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1466 microversion: 2.1 time: 1.453363 Jun 25 21:00:54.628693 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1052/2344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:53 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1466 bytes in 1455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:54.637821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-436378d1-7ea7-4222-8a51-3018b4c13703 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f985c0da700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.676492 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-436378d1-7ea7-4222-8a51-3018b4c13703 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1189076867" status: 204 len: 0 microversion: 2.2 time: 0.046445 Jun 25 21:00:54.677144 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1053/2345] 10.222.0.39 () {60 vars in 1320 bytes} [Sat Jun 25 21:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1189076867 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:54.687292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b21909c-b4ab-4d28-9832-4bc5a7c062f0 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f985c74cc10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.729044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:54.744062 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b21909c-b4ab-4d28-9832-4bc5a7c062f0 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1174600966" status: 204 len: 0 microversion: 2.2 time: 0.062383 Jun 25 21:00:54.745469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1054/2346] 10.222.0.39 () {60 vars in 1320 bytes} [Sat Jun 25 21:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1174600966 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:54.762400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e03326f2-2780-4be6-a72a-75f3c3486bcb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1315 microversion: 2.1 time: 0.323171 Jun 25 21:00:54.763025 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1293/2347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:54 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:54.765288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a46fdf28-766b-4ee9-957a-d116cc5bc581 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f985c785e50>, body: {"keypair": {"name": "tempest-keypair-1060512221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUPdf1sgkAGx7W9hkbCPy9Je+AA00H3OthSmVaZ+llFuT5bJ+Ow0RzSPum/CXU6J+M6Px1zH+KuIINfWo1j89brPcXUIBusOof81GCAcpWEE+VWOrcDzN1YActa7RgLVQ=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:54.796516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a46fdf28-766b-4ee9-957a-d116cc5bc581 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:54.804741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a46fdf28-766b-4ee9-957a-d116cc5bc581 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:54.844641 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a46fdf28-766b-4ee9-957a-d116cc5bc581 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.085497 Jun 25 21:00:54.845734 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1055/2348] 10.222.0.39 () {62 vars in 1198 bytes} [Sat Jun 25 21:00:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 93 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jun 25 21:00:54.856565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6fdf0554-df3e-4d79-b1fd-2709cb741895 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ee7b9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.866073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6fdf0554-df3e-4d79-b1fd-2709cb741895 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-1060512221" status: 200 len: 513 microversion: 2.2 time: 0.014103 Jun 25 21:00:54.873273 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1294/2349] 10.222.0.39 () {60 vars in 1257 bytes} [Sat Jun 25 21:00:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1060512221 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:54.884797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d97d285e-8f2d-44b1-a6cb-014d204c0503 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f985c536310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.891715 ncdv-master-1 devstack@n-api.service[137462]: WARNING oslo_db.sqlalchemy.utils [None req-d97d285e-8f2d-44b1-a6cb-014d204c0503 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 21:00:54.899789 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d97d285e-8f2d-44b1-a6cb-014d204c0503 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.025505 Jun 25 21:00:54.901038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1056/2350] 10.222.0.39 () {60 vars in 1176 bytes} [Sat Jun 25 21:00:54 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:00:54.912649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df9ac8f6-326a-4faa-a668-7ac447926207 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ee08700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:54.954371 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df9ac8f6-326a-4faa-a668-7ac447926207 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060512221" status: 204 len: 0 microversion: 2.2 time: 0.047223 Jun 25 21:00:54.961037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1295/2351] 10.222.0.39 () {60 vars in 1260 bytes} [Sat Jun 25 21:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060512221 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:54.968498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Action: 'create', calling method: .version_select at 0x7f985ca9d3a0>, body: {"keypair": {"name": "tempest-keypair-401952609", "type": "x509"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:55.004553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:55.019102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:55.033898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=8,nova_api:DELETE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:55.069379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.processutils [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpcuncw8bm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcuncw8bm/temp.key -subj /CN=e1950869fde34fc8b378526e790a77e7 -extensions v3_req_client {{(pid=137462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:00:55.455426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:55.456062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:55.481405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:55.481867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:55.482756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:55.483093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:55.918454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.processutils [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpcuncw8bm/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpcuncw8bm/temp.key -subj /CN=e1950869fde34fc8b378526e790a77e7 -extensions v3_req_client" returned: 0 in 0.854s {{(pid=137462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:00:55.919968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.processutils [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpcuncw8bm/temp.key -password pass: {{(pid=137462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jun 25 21:00:55.987809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.processutils [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpcuncw8bm/temp.key -password pass:" returned: 0 in 0.067s {{(pid=137462) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jun 25 21:00:56.059843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=49 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:00:56.074690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:56.083550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbac819e-78c0-47f5-8734-bdb25c09ee87 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.634708 Jun 25 21:00:56.084141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1296/2352] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:55 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:56.087441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:00:56.099164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:56.099793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:56.105095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Getting quotas for user e1950869fde34fc8b378526e790a77e7 and project a62d0abb0b1a4ca8bf61e722ba81b292. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:00:56.128787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:56.129250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:56.136020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:56.140282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:56.181261 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60b27cee-e29c-46a2-a8ab-e8ba284a8492 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 1.214080 Jun 25 21:00:56.187835 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1057/2353] 10.222.0.39 () {62 vars in 1197 bytes} [Sat Jun 25 21:00:54 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 1226 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:56.204185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:56.204939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:56.218075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:56.219135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:56.220382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:56.225914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:56.380221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:56.392462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01843718-232c-422f-a92e-ea1363b05b2c tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 200 len: 1424 microversion: 2.1 time: 0.300272 Jun 25 21:00:56.393582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1297/2354] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:56 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 1424 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:56.398967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-618351e6-8390-4a83-887c-ef3e86d0ee63 req-2bfc1206-49ad-405c-a05d-b7f53f853840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa987a9c-ea81-4b09-b4d7-b7fac791d7ba", "name": "network-vif-deleted", "tag": "cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:56.408971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-618351e6-8390-4a83-887c-ef3e86d0ee63 req-2bfc1206-49ad-405c-a05d-b7f53f853840 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:56.409770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-618351e6-8390-4a83-887c-ef3e86d0ee63 req-2bfc1206-49ad-405c-a05d-b7f53f853840 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:56.429850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-618351e6-8390-4a83-887c-ef3e86d0ee63 req-2bfc1206-49ad-405c-a05d-b7f53f853840 service nova] Creating event network-vif-deleted:cf6c8a7f-0680-4fab-98ed-3b2f3a916d0d for instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba on nch1-master-1 Jun 25 21:00:56.436325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-618351e6-8390-4a83-887c-ef3e86d0ee63 req-2bfc1206-49ad-405c-a05d-b7f53f853840 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040854 Jun 25 21:00:56.437349 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1298/2355] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:56.444621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d102e78b-bc7f-4e39-af10-4657a49d6374 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984ef77af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:56.454843 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d102e78b-bc7f-4e39-af10-4657a49d6374 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs/tempest-keypair-401952609" status: 200 len: 1533 microversion: 2.2 time: 0.016156 Jun 25 21:00:56.456878 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1299/2356] 10.222.0.39 () {60 vars in 1254 bytes} [Sat Jun 25 21:00:56 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-401952609 => generated 1533 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:56.470185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-181fd1e7-0cca-4a8c-9513-39d913cabd29 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984eebbc10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:56.473895 ncdv-master-1 devstack@n-api.service[137461]: WARNING oslo_db.sqlalchemy.utils [None req-181fd1e7-0cca-4a8c-9513-39d913cabd29 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 21:00:56.481741 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-181fd1e7-0cca-4a8c-9513-39d913cabd29 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.016103 Jun 25 21:00:56.483133 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1300/2357] 10.222.0.39 () {60 vars in 1176 bytes} [Sat Jun 25 21:00:56 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:56.503275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ca69dad-38f6-44ba-8851-3654a5b0e955 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] Calling method '.version_select at 0x7f984eed0670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:56.528172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ca69dad-38f6-44ba-8851-3654a5b0e955 tempest-KeyPairsV22TestJSON-1556789406 tempest-KeyPairsV22TestJSON-1556789406-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401952609" status: 204 len: 0 microversion: 2.2 time: 0.039168 Jun 25 21:00:56.530325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1301/2358] 10.222.0.39 () {60 vars in 1257 bytes} [Sat Jun 25 21:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401952609 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:57.102377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:57.102983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:57.126399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.127448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.130490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.132233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.270850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:57.286698 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4393d236-bd01-4dcd-9136-6d56ad1251fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1315 microversion: 2.1 time: 1.094734 Jun 25 21:00:57.288364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1058/2359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:56 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1315 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:57.423075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:57.424259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: aa987a9c-ea81-4b09-b4d7-b7fac791d7ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:57.438234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.439146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.441235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.442770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.534559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:57.536707 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] HTTP exception thrown: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Request method failure captured: Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba HTTP/1.1 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dQa1K1ces-Oq7esRF4bqtPu-ZVtLVz06_s8n9sJjOBm1YH5p1Wm_KSKe1NSEtcSFlNIt0vzMUSZdVwTFZ3QXdRwO4TT04RdymyFLHzfK4arGkkYMRhRhGe0AFEVNcunrk_QbunvW639QgwNZwjsURNYNdb_lAIITPZSTdLBSDHVqg Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: efa91ea7b5594fdb9700999e51c0a3e3 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efa91ea7b5594fdb9700999e51c0a3e3"}]}] Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: efa91ea7b5594fdb9700999e51c0a3e3 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-LiveMigrationNegativeTest-697152554-project Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d2012ddfbcf1467f94cdd03f70dc8e79 Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-LiveMigrationNegativeTest-697152554-project Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'aa987a9c-ea81-4b09-b4d7-b7fac791d7ba'} Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:00:57.543489 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. Jun 25 21:00:57.547558 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:00:57.559798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Returning 404 to user: Instance aa987a9c-ea81-4b09-b4d7-b7fac791d7ba could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:00:57.561063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e5293c71-1921-4cad-a233-483eab689524 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.464294 Jun 25 21:00:57.561761 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff841f97-503f-484d-8901-dfd04aa3f68e tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba" status: 404 len: 111 microversion: 2.1 time: 0.149946 Jun 25 21:00:57.562019 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1302/2360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:57 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:57.567231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-258c6ea6-c89c-47b6-a525-bb9e04045423 req-884ff71a-76ba-470e-bd51-260f261cb8fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:57.569656 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1059/2361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:57 2022] GET /compute/v2.1/servers/aa987a9c-ea81-4b09-b4d7-b7fac791d7ba => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:00:57.579258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-258c6ea6-c89c-47b6-a525-bb9e04045423 req-884ff71a-76ba-470e-bd51-260f261cb8fa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.585206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-258c6ea6-c89c-47b6-a525-bb9e04045423 req-884ff71a-76ba-470e-bd51-260f261cb8fa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.614637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:57.624802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-258c6ea6-c89c-47b6-a525-bb9e04045423 req-884ff71a-76ba-470e-bd51-260f261cb8fa service nova] Creating event network-changed:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:00:57.634506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-258c6ea6-c89c-47b6-a525-bb9e04045423 req-884ff71a-76ba-470e-bd51-260f261cb8fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071090 Jun 25 21:00:57.635371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1303/2362] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:00:57.640273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:57.657810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.659197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.660465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.661000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.730646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:00:57.944417 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-25237bfb-5868-4edb-98b3-82ee93aa956d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 204 len: 0 microversion: 2.1 time: 0.369459 Jun 25 21:00:57.944417 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1060/2363] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:00:57 2022] DELETE /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:00:57.952134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:57.952894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:57.963664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.967053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:57.968172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:57.971026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:58.297413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:58.305285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:58.306608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:58.323697 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c6451a67-6724-4764-9103-11b0acbbdf25 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1473 microversion: 2.1 time: 0.377123 Jun 25 21:00:58.324612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1304/2364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:57 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1473 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:58.333351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:58.334120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:58.335163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:58.343194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:58.579586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:58.581598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:58.594129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:58.595042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:58.596417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:58.597331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:58.879608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:58.891406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3e62312-0471-4c5e-8da6-e3e61bc247e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.316633 Jun 25 21:00:58.894298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1305/2365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:58 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:59.151523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-adaca96d-c958-427f-8e1f-a42a79226f9c req-9160fb5c-0229-4297-bc83-ff192effc79c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f130496-e0ba-47fb-a347-f26f1100ec2c", "name": "network-vif-plugged", "status": "completed", "tag": "bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:00:59.175911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-adaca96d-c958-427f-8e1f-a42a79226f9c req-9160fb5c-0229-4297-bc83-ff192effc79c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:59.180607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-adaca96d-c958-427f-8e1f-a42a79226f9c req-9160fb5c-0229-4297-bc83-ff192effc79c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:59.212548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-adaca96d-c958-427f-8e1f-a42a79226f9c req-9160fb5c-0229-4297-bc83-ff192effc79c service nova] Creating event network-vif-plugged:bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8 for instance 4f130496-e0ba-47fb-a347-f26f1100ec2c on nch1-master-1 Jun 25 21:00:59.221002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-adaca96d-c958-427f-8e1f-a42a79226f9c req-9160fb5c-0229-4297-bc83-ff192effc79c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073677 Jun 25 21:00:59.229029 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1306/2366] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:00:59.316279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:59.326273 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e45fb846-a57c-48fd-a156-ced054971bdd tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1315 microversion: 2.1 time: 1.025399 Jun 25 21:00:59.327523 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1061/2367] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:58 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:00:59.343733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:59.344482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:59.360811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:59.361282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:59.366093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:59.366625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:59.752281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:00:59.764614 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2110a42-3758-42f2-95a0-7fcce1c3ca0d tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1473 microversion: 2.1 time: 0.423861 Jun 25 21:00:59.774970 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1307/2368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:59 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1473 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:00:59.911403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:00:59.912027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:00:59.920535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:59.922800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:00:59.924207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:00:59.924969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:00.343978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:00.344886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:00.356126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:00.356837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:00.360950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:00.361639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:00.468176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:00.478773 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d6fe41c-b07c-42be-a894-448f3a9d34e8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.571352 Jun 25 21:01:00.479387 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1062/2369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:00:59 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:00.782931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:00.783597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:00.798094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:00.800869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:00.801871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:00.802463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:00.840282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:00.876221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:00.885205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a544829-1af6-45cd-9902-e04a10e5b4d6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1315 microversion: 2.1 time: 0.545685 Jun 25 21:01:00.897842 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1308/2370] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:00 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1315 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:01.074143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:01.247109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-609225442", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "e7e8ff1a-32de-4ab8-aded-5b18e835949b"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:01.262961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:01.276588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-633fba7e-cc45-4b3b-9aab-99013d3d94a7 tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1473 microversion: 2.1 time: 0.497520 Jun 25 21:01:01.279052 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1063/2371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:00 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1473 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:01.328700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] validate_networks() for [('e7e8ff1a-32de-4ab8-aded-5b18e835949b', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:01.498057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:01.499925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:01.514565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:01.518174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:01.519335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:01.520124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:02.005686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:02.487275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:02.506023 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-10050b11-336a-457c-9a9a-2fd908f2d385 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 1.014232 Jun 25 21:01:02.511536 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1064/2372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:01 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:02.532750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:02.533658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:02.556492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:02.561606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:02.562853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:02.563516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:02.849044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:02.850402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:02.851741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:02.853004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:02.853699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:02.881118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=74,nova_cell0:UPDATE=7 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:02.883815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:02.886291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:02.889883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:02.894195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:02.969483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Getting quotas for project 34a5d7e92e264a74a4be3ad4014a80ff. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:02.981169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Getting quotas for user 19dae0cdb1d54229ac38a3a9b68f7625 and project 34a5d7e92e264a74a4be3ad4014a80ff. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:03.026530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:03.036209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:03.142218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-051c4565-ebf9-42ca-ad1d-d6648490c888 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069910 Jun 25 21:01:03.144064 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1309/2373] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:01:03.159099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:03.162456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:03.180018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:03.182010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:03.184671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:03.186598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:03.302067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2012ddfbcf1467f94cdd03f70dc8e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efa91ea7b5594fdb9700999e51c0a3e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:03.314905 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db6d6f32-5c9e-4f57-aa90-141b6393c04a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 200 len: 1431 microversion: 2.1 time: 0.169599 Jun 25 21:01:03.317874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1310/2374] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:03 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 1431 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:03.334011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e6a3d2f-047e-426f-a3d6-9ce305539400 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:03.335025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e6a3d2f-047e-426f-a3d6-9ce305539400 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:03.706023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e6a3d2f-047e-426f-a3d6-9ce305539400 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:03.716748 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e6a3d2f-047e-426f-a3d6-9ce305539400 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1215 microversion: 2.1 time: 0.397444 Jun 25 21:01:03.718256 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1311/2375] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:03 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:03.734533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-45d8d09d-4050-4f04-80bd-53fd87acec51 req-e43ff66f-157c-4a0e-90de-bffd817ba280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81a9bed-6545-4585-8446-6340cff7fd36", "name": "network-vif-deleted", "tag": "e52fd42e-bb0c-4680-8ddd-1c831de710ed"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:03.759015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-45d8d09d-4050-4f04-80bd-53fd87acec51 req-e43ff66f-157c-4a0e-90de-bffd817ba280 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:03.759472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-45d8d09d-4050-4f04-80bd-53fd87acec51 req-e43ff66f-157c-4a0e-90de-bffd817ba280 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:03.786595 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-45d8d09d-4050-4f04-80bd-53fd87acec51 req-e43ff66f-157c-4a0e-90de-bffd817ba280 service nova] Creating event network-vif-deleted:e52fd42e-bb0c-4680-8ddd-1c831de710ed for instance b81a9bed-6545-4585-8446-6340cff7fd36 on nch2-master-1 Jun 25 21:01:03.799807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-45d8d09d-4050-4f04-80bd-53fd87acec51 req-e43ff66f-157c-4a0e-90de-bffd817ba280 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077000 Jun 25 21:01:03.800952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1312/2376] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:03.817472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:03.818324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:03.837586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:03.838467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:03.840258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:03.842053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:04.040679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:04.049008 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6caf683-1f9e-4e3a-8dbe-b635a065b5df tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1501 microversion: 2.1 time: 1.535548 Jun 25 21:01:04.049629 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1065/2377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:02 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1501 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:04.189283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:04.207954 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d283267c-5a84-402b-85f7-dbec616243f4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.402582 Jun 25 21:01:04.210048 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1313/2378] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:03 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:04.337143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:04.338063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] [instance: b81a9bed-6545-4585-8446-6340cff7fd36] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:04.349956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:04.354828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:04.355964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:04.356903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:04.401692 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] HTTP exception thrown: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Request method failure captured: Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 HTTP/1.1 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dQa1K1ces-Oq7esRF4bqtPu-ZVtLVz06_s8n9sJjOBm1YH5p1Wm_KSKe1NSEtcSFlNIt0vzMUSZdVwTFZ3QXdRwO4TT04RdymyFLHzfK4arGkkYMRhRhGe0AFEVNcunrk_QbunvW639QgwNZwjsURNYNdb_lAIITPZSTdLBSDHVqg Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: efa91ea7b5594fdb9700999e51c0a3e3 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_efa91ea7b5594fdb9700999e51c0a3e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/efa91ea7b5594fdb9700999e51c0a3e3"}]}] Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: efa91ea7b5594fdb9700999e51c0a3e3 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-697152554 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-LiveMigrationNegativeTest-697152554-project Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d2012ddfbcf1467f94cdd03f70dc8e79 Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-LiveMigrationNegativeTest-697152554-project Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'b81a9bed-6545-4585-8446-6340cff7fd36'} Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:04.403785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. Jun 25 21:01:04.407603 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:04.415312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] Returning 404 to user: Instance b81a9bed-6545-4585-8446-6340cff7fd36 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:04.424766 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7800b17-a8ee-4399-854b-9fee2c96ef9a tempest-LiveMigrationNegativeTest-697152554 tempest-LiveMigrationNegativeTest-697152554-project] 10.222.0.39 "GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36" status: 404 len: 111 microversion: 2.1 time: 0.084106 Jun 25 21:01:04.426141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1066/2379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:04 2022] GET /compute/v2.1/servers/b81a9bed-6545-4585-8446-6340cff7fd36 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:04.740001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:04.741559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:04.758052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:04.758517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:04.772011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:04.777387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:04.856052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:04.961271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:04.972347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abc0edce-8614-41c4-9a8d-d84659bd05c8 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1267 microversion: 2.1 time: 0.239831 Jun 25 21:01:04.973590 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1314/2380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:04 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:05.232177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:05.237445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:05.253452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:05.254531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:05.255829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:05.258700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:05.931180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06f3ff0b-ee4d-4e7f-9630-106497046641"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:05.933177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:05.942126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:05.943434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:05.944702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:05.945350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:06.136096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:06.336071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:06.353880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2736086e-c32f-4b60-8f5e-820f516900bf tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 1.131263 Jun 25 21:01:06.365019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1067/2381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:05 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:06.378790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:06.379420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:06.409415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:06.409884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:06.412211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:06.412762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:06.501421 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd6fab37-7faa-4789-bd20-d02e48d52fc3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.574189 Jun 25 21:01:06.509748 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1315/2382] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:01:05 2022] POST /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c/os-volume_attachments => generated 194 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:01:06.926070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:06.947382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a13d2b1e-ff47-4092-b44d-11a66e6f66f3 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1273 microversion: 2.1 time: 0.572644 Jun 25 21:01:06.955920 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1068/2383] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:06 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1273 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:07.372288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:07.373075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:07.386583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:07.387060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:07.389979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:07.393843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:07.972818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:07.974213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:07.989645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:07.990456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:07.991646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:07.992307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:08.064633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:08.077311 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5197ffda-1caf-4dc2-b6ed-da58459305a8 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.710170 Jun 25 21:01:08.095734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1316/2384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:07 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:08.318883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:08.338163 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a6289b82-228e-495f-b674-39ad5be1d734 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1273 microversion: 2.1 time: 0.369326 Jun 25 21:01:08.353277 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1069/2385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:07 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:09.102458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:09.103750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:09.114999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:09.119171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:09.120257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:09.123074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:09.441420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:09.455026 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3819ed6-9fc8-49e1-b7c7-a92b37abf7ff tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.357819 Jun 25 21:01:09.457656 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1317/2386] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:09 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:09.473295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:09.475666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:09.500780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:09.501629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:09.502787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:09.503889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:09.789850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1133709444", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "aeee49d1-e28e-4b59-b155-c17b43a227a5"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:09.903926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] validate_networks() for [('aeee49d1-e28e-4b59-b155-c17b43a227a5', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:09.912015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:09.923165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-82636575-a206-4f60-87fe-9dc459e245fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 0.459260 Jun 25 21:01:09.931398 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1318/2387] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:09 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:10.374725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1480916886", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:10.383012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:10.441349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:11.011277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:11.015838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:11.016568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:11.017166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:11.017806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:11.035498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.036285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.044456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.045299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.091240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:11.097281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:11.121241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:11.124458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:11.220727 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ada9a04-3cb5-4c8f-9384-a65e0bf10aed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.985490 Jun 25 21:01:11.223115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1319/2388] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:01:11.235589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:11.237764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:11.256321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.258473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.259587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.271766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.620171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:11.621366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:11.622206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:11.624656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:11.626149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:11.641429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.643112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.644853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.646116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.679783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Getting quotas for project 13f32fd4885a4850996d1208dc1bcbba. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:11.699811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Getting quotas for user 18b8e3ac2c484ae49e678ef734b52e99 and project 13f32fd4885a4850996d1208dc1bcbba. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:11.730309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:11.731622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:11.733736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:11.746027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65d3ee35-2c02-4594-8785-bd00c31df65b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.521525 Jun 25 21:01:11.759531 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1320/2389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:11 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:11.779051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:11.781929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:11.799910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.801741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.807265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:11.809394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:11.871965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f3fed28-a563-4748-9729-faa6c52587e5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.628542 Jun 25 21:01:11.874971 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1070/2390] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:01:11.892344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64868b45-1c6d-4007-b9b7-df4df2d8adbc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:11.897903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64868b45-1c6d-4007-b9b7-df4df2d8adbc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:12.216460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64868b45-1c6d-4007-b9b7-df4df2d8adbc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:12.227981 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64868b45-1c6d-4007-b9b7-df4df2d8adbc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1213 microversion: 2.1 time: 0.349291 Jun 25 21:01:12.233528 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1071/2391] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:11 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1213 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:12.262856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:12.263409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:12.281430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:12.295004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78bf0cfe-c8f9-43bc-9862-eed13154fd2a tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 0.532770 Jun 25 21:01:12.309071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:12.309706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:12.310628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:12.311056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:12.321778 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1321/2392] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:11 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:12.343657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fd0be8de-35d7-4487-8bcc-c8ed84430bfb req-dcda1d06-ff04-4bf6-839b-f8176ba6bb81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-plugged", "status": "completed", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:12.369661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fd0be8de-35d7-4487-8bcc-c8ed84430bfb req-dcda1d06-ff04-4bf6-839b-f8176ba6bb81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:12.370375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fd0be8de-35d7-4487-8bcc-c8ed84430bfb req-dcda1d06-ff04-4bf6-839b-f8176ba6bb81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:12.388914 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fd0be8de-35d7-4487-8bcc-c8ed84430bfb req-dcda1d06-ff04-4bf6-839b-f8176ba6bb81 service nova] Creating event network-vif-plugged:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:01:12.401855 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fd0be8de-35d7-4487-8bcc-c8ed84430bfb req-dcda1d06-ff04-4bf6-839b-f8176ba6bb81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072789 Jun 25 21:01:12.404507 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1322/2393] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:12.437621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:01:12.457506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6fcd7f71-e836-4814-b402-a91cb8bd0730 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:12.466433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6fcd7f71-e836-4814-b402-a91cb8bd0730 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:12.690687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd0866e1-6b06-42cb-83af-47d0b1ca6864 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 204 len: 0 microversion: 2.1 time: 0.455813 Jun 25 21:01:12.692250 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1072/2394] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:12 2022] DELETE /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:12.702039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:12.703112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:12.715161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:12.731556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:12.750704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:12.753880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:12.869241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6fcd7f71-e836-4814-b402-a91cb8bd0730 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:12.886230 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6fcd7f71-e836-4814-b402-a91cb8bd0730 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1216 microversion: 2.1 time: 0.455227 Jun 25 21:01:12.887257 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1323/2395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:12 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1216 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:13.102562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1769537177", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:13.249641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] validate_networks() for [('e6c48141-958b-44ae-a71f-6d79ebb54dbf', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:13.582665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:13.595546 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cec384eb-e2fc-4f23-b835-f7123ea1b52d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1553 microversion: 2.1 time: 0.897580 Jun 25 21:01:13.635486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1073/2396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:12 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1553 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:13.660217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:13.668723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:13.680507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:13.681282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:13.682745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:13.683368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.127376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:14.139382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b25482ce-c167-417b-a526-1770d19073a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1317 microversion: 2.1 time: 0.502381 Jun 25 21:01:14.143391 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1074/2397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:13 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:14.148736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4448f0a3-7373-4ced-84b6-96ab5d18d59f req-83d2e70d-5d20-484c-9dab-186d3cedefbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8bfa6ec-4c86-48de-9b06-a883dcd71627", "tag": "e2dcb82e-9819-4694-9f48-d9c2189f2c54"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:14.175339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4448f0a3-7373-4ced-84b6-96ab5d18d59f req-83d2e70d-5d20-484c-9dab-186d3cedefbe service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.176808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4448f0a3-7373-4ced-84b6-96ab5d18d59f req-83d2e70d-5d20-484c-9dab-186d3cedefbe service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.204271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4448f0a3-7373-4ced-84b6-96ab5d18d59f req-83d2e70d-5d20-484c-9dab-186d3cedefbe service nova] Creating event network-changed:e2dcb82e-9819-4694-9f48-d9c2189f2c54 for instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 on nch1-master-1 Jun 25 21:01:14.221320 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4448f0a3-7373-4ced-84b6-96ab5d18d59f req-83d2e70d-5d20-484c-9dab-186d3cedefbe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076001 Jun 25 21:01:14.222582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1075/2398] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:14.229597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:14.230561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:14.249990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.250780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.253490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.255311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.468404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:14.480584 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e0c538f-e951-4bf5-904f-24306f71d522 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1271 microversion: 2.1 time: 0.256420 Jun 25 21:01:14.481200 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1076/2399] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:14 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1271 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:14.502437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:14.503363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:14.510784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.511460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.512404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.513104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.530183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:14.531301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:14.532017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:14.532650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:14.533339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:14.547640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.549983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.557802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.558513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.580676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:14.586265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for user a6a15dadfd0448fab9e84a89173ed7d1 and project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:14.603369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:14.606130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:14.683300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-818a15fe-201f-46c0-847b-c13ea280efc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.783240 Jun 25 21:01:14.685321 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1324/2400] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:14.703750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:14.705573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:14.722939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.724218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.725811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.730232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.922808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:14.937858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cae45aba-1111-4dd1-acac-993b99b8de5b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1268 microversion: 2.1 time: 0.243898 Jun 25 21:01:14.941606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1325/2401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:14 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1268 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:14.953333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:14.956612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:14.971366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.973944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:14.975930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:14.977416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:15.553124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:15.566023 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a6df529-6cf4-47f5-981f-cf65a8f11aee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1553 microversion: 2.1 time: 0.621753 Jun 25 21:01:15.568750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1326/2402] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:14 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1553 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:15.575628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11b99881-344c-42a5-8b6a-5adc868a88e2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:15.576491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11b99881-344c-42a5-8b6a-5adc868a88e2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:15.763398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11b99881-344c-42a5-8b6a-5adc868a88e2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:15.777330 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11b99881-344c-42a5-8b6a-5adc868a88e2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1222 microversion: 2.1 time: 0.205979 Jun 25 21:01:15.779905 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1327/2403] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:15 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:15.826463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:15.827135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:15.852354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:15.852845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:15.853640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:15.860452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:15.941128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:15.956677 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-725dc626-b34f-4f4a-a012-e67f3d7233c4 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 1.472309 Jun 25 21:01:15.973178 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1077/2404] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:14 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:15.980409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:15.991401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:16.000616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:16.001518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:16.002622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:16.003280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:16.522964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:16.537762 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07de9f80-83e0-4699-ba6b-fd4b3143a12d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1271 microversion: 2.1 time: 0.563108 Jun 25 21:01:16.539546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1078/2405] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:15 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1271 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:16.555708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-541077458", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:16.689476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] validate_networks() for [('e6c48141-958b-44ae-a71f-6d79ebb54dbf', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:16.737443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:16.747731 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2023445a-7c33-4947-9d11-0e79e7c368ab tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1467 microversion: 2.1 time: 0.965798 Jun 25 21:01:16.764323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1328/2406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:15 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1467 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:16.770755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:16.771713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:16.783023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:16.784106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:16.785258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:16.785925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:17.427732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:17.444830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e77759a6-3196-4b51-b579-a364d3197495 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.678608 Jun 25 21:01:17.445432 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1329/2407] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:16 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:17.464171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:17.467905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:17.486633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:17.487303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:17.488383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:17.489866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.030273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:18.043969 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-122b1c6b-0be2-41b5-ae3e-d1564330f8f2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 200 len: 1346 microversion: 2.1 time: 0.588511 Jun 25 21:01:18.044865 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1330/2408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:17 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 1346 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:18.054458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-925158266", "metadata": {"image_type": "test"}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:18.055675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:18.080297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.085125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.089780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.090426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.215249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Getting quotas for project aa04ed2c6ea14438b506a2b7f4e3f377. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:18.228041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Getting quotas for user 5a80f9c350664a839bdada41c1973b1e and project aa04ed2c6ea14438b506a2b7f4e3f377. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:18.391555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:18.392533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:18.393226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:18.393847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:18.394468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:18.417698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.418534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.419822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.420267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.463338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:18.474707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for user a6a15dadfd0448fab9e84a89173ed7d1 and project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:18.516503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:18.526112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:18.574752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:18.716690 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c7ca5c0e-2cbe-41bf-affd-36c8f61bfd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.175474 Jun 25 21:01:18.729922 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1079/2409] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:18.766526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:18.767726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:18.808099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.808644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.809530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.809932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:18.868295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:18.891605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-866e0362-e6a2-40a7-906f-3bf5e9af7f4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "POST /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d/action" status: 202 len: 0 microversion: 2.1 time: 0.843436 Jun 25 21:01:18.910141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1331/2410] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:01:18 2022] POST /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d/action => generated 0 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:01:18.923865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-65e81075-9708-4844-ac9b-9e98d8dcabe8 req-3bcec8cc-eba3-45ba-a195-aea99102e86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f130496-e0ba-47fb-a347-f26f1100ec2c", "name": "network-vif-deleted", "tag": "bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:18.963533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-65e81075-9708-4844-ac9b-9e98d8dcabe8 req-3bcec8cc-eba3-45ba-a195-aea99102e86d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:18.965117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-65e81075-9708-4844-ac9b-9e98d8dcabe8 req-3bcec8cc-eba3-45ba-a195-aea99102e86d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.002515 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-65e81075-9708-4844-ac9b-9e98d8dcabe8 req-3bcec8cc-eba3-45ba-a195-aea99102e86d service nova] Creating event network-vif-deleted:bd7e4c1e-0bc7-414a-a72d-f4940b94a1f8 for instance 4f130496-e0ba-47fb-a347-f26f1100ec2c on nch1-master-1 Jun 25 21:01:19.023724 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-65e81075-9708-4844-ac9b-9e98d8dcabe8 req-3bcec8cc-eba3-45ba-a195-aea99102e86d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111723 Jun 25 21:01:19.024468 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1332/2411] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:19.029714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:19.030411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:19.074832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.079133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.080092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.080712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.413056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:19.436701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-255902ae-336e-4aae-869d-f924c58358f1 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 0.704241 Jun 25 21:01:19.451687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1080/2412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:18 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:19.582152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79a26a25-6b92-45ee-b99d-dc4d1158d89a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Action: 'create', calling method: .version_select at 0x7f985c437160>, body: {"keypair": {"name": "tempest-keypair-984844796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxeVKIMWkxrmn93CbHx6owFcmGqrkXMqI9SRlyGF+GdpFX2RY8et8tvcRz7YZi5uZeJoIQDwHHY4LILtH3MPkgOnzSRyX3soQz2I93xIXmA/AjtoyJfrnsZCvKd2MxHYw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:19.607464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-79a26a25-6b92-45ee-b99d-dc4d1158d89a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for project 7f998f8bc87c4e009254746816812231. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:19.616249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-79a26a25-6b92-45ee-b99d-dc4d1158d89a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for user f9abc0f22f944a95a70b23e50bafdccb and project 7f998f8bc87c4e009254746816812231. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:19.664568 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79a26a25-6b92-45ee-b99d-dc4d1158d89a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.218199 Jun 25 21:01:19.666075 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1081/2413] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:01:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:19.679512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:19.680879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:19.700047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.700781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.702030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.702953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.767690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:19.791929 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-95f411a7-e648-4484-95b9-9a95b1ca337f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.764827 Jun 25 21:01:19.804968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1333/2414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:19 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:19.810495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:19.821272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:19.833994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.835221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:19.836211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:19.837053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.034645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:20.046313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8abdd75f-ba35-4f4a-a6bf-36b8da6cfb8d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1217 microversion: 2.1 time: 0.239540 Jun 25 21:01:20.046971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1334/2415] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:19 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1217 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:20.060124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de74a474-3c5f-4eb2-b5e2-b9c150347254 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ee041f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:20.147287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de74a474-3c5f-4eb2-b5e2-b9c150347254 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.099176 Jun 25 21:01:20.153473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1335/2416] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:20 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:20.160378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:20.160983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:20.187467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.193155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.194234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.198149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.234179 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c HTTP/1.1 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '4f130496-e0ba-47fb-a347-f26f1100ec2c'} Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:20.239400 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.244051 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.245414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:20.246461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc8c2117-7090-48ec-897d-7925fd59162d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 404 len: 111 microversion: 2.1 time: 0.091961 Jun 25 21:01:20.247208 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1336/2417] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:20 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:20.463156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:20.464115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:20.484395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.488227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.493530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.494196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.772597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:20.797637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7426334-fb96-4903-8339-ed006db0790c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 1.127553 Jun 25 21:01:20.829681 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1082/2418] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:19 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:20.844677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:20.846143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:20.865882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.866580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.867578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.868146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.895147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:20.898091 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c/os-volume_attachments HTTP/1.1 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '4f130496-e0ba-47fb-a347-f26f1100ec2c'} Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:20.906992 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:01:20.911822 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:20.916276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:20.918315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-710bb575-6751-447f-bc8e-2e306f85df18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086024 Jun 25 21:01:20.921444 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1083/2419] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:01:20 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c/os-volume_attachments => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:20.937858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:20.942712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:20.971860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.973696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:20.974694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:20.976979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.543726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:21.557292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79c5a194-f39b-446a-9590-a7e259622edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.634416 Jun 25 21:01:21.560582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1084/2420] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:20 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:21.562034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:21.574107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:21.575787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3640c5ba-9080-41b7-b57c-641ee792b423 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 1.117609 Jun 25 21:01:21.586305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:21.586907 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1337/2421] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:20 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:21.590576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0a77f80f-dbc9-40e0-968a-757147316769 req-54fac788-7211-457f-9e35-957124600b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:21.600173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0a77f80f-dbc9-40e0-968a-757147316769 req-54fac788-7211-457f-9e35-957124600b31 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.600715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0a77f80f-dbc9-40e0-968a-757147316769 req-54fac788-7211-457f-9e35-957124600b31 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.603407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.606094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.607982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.608931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.617878 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0a77f80f-dbc9-40e0-968a-757147316769 req-54fac788-7211-457f-9e35-957124600b31 service nova] Creating event network-changed:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch2-master-1 Jun 25 21:01:21.624789 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0a77f80f-dbc9-40e0-968a-757147316769 req-54fac788-7211-457f-9e35-957124600b31 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039192 Jun 25 21:01:21.627409 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1338/2422] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:21.633768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0d21681-e389-4b32-a08b-f10b8422c7a0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ee04af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:21.722309 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0d21681-e389-4b32-a08b-f10b8422c7a0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.093002 Jun 25 21:01:21.723639 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1339/2423] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:21 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:21.735240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-617808935", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:21.791914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:21.800448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb5d4667-e22d-4647-b849-9bee3cf303d7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1279 microversion: 2.1 time: 0.238408 Jun 25 21:01:21.810254 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1085/2424] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:21 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:21.817521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cb822ad0-c706-400d-96c7-d94b28f87a0f req-9e2c2c17-59e9-4dcd-ba13-65f0c4e5b8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777ed7af-f188-4a90-86f6-85737666f7cb", "tag": "8005a3c3-3fa4-422a-ab92-55172ec1caf1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:21.840382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cb822ad0-c706-400d-96c7-d94b28f87a0f req-9e2c2c17-59e9-4dcd-ba13-65f0c4e5b8f5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.849936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:21.856170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cb822ad0-c706-400d-96c7-d94b28f87a0f req-9e2c2c17-59e9-4dcd-ba13-65f0c4e5b8f5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.892149 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cb822ad0-c706-400d-96c7-d94b28f87a0f req-9e2c2c17-59e9-4dcd-ba13-65f0c4e5b8f5 service nova] Creating event network-changed:8005a3c3-3fa4-422a-ab92-55172ec1caf1 for instance 777ed7af-f188-4a90-86f6-85737666f7cb on nch2-master-1 Jun 25 21:01:21.900921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cb822ad0-c706-400d-96c7-d94b28f87a0f req-9e2c2c17-59e9-4dcd-ba13-65f0c4e5b8f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093439 Jun 25 21:01:21.901573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1086/2425] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:21.917313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:21.945457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:21.954440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.957594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:21.961964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:21.962635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.409978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:22.428236 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0908ea4-c8a5-4694-9fe2-a096be6e58f5 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.518614 Jun 25 21:01:22.433306 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1087/2426] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:21 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:22.440146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ff110275-f93f-40f9-864e-7aaffc5f0c67 req-aab81b49-48f9-4793-ba32-55ec9cba0d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bfa6ec-4c86-48de-9b06-a883dcd71627", "name": "network-vif-plugged", "status": "completed", "tag": "e2dcb82e-9819-4694-9f48-d9c2189f2c54"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:22.465602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ff110275-f93f-40f9-864e-7aaffc5f0c67 req-aab81b49-48f9-4793-ba32-55ec9cba0d0e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:22.476023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ff110275-f93f-40f9-864e-7aaffc5f0c67 req-aab81b49-48f9-4793-ba32-55ec9cba0d0e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.496979 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ff110275-f93f-40f9-864e-7aaffc5f0c67 req-aab81b49-48f9-4793-ba32-55ec9cba0d0e service nova] Creating event network-vif-plugged:e2dcb82e-9819-4694-9f48-d9c2189f2c54 for instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 on nch1-master-1 Jun 25 21:01:22.503245 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ff110275-f93f-40f9-864e-7aaffc5f0c67 req-aab81b49-48f9-4793-ba32-55ec9cba0d0e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068648 Jun 25 21:01:22.504602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1088/2427] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:22.575703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:22.576480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:22.586871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:22.591484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.592670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:22.601703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.917611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:22.918855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:22.919805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:22.920612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:22.923327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:22.938732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:22.939561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.940766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:22.941220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:22.963162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:22.969423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:22.983953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:22.986521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:23.089079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4b8486f-391c-49b1-8ea7-f4aed4ef12d1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363126 Jun 25 21:01:23.090119 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1340/2428] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:23.100774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.101386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:23.136321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.136812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.137596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.138048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.446917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:23.464175 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89bbcc87-3878-4d28-b102-f90aa41e14aa tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 0.372978 Jun 25 21:01:23.468749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1341/2429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:23 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:23.490190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52a537d9-79b3-43b9-806b-2832395edecb tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef77b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.580181 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52a537d9-79b3-43b9-806b-2832395edecb tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.110085 Jun 25 21:01:23.585362 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1342/2430] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:23 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:23.590756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.592152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:23.599297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.599935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.601058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.601972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.690928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:23.703834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f8cc94e-dc67-403f-81f6-803a5bede989 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1279 microversion: 2.1 time: 0.117023 Jun 25 21:01:23.715376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1343/2431] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:23 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:23.722133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4449bef3-5e67-40fe-820e-5f6fae92e131 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.722750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4449bef3-5e67-40fe-820e-5f6fae92e131 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:23.734904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:23.802373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4449bef3-5e67-40fe-820e-5f6fae92e131 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:23.812336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4449bef3-5e67-40fe-820e-5f6fae92e131 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e" status: 200 len: 1214 microversion: 2.1 time: 0.095152 Jun 25 21:01:23.816955 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1344/2432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:23 2022] GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:23.826703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.828300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:23.843894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.844621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.845692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.847202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.894962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:23.917226 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb35abf4-f0a0-429f-9e9e-a28f1c29a92e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 1.345593 Jun 25 21:01:23.921041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1089/2433] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:22 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:23.933588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:23.934855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:23.955564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.957415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:23.960626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:23.961325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:24.006823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:01:24.024241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:24.024985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:24.096209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'flavor' on Instance uuid 208e5ac3-fb1b-4b65-a587-c87e366c7c9e {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:01:24.179177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:24.201867 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc321530-000b-4ba0-b120-bc95ae844ed8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.382852 Jun 25 21:01:24.203773 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1345/2434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:23 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:24.240375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'system_metadata' on Instance uuid 208e5ac3-fb1b-4b65-a587-c87e366c7c9e {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:01:24.356283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'metadata' on Instance uuid 208e5ac3-fb1b-4b65-a587-c87e366c7c9e {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:01:24.484346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:24.485082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:24.507606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:24.508517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:24.509927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:24.510711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:24.940706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:24.952627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa26a81c-6eb4-42e9-9226-269b3117ae08 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1315 microversion: 2.1 time: 0.471530 Jun 25 21:01:24.972836 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1346/2435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:24 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:24.979279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-635c3fbe-66ba-483a-8942-3b1b3ab439c0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef1f1f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:25.047418 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-635c3fbe-66ba-483a-8942-3b1b3ab439c0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.069097 Jun 25 21:01:25.056957 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1347/2436] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:24 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:25.072718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:25.078150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:25.103064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.105384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.107360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.109385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.152534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.scheduler.client.report [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Deleted allocations for instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e Jun 25 21:01:25.177813 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a5fa255-c299-4602-9620-af4888911af3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e" status: 204 len: 0 microversion: 2.1 time: 1.255212 Jun 25 21:01:25.178930 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1090/2437] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:23 2022] DELETE /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:25.201565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:25.202278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:25.210444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.211239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.212259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.212965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.637205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:25.645590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab7085a0-4420-43e9-a386-2610a67acc6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.587807 Jun 25 21:01:25.648299 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1348/2438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:25 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:25.660019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:25.660707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:25.681147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.682745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.683738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.684448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.707741 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e HTTP/1.1 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '208e5ac3-fb1b-4b65-a587-c87e366c7c9e'} Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:25.709647 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0535f6d7-9001-48a1-85bf-0ece74accfce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e" status: 404 len: 111 microversion: 2.1 time: 0.057954 Jun 25 21:01:25.713325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1349/2439] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:25 2022] GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:25.726992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:25.727653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:25.746245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.749495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.750386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.750845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.849164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:25.857334 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da1abedf-2d50-41e8-9405-49711e3d091c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.668597 Jun 25 21:01:25.858410 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1091/2440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:25 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:25.863412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-24a47b67-6f2f-4df2-b701-c6123281b5dd req-336109a9-e063-4581-bd65-7567c907fc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a104cd86-0a2f-45ec-8047-c581153d539c", "tag": "91391f5e-59e8-41e4-8093-05cdb502d33b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:25.871690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-24a47b67-6f2f-4df2-b701-c6123281b5dd req-336109a9-e063-4581-bd65-7567c907fc22 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:25.872355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-24a47b67-6f2f-4df2-b701-c6123281b5dd req-336109a9-e063-4581-bd65-7567c907fc22 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:25.885000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-24a47b67-6f2f-4df2-b701-c6123281b5dd req-336109a9-e063-4581-bd65-7567c907fc22 service nova] Creating event network-changed:91391f5e-59e8-41e4-8093-05cdb502d33b for instance a104cd86-0a2f-45ec-8047-c581153d539c on nch1-master-1 Jun 25 21:01:25.890722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-24a47b67-6f2f-4df2-b701-c6123281b5dd req-336109a9-e063-4581-bd65-7567c907fc22 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030627 Jun 25 21:01:25.891340 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1092/2441] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:25.896860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1497833636", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:25.960401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:26.020152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:26.029008 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9e7a402-6dae-4803-b19d-d31b95964438 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.315044 Jun 25 21:01:26.039314 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1350/2442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:25 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:26.039314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.039314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:26.042288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.042421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.043223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.043624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.268900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:26.281787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16d5a407-6236-4fbd-94f7-b84812cea465 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1504 microversion: 2.1 time: 0.251031 Jun 25 21:01:26.283055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1351/2443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:26 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:26.298856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0d5f51e-f641-4890-b8ee-e54b54a8f4f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ed691f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.370967 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0d5f51e-f641-4890-b8ee-e54b54a8f4f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.086460 Jun 25 21:01:26.374326 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1352/2444] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:26 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:26.386499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.392991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:26.402143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.403109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.404064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.404859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.508401 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-451656d6-c8de-4205-80d6-5d1b42d1bc47 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.132707 Jun 25 21:01:26.509854 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1353/2445] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 21:01:26 2022] DELETE /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627/os-server-password => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:26.521358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.521869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:26.531444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.533424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.534602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.536762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.602780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7976c3a3-d16a-4751-84c6-7b5a765289fd tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.086751 Jun 25 21:01:26.608214 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1354/2446] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:01:26 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627/os-server-password => generated 16 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:01:26.608632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6fe5f788-74e1-43af-acaa-0445b8ef7028 req-3d4b1e53-ab67-45f5-9e41-70a5c35ae1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-plugged", "status": "completed", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:26.621810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6fe5f788-74e1-43af-acaa-0445b8ef7028 req-3d4b1e53-ab67-45f5-9e41-70a5c35ae1b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.622260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6fe5f788-74e1-43af-acaa-0445b8ef7028 req-3d4b1e53-ab67-45f5-9e41-70a5c35ae1b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.654282 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6fe5f788-74e1-43af-acaa-0445b8ef7028 req-3d4b1e53-ab67-45f5-9e41-70a5c35ae1b3 service nova] Creating event network-vif-plugged:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:01:26.677773 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6fe5f788-74e1-43af-acaa-0445b8ef7028 req-3d4b1e53-ab67-45f5-9e41-70a5c35ae1b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070919 Jun 25 21:01:26.678992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1355/2447] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:26.694907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.695565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:26.721692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.722379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.723390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.724238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.764509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:01:26.819298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:INSERT=5,nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:26.934384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f26855a-4693-4029-9b53-c8d104eba04e tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 204 len: 0 microversion: 2.1 time: 0.252267 Jun 25 21:01:26.936271 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1356/2448] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:26 2022] DELETE /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:26.945167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:26.947497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:26.956798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.959010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.959910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:26.960592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:26.981539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:26.982607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:26.983301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:26.983813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:26.984323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:27.007227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.007830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.008765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.009369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.034205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:27.040632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:27.073015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:27.075816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:27.143288 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ca719fd-66f6-4925-99d0-cea439b43de4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250464 Jun 25 21:01:27.148921 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1093/2449] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:27.161711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d72bc2c4-c6ea-45c0-b153-d6b06d924f8e req-a8addc1e-e0e9-4026-9078-093f99a2755b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49fe50b3-4f75-49b0-af3d-53f105e5f46e", "tag": "73e60ca6-2575-4b82-a46d-2aab07dd0f70"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:27.170716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:27.185440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d72bc2c4-c6ea-45c0-b153-d6b06d924f8e req-a8addc1e-e0e9-4026-9078-093f99a2755b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.186262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d72bc2c4-c6ea-45c0-b153-d6b06d924f8e req-a8addc1e-e0e9-4026-9078-093f99a2755b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.187833 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-defd5e1f-627a-4c89-9339-75985a471dd9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.249562 Jun 25 21:01:27.200291 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1357/2450] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:26 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:27.207042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:27.217249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:27.233887 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d72bc2c4-c6ea-45c0-b153-d6b06d924f8e req-a8addc1e-e0e9-4026-9078-093f99a2755b service nova] Creating event network-changed:73e60ca6-2575-4b82-a46d-2aab07dd0f70 for instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e on nch1-master-1 Jun 25 21:01:27.237019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.237859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.238957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.239578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.246609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d72bc2c4-c6ea-45c0-b153-d6b06d924f8e req-a8addc1e-e0e9-4026-9078-093f99a2755b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096244 Jun 25 21:01:27.247726 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1094/2451] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:27.255093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:27.257368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:27.266684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.267430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.268389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.269348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.461490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:27.474004 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c27e520-e71a-4952-8186-06abf16dcb00 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1510 microversion: 2.1 time: 0.224335 Jun 25 21:01:27.485184 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1095/2452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:27 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:27.490642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:27.498130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:27.500892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:27.509882 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78625056-8c5a-4f29-a791-9762e583a36a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.307762 Jun 25 21:01:27.512730 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1358/2453] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:27 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:27.520100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.521057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.522070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:27.523505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:27.531581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-737be0fe-8c5c-4e0e-8038-64277fec7542 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:27.532211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-737be0fe-8c5c-4e0e-8038-64277fec7542 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:27.615182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-737be0fe-8c5c-4e0e-8038-64277fec7542 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:27.622415 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-737be0fe-8c5c-4e0e-8038-64277fec7542 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1215 microversion: 2.1 time: 0.108582 Jun 25 21:01:27.623226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1359/2454] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:27 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:27.639944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1fe232b-e23a-4b72-a2c8-fad3c1c68f37 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ee04a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:27.730765 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1fe232b-e23a-4b72-a2c8-fad3c1c68f37 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.096016 Jun 25 21:01:27.732568 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1360/2455] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:27 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:27.837263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:27.851568 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f1aa6f4-01aa-470e-8301-91f12e3f2ce8 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.361472 Jun 25 21:01:27.853897 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1096/2456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:27 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:28.219781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:28.220900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:28.251664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.257623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:28.258825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.260754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:28.491696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:28.492299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:28.500106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.501343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:28.502218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.502659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:28.653401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:28.663525 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d37299df-3b42-4e1b-9e3a-649c0e8e0e3c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.450137 Jun 25 21:01:28.668538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1361/2457] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:28 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:28.686856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:28.687875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:28.695242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.695708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:28.700090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:28.700646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.173342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:29.201379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88e13341-8392-4a3e-93b6-2b599aedfdb6 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1510 microversion: 2.1 time: 0.713681 Jun 25 21:01:29.217981 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1097/2458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:28 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1510 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:29.234845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:29.238246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:29.261473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:29.263857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.265081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:29.267461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.416804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:29.426562 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a2f9aa1-425c-42a1-b961-1921ca4031c1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1273 microversion: 2.1 time: 0.205960 Jun 25 21:01:29.432723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1098/2459] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:29 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1273 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:29.444390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51bac354-1282-47be-8975-38bd11aedc92 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fcedf70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:29.517683 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51bac354-1282-47be-8975-38bd11aedc92 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.083483 Jun 25 21:01:29.522504 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1099/2460] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:29 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:29.531363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:29.537362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:29.550011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:29.550672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.553723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:29.554439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.588819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:29.595561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:29.609326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-411f11a5-fd0f-46d6-9eb5-1e1e5962b2e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.939407 Jun 25 21:01:29.610040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1362/2461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:28 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:29.624467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-955f8e3b-4876-44fb-83ca-ae6a0f347521 req-70b8120d-e183-4112-8c73-089d882414f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777ed7af-f188-4a90-86f6-85737666f7cb", "name": "network-vif-plugged", "status": "completed", "tag": "8005a3c3-3fa4-422a-ab92-55172ec1caf1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:29.648923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-955f8e3b-4876-44fb-83ca-ae6a0f347521 req-70b8120d-e183-4112-8c73-089d882414f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:29.649387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-955f8e3b-4876-44fb-83ca-ae6a0f347521 req-70b8120d-e183-4112-8c73-089d882414f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:29.674745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-955f8e3b-4876-44fb-83ca-ae6a0f347521 req-70b8120d-e183-4112-8c73-089d882414f8 service nova] Creating event network-vif-plugged:8005a3c3-3fa4-422a-ab92-55172ec1caf1 for instance 777ed7af-f188-4a90-86f6-85737666f7cb on nch2-master-1 Jun 25 21:01:29.694408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-955f8e3b-4876-44fb-83ca-ae6a0f347521 req-70b8120d-e183-4112-8c73-089d882414f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073506 Jun 25 21:01:29.694956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1363/2462] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:29.703878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-411224222", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "76549714-6760-43fd-ac6a-c8767b720a66"}], "security_groups": [{"name": "tempest-securitygroup--1870494430"}], "key_name": "tempest-keypair-984844796", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9c586065-2b39-4ffe-b34f-cbd319f8cac0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:29.946403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] validate_networks() for [('76549714-6760-43fd-ac6a-c8767b720a66', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:30.161234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:30.172532 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a0599008-11a6-4c89-bded-bed1e645ba46 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.648558 Jun 25 21:01:30.184728 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1100/2463] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:29 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:30.195551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:30.196539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:30.205859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.216981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.218969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.219740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.374217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for project 7f998f8bc87c4e009254746816812231. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:30.379141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for user f9abc0f22f944a95a70b23e50bafdccb and project 7f998f8bc87c4e009254746816812231. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:30.392183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:30.392750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:30.393231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:30.393629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:30.394047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:30.402577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.403031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.403845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.404283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.422156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for project 7f998f8bc87c4e009254746816812231. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:30.427191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Getting quotas for user f9abc0f22f944a95a70b23e50bafdccb and project 7f998f8bc87c4e009254746816812231. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:30.445567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:30.454683 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-519aacb5-ef6d-4324-9fab-ec6cbff49670 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.268038 Jun 25 21:01:30.455392 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1101/2464] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:30 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:30.460294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-eb9f432d-fa5a-4e75-98b2-d3297514d4d2 req-7398cb99-1e68-41af-9444-6f30367a84f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8bfa6ec-4c86-48de-9b06-a883dcd71627", "name": "network-vif-deleted", "tag": "e2dcb82e-9819-4694-9f48-d9c2189f2c54"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:30.470093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-eb9f432d-fa5a-4e75-98b2-d3297514d4d2 req-7398cb99-1e68-41af-9444-6f30367a84f6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.470404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-eb9f432d-fa5a-4e75-98b2-d3297514d4d2 req-7398cb99-1e68-41af-9444-6f30367a84f6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.481964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-eb9f432d-fa5a-4e75-98b2-d3297514d4d2 req-7398cb99-1e68-41af-9444-6f30367a84f6 service nova] Creating event network-vif-deleted:e2dcb82e-9819-4694-9f48-d9c2189f2c54 for instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 on nch1-master-1 Jun 25 21:01:30.487437 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-eb9f432d-fa5a-4e75-98b2-d3297514d4d2 req-7398cb99-1e68-41af-9444-6f30367a84f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030363 Jun 25 21:01:30.487599 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1102/2465] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:30.492634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:30.493383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:30.500988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:30.501486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.502065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.503031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.503621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.505356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c586065-2b39-4ffe-b34f-cbd319f8cac0',volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:30.562222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.563019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.563260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lazy-loading 'fault' on Instance uuid f8bfa6ec-4c86-48de-9b06-a883dcd71627 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:01:30.620209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19dae0cdb1d54229ac38a3a9b68f7625', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a5d7e92e264a74a4be3ad4014a80ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:30.629541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4bb10f0c-c4ef-46bc-9aca-4afc4b22f3d7 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 200 len: 1305 microversion: 2.1 time: 0.140778 Jun 25 21:01:30.630258 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1103/2466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:30 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:30.634793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:30.635431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:30.642190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.643172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.644151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.644797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.719314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de69bf56-dc0c-4fab-8571-e992cb6a60aa tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.019867 Jun 25 21:01:30.720115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1364/2467] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:29 2022] POST /compute/v2.1/servers => generated 407 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:30.726010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0840179-e3a6-4ef6-b325-39c566a214e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef1e670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:30.793340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0840179-e3a6-4ef6-b325-39c566a214e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.071842 Jun 25 21:01:30.794157 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1365/2468] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:30 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:30.801271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:30.802527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:30.811586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.812259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:30.813604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:30.821383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.064753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:31.083009 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22100025-eb5d-4d0b-9e2b-6028201ac12e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.451542 Jun 25 21:01:31.083964 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1104/2469] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:30 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:31.116464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64b9e14d-ccd4-46d6-8bc8-8823b35d3a9f tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:31.117590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64b9e14d-ccd4-46d6-8bc8-8823b35d3a9f tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:31.213906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:31.230177 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-45598126-c2d9-4f1c-af25-455629b86874 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.430901 Jun 25 21:01:31.230870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1366/2470] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:30 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:31.246159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:31.246785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:31.267077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.267422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.268620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.269249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.320272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64b9e14d-ccd4-46d6-8bc8-8823b35d3a9f tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:31.331651 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64b9e14d-ccd4-46d6-8bc8-8823b35d3a9f tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1120 microversion: 2.1 time: 0.246948 Jun 25 21:01:31.334868 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1105/2471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:31 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1120 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:31.473967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:31.474980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:31.491865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.501020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.502853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.507874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.540463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:31.556093 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-780773ee-ae8f-4832-bdea-2fdbec90c65a tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1316 microversion: 2.1 time: 0.313787 Jun 25 21:01:31.556996 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1367/2472] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:31 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1316 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:31.650569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:31.651649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] [instance: f8bfa6ec-4c86-48de-9b06-a883dcd71627] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:31.673148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.674506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.675583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.676412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.700679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] HTTP exception thrown: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Request method failure captured: Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 HTTP/1.1 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eMxiZZ2GfD4RHbzcryYzg08NZ4-DwIc0KYaxa_px1QEBTfohBV77FzRZs-uWcT8h4pd7zh770QZY46nPDjvcYST2mdwgwYptY7TgdCj1FDx_XF2FHiPPl3W5d2EcCoQH-9zipNdlQj2DaiyJeTgPWNjmjgF7euNcsNXIDHKzqZtug Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 34a5d7e92e264a74a4be3ad4014a80ff Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerPasswordTestJSON-690414307 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/34a5d7e92e264a74a4be3ad4014a80ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34a5d7e92e264a74a4be3ad4014a80ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_34a5d7e92e264a74a4be3ad4014a80ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/34a5d7e92e264a74a4be3ad4014a80ff"}]}] Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerPasswordTestJSON-690414307 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 34a5d7e92e264a74a4be3ad4014a80ff Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerPasswordTestJSON-690414307 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerPasswordTestJSON-690414307-project Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 19dae0cdb1d54229ac38a3a9b68f7625 Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerPasswordTestJSON-690414307-project Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'f8bfa6ec-4c86-48de-9b06-a883dcd71627'} Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:31.702967 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. Jun 25 21:01:31.707348 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:31.710136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] Returning 404 to user: Instance f8bfa6ec-4c86-48de-9b06-a883dcd71627 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:31.711099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85f717d9-0dfc-4fbd-b13a-33a78bd71764 tempest-ServerPasswordTestJSON-690414307 tempest-ServerPasswordTestJSON-690414307-project] 10.222.0.39 "GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627" status: 404 len: 111 microversion: 2.1 time: 0.067821 Jun 25 21:01:31.712228 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1368/2473] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:31 2022] GET /compute/v2.1/servers/f8bfa6ec-4c86-48de-9b06-a883dcd71627 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:01:31.730501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f13209c0-7db3-4664-912b-08f88fa1ee32 req-db817087-e592-4063-aeae-1984d393b103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a104cd86-0a2f-45ec-8047-c581153d539c", "name": "network-vif-plugged", "status": "completed", "tag": "91391f5e-59e8-41e4-8093-05cdb502d33b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:31.742799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f13209c0-7db3-4664-912b-08f88fa1ee32 req-db817087-e592-4063-aeae-1984d393b103 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:31.743706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f13209c0-7db3-4664-912b-08f88fa1ee32 req-db817087-e592-4063-aeae-1984d393b103 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:31.764295 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f13209c0-7db3-4664-912b-08f88fa1ee32 req-db817087-e592-4063-aeae-1984d393b103 service nova] Creating event network-vif-plugged:91391f5e-59e8-41e4-8093-05cdb502d33b for instance a104cd86-0a2f-45ec-8047-c581153d539c on nch1-master-1 Jun 25 21:01:31.772146 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f13209c0-7db3-4664-912b-08f88fa1ee32 req-db817087-e592-4063-aeae-1984d393b103 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050191 Jun 25 21:01:31.772954 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1369/2474] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:01:31.828363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f27725d-1ccd-4966-9992-c1aa4030960e tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984eec4c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:31.969258 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f27725d-1ccd-4966-9992-c1aa4030960e tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.166467 Jun 25 21:01:31.970612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1370/2475] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:31 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:32.101100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:32.102064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:32.120381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.127198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.128236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.128855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.325864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:32.335160 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17c681c8-6bfe-496b-9b75-b2cf8dbc9c95 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.866725 Jun 25 21:01:32.341202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1106/2476] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:31 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:32.348107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:32.358443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:32.382924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.383532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.384443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.384984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.521054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:32.530724 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b1b509a3-e924-48d8-9bbb-a8335a7cc5ed tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.434016 Jun 25 21:01:32.533371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1371/2477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:32 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:32.545639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:32.546538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:32.568013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.568862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.569852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.570652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.699334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:32.711988 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f9ef663-a67f-4980-9979-4c2195471864 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1218 microversion: 2.1 time: 0.176449 Jun 25 21:01:32.715471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1372/2478] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:32 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:32.739335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:32.740596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:32.763422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.765059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.766349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:32.766888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:32.770495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:32.778770 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fa101a6-efe6-4aba-8c66-6215ed9a28a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.435621 Jun 25 21:01:32.781984 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1107/2479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:32 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:32.985399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8007f8a9-1e1a-42cb-977c-bb0b1ab88b31 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f985c88f3a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:33.079123 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8007f8a9-1e1a-42cb-977c-bb0b1ab88b31 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.098940 Jun 25 21:01:33.080559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1108/2480] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:32 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:33.196417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:33.205721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dddc37ef-4885-4a18-9cfb-3c2c9ea24494 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1503 microversion: 2.1 time: 0.489128 Jun 25 21:01:33.210050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1373/2481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:32 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1503 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:33.230485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:33.231261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:33.245661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.246126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.246920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.247357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.321310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:01:33.359456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:33.360217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:33.374024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.390391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.392843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.395174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.465052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:33.478371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec421692-1377-4b21-9e80-977aa9e71a80 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "DELETE /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 204 len: 0 microversion: 2.1 time: 0.251498 Jun 25 21:01:33.479532 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1109/2482] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:33 2022] DELETE /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:33.494218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:33.496660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:33.506154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.511194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.512698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.513262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.901689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:33.925216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8f66415-3177-499f-963f-b1a4f8fbfffb tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.567917 Jun 25 21:01:33.927166 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1374/2483] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:33 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:33.934238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:33.938041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:33.947741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.948999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:33.952003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:33.952749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.092263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:34.106853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-737e1445-cfb7-4ac4-9ac2-0bd8e0fb615d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1509 microversion: 2.1 time: 0.618409 Jun 25 21:01:34.109678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1110/2484] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:33 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1509 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:34.116595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:34.117455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:34.136826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.137568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.138584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.140699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.277208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:34.287414 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6db51908-38b3-4446-929e-a7a726c6b2ec tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1236 microversion: 2.1 time: 0.176468 Jun 25 21:01:34.303626 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1111/2485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:34 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1236 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:34.321891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:34.323042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:34.346592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.347036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.347859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.348278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.648379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:34.670397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf01a7d6-59ec-45bf-9434-86346eb3ec2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.741921 Jun 25 21:01:34.671371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1375/2486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:33 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:34.681880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec4e2e39-40ce-48f6-a2b2-780d83cc5285 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef1f700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:34.777833 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec4e2e39-40ce-48f6-a2b2-780d83cc5285 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.105130 Jun 25 21:01:34.779187 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1376/2487] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:34 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:34.787796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b94ce711-1921-4cf3-a2ef-e723090e6f5d req-e5289b9e-cfb0-4d79-8426-476db52462ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fe50b3-4f75-49b0-af3d-53f105e5f46e", "name": "network-vif-plugged", "status": "completed", "tag": "73e60ca6-2575-4b82-a46d-2aab07dd0f70"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:34.824730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b94ce711-1921-4cf3-a2ef-e723090e6f5d req-e5289b9e-cfb0-4d79-8426-476db52462ad service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.826261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b94ce711-1921-4cf3-a2ef-e723090e6f5d req-e5289b9e-cfb0-4d79-8426-476db52462ad service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.867366 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b94ce711-1921-4cf3-a2ef-e723090e6f5d req-e5289b9e-cfb0-4d79-8426-476db52462ad service nova] Creating event network-vif-plugged:73e60ca6-2575-4b82-a46d-2aab07dd0f70 for instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e on nch1-master-1 Jun 25 21:01:34.873527 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b94ce711-1921-4cf3-a2ef-e723090e6f5d req-e5289b9e-cfb0-4d79-8426-476db52462ad service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092884 Jun 25 21:01:34.875933 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1377/2488] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:34.885800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e30d2fe2-1ff4-4bf3-b4dc-2d6272eadc20 req-923b0a1f-5cb8-4b40-8fad-6f9546c95d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a04f94-7a5c-4ddd-9702-de720634c98d", "tag": "60327cb3-e81c-4536-8326-a2d537600d19"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:34.921310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e30d2fe2-1ff4-4bf3-b4dc-2d6272eadc20 req-923b0a1f-5cb8-4b40-8fad-6f9546c95d14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.924954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e30d2fe2-1ff4-4bf3-b4dc-2d6272eadc20 req-923b0a1f-5cb8-4b40-8fad-6f9546c95d14 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.949066 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e30d2fe2-1ff4-4bf3-b4dc-2d6272eadc20 req-923b0a1f-5cb8-4b40-8fad-6f9546c95d14 service nova] Creating event network-changed:60327cb3-e81c-4536-8326-a2d537600d19 for instance 17a04f94-7a5c-4ddd-9702-de720634c98d on nch1-master-1 Jun 25 21:01:34.960505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e30d2fe2-1ff4-4bf3-b4dc-2d6272eadc20 req-923b0a1f-5cb8-4b40-8fad-6f9546c95d14 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081136 Jun 25 21:01:34.963665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1378/2489] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:34.975254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:34.978969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:34.989477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.994522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:34.995555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:34.996128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.235283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:35.247277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-06b9dd00-490e-404a-bf36-99e51efce4aa tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.942324 Jun 25 21:01:35.247908 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1112/2490] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:34 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:35.261211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:35.263013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:35.285682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.293733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.294830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.295743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.385572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:35.395305 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8008b8e1-b341-447c-b8a8-e2a2db65f57a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.429950 Jun 25 21:01:35.398535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1379/2491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:34 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:35.411703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:35.412722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:35.426207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.426418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.429372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.429832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.622490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:35.639497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9d2488a-024f-4487-aa98-a88b7ac3e657 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1236 microversion: 2.1 time: 0.230071 Jun 25 21:01:35.640597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1380/2492] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:35 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1236 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:35.687621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:35.688254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:35.697628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.702259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.703178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:35.703636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:35.751767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:35.931161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:35.950045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e2fe55e4-dfd3-4301-a487-1573162f1c88 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1509 microversion: 2.1 time: 0.697516 Jun 25 21:01:35.951327 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1113/2493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:35 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1509 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:35.957087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-220acc58-e1de-45e7-ac40-dbd78495abcb tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9862012af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:36.025949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:36.046442 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-220acc58-e1de-45e7-ac40-dbd78495abcb tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.093661 Jun 25 21:01:36.047312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1114/2494] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:35 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:36.091594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-953faeb3-236f-4155-8575-391a3de5a9f0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.408171 Jun 25 21:01:36.124896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1381/2495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:35 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:36.264282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:36.265527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:36.276849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.281463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.286058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.287674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.414644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:36.415305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:36.430417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.430883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.431706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.432163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.721969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:36.731270 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f80ea0f4-adfa-42c5-b3c3-f9d06ce9410a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.470563 Jun 25 21:01:36.746954 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1115/2496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:36 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:36.757505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:36.758373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:36.768493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.769980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.771008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.771700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.867222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:36.875274 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be654ba2-3427-4ad1-b591-bcada6f9c671 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1321 microversion: 2.1 time: 0.464573 Jun 25 21:01:36.887289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1382/2497] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:36 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1321 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:36.895165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5fb90f25-bfa7-4b09-8e37-77ef76da3247 req-089c6b5d-2822-46ef-9311-082ebcf67974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "name": "network-vif-plugged", "status": "completed", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:36.918189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fb90f25-bfa7-4b09-8e37-77ef76da3247 req-089c6b5d-2822-46ef-9311-082ebcf67974 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.918638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5fb90f25-bfa7-4b09-8e37-77ef76da3247 req-089c6b5d-2822-46ef-9311-082ebcf67974 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.937259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:36.939253 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5fb90f25-bfa7-4b09-8e37-77ef76da3247 req-089c6b5d-2822-46ef-9311-082ebcf67974 service nova] Creating event network-vif-plugged:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch2-master-1 Jun 25 21:01:36.951003 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b69bfa56-4263-4d70-96c1-54d45a4fca42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1224 microversion: 2.1 time: 0.200992 Jun 25 21:01:36.953331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5fb90f25-bfa7-4b09-8e37-77ef76da3247 req-089c6b5d-2822-46ef-9311-082ebcf67974 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061703 Jun 25 21:01:36.954408 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1383/2498] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:36.969906 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1116/2499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:36 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:36.970957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:36.971932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:36.990004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:36.993949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.995328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:36.996324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:36.996977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:37.062470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ccff490b-b44a-4492-86a1-a20cd99499c0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9862032c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:37.083244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:37.161128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ccff490b-b44a-4492-86a1-a20cd99499c0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.103503 Jun 25 21:01:37.168803 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1117/2500] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:37 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:37.170894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b8e3ac2c484ae49e678ef734b52e99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f32fd4885a4850996d1208dc1bcbba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:37.174460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-199286a5-7df9-4ec3-9875-bcb85b1cf845 req-9509b26f-314f-4849-bd03-2cb1c8e6ce3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777ed7af-f188-4a90-86f6-85737666f7cb", "name": "network-vif-deleted", "tag": "8005a3c3-3fa4-422a-ab92-55172ec1caf1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:37.185347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32689a7c-2051-4e01-b3e6-2332978df8c1 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 200 len: 1467 microversion: 2.1 time: 0.217839 Jun 25 21:01:37.189452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1384/2501] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:36 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:37.190234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-199286a5-7df9-4ec3-9875-bcb85b1cf845 req-9509b26f-314f-4849-bd03-2cb1c8e6ce3c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:37.190826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-199286a5-7df9-4ec3-9875-bcb85b1cf845 req-9509b26f-314f-4849-bd03-2cb1c8e6ce3c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:37.225577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-199286a5-7df9-4ec3-9875-bcb85b1cf845 req-9509b26f-314f-4849-bd03-2cb1c8e6ce3c service nova] Creating event network-vif-deleted:8005a3c3-3fa4-422a-ab92-55172ec1caf1 for instance 777ed7af-f188-4a90-86f6-85737666f7cb on nch2-master-1 Jun 25 21:01:37.228128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:37.231714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:37.248296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-199286a5-7df9-4ec3-9875-bcb85b1cf845 req-9509b26f-314f-4849-bd03-2cb1c8e6ce3c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077717 Jun 25 21:01:37.251350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1118/2502] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:37.262352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:37.263468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:37.266237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:37.272085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:37.761031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:37.763279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:37.782224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:37.783211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:37.785607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:37.789298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.138778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:38.150393 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3787845-dde2-4d16-9a9c-faaa91ac8ce9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.959151 Jun 25 21:01:38.151414 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1385/2503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:37 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:38.164908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:38.165848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:38.174436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.175650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.176761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.177418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.240834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:38.251927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c74e26fd-f594-42b6-a5b2-0e9453aaf0ca tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1313 microversion: 2.1 time: 0.499341 Jun 25 21:01:38.255520 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1119/2504] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:37 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:38.262110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:38.265687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:38.277982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.279949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.283976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.284690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.312956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:38.602734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:38.614017 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-672b9e62-b50e-4a75-b92b-64810590d346 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1515 microversion: 2.1 time: 0.461031 Jun 25 21:01:38.615307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1386/2505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:38 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1515 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:38.620618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-030ab5e7-9b2c-48ea-a641-255025a9f9cc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef4a700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:38.698391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-030ab5e7-9b2c-48ea-a641-255025a9f9cc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.081748 Jun 25 21:01:38.702662 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1387/2506] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:38 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:38.721128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:38.722296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:38.730356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.731215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.732070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.734808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.751806 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb HTTP/1.1 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '777ed7af-f188-4a90-86f6-85737666f7cb'} Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:38.756835 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.760368 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.762625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:38.766297 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ac0ceb6-27b4-4238-8731-f2535b5cad9b tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 404 len: 111 microversion: 2.1 time: 0.062468 Jun 25 21:01:38.767655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1388/2507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:38 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:38.774111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:38.775568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:38.784708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.785543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.786707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.787380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.816205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:38.849508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c981124d-bdde-46db-ab34-519e2c3e159b tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.589825 Jun 25 21:01:38.850163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1120/2508] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:38 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:38.896877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'flavor' on Instance uuid 49fe50b3-4f75-49b0-af3d-53f105e5f46e {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:01:38.902891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-355398067", "metadata": {"image_type": "test"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:38.908553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:38.936937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.938344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.944809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:38.947727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:38.977898 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb/action HTTP/1.1 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 111 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-355398067", "metadata": {"image_type": "test"}}} Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '777ed7af-f188-4a90-86f6-85737666f7cb', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-355398067', 'metadata': {'image_type': 'test'}}}} Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:01:38.985109 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:38.989602 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:38.994202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:38.995301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef318734-e00a-4f32-83ab-e670fdf59943 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "POST /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb/action" status: 404 len: 111 microversion: 2.1 time: 0.114706 Jun 25 21:01:38.996095 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1121/2509] 10.222.0.39 () {60 vars in 1278 bytes} [Sat Jun 25 21:01:38 2022] POST /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb/action => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.009707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1920631621", "metadata": {"image_type": "test"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:39.012216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Failed to fetch instance by id tempest-invalid-490713017 {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:01:39.013494 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance tempest-invalid-490713017 could not be found. Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/tempest-invalid-490713017/action HTTP/1.1 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 112 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1920631621", "metadata": {"image_type": "test"}}} Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance tempest-invalid-490713017 could not be found. Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'tempest-invalid-490713017', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1920631621', 'metadata': {'image_type': 'test'}}}} Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-490713017 could not be found. Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:39.015577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-490713017 could not be found. Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-490713017 could not be found. Jun 25 21:01:39.020549 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.022248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance tempest-invalid-490713017 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:39.024918 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e99bcd2-a915-48cf-a5a3-aa270879a76d tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "POST /compute/v2.1/servers/tempest-invalid-490713017/action" status: 404 len: 100 microversion: 2.1 time: 0.018559 Jun 25 21:01:39.026164 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1122/2510] 10.222.0.39 () {60 vars in 1245 bytes} [Sat Jun 25 21:01:39 2022] POST /compute/v2.1/servers/tempest-invalid-490713017/action => generated 100 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.039505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1558678864"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:39.040880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:01:39.041573 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 57 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-test-snap-1558678864"}} Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1558678864'}}} Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.043425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.047250 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.051668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:39.053276 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-533c9111-9242-4c87-b92d-00508916545c tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.018314 Jun 25 21:01:39.060530 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1123/2511] 10.222.0.39 () {60 vars in 1274 bytes} [Sat Jun 25 21:01:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.072104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1466360722"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:39.073166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:01:39.073684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 57 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: {"createImage": {"name": "tempest-test-snap-1466360722"}} Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1466360722'}}} Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.075225 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:39.078708 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48d94376-88c6-43dd-beba-61c55cea4131 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.015082 Jun 25 21:01:39.081083 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1124/2512] 10.222.0.39 () {60 vars in 1280 bytes} [Sat Jun 25 21:01:39 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.091156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:39.091698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:39.102289 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7bcee12-b0af-4428-a478-34c764962e62 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action" status: 200 len: 32 microversion: 2.1 time: 0.332941 Jun 25 21:01:39.103505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1389/2513] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:01:38 2022] POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:01:39.114712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:39.116362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:39.118073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.118738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.122718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.123460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.136011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.137678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.139427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.145503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.167884 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb HTTP/1.1 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '777ed7af-f188-4a90-86f6-85737666f7cb'} Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:39.178884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:39.183321 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2e4d00eb-09ef-4a2f-8000-0347d8f45f68 tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "DELETE /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 404 len: 111 microversion: 2.1 time: 0.093298 Jun 25 21:01:39.196254 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1125/2514] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:39 2022] DELETE /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.213921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:39.214911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:39.232974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.237192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.240641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.241096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.851582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:39.864783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ef295f0b-d337-488d-81ff-f64f559502a0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.755892 Jun 25 21:01:39.868583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1390/2515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:39 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:39.876286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:39.877231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] [instance: 777ed7af-f188-4a90-86f6-85737666f7cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:39.884871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.885763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.887087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.887764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.907080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] HTTP exception thrown: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Request method failure captured: Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb HTTP/1.1 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eVb1wQXXvipL5h7pQcRZCWV_U11E6HIlQ9E2nl8_0A4lnNrKiCTIi3Yo8L10iKPNr-Qi6J7972sxvLFATzkJCKkBitMbC3_UO24ENMUmFl3ALZpXBNcJPF3K_D_c8yU_vkuhWDuOarDhXghDy0de3qaFktzKWcq4aIULQityuE5Pw Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_13f32fd4885a4850996d1208dc1bcbba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/13f32fd4885a4850996d1208dc1bcbba"}]}] Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 13f32fd4885a4850996d1208dc1bcbba Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1005540294 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 18b8e3ac2c484ae49e678ef734b52e99 Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesNegativeTestJSON-1005540294-project Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '777ed7af-f188-4a90-86f6-85737666f7cb'} Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:39.909747 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. Jun 25 21:01:39.913282 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:01:39.922637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] Returning 404 to user: Instance 777ed7af-f188-4a90-86f6-85737666f7cb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:39.925242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b1cd03bd-c351-4873-8b78-51cfb21e32ee tempest-ImagesNegativeTestJSON-1005540294 tempest-ImagesNegativeTestJSON-1005540294-project] 10.222.0.39 "GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb" status: 404 len: 111 microversion: 2.1 time: 0.054785 Jun 25 21:01:39.927263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1391/2516] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:39 2022] GET /compute/v2.1/servers/777ed7af-f188-4a90-86f6-85737666f7cb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:39.934059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:39.935411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:39.943559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.944348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.945526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:39.946214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:39.968408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:39.980379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dad7808e-708d-42c0-884e-92beda2b1313 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.782772 Jun 25 21:01:39.982666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1126/2517] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:39 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:39.995742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee2873df-006c-4568-8b1e-ba5d636e2a18 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fe59d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:40.076230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee2873df-006c-4568-8b1e-ba5d636e2a18 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.091483 Jun 25 21:01:40.077782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1127/2518] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:39 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:40.090715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:40.091350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:40.116779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.117808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:40.119011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.119654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:40.413125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:40.433558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=43 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:40.452639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:40.465022 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ac2e7a06-99bf-4d3e-a22b-84586d97b902 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1463 microversion: 2.1 time: 0.535727 Jun 25 21:01:40.467450 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1392/2519] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:39 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1463 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:40.579014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:40.580503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:40.592774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.593557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:40.595999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.597797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:40.799339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:40.829428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-360e0153-a223-4f66-87cf-001f38bef16a tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.750316 Jun 25 21:01:40.839275 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1128/2520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:40 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:40.887946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:40.890344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:40.907028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.912011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:40.913101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:40.913714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.265747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21ba9909-5399-49e0-9f84-825225179f40 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1614 microversion: 2.1 time: 0.783259 Jun 25 21:01:41.283627 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1393/2521] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:40 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1614 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:41.290647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-298e333d-1a10-4a71-ad1b-0e55edc5a463 req-cd794a21-d54a-4f33-b9ea-1e0a69dcac60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bfd505-2b77-4e11-a800-c92a473a73e6", "tag": "d8dadee9-cfd0-4802-908a-a00de6cb54eb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:41.300817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-298e333d-1a10-4a71-ad1b-0e55edc5a463 req-cd794a21-d54a-4f33-b9ea-1e0a69dcac60 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.301376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-298e333d-1a10-4a71-ad1b-0e55edc5a463 req-cd794a21-d54a-4f33-b9ea-1e0a69dcac60 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.325679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-298e333d-1a10-4a71-ad1b-0e55edc5a463 req-cd794a21-d54a-4f33-b9ea-1e0a69dcac60 service nova] Creating event network-changed:d8dadee9-cfd0-4802-908a-a00de6cb54eb for instance 54bfd505-2b77-4e11-a800-c92a473a73e6 on nch2-master-1 Jun 25 21:01:41.327890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=26 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:41.332523 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-298e333d-1a10-4a71-ad1b-0e55edc5a463 req-cd794a21-d54a-4f33-b9ea-1e0a69dcac60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046556 Jun 25 21:01:41.334826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1394/2522] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:41.342794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:41.343421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:41.353686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.354317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.355949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.356999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.467921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:41.476349 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-877baf25-5354-4155-8fb7-f0252b4b1685 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.594824 Jun 25 21:01:41.493626 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1129/2523] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:40 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:41.493626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-80e7c30d-19f7-4b34-a805-1afd8cd9ce32 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f985c88faf0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:41.580551 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-80e7c30d-19f7-4b34-a805-1afd8cd9ce32 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.094645 Jun 25 21:01:41.581695 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1130/2524] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:41 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:41.591174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:41.593201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:41.630507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.631354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.632726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.633333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.686807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f6e3d3212ab942feb30bae5b2fd9885d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e758e68d8094b8bb4d528182ef10a3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:41.687763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] flavor_id is None. Assuming migration. {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 25 21:01:41.688512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:01:41.833662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:41.845715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fd732c9a-8301-484b-b391-7f2a696c7232 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.508848 Jun 25 21:01:41.852911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1395/2525] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:41 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:41.871004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e495c5ca-7d28-4697-957d-79b1a7689b94 req-4cfc4d0d-dbaa-4e1c-9572-4457a39aa3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a04f94-7a5c-4ddd-9702-de720634c98d", "name": "network-vif-plugged", "status": "completed", "tag": "60327cb3-e81c-4536-8326-a2d537600d19"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:41.886971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e495c5ca-7d28-4697-957d-79b1a7689b94 req-4cfc4d0d-dbaa-4e1c-9572-4457a39aa3f4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.888160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e495c5ca-7d28-4697-957d-79b1a7689b94 req-4cfc4d0d-dbaa-4e1c-9572-4457a39aa3f4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.905985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e495c5ca-7d28-4697-957d-79b1a7689b94 req-4cfc4d0d-dbaa-4e1c-9572-4457a39aa3f4 service nova] Creating event network-vif-plugged:60327cb3-e81c-4536-8326-a2d537600d19 for instance 17a04f94-7a5c-4ddd-9702-de720634c98d on nch1-master-1 Jun 25 21:01:41.913718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e495c5ca-7d28-4697-957d-79b1a7689b94 req-4cfc4d0d-dbaa-4e1c-9572-4457a39aa3f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059469 Jun 25 21:01:41.914990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1396/2526] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:41.936062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:41.937061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:41.947700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.948174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:41.948988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:41.949745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.187168 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1c2e047-87e1-4a28-87d3-a1b378b1fd4e tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa/action" status: 202 len: 0 microversion: 2.1 time: 0.603865 Jun 25 21:01:42.188181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1131/2527] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:01:41 2022] POST /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:01:42.198733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:42.199923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:42.209951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.210569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.211541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.212160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.368740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:42.380859 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-339bb897-eed0-4e85-a914-48a832e9d3f1 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.464177 Jun 25 21:01:42.383425 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1397/2528] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:41 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:42.406385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:42.423109 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f461e70a-7f93-4beb-85a2-6ece9f22234c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1472 microversion: 2.1 time: 0.230388 Jun 25 21:01:42.424501 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1132/2529] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:42 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1472 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:42.506273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:42.506968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:42.514588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.515491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.516297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.516772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.594694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3919578-c433-44b9-8675-f45fb6147211 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f985c45de50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:42.679764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e3919578-c433-44b9-8675-f45fb6147211 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.089460 Jun 25 21:01:42.681610 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1133/2530] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:42 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:42.865340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:42.866322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:42.879750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.881032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:42.882062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:42.883171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:43.108785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:43.118538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:43.126468 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04ac78ad-b3b8-44c6-9ee5-f7f4df6991fa tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1315 microversion: 2.1 time: 0.263905 Jun 25 21:01:43.128847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1134/2531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:42 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:43.150636 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54c991c7-2b0f-4b2d-ad07-f07435272c1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.644754 Jun 25 21:01:43.151902 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1398/2532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:42 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:43.401208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:43.401837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:43.423150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:43.426586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:43.427637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:43.431932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:43.441458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:43.442089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:43.471763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:43.473249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:43.477724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:43.483554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:43.825138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:43.836253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a1d8f31-6bad-42ed-bb92-5c099b22d8fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.441137 Jun 25 21:01:43.837436 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1135/2533] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:43 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:43.848177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc6baa3a-f2e0-4aab-beba-bba359585632 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fce3310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:43.934376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc6baa3a-f2e0-4aab-beba-bba359585632 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.095571 Jun 25 21:01:43.934986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1136/2534] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:43 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:44.133652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:44.143030 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2a2d312-291f-457f-a25f-742ed4459fc3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1472 microversion: 2.1 time: 0.706467 Jun 25 21:01:44.148551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:44.149417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:44.149586 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1399/2535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:43 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:44.166158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.168024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.168844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:44.169600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:44.170346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.172557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.195840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.198369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.201391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.201963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.259717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:44.575842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:44.594151 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6715e57-27fd-460d-b423-5b9a8103e27a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1501 microversion: 2.1 time: 0.452507 Jun 25 21:01:44.609627 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1137/2536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:44 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1501 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:44.617190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:44.617984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:44.630284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.631009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.632579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.633200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.699618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:44.715851 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9340876-79d5-4da5-9ae0-a7073890f91f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.551427 Jun 25 21:01:44.719646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1400/2537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:44 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:44.763280 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0e24df7-70de-41d1-a57f-7fcfffac0538 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d/action" status: 202 len: 0 microversion: 2.1 time: 0.151239 Jun 25 21:01:44.763958 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1138/2538] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:01:44 2022] POST /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:01:44.774121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:44.774613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:44.781480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.782075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.783058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.783706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.858385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:44.859559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:44.877877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.881184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:44.882284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:44.882867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:45.085829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:45.102491 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de48cfef-f458-479c-9df2-0ff39d3e3512 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1506 microversion: 2.1 time: 0.331665 Jun 25 21:01:45.114917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1401/2539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:44 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1506 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:45.132697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0cf2a36-5759-4a61-bd10-5a95275a83f6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861ea7550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:45.279177 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0cf2a36-5759-4a61-bd10-5a95275a83f6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.161966 Jun 25 21:01:45.286749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1402/2540] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:45 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:45.293582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:45.295070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:45.305049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:45.306016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:45.307280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:45.308671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:45.506690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:45.515756 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43a99acd-75a6-42a2-ad11-f9e3241b6299 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.664443 Jun 25 21:01:45.523787 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1139/2541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:44 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:45.741690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:45.742537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:45.754702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:45.755746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:45.758835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:45.759533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:45.759807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:45.771177 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c40f82b6-56b0-4367-8f15-f93b2e3f3300 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1472 microversion: 2.1 time: 0.482748 Jun 25 21:01:45.774429 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1403/2542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:45 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1472 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:46.118886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.119521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:46.127088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:46.136201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.136684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.137477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.138081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.141906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55297553-c486-4c52-b967-88d328b41208 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.399818 Jun 25 21:01:46.143378 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1140/2543] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:45 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:46.292762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d741e30-c438-4aa2-aaa4-494f71ab7167 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861fd3dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.356865 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d741e30-c438-4aa2-aaa4-494f71ab7167 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.068040 Jun 25 21:01:46.357774 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1141/2544] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:46 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:46.419754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:46.431384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a4eca2e-cc62-4c0c-975d-04223af691a8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1486 microversion: 2.1 time: 0.316440 Jun 25 21:01:46.434196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1404/2545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:46 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1486 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:46.452331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.452728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:46.479995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.484921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.485892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.486344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.540082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.540752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:46.552526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.553250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.554196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.557379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:01:46.558093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.638833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:46.716323 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af589988-7d4d-481b-a8c7-3b13f08c2223 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 204 len: 0 microversion: 2.1 time: 0.268015 Jun 25 21:01:46.721697 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1142/2546] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:01:46 2022] DELETE /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:46.731954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.733071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:46.740346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.741168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.742610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.743743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.920290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:46.942050 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06e42a64-d378-445f-93d0-7296b0f06df7 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.397563 Jun 25 21:01:46.953804 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1405/2547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:46 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:46.968783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:46.969756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:46.982986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.984959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:46.986780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:46.987469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:47.354429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:47.368973 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c14c5dbe-9da9-4747-852c-f2182ae6ad88 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1472 microversion: 2.1 time: 0.409490 Jun 25 21:01:47.369996 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1406/2548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:46 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1472 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:47.376598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:47.377448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:47.384731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:47.385544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:47.386628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:47.387230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:47.598778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:47.607480 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32872e98-1955-4e19-84f2-24c354ed366c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1492 microversion: 2.1 time: 0.880352 Jun 25 21:01:47.608087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1143/2549] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:46 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1492 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:47.622297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0fc41bc1-066d-41cb-aad0-724d837b1cfc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f985c4a33a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:47.669264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:47.705305 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79b29150-8ec1-4716-a6ee-741b84ee276f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.333889 Jun 25 21:01:47.715978 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1407/2550] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:47 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:47.733712 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0fc41bc1-066d-41cb-aad0-724d837b1cfc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.119447 Jun 25 21:01:47.734588 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1144/2551] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:47 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:47.959631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:47.960866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:47.973964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:47.976904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:47.979965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:47.982600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.311844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:48.324796 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a3dd2f0-de5e-443d-81bc-73d31d66d839 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.369128 Jun 25 21:01:48.325948 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1408/2552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:47 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:48.386656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:48.387283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:48.403395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.417028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.418182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.418779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.624938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:48.625580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:48.635262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.641436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.642719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.643430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.848792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:48.857868 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f480669d-ab23-4462-87dd-6cee1078a305 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1492 microversion: 2.1 time: 0.236915 Jun 25 21:01:48.858737 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1409/2553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:48 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1492 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:48.866161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:48.867131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:48.875438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.876371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:48.877421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:48.878148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:49.082920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:49.092858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e10a8c8-8b50-468e-9ba2-8819edf3f1f6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.232827 Jun 25 21:01:49.101835 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1410/2554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:48 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:49.107430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-107108b8-1d3a-462b-9311-2a89cf2a27e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef53e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:49.164096 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-107108b8-1d3a-462b-9311-2a89cf2a27e2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.066545 Jun 25 21:01:49.167862 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1411/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:49 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:49.345441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:49.348410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:49.383059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:49.383609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:49.385994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:49.386615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:49.430120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:49.439769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9f3e29ea-466f-418c-b3c3-a5c54f347311 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 1.056858 Jun 25 21:01:49.452006 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1145/2556] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:48 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:49.633385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:49.654756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-403d362f-5c92-4cc3-b0e2-239122371a33 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.316519 Jun 25 21:01:49.655603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1412/2557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:49 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:49.877328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:49.878320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:49.889624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:49.890089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:49.894716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:49.895177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:49.995018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5c1d85ed-72a3-438c-ab30-ca43cb998953 req-79506f94-5fa4-43f3-a550-802c658182dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a04f94-7a5c-4ddd-9702-de720634c98d", "name": "network-vif-deleted", "tag": "60327cb3-e81c-4536-8326-a2d537600d19"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:50.017568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5c1d85ed-72a3-438c-ab30-ca43cb998953 req-79506f94-5fa4-43f3-a550-802c658182dc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.018013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5c1d85ed-72a3-438c-ab30-ca43cb998953 req-79506f94-5fa4-43f3-a550-802c658182dc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.081880 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5c1d85ed-72a3-438c-ab30-ca43cb998953 req-79506f94-5fa4-43f3-a550-802c658182dc service nova] Creating event network-vif-deleted:60327cb3-e81c-4536-8326-a2d537600d19 for instance 17a04f94-7a5c-4ddd-9702-de720634c98d on nch1-master-1 Jun 25 21:01:50.093539 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5c1d85ed-72a3-438c-ab30-ca43cb998953 req-79506f94-5fa4-43f3-a550-802c658182dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102853 Jun 25 21:01:50.096021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:50.104312 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1413/2558] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:01:50.112679 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-388a9a00-03c2-4086-9c41-edcc575c69f3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 200 len: 1450 microversion: 2.1 time: 0.232588 Jun 25 21:01:50.119325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:50.126648 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1146/2559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:49 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 1450 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:50.130140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:50.153195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.153674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.154521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.162170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.181846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20f543df-e062-4585-a92a-8e697ccde155 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f985c45d700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:50.288139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20f543df-e062-4585-a92a-8e697ccde155 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.110538 Jun 25 21:01:50.291191 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1147/2560] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:50 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:50.457469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:50.458173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:50.467247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.467708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.471768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.472517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.831400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:50.846629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2077736a-b3cc-4db8-93cc-a3dfc640ebbd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.737826 Jun 25 21:01:50.848145 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1414/2561] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:50 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:50.859227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:50.861735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:50.880134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.883686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.888625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:50.889313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:50.924702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:50.996194 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f9b4916-6d4c-4986-bb2f-955390815da4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.527224 Jun 25 21:01:50.996957 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1148/2562] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:50 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:51.024035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-58653add-69a7-48f5-9777-e55ee409b77e req-0e0a8c57-6ff4-435e-86e8-fde68a031614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bfd505-2b77-4e11-a800-c92a473a73e6", "name": "network-vif-plugged", "status": "completed", "tag": "d8dadee9-cfd0-4802-908a-a00de6cb54eb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:51.049863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-58653add-69a7-48f5-9777-e55ee409b77e req-0e0a8c57-6ff4-435e-86e8-fde68a031614 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:51.050775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-58653add-69a7-48f5-9777-e55ee409b77e req-0e0a8c57-6ff4-435e-86e8-fde68a031614 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:51.076032 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-58653add-69a7-48f5-9777-e55ee409b77e req-0e0a8c57-6ff4-435e-86e8-fde68a031614 service nova] Creating event network-vif-plugged:d8dadee9-cfd0-4802-908a-a00de6cb54eb for instance 54bfd505-2b77-4e11-a800-c92a473a73e6 on nch2-master-1 Jun 25 21:01:51.156311 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-58653add-69a7-48f5-9777-e55ee409b77e req-0e0a8c57-6ff4-435e-86e8-fde68a031614 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146295 Jun 25 21:01:51.158271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1149/2563] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:51.206281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:51.215115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:51.227091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:51.235759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d74403c5-f579-4910-8b99-630ebd506145 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.385747 Jun 25 21:01:51.244280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1415/2564] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:50 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:51.245396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:51.249320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:51.252109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:51.257023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:51.288243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d HTTP/1.1 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '17a04f94-7a5c-4ddd-9702-de720634c98d'} Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:51.291205 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:51.295958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:51.297240 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c104f755-3ed9-4799-a9a6-dcd5125ec71b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 404 len: 111 microversion: 2.1 time: 0.136805 Jun 25 21:01:51.298038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1150/2565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:51 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:01:51.323530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53137d79-d817-4eb7-8882-56bd66bc08f3 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984efca820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:51.470058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1052873459", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:51.501624 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53137d79-d817-4eb7-8882-56bd66bc08f3 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1423 microversion: 2.1 time: 0.190786 Jun 25 21:01:51.502692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1416/2566] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:51 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1423 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:51.564718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:51.864755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:51.865388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:51.874360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:51.874829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:51.877558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:51.878046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.561366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:52.561868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:52.562592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:52.562754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:52.563174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:52.577294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.577761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.578590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.579013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.591782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:52.601939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-052a3db7-ee43-4430-b07f-36b158c286ee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.741137 Jun 25 21:01:52.602553 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1417/2567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:51 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:52.612045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:52.614407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:52.629894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.630202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.630992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.631433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.638149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:52.643407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:52.668863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:52.671567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:52.775676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-05839ffd-502d-4b01-bebe-b11f9d14cf2c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.310708 Jun 25 21:01:52.778650 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1151/2568] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:01:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:01:52.792384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:52.794257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:52.805493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.807244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.809456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:52.810309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:52.956355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:52.970495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8309028-6ff5-4195-8815-7a7b70250629 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.362260 Jun 25 21:01:52.972273 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1418/2569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:52 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:52.985890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa5f8695-4840-4e01-a275-84a3853af9a0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef1f5e0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:53.070621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa5f8695-4840-4e01-a275-84a3853af9a0 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1432 microversion: 2.1 time: 0.094112 Jun 25 21:01:53.073305 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1419/2570] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:52 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1432 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:53.096626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-551db886-6561-4cd2-957c-7b09d5866ea5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:53.099131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-551db886-6561-4cd2-957c-7b09d5866ea5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:53.381471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-551db886-6561-4cd2-957c-7b09d5866ea5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:53.400299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-551db886-6561-4cd2-957c-7b09d5866ea5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1215 microversion: 2.1 time: 0.317856 Jun 25 21:01:53.405447 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1420/2571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:53 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1215 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:53.420332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-275b1e87-a4af-4783-bbef-0d4081018f65 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861ebb670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:53.428899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:53.449184 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3d81580-6c5f-4411-89f5-2bc55d6ecc96 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1292 microversion: 2.1 time: 0.669038 Jun 25 21:01:53.460660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1152/2572] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:52 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1292 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:53.517700 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-275b1e87-a4af-4783-bbef-0d4081018f65 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 200 len: 1432 microversion: 2.1 time: 0.111382 Jun 25 21:01:53.518636 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1421/2573] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:53 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 1432 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:53.532633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:53.534366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:53.546386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:53.547785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:53.549244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:53.549942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:53.620003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:53.622564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:53.647343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:53.648607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:53.658120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:53.658976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.005599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:54.018436 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba047da2-9d52-4575-b9d2-4c36982c810b tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1480 microversion: 2.1 time: 0.490607 Jun 25 21:01:54.028868 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1153/2574] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:53 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1480 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:54.039581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:54.046378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:54.054217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.055184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.056642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.057257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.296523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:54.308127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aaadd6b7-d414-4bd2-85de-ea09ab4d837c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.692931 Jun 25 21:01:54.310256 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1422/2575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:53 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:54.343282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:54.360987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f013962-faf2-4bcf-b5c3-18a230fe21be tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.330868 Jun 25 21:01:54.367768 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1154/2576] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:54 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:54.421482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:54.422498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:54.435215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.451124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.454467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.455020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.467823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:54.470734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:54.487679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.492705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.493895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:54.494480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:54.611618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:54.617827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:54.627072 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d12a9a49-6aea-4c68-9918-9ef6b887a662 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1285 microversion: 2.1 time: 0.208329 Jun 25 21:01:54.636904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1423/2577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:54 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:54.991556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:55.003411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-33f2a01e-d8d0-4fdf-ac3c-32fd72b3ec6d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1483 microversion: 2.1 time: 0.540804 Jun 25 21:01:55.006825 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1155/2578] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:54 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1483 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:55.029226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:55.030072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:55.037412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:55.047086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:55.053249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.056061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.058751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.061264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.067210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.068286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.071220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.071674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.231174 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fd36cc8-d6f1-491d-afc8-58d3225d4d5c tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211798 Jun 25 21:01:55.232085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1424/2579] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:01:55 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6/os-interface => generated 285 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:55.326748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:55.327366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:55.334035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.334487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.335268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.346901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.680664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:55.689748 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a2e3f6e-7690-462b-be41-64c4ec63d898 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.366873 Jun 25 21:01:55.694743 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1425/2580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:55 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:01:55.699577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:55.700195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:55.724083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.724574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.725364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:55.725800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:55.932098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:55.942155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d90956a2-64bd-4385-8a4e-31bc51bb6e69 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1467 microversion: 2.1 time: 0.909741 Jun 25 21:01:55.943480 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1156/2581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:55 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1467 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:55.950913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:55.974026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:56.023357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:56.023726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:56.025823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:56.026940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:56.031952 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bc06f89-8f6d-4cf3-9c45-3768d1d5fb3f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.336115 Jun 25 21:01:56.032625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:56.052364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1426/2582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:55 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:56.168989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:56.190636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8d17f06-5300-4a85-8eaf-b9b2a600f24a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1273 microversion: 2.1 time: 0.240333 Jun 25 21:01:56.193365 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1157/2583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:55 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1273 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:56.205994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9840e888-a58c-4470-9ab3-4670ec0f539d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861f0f0d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:56.297718 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9840e888-a58c-4470-9ab3-4670ec0f539d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795" status: 200 len: 784 microversion: 2.1 time: 0.102335 Jun 25 21:01:56.298965 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1158/2584] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:56 2022] GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795 => generated 784 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:56.319287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-259320198", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "f626c25f-f57a-4234-9b21-acbfef776e96"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:56.329382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-694c4c4c-be43-4e18-abb6-eb5ba76c8a21 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:56.343525 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-694c4c4c-be43-4e18-abb6-eb5ba76c8a21 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036828 Jun 25 21:01:56.344692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1159/2585] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:01:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:01:56.361043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01a82433-8204-47cf-8c6c-b6f2a4115c7f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861eb7790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:56.405864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] validate_networks() for [('f626c25f-f57a-4234-9b21-acbfef776e96', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:01:57.317863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01a82433-8204-47cf-8c6c-b6f2a4115c7f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "DELETE /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 204 len: 0 microversion: 2.1 time: 0.966836 Jun 25 21:01:57.318577 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1160/2586] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:56 2022] DELETE /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 0 bytes in 968 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:01:57.323763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:57.324653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:57.337637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.338830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.340407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.341081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.363392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:01:57.364408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:01:57.365061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:01:57.365626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:01:57.366191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:01:57.389236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.389903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.391000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.391543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.421720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Getting quotas for project 58851e54cb214793b2e9ab09d0b3dac6. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:01:57.429288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Getting quotas for user 22302e87c7c141829fe04c06684650a5 and project 58851e54cb214793b2e9ab09d0b3dac6. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:01:57.445975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:01:57.449609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:01:57.578210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9ed19bd-c7be-4ba1-b43e-949d68ce3d19 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.521021 Jun 25 21:01:57.579385 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1427/2587] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:01:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:01:57.585338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:57.586168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:57.594181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.595219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.596240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.596910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.745707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:57.756257 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01ea4b33-29e2-4000-9564-a9f6513fac86 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.436330 Jun 25 21:01:57.761849 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1161/2588] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:57 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:57.772391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:57.773050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:57.776155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:57.788834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.793325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.797124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.797589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.819857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:57.834679 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a163fc9-44d0-496b-b88c-4ae2c38667ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.253775 Jun 25 21:01:57.835884 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1428/2589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:57 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:57.841462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:57.842559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:57.849502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.850314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:57.851330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:57.852007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.103680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.112723 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fca8506f-bdcc-4d33-a671-33e35f7bce60 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.349542 Jun 25 21:01:58.123337 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1162/2590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:57 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:58.137056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c308476-a58d-4395-975b-1f301140c4e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861f249d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:58.173662 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2c308476-a58d-4395-975b-1f301140c4e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] HTTP exception thrown: Image not found. Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c308476-a58d-4395-975b-1f301140c4e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Request method failure captured: Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 HTTP/1.1 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eC48llsnD-KgiyIXpg-xUKSIowKDXBwQRQx3JaLDNXgCLJ_2uC9OrE3dIDRcH7Tlnr8ESF6xHD_XK1BTS8aADdB3WlgVEPM_SJrA_31TiqT4I1vCHyIIB7YXqGfTa5H7M1im9mETg4NOXeX6vgnQRehBdmnzXvWwTORE-LFRceDWk Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}] Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 5a80f9c350664a839bdada41c1973b1e Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: exception: Image not found. Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '80fad322-7eeb-4844-9143-abce15aa3315'} Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 80fad322-7eeb-4844-9143-abce15aa3315 Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:01:58.175981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80fad322-7eeb-4844-9143-abce15aa3315 could not be found. Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:01:58.179624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:01:58.184334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.188131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c308476-a58d-4395-975b-1f301140c4e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Returning 404 to user: Image not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:01:58.188131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c308476-a58d-4395-975b-1f301140c4e9 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 404 len: 62 microversion: 2.1 time: 0.061943 Jun 25 21:01:58.188131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1163/2591] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:01:58 2022] GET /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:01:58.193228 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-994574df-6040-4e78-918f-7dd66dccdcb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.355861 Jun 25 21:01:58.194719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1429/2592] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:57 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:58.206910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:58.207599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:58.210197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d12e22fd-a60c-4b21-9c9f-8c9d66aa4f7c req-9a92d4e4-770a-4440-b3de-310da601b85c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54bfd505-2b77-4e11-a800-c92a473a73e6", "tag": "d8dadee9-cfd0-4802-908a-a00de6cb54eb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:58.223515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d12e22fd-a60c-4b21-9c9f-8c9d66aa4f7c req-9a92d4e4-770a-4440-b3de-310da601b85c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.223718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.224199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.224606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d12e22fd-a60c-4b21-9c9f-8c9d66aa4f7c req-9a92d4e4-770a-4440-b3de-310da601b85c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.225044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.225555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.244721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d12e22fd-a60c-4b21-9c9f-8c9d66aa4f7c req-9a92d4e4-770a-4440-b3de-310da601b85c service nova] Creating event network-changed:d8dadee9-cfd0-4802-908a-a00de6cb54eb for instance 54bfd505-2b77-4e11-a800-c92a473a73e6 on nch2-master-1 Jun 25 21:01:58.254431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d12e22fd-a60c-4b21-9c9f-8c9d66aa4f7c req-9a92d4e4-770a-4440-b3de-310da601b85c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056911 Jun 25 21:01:58.261270 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1430/2593] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:01:58.269348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:58.270337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:58.281975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:58.498771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.512963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.515842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.519327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36ba4d0a-1631-44b7-98a1-07603f5990c8 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1261 microversion: 2.26 time: 0.256448 Jun 25 21:01:58.519932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1431/2594] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:01:58 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:01:58.530943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:58.541736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-162149190"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:01:58.542970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:58.545796 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d21939bb-7756-4562-b251-9bafef15ef2e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1483 microversion: 2.1 time: 0.357817 Jun 25 21:01:58.552245 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1164/2595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:58 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1483 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:58.561741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:58.575178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.576450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:58.577135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.577975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.578443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.593382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.593843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:58.594682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:58.595130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.285286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24e82c48-4843-4692-a77e-83f64c498412 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "POST /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d/action" status: 202 len: 0 microversion: 2.1 time: 0.763757 Jun 25 21:01:59.300887 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1432/2596] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:01:58 2022] POST /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:01:59.312395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:59.313498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:59.325234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.325875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.327157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.327813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.366797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:59.375935 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d27f4b3a-7909-4c32-9a30-2437276047d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.817986 Jun 25 21:01:59.378754 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1165/2597] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:58 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:59.393911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:59.394995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:59.408170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.414751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.416113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.424316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.822967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:59.843115 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-12364383-1b2d-4802-817e-512e84f0e3ef tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.538329 Jun 25 21:01:59.858034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1433/2598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:59 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:01:59.863618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:01:59.864679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:01:59.878624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.879295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.880231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:01:59.880730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:01:59.987105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:01:59.990937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:00.003432 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85246a02-9858-454c-be8a-698749b039c8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.622488 Jun 25 21:02:00.007315 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1166/2599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:59 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:00.026951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79ed8702-5902-4454-bfeb-92cf8e6f3076 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861f0c550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:00.077621 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79ed8702-5902-4454-bfeb-92cf8e6f3076 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.068979 Jun 25 21:02:00.085384 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1167/2600] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:00 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:00.091518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:00.092416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:00.099842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.100602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.101640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.102542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.262028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:00.274034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04790a04-eb33-413e-9f74-8e20110149f5 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.414290 Jun 25 21:02:00.275616 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1434/2601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:01:59 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:00.281253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:00.282271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:00.302653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.303366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.304443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.305139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.451323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:00.461569 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eec06a90-89b0-417f-af64-2358795fc8a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.374654 Jun 25 21:02:00.462764 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1168/2602] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:00 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:00.471067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-990e865b-6897-4ca7-b65e-f2ac23e71a1e req-2b8ac17f-d599-49d6-9bb9-60a012211b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c803ec-b4b8-4e7f-abb4-0729fafb8747", "tag": "a576aa0f-a7a6-4575-821b-527e7754fe55"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:00.482878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-990e865b-6897-4ca7-b65e-f2ac23e71a1e req-2b8ac17f-d599-49d6-9bb9-60a012211b5b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.483660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-990e865b-6897-4ca7-b65e-f2ac23e71a1e req-2b8ac17f-d599-49d6-9bb9-60a012211b5b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.493693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:00.497275 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-990e865b-6897-4ca7-b65e-f2ac23e71a1e req-2b8ac17f-d599-49d6-9bb9-60a012211b5b service nova] Creating event network-changed:a576aa0f-a7a6-4575-821b-527e7754fe55 for instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 on nch1-master-1 Jun 25 21:02:00.505953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-990e865b-6897-4ca7-b65e-f2ac23e71a1e req-2b8ac17f-d599-49d6-9bb9-60a012211b5b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040739 Jun 25 21:02:00.506976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:00.507294 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1169/2603] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:00.509082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:00.510167 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8008f784-95eb-41bf-8da7-9248105b3774 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1319 microversion: 2.26 time: 0.232886 Jun 25 21:02:00.510953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1435/2604] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:00 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:00.521109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-788898156"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:00.521109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:00.525451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.525920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.526713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.527263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.528398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2774d4da-f514-470a-bbe0-bb888ae50987 req-cfb01b67-7f3f-4e74-a046-cc4dd2528f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-unplugged", "status": "completed", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:00.544263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2774d4da-f514-470a-bbe0-bb888ae50987 req-cfb01b67-7f3f-4e74-a046-cc4dd2528f2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.545013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2774d4da-f514-470a-bbe0-bb888ae50987 req-cfb01b67-7f3f-4e74-a046-cc4dd2528f2c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.575292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2774d4da-f514-470a-bbe0-bb888ae50987 req-cfb01b67-7f3f-4e74-a046-cc4dd2528f2c service nova] Creating event network-vif-unplugged:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:02:00.586611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2774d4da-f514-470a-bbe0-bb888ae50987 req-cfb01b67-7f3f-4e74-a046-cc4dd2528f2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077534 Jun 25 21:02:00.590740 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1170/2605] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:00.864728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:00.865438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:00.878529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.878984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.879970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:00.887694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:00.940746 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a105bf7-5c28-48f9-8ac5-df0da14b01a6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.428413 Jun 25 21:02:00.944168 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1436/2606] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:00 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 25 21:02:01.031907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:01.032987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:01.051287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.052209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.053379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.055195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.123620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.140299 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70b53e7d-7d5d-4d9b-bb59-664e059d5ab7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.280147 Jun 25 21:02:01.143409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1171/2607] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:00 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:01.156179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b965296-2f52-407e-b171-ec726be2ff43 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861eb7c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:01.210008 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b965296-2f52-407e-b171-ec726be2ff43 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.064994 Jun 25 21:02:01.210632 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1172/2608] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:01 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:01.294484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:01.296146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:01.305087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.305834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.307222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.307900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.482119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.493416 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77788ee0-ffc2-4a08-b7f9-658aa2292cf9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.205804 Jun 25 21:02:01.494166 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1173/2609] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:01 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:01.530960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:01.531833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:01.540250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.551810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.553781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.554981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:01.555640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:01.557559 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1372f4d4-4886-4e5f-8702-d6ff96ec4a49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.537185 Jun 25 21:02:01.558498 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1437/2610] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:01 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:01.865132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.876281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.878114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:01.879485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6633409-b9e8-4e39-bd59-2380969cb734 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.352736 Jun 25 21:02:01.880503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1174/2611] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:01 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:02.176210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:02.178254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:02.202613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.203071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.203856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.204384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.224699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dcce38b2-3215-4e28-826f-071b3a054f28 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861f0c160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:02.305042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dcce38b2-3215-4e28-826f-071b3a054f28 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.085133 Jun 25 21:02:02.311958 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1175/2612] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:02 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:02.510914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:02.511640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:02.523535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.524088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.525054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.525711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.608976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:02.617312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:02.626324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-27fc326c-b6b6-4f2f-a2d8-d1872b1b1a7b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.470817 Jun 25 21:02:02.627273 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1438/2613] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:02 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:02.632095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:02.640551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:02.649514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.654867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.658160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:02.660397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:02.663277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:03.049377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.060477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4eebef83-8a44-439b-98cf-e2e931f04ee2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.431775 Jun 25 21:02:03.079799 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1439/2614] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:02 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:03.095132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:03.097254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:03.115038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:03.123299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:03.124304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:03.127074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:03.184510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:03.345169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.354127 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f2f7ac4-d6d8-4ec8-a85c-fe87d1fb59d8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.847071 Jun 25 21:02:03.366108 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1176/2615] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:02 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:03.371539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-122352f8-ada0-4ed6-a2e3-981ab98a6748 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861fd3940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:03.461341 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-122352f8-ada0-4ed6-a2e3-981ab98a6748 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.093566 Jun 25 21:02:03.461951 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1177/2616] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:03 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:03.571963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.583626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.585686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.587081 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb662200-3daa-4ed4-89c2-fda3a0d2879c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.506170 Jun 25 21:02:03.587853 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1440/2617] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:03 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:03.645962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:03.646672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:03.660120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:03.661228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:03.662345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:03.663739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:03.859272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff59c39a-6adf-45cd-86d5-9498a2b4f9c3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984efcaaf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1601628341", "description": "tempest-description-277674764"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:03.916540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:03.926248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b333663-11b2-4fb2-aebb-52b6a44d0ade tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.285663 Jun 25 21:02:03.927173 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1178/2618] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:03 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:03.932569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-14dfd477-2fce-4bf9-95f9-82b2e2f23c94 req-87088dcf-9cb8-4d96-ac42-80719799bc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8", "tag": "a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:03.942392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-14dfd477-2fce-4bf9-95f9-82b2e2f23c94 req-87088dcf-9cb8-4d96-ac42-80719799bc26 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:03.942929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-14dfd477-2fce-4bf9-95f9-82b2e2f23c94 req-87088dcf-9cb8-4d96-ac42-80719799bc26 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:03.957533 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-14dfd477-2fce-4bf9-95f9-82b2e2f23c94 req-87088dcf-9cb8-4d96-ac42-80719799bc26 service nova] Creating event network-changed:a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38 for instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 on nch2-master-1 Jun 25 21:02:03.962996 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-14dfd477-2fce-4bf9-95f9-82b2e2f23c94 req-87088dcf-9cb8-4d96-ac42-80719799bc26 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034194 Jun 25 21:02:03.963913 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1179/2619] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:04.048625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff59c39a-6adf-45cd-86d5-9498a2b4f9c3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.280905 Jun 25 21:02:04.049236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1441/2620] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:02:04.061373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55dc38db-c040-4d2b-87a0-4e552840eb59 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f985c785e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-675004221", "description": "tempest-description-879048064"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:04.097350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:04.098471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:04.105071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.105602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:04.106748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.107372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:04.245501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55dc38db-c040-4d2b-87a0-4e552840eb59 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.188876 Jun 25 21:02:04.246488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1180/2621] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:04 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:02:04.279289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:04.297319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa2f9b76-9eea-4b26-b7fb-6029b6f5f6cf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1477 microversion: 2.1 time: 0.203864 Jun 25 21:02:04.307173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1442/2622] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:04 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1477 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:04.324504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1347577417", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "155055c1-4914-4551-857d-2818fd5d2a3f"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:04.376923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] validate_networks() for [('155055c1-4914-4551-857d-2818fd5d2a3f', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:02:04.382489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:04.383187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:04.397930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.400593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:04.401747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.402458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:04.760980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:04.770456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-537c1a45-f29a-4530-ab47-2105d496bb6f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.391560 Jun 25 21:02:04.771643 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1443/2623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:04 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:04.789268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5925edd-4bab-4ec5-ac97-831082fa56fc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef89550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:04.887958 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5925edd-4bab-4ec5-ac97-831082fa56fc tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.114926 Jun 25 21:02:04.890116 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1444/2624] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:04 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:04.900130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:04.903902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:04.922844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.926927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:04.929713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:04.931903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.183779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:05.184866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:05.185552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:05.186172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:05.187048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:05.204858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.205884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.207191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.209060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.250677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Getting quotas for project 663694278b344fe7896f524fac12ffcc. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:02:05.258576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:05.259420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Getting quotas for user 1253f8908e434038b07f5e2ed7d15d30 and project 663694278b344fe7896f524fac12ffcc. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:02:05.269617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:05.273682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:05.276348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d43e518-67fa-400e-94eb-352fcae8ae31 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.382822 Jun 25 21:02:05.277877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:02:05.278169 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1445/2625] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:04 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:05.281199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:02:05.300776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:05.302622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:05.320651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.322359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.324631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.325980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.353461 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf269816-5131-41e5-ab1c-088a281a89fa tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.033306 Jun 25 21:02:05.355137 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1181/2626] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:02:05.364175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:05.365195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:05.379631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.381607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.383037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.384053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.693425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:05.708646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78bb454f-dc36-4b78-ab17-38c5a9b6f4e5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1476 microversion: 2.1 time: 0.350012 Jun 25 21:02:05.709309 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1182/2627] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:05 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:05.725279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bbb96368-232c-4126-947c-1dfef6291b40 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:05.729907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bbb96368-232c-4126-947c-1dfef6291b40 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:05.878033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bbb96368-232c-4126-947c-1dfef6291b40 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:05.892082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bbb96368-232c-4126-947c-1dfef6291b40 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1216 microversion: 2.1 time: 0.178143 Jun 25 21:02:05.894140 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1183/2628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:05 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1216 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:05.911132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a5860a23-bc13-4131-b8ee-ff45f3a77620 req-98efc113-5b79-4cb3-9431-d10d19e37066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c803ec-b4b8-4e7f-abb4-0729fafb8747", "name": "network-vif-plugged", "status": "completed", "tag": "a576aa0f-a7a6-4575-821b-527e7754fe55"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:05.932404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5860a23-bc13-4131-b8ee-ff45f3a77620 req-98efc113-5b79-4cb3-9431-d10d19e37066 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:05.937532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5860a23-bc13-4131-b8ee-ff45f3a77620 req-98efc113-5b79-4cb3-9431-d10d19e37066 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:05.966862 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a5860a23-bc13-4131-b8ee-ff45f3a77620 req-98efc113-5b79-4cb3-9431-d10d19e37066 service nova] Creating event network-vif-plugged:a576aa0f-a7a6-4575-821b-527e7754fe55 for instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 on nch1-master-1 Jun 25 21:02:05.973843 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a5860a23-bc13-4131-b8ee-ff45f3a77620 req-98efc113-5b79-4cb3-9431-d10d19e37066 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077250 Jun 25 21:02:05.974702 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1184/2629] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:05.990349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:05.996898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:06.010801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.011590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.013109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.013856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.359283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:06.368572 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec3fa555-b767-45f2-b4e4-aafddf4d4487 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.392350 Jun 25 21:02:06.373366 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1185/2630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:05 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:06.386963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "name": "network-vif-unplugged", "status": "completed", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:06.410723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:06.415470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.421057 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-638c43b7-c586-454b-9b6f-59beafc79d12 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 1.130954 Jun 25 21:02:06.422001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.425286 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1446/2631] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:05 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:06.433870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6de46ba2-7bbc-4edb-be5d-b32c7b96b6b4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fe1ae50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:06.463361 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] Creating event network-vif-unplugged:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch1-master-1 Jun 25 21:02:06.477791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] Instance e03d38f8-6dce-4362-9511-c88250b1baaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:02:06.507276 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3f68703c-f693-48aa-941f-c24891820c2f req-e5fafb78-22e2-420d-af76-e0bc7dae224c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132324 Jun 25 21:02:06.510861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6de46ba2-7bbc-4edb-be5d-b32c7b96b6b4 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.082071 Jun 25 21:02:06.511690 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1186/2632] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:06.519470 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1447/2633] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:06 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:06.522329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:06.523356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:06.540678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.544440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.546059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.546589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.729295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:06.730398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:06.768002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.773030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.774230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.774868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.802146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:06.811974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:06.814058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:06.815672 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-387028bd-7077-4419-a015-3545817bb191 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.302711 Jun 25 21:02:06.816393 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1187/2634] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:06 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:06.913240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:06.914213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:06.926782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.937233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:06.938456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:06.939098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.061849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.065986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.075847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35016613-5a93-49ee-965f-e40129f41b49 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1476 microversion: 2.1 time: 0.353037 Jun 25 21:02:07.077853 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1448/2635] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:06 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1476 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:07.090720 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fedd4063-9d3e-42ef-a27e-8ef3c778f315 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1268 microversion: 2.1 time: 0.183524 Jun 25 21:02:07.091329 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1188/2636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:06 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:07.389693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:07.391208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:07.399717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.400282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.401305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.401840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.406496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:07.444162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:07.445453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:07.469604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.470679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.471767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.472628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.585455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.594112 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59bdbc30-7e31-4f6f-bf16-b80be44d9582 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1315 microversion: 2.1 time: 0.208443 Jun 25 21:02:07.595221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1449/2637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:07 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:07.600927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a37edae3-dc85-450f-959c-2233aed39991 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fcbfee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:07.656194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.656845 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a37edae3-dc85-450f-959c-2233aed39991 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.059976 Jun 25 21:02:07.657643 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1450/2638] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:07 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:07.665394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a444a7d-9701-490c-b7f2-fc6f4cb45871 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.227434 Jun 25 21:02:07.666740 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1189/2639] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:07 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:07.834990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:07.835843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:07.842880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.843584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.844627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:07.845074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:07.987426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.996516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.998479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:07.999659 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4af9ccf-ffb5-41d7-a469-8c67bed1cd7a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.169832 Jun 25 21:02:08.000234 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1451/2640] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:07 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:08.013048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b272656c-b28d-431d-8039-3841d7b99140 req-e811dc2a-caa3-44f5-a601-af18bd87f21c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-plugged", "status": "completed", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:08.027858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b272656c-b28d-431d-8039-3841d7b99140 req-e811dc2a-caa3-44f5-a601-af18bd87f21c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.028352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b272656c-b28d-431d-8039-3841d7b99140 req-e811dc2a-caa3-44f5-a601-af18bd87f21c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.047166 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b272656c-b28d-431d-8039-3841d7b99140 req-e811dc2a-caa3-44f5-a601-af18bd87f21c service nova] Creating event network-vif-plugged:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:02:08.052513 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b272656c-b28d-431d-8039-3841d7b99140 req-e811dc2a-caa3-44f5-a601-af18bd87f21c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043550 Jun 25 21:02:08.053133 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1190/2641] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:08.096756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:08.098168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:08.107808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:08.108573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:08.113543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.114209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.115175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.116368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.117593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.118319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.119252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.119850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.222597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:08.234835 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4afe5a44-3950-4f90-b7e3-e7df48dd480c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1274 microversion: 2.1 time: 0.130602 Jun 25 21:02:08.236130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1191/2642] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:08 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:08.293931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:08.303137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e9148e3-e81e-4b1c-b8be-8017cf4116e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1476 microversion: 2.1 time: 0.211477 Jun 25 21:02:08.303934 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1452/2643] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:08 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:08.538757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:08.553109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.553853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.568572 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] Creating event network-changed:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch1-master-1 Jun 25 21:02:08.576562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] Instance e03d38f8-6dce-4362-9511-c88250b1baaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:02:08.592450 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9eee4958-57ad-4acf-ad89-7a276c9e8e54 req-45b40be3-e091-4f8b-a6f7-fc4692059aa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062004 Jun 25 21:02:08.593856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1192/2644] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:08.615700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:08.617112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:08.630274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:08.632233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.632845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.633693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.634347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.671907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5ea0ba6-a875-4635-8081-80ae01bdca7f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861eb4790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:08.734093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5ea0ba6-a875-4635-8081-80ae01bdca7f tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.067032 Jun 25 21:02:08.734933 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1193/2645] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:08 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:08.740915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:08.741834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:08.750345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.750874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.758569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.759021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.819961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:08.830880 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-20bcad10-a9db-4cfb-ad7b-85411d2a9456 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1502 microversion: 2.1 time: 0.223134 Jun 25 21:02:08.831851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1453/2646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:08 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:08.849765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:08.850545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:08.859341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.860005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.861243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:08.862107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:08.898198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'flavor' on Instance uuid 01c803ec-b4b8-4e7f-abb4-0729fafb8747 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:08.940685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:08.950437 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a39e05f0-19c4-4144-95a8-7a4b6cf0efb7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.213577 Jun 25 21:02:08.951351 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1194/2647] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:08 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:09.020323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.021321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:09.029896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.030668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.031582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.032142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.038671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:09.206961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.220558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.222763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.224149 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48cfce23-043f-4dac-a1bf-ce9b43d88c3a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.209107 Jun 25 21:02:09.225019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1195/2648] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:09.244220 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1fa3035d-b57b-4788-9ca3-473e1e72bed0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747/action" status: 202 len: 0 microversion: 2.1 time: 0.398550 Jun 25 21:02:09.245535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1454/2649] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:08 2022] POST /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:02:09.254818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.256022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:09.257059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.257688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:09.264045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.264543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.265115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.265350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.265775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.266113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.267026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.267979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.436614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.443571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.444523 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0dcec0eb-3c1b-43c1-842b-dc2baba51b91 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.195158 Jun 25 21:02:09.445861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1196/2650] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:09.450751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.451365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:09.457641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.458318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.459312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:09.459922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:09.460886 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e127e08e-06cb-49db-a202-3129c04a26ce tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.211098 Jun 25 21:02:09.461497 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1455/2651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:09.603245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:09.612281 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4dcc85f4-e767-4bef-9336-c92f879281a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1474 microversion: 2.1 time: 0.165009 Jun 25 21:02:09.612896 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1197/2652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1474 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:09.747428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9de8884-198d-48d3-bf7d-3c17d472f7c7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef89940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.810484 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9de8884-198d-48d3-bf7d-3c17d472f7c7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.066878 Jun 25 21:02:09.811919 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1456/2653] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:09.973203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:09.980682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:10.005827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.006283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.012694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.016124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.097388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ac5f145a-a909-4145-b9ab-4516da9ddae6 req-e05f9a55-1e18-4e0b-84d4-7bafc16334c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:10.117488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ac5f145a-a909-4145-b9ab-4516da9ddae6 req-e05f9a55-1e18-4e0b-84d4-7bafc16334c4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.121298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ac5f145a-a909-4145-b9ab-4516da9ddae6 req-e05f9a55-1e18-4e0b-84d4-7bafc16334c4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.145072 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ac5f145a-a909-4145-b9ab-4516da9ddae6 req-e05f9a55-1e18-4e0b-84d4-7bafc16334c4 service nova] Creating event network-vif-plugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:02:10.151609 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ac5f145a-a909-4145-b9ab-4516da9ddae6 req-e05f9a55-1e18-4e0b-84d4-7bafc16334c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058463 Jun 25 21:02:10.153027 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1457/2654] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:10.248926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:10.249650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:10.269730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.270181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.270992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.271421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.583505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:10.587877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:10.594038 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ab79497-4b0a-4c0f-a67a-ced42905efa3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.629674 Jun 25 21:02:10.606205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:10.607127 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1198/2655] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:09 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:10.607697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:10.609903 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f19372c0-0d9c-483b-bcf3-5a180f404908 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.367928 Jun 25 21:02:10.615124 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1458/2656] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:10 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:10.618615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:10.621867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:10.629564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:10.631563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:10.638046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.641079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.642201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.642790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.647850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.648451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.652175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:10.653909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:10.973345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:10.981764 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-004b8e32-66be-43f2-b844-007340345122 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.363276 Jun 25 21:02:10.982389 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1459/2657] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:10 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:10.996362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:10.997256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:11.004680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.005308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.006661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.007139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.163744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:11.166263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:11.173392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2870af6f-30f5-4c0b-b197-64d37007cafc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1471 microversion: 2.1 time: 0.189945 Jun 25 21:02:11.174106 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1460/2658] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:10 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1471 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:11.179250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e52597f-50b7-464e-a377-c19fc8e65e4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ef89550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:11.232687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e52597f-50b7-464e-a377-c19fc8e65e4d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.056950 Jun 25 21:02:11.233492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1461/2659] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:11 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:11.239532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:11.240379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:11.247088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.247561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.248417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.248950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.326435 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-726a7350-f305-43cb-ac3c-47a1c156bbee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa/action" status: 204 len: 0 microversion: 2.1 time: 0.091200 Jun 25 21:02:11.327758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1462/2660] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:11 2022] POST /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa/action => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:02:11.348732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:11.349822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:11.378387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.380377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.382850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.384823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.388609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:11.404960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0631e00e-c8e6-484e-accf-c7bc1c49a82e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.795569 Jun 25 21:02:11.414480 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1199/2661] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:10 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:11.576882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-711fc70c-8e1d-4b24-ab13-7278c17e2664 req-d488398d-cf1c-4f29-b418-4748f4ea0499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b7f128-174d-4e0d-b5d1-7c575e73ef4a", "tag": "5324ff71-996c-4e38-ae82-0a8264ef5901"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:11.588072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-711fc70c-8e1d-4b24-ab13-7278c17e2664 req-d488398d-cf1c-4f29-b418-4748f4ea0499 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.588854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-711fc70c-8e1d-4b24-ab13-7278c17e2664 req-d488398d-cf1c-4f29-b418-4748f4ea0499 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.615341 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-711fc70c-8e1d-4b24-ab13-7278c17e2664 req-d488398d-cf1c-4f29-b418-4748f4ea0499 service nova] Creating event network-changed:5324ff71-996c-4e38-ae82-0a8264ef5901 for instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a on nch1-master-1 Jun 25 21:02:11.621293 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-711fc70c-8e1d-4b24-ab13-7278c17e2664 req-d488398d-cf1c-4f29-b418-4748f4ea0499 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050416 Jun 25 21:02:11.622257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1200/2662] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:11.628025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:11.629012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:11.635705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.641064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.642202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.642596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.749434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:11.758161 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9864877-023e-47e5-97ab-98bfa218aad3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1471 microversion: 2.1 time: 0.426092 Jun 25 21:02:11.767660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1463/2663] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:11 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:11.767660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:11.767660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:11.779381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.779916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.780878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:11.781389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:11.908802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:11.917877 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d65baac7-c9d0-4f7e-bf54-2bfe5ae31c76 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.294226 Jun 25 21:02:11.919621 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1201/2664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:11 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:11.999628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:12.000197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:12.006619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.007118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.007886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.008327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.048149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:12.058272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:12.059070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:12.060258 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8bed7645-ee19-40f6-9e50-6484ed3918f0 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.300118 Jun 25 21:02:12.060857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1464/2665] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:11 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:12.140286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:12.148772 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2402f0e6-2309-4601-8742-01cf4c35af68 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.153455 Jun 25 21:02:12.150730 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1202/2666] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:11 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:12.180198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "name": "network-vif-plugged", "status": "completed", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:12.188734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.189175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.201192 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] Creating event network-vif-plugged:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch1-master-1 Jun 25 21:02:12.206808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] Instance e03d38f8-6dce-4362-9511-c88250b1baaa is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:02:12.218328 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4776b6d5-4a69-42bf-ac8a-b4e3a3962916 req-cf6c0c05-19be-4581-9d33-ea2cb0188e87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041635 Jun 25 21:02:12.218672 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1465/2667] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:12.246839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-941428f7-30a9-4be6-9547-80ee1c959471 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984fce33a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:12.291837 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-941428f7-30a9-4be6-9547-80ee1c959471 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.049041 Jun 25 21:02:12.292450 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1203/2668] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:12 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:12.422798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:12.423518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:12.430786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.431250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.432032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.432497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.568821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:12.576505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0216a62-3bd3-4690-8495-006c0d92b2d3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.158296 Jun 25 21:02:12.577093 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1466/2669] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:12 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:12.777153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:12.778689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:12.786807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.787285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.788049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.788660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.936203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:12.937078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:12.944555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.945108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:12.946171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:12.946784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.072248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.096814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-96f9dc41-9184-4b62-8d65-406df046dadc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1471 microversion: 2.1 time: 0.324796 Jun 25 21:02:13.097437 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1204/2670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:12 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:13.105907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:13.106530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:13.113187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.113645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.114424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.114862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.123486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.133944 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b99924b8-5515-4146-bc6d-1d46c408b00b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.202533 Jun 25 21:02:13.134533 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1467/2671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:12 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:13.169555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:13.170196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:13.181307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.182101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.183764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.184775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.317232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.325620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.327120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.328250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2052c261-b422-4210-9979-a186eb394917 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.227838 Jun 25 21:02:13.329042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1205/2672] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:13 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:13.341712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab158f22-1fc8-40ee-954f-a69c58aeb25c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984f778e50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:13.383494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.393847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40e1773c-7b22-4e86-83e7-de8b31f6177f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.227642 Jun 25 21:02:13.396020 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1468/2673] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:13 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:13.399416 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab158f22-1fc8-40ee-954f-a69c58aeb25c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1428 microversion: 2.1 time: 0.069236 Jun 25 21:02:13.405264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1206/2674] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:13 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1428 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:13.594640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:13.595471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:13.602401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.602899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.603709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:13.604150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:13.775824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:13.787685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe3faead-5c8e-45f2-841a-dc129f0958fd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.197259 Jun 25 21:02:13.789030 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1469/2675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:13 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:14.121816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:14.122439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:14.135745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.136604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.137379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.137813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.152825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:14.153664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:14.188858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.192123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.197229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.198148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.447443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.462124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.475300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cad347e9-f5e7-44cc-a568-473bd64f064e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1521 microversion: 2.1 time: 0.327338 Jun 25 21:02:14.476478 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1470/2676] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:14.481805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1aaa68b9-7a40-471d-b65b-db4f2081e9e4 req-7e3a307d-9bc2-4627-8f6e-ff5c406d0719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8", "name": "network-vif-plugged", "status": "completed", "tag": "a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:14.488034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93f2a7d0-99f8-4ba3-bb3f-2a6f8020c6e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1463 microversion: 2.1 time: 0.377832 Jun 25 21:02:14.489107 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1207/2677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1463 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:14.493058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1aaa68b9-7a40-471d-b65b-db4f2081e9e4 req-7e3a307d-9bc2-4627-8f6e-ff5c406d0719 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.494043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1aaa68b9-7a40-471d-b65b-db4f2081e9e4 req-7e3a307d-9bc2-4627-8f6e-ff5c406d0719 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.505013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:14.505686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:14.512144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1aaa68b9-7a40-471d-b65b-db4f2081e9e4 req-7e3a307d-9bc2-4627-8f6e-ff5c406d0719 service nova] Creating event network-vif-plugged:a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38 for instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 on nch2-master-1 Jun 25 21:02:14.520910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1aaa68b9-7a40-471d-b65b-db4f2081e9e4 req-7e3a307d-9bc2-4627-8f6e-ff5c406d0719 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Jun 25 21:02:14.522475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1471/2678] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:14.527549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.529282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.530393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.530837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.545588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:14.546864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:14.559557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.560351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.561717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:14.562309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:14.785556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.795521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.800918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.802497 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f46268cf-8ee2-49dc-8e95-07413f1bfc45 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1361 microversion: 2.26 time: 0.312365 Jun 25 21:02:14.803271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1208/2679] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:14.808966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2017a3e9-381a-42d9-ac8c-7eef800479f2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984f6ffb80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:14.985337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:14.994233 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1de28fba-0037-40e9-baa5-ecfc2be91221 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.470216 Jun 25 21:02:14.994837 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1472/2680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:15.012806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:15.013446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:15.026653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.027129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.027935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.036573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.231509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:15.309824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89f3e66c-22fd-4c17-8efa-ba71ffffe88d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1614 microversion: 2.1 time: 0.298697 Jun 25 21:02:15.313896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1473/2681] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1614 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:15.326189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:15.330788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:15.346536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.347257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.348837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.350646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.545301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:15.554412 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4d8061cd-634a-408d-98f4-5c427b9798e1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.239199 Jun 25 21:02:15.557236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1474/2682] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:15 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:15.571648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77e682f3-51a9-439c-8344-3406ab80c327 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '.version_select at 0x7f9861f1b5e0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:15.579259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77e682f3-51a9-439c-8344-3406ab80c327 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.579719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77e682f3-51a9-439c-8344-3406ab80c327 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.594128 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77e682f3-51a9-439c-8344-3406ab80c327 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.035024 Jun 25 21:02:15.595041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1475/2683] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 21:02:15 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:15.607178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:15.608036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:15.619135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.619441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.620346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:15.620788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:15.838273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:15.851651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a5e49ca-97a9-45bc-ba87-274753169ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1501 microversion: 2.1 time: 0.255746 Jun 25 21:02:15.857057 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1476/2684] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:15 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:15.863101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1570696183", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:15.890763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:24.522917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:24.622992 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2017a3e9-381a-42d9-ac8c-7eef800479f2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1437 microversion: 2.1 time: 9.818350 Jun 25 21:02:24.624351 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1209/2685] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:14 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1437 bytes in 9820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:24.629758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:24.631238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:24.631587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:02:24.640078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.640791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.641758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.642206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.821196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:24.831274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:24.833007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:24.834200 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8af2b7b0-2a80-4edc-a4d2-9a0e040a019b tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1546 microversion: 2.26 time: 0.208582 Jun 25 21:02:24.848643 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1210/2686] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:24 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1546 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:24.854649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:24.855505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:24.862478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.863157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.864179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.874016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.895423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:24.896088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:24.896646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:24.897101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:24.897501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:24.908649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.909205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.910176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:24.910633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:24.930377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:02:24.937126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:02:24.951765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:02:24.954645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:02:25.009345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ab91ad9-3042-4004-b0c7-12fb29d6778c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.150236 Jun 25 21:02:25.010540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1477/2687] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:02:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 9152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:02:25.015743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.016860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.025039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.025498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.026277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.026889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.050184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.059470 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fda72351-f811-41a0-881f-2cd6eee4e0a2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1517 microversion: 2.1 time: 0.209340 Jun 25 21:02:25.060412 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1211/2688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:24 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.066549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.067679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.076567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.077895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.078928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.079560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.187629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.199747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93e7e001-4d0b-4e46-8b29-ba2e7e71395f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.187715 Jun 25 21:02:25.201548 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1478/2689] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.253571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.264037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-970ce3b8-1bf9-4480-a3eb-e050767b8ce3 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.202351 Jun 25 21:02:25.264961 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1212/2690] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.271457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0b7441f-5dc3-4806-ba44-52a12f621b44 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f9861ec3310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.335729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4083030d-efeb-46ca-93cf-238a65fec451 req-e452178f-6f3b-469a-9061-d0a0569dfab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b7f128-174d-4e0d-b5d1-7c575e73ef4a", "name": "network-vif-plugged", "status": "completed", "tag": "5324ff71-996c-4e38-ae82-0a8264ef5901"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:25.345701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4083030d-efeb-46ca-93cf-238a65fec451 req-e452178f-6f3b-469a-9061-d0a0569dfab6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.346186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4083030d-efeb-46ca-93cf-238a65fec451 req-e452178f-6f3b-469a-9061-d0a0569dfab6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.346971 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0b7441f-5dc3-4806-ba44-52a12f621b44 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 200 len: 1437 microversion: 2.1 time: 0.080831 Jun 25 21:02:25.348341 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1213/2691] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 1437 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.353893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f9861f24af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.361285 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4083030d-efeb-46ca-93cf-238a65fec451 req-e452178f-6f3b-469a-9061-d0a0569dfab6 service nova] Creating event network-vif-plugged:5324ff71-996c-4e38-ae82-0a8264ef5901 for instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a on nch1-master-1 Jun 25 21:02:25.365988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.366747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4083030d-efeb-46ca-93cf-238a65fec451 req-e452178f-6f3b-469a-9061-d0a0569dfab6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163795 Jun 25 21:02:25.367375 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1479/2692] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:25.367723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.368558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.373843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a4a67df-28ed-492a-b24d-3bee65c0e4d5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.374558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5a4a67df-28ed-492a-b24d-3bee65c0e4d5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.377556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.378929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.380372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.381585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.382247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:25.417247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.421373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.440373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.440976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.447860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5a4a67df-28ed-492a-b24d-3bee65c0e4d5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.456255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5a4a67df-28ed-492a-b24d-3bee65c0e4d5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1213 microversion: 2.1 time: 0.087125 Jun 25 21:02:25.456889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1480/2693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.470552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:25.474303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:25.475806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 19bf6237-6a7a-4837-a14c-071bf5e28f2f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.486297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:25.490518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. Jun 25 21:02:25.494771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4cf49dbb-45b0-4099-8333-9464e25ecd63 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-690967096" status: 201 len: 0 microversion: 2.26 time: 0.144979 Jun 25 21:02:25.495971 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1214/2694] 10.222.0.39 () {62 vars in 1376 bytes} [Sat Jun 25 21:02:25 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-690967096 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/19bf6237-6a7a-4837-a14c-071bf5e28f2f/action HTTP/1.1 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 14 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: {"rescue": {}} Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '19bf6237-6a7a-4837-a14c-071bf5e28f2f', 'body': {'rescue': {}}} Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:25.501147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:25.505949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 404 to user: Instance 19bf6237-6a7a-4837-a14c-071bf5e28f2f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:25.511364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.511812 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1f92e658-0df7-46b2-a721-681fc4445616 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/19bf6237-6a7a-4837-a14c-071bf5e28f2f/action" status: 404 len: 111 microversion: 2.1 time: 0.036024 Jun 25 21:02:25.511812 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1481/2695] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:25 2022] POST /compute/v2.1/servers/19bf6237-6a7a-4837-a14c-071bf5e28f2f/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:25.512002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.526631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0bd4c91-01c5-456a-9ea2-92c92521284c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984ed54790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.528738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.529211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.529984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.530657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.540221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0bd4c91-01c5-456a-9ea2-92c92521284c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.540845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0bd4c91-01c5-456a-9ea2-92c92521284c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.586588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:25.612247 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0bd4c91-01c5-456a-9ea2-92c92521284c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-690967096" status: 204 len: 0 microversion: 2.26 time: 0.103403 Jun 25 21:02:25.613127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1482/2696] 10.222.0.39 () {60 vars in 1357 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-690967096 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:25.621715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:25.622545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.630453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.630885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.631701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.632270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.754237 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-232f969a-2eac-4163-93d1-77614b225f8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action" status: 202 len: 0 microversion: 2.1 time: 0.138644 Jun 25 21:02:25.758318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.758779 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1483/2697] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:25 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:25.763088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.763775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.768091 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-145695e8-21bd-4dfc-a5ca-a2ecaf7606a6 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1467 microversion: 2.1 time: 0.270925 Jun 25 21:02:25.768918 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1215/2698] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1467 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.772811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.773344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.774241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.774783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.775141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f6ffc10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.784515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.785373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.786045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.792956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.793836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.794860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.795312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.838714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.839463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.861769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:25.880840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9bc9baf7-9429-400a-8ce7-ca50dd5998a6 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.110342 Jun 25 21:02:25.886802 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1216/2699] 10.222.0.39 () {60 vars in 1294 bytes} [Sat Jun 25 21:02:25 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:25.892966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:25.893598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:25.900842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.901301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.902461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:25.902904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:25.935769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:25.945160 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e301b792-a65b-47b8-aee7-90cdb200ea07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.187578 Jun 25 21:02:25.945740 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1484/2700] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:25.951212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0a56554-58cf-44f1-8c0e-2bf68d8bc33d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984f5b4ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.067917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:26.076587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d38f67d-3b5b-4acc-bf2c-10da33515a1c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1522 microversion: 2.1 time: 0.188280 Jun 25 21:02:26.077173 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1217/2701] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.082153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c81ec7f1-0ac5-43c7-91a6-065c1435725a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f714820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.090026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c81ec7f1-0ac5-43c7-91a6-065c1435725a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.090474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c81ec7f1-0ac5-43c7-91a6-065c1435725a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.101298 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c81ec7f1-0ac5-43c7-91a6-065c1435725a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.022886 Jun 25 21:02:26.107197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1218/2702] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 21:02:26 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 12 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.107197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1794021203"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:26.108266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.114748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.115353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.116120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.116666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.463926 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f0985ed-b5b9-458f-a8b2-0ce9af17eef8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.360311 Jun 25 21:02:26.472157 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1219/2703] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:26 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 25 21:02:26.490495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f714d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.508866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.509518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.510765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.519574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.520102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.521070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.522072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.529848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0a56554-58cf-44f1-8c0e-2bf68d8bc33d tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "DELETE /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4" status: 204 len: 0 microversion: 2.1 time: 0.582738 Jun 25 21:02:26.530446 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1485/2704] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:25 2022] DELETE /compute/v2.1/images/e8068e17-d2ff-43e4-aea0-f4cea88128f4 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:02:26.536739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.537876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.546512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.547205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.548342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.548814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.554083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.555203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.566869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.567731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.597390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:26.614515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7420229b-887f-4cce-834c-6986a9a53e6f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1071387451" status: 201 len: 0 microversion: 2.26 time: 0.139763 Jun 25 21:02:26.615573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1220/2705] 10.222.0.39 () {62 vars in 1379 bytes} [Sat Jun 25 21:02:26 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1071387451 => generated 0 bytes in 142 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jun 25 21:02:26.620681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.621362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.628077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.628584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.629356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.629786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.778285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:26.787749 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f909ebb9-90cd-4278-b982-945c6e3de435 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1316 microversion: 2.1 time: 0.170687 Jun 25 21:02:26.788845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1221/2706] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:26 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.794590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.795360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.810028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.814403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.816113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.817428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.829282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:26.837619 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b50edd2-97de-4909-afef-5f5ab181bc84 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.305883 Jun 25 21:02:26.838580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1486/2707] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:26 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.844682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e47ac2ad-23be-4ba6-a838-4b1e6ecf73f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '.version_select at 0x7f984ed76af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.866278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e47ac2ad-23be-4ba6-a838-4b1e6ecf73f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] HTTP exception thrown: Image not found. Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e47ac2ad-23be-4ba6-a838-4b1e6ecf73f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Request method failure captured: Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 HTTP/1.1 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eC48llsnD-KgiyIXpg-xUKSIowKDXBwQRQx3JaLDNXgCLJ_2uC9OrE3dIDRcH7Tlnr8ESF6xHD_XK1BTS8aADdB3WlgVEPM_SJrA_31TiqT4I1vCHyIIB7YXqGfTa5H7M1im9mETg4NOXeX6vgnQRehBdmnzXvWwTORE-LFRceDWk Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}] Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5a80f9c350664a839bdada41c1973b1e Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '80fad322-7eeb-4844-9143-abce15aa3315'} Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 80fad322-7eeb-4844-9143-abce15aa3315 to delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 80fad322-7eeb-4844-9143-abce15aa3315 could not be found. Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.868204 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e47ac2ad-23be-4ba6-a838-4b1e6ecf73f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e47ac2ad-23be-4ba6-a838-4b1e6ecf73f1 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "DELETE /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315" status: 404 len: 62 microversion: 2.1 time: 0.029843 Jun 25 21:02:26.872200 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1487/2708] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:26 2022] DELETE /compute/v2.1/images/80fad322-7eeb-4844-9143-abce15aa3315 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:02:26.878805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-874f77f7-293f-414f-8033-9a2d7d750f03 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984ff79a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.888527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874f77f7-293f-414f-8033-9a2d7d750f03 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.888990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874f77f7-293f-414f-8033-9a2d7d750f03 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.912552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-874f77f7-293f-414f-8033-9a2d7d750f03 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 36 microversion: 2.26 time: 0.036822 Jun 25 21:02:26.913517 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1488/2709] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 21:02:26 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 36 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.925976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:26.933308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.934873 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-378b94ed-774f-4e5b-8476-afc8e1f40d9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1271 microversion: 2.1 time: 0.144806 Jun 25 21:02:26.935083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.945318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1222/2710] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:26 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:26.955168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.956200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.956338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f7141f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:26.957969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.959076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.967085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.967457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.967944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:26.975463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.975861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.976915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:26.977357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:26.993217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:02:27.020882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.021395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.055991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.078757 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3b98292-9248-4872-9e71-27563665af95 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1071387451" status: 204 len: 0 microversion: 2.26 time: 0.129166 Jun 25 21:02:27.083161 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1223/2711] 10.222.0.39 () {60 vars in 1363 bytes} [Sat Jun 25 21:02:26 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1071387451 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:27.090211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb108ad2-f962-4d16-808d-ce2eac491f78 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f985c88f3a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.099068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c07d7e3-66df-4d42-896f-843af412eff2 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 204 len: 0 microversion: 2.1 time: 0.183101 Jun 25 21:02:27.099985 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1489/2712] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:02:26 2022] DELETE /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:02:27.103188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb108ad2-f962-4d16-808d-ce2eac491f78 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.103188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb108ad2-f962-4d16-808d-ce2eac491f78 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.111044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.111979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.113183 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb108ad2-f962-4d16-808d-ce2eac491f78 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.027948 Jun 25 21:02:27.118433 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1224/2713] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 12 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:27.123049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.123558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.124463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.124612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.125324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.125495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.133189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.133580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.134798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.135172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.299340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:27.320605 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02db7213-998e-4479-9b48-91d44ae0d290 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1473 microversion: 2.1 time: 0.204262 Jun 25 21:02:27.321919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1225/2714] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:27.327233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f9861ec3ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.342964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.343974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.345175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.352463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.353033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.353678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.354303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.389557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.390144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.404096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.422741 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18cce4a6-1da1-4720-a208-bd326d212fa5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.100373 Jun 25 21:02:27.423948 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1226/2715] 10.222.0.39 () {60 vars in 1294 bytes} [Sat Jun 25 21:02:27 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:27.430980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:27.435611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f9861eb4670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.441990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e96bd9b0-f68f-4a2f-9992-285f34334524 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1502 microversion: 2.1 time: 0.336123 Jun 25 21:02:27.442719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1490/2716] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:27.445780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.446232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.446780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.455604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.456188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.457405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.457928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.460836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:27.462275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.462476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=3,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:27.471699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.472162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.473071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.473687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.486705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.487081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.498161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.498608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.504728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'flavor' on Instance uuid a104cd86-0a2f-45ec-8047-c581153d539c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.522461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Cannot 'rescue' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state paused Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action HTTP/1.1 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 14 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: {"rescue": {}} Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'rescue' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state paused Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a104cd86-0a2f-45ec-8047-c581153d539c', 'body': {'rescue': {}}} Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a104cd86-0a2f-45ec-8047-c581153d539c in vm_state paused. Cannot rescue while the instance is in this state. Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state paused Jun 25 21:02:27.525220 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state paused Jun 25 21:02:27.530877 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:27.532878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 409 to user: Cannot 'rescue' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state paused {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:27.534106 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ddb7473-4528-4c9d-b393-2d7fa7b5e7d8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action" status: 409 len: 144 microversion: 2.1 time: 0.077807 Jun 25 21:02:27.536886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.539971 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1491/2717] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:27 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action => generated 144 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 25 21:02:27.547727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:27.548346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.556643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65e05062-4222-49c0-8436-8c47cd125d33 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-269472089" status: 201 len: 0 microversion: 2.26 time: 0.125780 Jun 25 21:02:27.557225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.557225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.557960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.558408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.560640 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1227/2718] 10.222.0.39 () {62 vars in 1376 bytes} [Sat Jun 25 21:02:27 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-269472089 => generated 0 bytes in 131 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 25 21:02:27.569402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f9861ed3ca0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.580742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.581280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.581862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.589017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.590127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.591695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.592317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.619621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.620120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.630759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.631306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.643004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e165ebce-039b-41e7-9cad-1f36177dbd06 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action" status: 202 len: 0 microversion: 2.1 time: 0.101208 Jun 25 21:02:27.643737 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1492/2719] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:27 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:27.654310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.655409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.662949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.663938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.665040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.666154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.670774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.706632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45d0ee56-77c8-46af-8768-5a6d35dda2c2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1211585128" status: 201 len: 0 microversion: 2.26 time: 0.143585 Jun 25 21:02:27.708069 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1228/2720] 10.222.0.39 () {62 vars in 1379 bytes} [Sat Jun 25 21:02:27 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-1211585128 => generated 0 bytes in 146 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Jun 25 21:02:27.725418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f778310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.734714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.735309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.736241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.749065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.749587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.750537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.751010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.777282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.777736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.794515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:27.811170 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a650bc7-9f72-44c3-a6f0-77f075d5a63f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.096786 Jun 25 21:02:27.812313 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1229/2721] 10.222.0.39 () {60 vars in 1294 bytes} [Sat Jun 25 21:02:27 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:27.817904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.818545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.825255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.825727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.826511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.827332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.848215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:27.857475 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e63d4bb8-c781-4540-96c2-dc341a878395 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1509 microversion: 2.1 time: 0.208507 Jun 25 21:02:27.858221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1493/2722] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:27.863505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4e183df5-0b34-4c40-9c97-2adff897d70c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f5b4ee0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.871668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e183df5-0b34-4c40-9c97-2adff897d70c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.872146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e183df5-0b34-4c40-9c97-2adff897d70c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.882870 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4e183df5-0b34-4c40-9c97-2adff897d70c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 12 microversion: 2.26 time: 0.023280 Jun 25 21:02:27.883618 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1494/2723] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 12 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:27.889052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:27.890126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:27.897148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.897834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.898761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:27.899384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:27.994756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:28.009989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cbeafed1-edb2-4a70-9cde-0c5ba3fe5911 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1503 microversion: 2.1 time: 0.196229 Jun 25 21:02:28.010969 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1230/2724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:28.025709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f778ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.040097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.041073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.041729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.048663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.049444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.049878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.050310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.059916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:28.068087 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f4ab36c-96e7-43b8-85af-aaeb51908bbc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.183177 Jun 25 21:02:28.068818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1495/2725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:27 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:28.073370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.074226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.075943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.076784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.081701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.082154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.082919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.083355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.089234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:28.106561 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ce9b30a-6e89-4ea0-955f-c39032be507d tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.094351 Jun 25 21:02:28.107184 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1231/2726] 10.222.0.39 () {60 vars in 1294 bytes} [Sat Jun 25 21:02:28 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:28.112146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1601628341"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:28.112758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.119763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.120210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.121130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.121562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.237968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:28.246085 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3f80ca51-80a0-44e2-be1c-e3be0836f0ce tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.176138 Jun 25 21:02:28.246698 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1496/2727] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:28 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:28.251943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984fd31550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.254736 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.network.security_group_api [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Adding security group 439b87bf-e0a0-4d62-aa29-c416bc049805 to port 5324ff71-996c-4e38-ae82-0a8264ef5901 Jun 25 21:02:28.260270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.260752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.261880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.268495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.268981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.269794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.270237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.295864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.296396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.307558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.308148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.317912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:28.340479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:28.358522 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc1c6765-0182-4916-8304-ee1184b77b5c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-396616510" status: 201 len: 0 microversion: 2.26 time: 0.110712 Jun 25 21:02:28.363440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1497/2728] 10.222.0.39 () {62 vars in 1376 bytes} [Sat Jun 25 21:02:28 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-396616510 => generated 0 bytes in 112 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 25 21:02:28.367578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.368202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.375229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.375758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.376607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.377386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.518898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:28.527657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f269402-32ea-4a2b-88fd-e6aeea488c7c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1473 microversion: 2.1 time: 0.166847 Jun 25 21:02:28.528479 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1498/2729] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:28 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1473 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:28.533800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984f5b4a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.542716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.543171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.543685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.550269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.550866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.551719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.552529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.596858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.597693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.608748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.609276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.640479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:28.649531 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c31ec331-7058-4523-9a32-3629106c739e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/action" status: 202 len: 0 microversion: 2.1 time: 0.541189 Jun 25 21:02:28.652171 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1232/2730] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:28 2022] POST /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:28.661847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-675004221"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:28.662823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.673093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.673632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.674607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.675214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.678780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32034e1c-889d-4caf-ac9a-8330da7fbff5 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-566696427" status: 201 len: 0 microversion: 2.26 time: 0.148822 Jun 25 21:02:28.679907 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1499/2731] 10.222.0.39 () {62 vars in 1376 bytes} [Sat Jun 25 21:02:28 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags/tempest-tag-566696427 => generated 0 bytes in 151 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jun 25 21:02:28.770081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-280745b1-fa3a-4c11-b618-cc6aa4afb79d req-088647e6-6389-4209-acdf-a7bfc90aba48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b7f128-174d-4e0d-b5d1-7c575e73ef4a", "tag": "5324ff71-996c-4e38-ae82-0a8264ef5901"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:28.781146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-280745b1-fa3a-4c11-b618-cc6aa4afb79d req-088647e6-6389-4209-acdf-a7bfc90aba48 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.782469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-280745b1-fa3a-4c11-b618-cc6aa4afb79d req-088647e6-6389-4209-acdf-a7bfc90aba48 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.801850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-280745b1-fa3a-4c11-b618-cc6aa4afb79d req-088647e6-6389-4209-acdf-a7bfc90aba48 service nova] Creating event network-changed:5324ff71-996c-4e38-ae82-0a8264ef5901 for instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a on nch1-master-1 Jun 25 21:02:28.809571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-280745b1-fa3a-4c11-b618-cc6aa4afb79d req-088647e6-6389-4209-acdf-a7bfc90aba48 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127375 Jun 25 21:02:28.810595 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1500/2732] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:28.819528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Action: 'update_all', calling method: .version_select at 0x7f9861eaeee0>, body: {"tags": ["tempest-tag-560101682", "tempest-tag-1541267607"]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:28.830858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.831853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.832641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.840715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.841338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.848491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.849767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.900572 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.network.security_group_api [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Adding security group 37ed41cb-ba14-4438-8f8a-b6aba8b16cfa to port 5324ff71-996c-4e38-ae82-0a8264ef5901 Jun 25 21:02:28.907118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.907613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.942653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:28.967847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fabb65b7-95b7-4a45-9c94-cc1fe2ba3f3f tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 61 microversion: 2.26 time: 0.155831 Jun 25 21:02:28.969072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1501/2733] 10.222.0.39 () {62 vars in 1311 bytes} [Sat Jun 25 21:02:28 2022] PUT /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 61 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:28.976969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:28.978057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:28.987591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.988138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:28.989393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:28.989928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.279204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:29.298317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a8ff171-a380-4cb4-8191-3728abca61af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1517 microversion: 2.1 time: 0.326672 Jun 25 21:02:29.300128 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1502/2734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:28 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1517 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:29.313433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-789aac59-91d1-47ad-bc53-85e2de3f4b87 req-81727571-fa6c-46c2-bafc-1e8977210ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:29.323665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-789aac59-91d1-47ad-bc53-85e2de3f4b87 req-81727571-fa6c-46c2-bafc-1e8977210ed2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.324890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-789aac59-91d1-47ad-bc53-85e2de3f4b87 req-81727571-fa6c-46c2-bafc-1e8977210ed2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.341384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-789aac59-91d1-47ad-bc53-85e2de3f4b87 req-81727571-fa6c-46c2-bafc-1e8977210ed2 service nova] Creating event network-vif-unplugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:02:29.348023 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-789aac59-91d1-47ad-bc53-85e2de3f4b87 req-81727571-fa6c-46c2-bafc-1e8977210ed2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044125 Jun 25 21:02:29.349565 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1503/2735] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:29.356664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d141629b-5acd-48df-be82-98285686bced tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984ff67310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:29.369377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d141629b-5acd-48df-be82-98285686bced tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.370065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d141629b-5acd-48df-be82-98285686bced tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.382285 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d141629b-5acd-48df-be82-98285686bced tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 200 len: 61 microversion: 2.26 time: 0.030111 Jun 25 21:02:29.384451 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1504/2736] 10.222.0.39 () {60 vars in 1291 bytes} [Sat Jun 25 21:02:29 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 61 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:29.406334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:29.407626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:29.416304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.417188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.418422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.419047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.694023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:29.704777 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65301058-6f2f-4ce4-b532-33c70ea3c94c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.316703 Jun 25 21:02:29.717485 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1505/2737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:29 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:29.730678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:29.731505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:29.739133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.739835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:29.740815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:29.741266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.110582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:30.125936 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28948382-aea1-4a0d-b553-0fb972d2ed14 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.405530 Jun 25 21:02:30.136870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1506/2738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:29 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:30.136870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '.version_select at 0x7f984ff67310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:30.148022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.148877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.150012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:30.160734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.161977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.163260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.164366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.207851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.208842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.269559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lazy-loading 'flavor' on Instance uuid 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:30.291322 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c15df36-5eab-4715-8b2f-fa200d89a22c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags" status: 204 len: 0 microversion: 2.26 time: 0.161695 Jun 25 21:02:30.297453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1507/2739] 10.222.0.39 () {60 vars in 1294 bytes} [Sat Jun 25 21:02:30 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:30.303276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:30.304069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:30.311135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.312416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.315953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.315953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.413620 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6fa0e36e-98f7-46ca-b042-01aad40af658 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/action" status: 202 len: 0 microversion: 2.1 time: 1.757058 Jun 25 21:02:30.414808 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1233/2740] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:28 2022] POST /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/action => generated 0 bytes in 1759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:30.425934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:30.426960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:30.454068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.454616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.455506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.455996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.511558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:02:30.715005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e4aadc5e-2f83-4f6a-ab15-a7e59018fb2a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 204 len: 0 microversion: 2.26 time: 0.297715 Jun 25 21:02:30.719540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1234/2741] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:02:30 2022] DELETE /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:02:30.839056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:30.842479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f97aee16-739f-44b1-8a83-75d10a40d430 req-b8e1a732-0931-40d1-b794-6b72fd6c2f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def3f120-ac80-4b2f-8cad-7d7859fc5246", "tag": "4e6556ec-82c5-4ce6-8c04-2b5bfade04b6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:30.847978 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9185b832-b1a3-4f45-8482-70e7b353d92c tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1473 microversion: 2.1 time: 0.549214 Jun 25 21:02:30.852711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f97aee16-739f-44b1-8a83-75d10a40d430 req-b8e1a732-0931-40d1-b794-6b72fd6c2f74 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.853625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f97aee16-739f-44b1-8a83-75d10a40d430 req-b8e1a732-0931-40d1-b794-6b72fd6c2f74 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.858432 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1508/2742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:30 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1473 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:30.864204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:30.864911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:30.872174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.872932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.873855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.874443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.874687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f97aee16-739f-44b1-8a83-75d10a40d430 req-b8e1a732-0931-40d1-b794-6b72fd6c2f74 service nova] Creating event network-changed:4e6556ec-82c5-4ce6-8c04-2b5bfade04b6 for instance def3f120-ac80-4b2f-8cad-7d7859fc5246 on nch2-master-1 Jun 25 21:02:30.880809 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f97aee16-739f-44b1-8a83-75d10a40d430 req-b8e1a732-0931-40d1-b794-6b72fd6c2f74 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158875 Jun 25 21:02:30.881546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1235/2743] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:30.892467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:30.893458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:30.901460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.902007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:30.903175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:30.903725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.083164 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-874c1ace-6e16-4d07-aaba-683254b26848 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.222762 Jun 25 21:02:31.084335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1509/2744] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:02:30 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a/os-security-groups => generated 1156 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:31.092794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:31.093647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:31.107399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.108300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.109577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.110419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.220694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.233348 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a34c48a-3f51-41f2-908b-db3dfee4c3ad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.350061 Jun 25 21:02:31.234996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1236/2745] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:30 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:31.247822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-15798f31-8ca2-4d26-85bc-7b603b6adac0 req-f7945e5a-675d-4786-9dee-03e8cf1644bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b7f128-174d-4e0d-b5d1-7c575e73ef4a", "tag": "5324ff71-996c-4e38-ae82-0a8264ef5901"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:31.257641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-15798f31-8ca2-4d26-85bc-7b603b6adac0 req-f7945e5a-675d-4786-9dee-03e8cf1644bb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.258133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-15798f31-8ca2-4d26-85bc-7b603b6adac0 req-f7945e5a-675d-4786-9dee-03e8cf1644bb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.276338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-15798f31-8ca2-4d26-85bc-7b603b6adac0 req-f7945e5a-675d-4786-9dee-03e8cf1644bb service nova] Creating event network-changed:5324ff71-996c-4e38-ae82-0a8264ef5901 for instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a on nch1-master-1 Jun 25 21:02:31.283577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-15798f31-8ca2-4d26-85bc-7b603b6adac0 req-f7945e5a-675d-4786-9dee-03e8cf1644bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045998 Jun 25 21:02:31.284848 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1237/2746] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:31.293952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.302323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:31.304338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:31.304851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.309686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.311241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.311479 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe73e91d-5b55-44a4-ace0-8b295a6fb570 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1552 microversion: 2.26 time: 0.225693 Jun 25 21:02:31.312238 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1510/2747] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:31 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:31.318746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fda5952-3505-4f61-85ab-5d1997950189 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984ff67700>, body: {"security_group": {"name": " tempest-securitygroup -581712236 ", "description": "tempest-description-360206180"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:31.325045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.326152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.326742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.358971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'flavor' on Instance uuid a104cd86-0a2f-45ec-8047-c581153d539c {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:02:31.400048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2,nova_cell1:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:31.493644 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01676c2e-80ca-492e-b777-be38122043f1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action" status: 200 len: 32 microversion: 2.1 time: 0.207057 Jun 25 21:02:31.494299 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1238/2748] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:31 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:02:31.502569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:31.509608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fda5952-3505-4f61-85ab-5d1997950189 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.195391 Jun 25 21:02:31.516490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1511/2749] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:31 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:31.516683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:31.516922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fc9b7262-edc0-46a9-8944-73b73cb7c8f7 req-275b6287-d031-40a9-bce7-41f1b83a96cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-unplugged", "status": "completed", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:31.535714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fc9b7262-edc0-46a9-8944-73b73cb7c8f7 req-275b6287-d031-40a9-bce7-41f1b83a96cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.536599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fc9b7262-edc0-46a9-8944-73b73cb7c8f7 req-275b6287-d031-40a9-bce7-41f1b83a96cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.539909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.540388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.543440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.544921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.566498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fc9b7262-edc0-46a9-8944-73b73cb7c8f7 req-275b6287-d031-40a9-bce7-41f1b83a96cc service nova] Creating event network-vif-unplugged:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:02:31.578687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fc9b7262-edc0-46a9-8944-73b73cb7c8f7 req-275b6287-d031-40a9-bce7-41f1b83a96cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066191 Jun 25 21:02:31.581509 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1512/2750] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:31.587248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:31.588270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:31.606174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.607735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.608833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.609996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.786615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.795323 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04b3d9a8-eac0-40e9-be80-fa4a8e7e929f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.212049 Jun 25 21:02:31.796098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1513/2751] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:31 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:31.801259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1969b30-cfdc-44c2-baab-cfb5c77e6652 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984ff193a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:31.855582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1969b30-cfdc-44c2-baab-cfb5c77e6652 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977" status: 200 len: 222 microversion: 2.1 time: 0.058123 Jun 25 21:02:31.856296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1514/2752] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:02:31 2022] GET /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 => generated 222 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:31.864384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:31.865024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:31.871622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.872064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.872865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:31.873460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:31.876691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:RELEASE=2,nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:DELETE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:31.942791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a80f9c350664a839bdada41c1973b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa04ed2c6ea14438b506a2b7f4e3f377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:31.951013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-744ad899-f35d-439f-ba53-28bbdb63d1a7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 200 len: 1431 microversion: 2.1 time: 0.090751 Jun 25 21:02:31.951635 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1515/2753] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:31 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 1431 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:31.956298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69a4611c-0d40-49ae-94ef-fbc06c990f70 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984fe3fe50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:32.201229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:32.209220 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0dffb91c-54b3-4c60-87f2-d69527d0ed39 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.711414 Jun 25 21:02:32.209877 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1239/2754] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:31 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:32.239612 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69a4611c-0d40-49ae-94ef-fbc06c990f70 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977" status: 202 len: 0 microversion: 2.1 time: 0.286855 Jun 25 21:02:32.240175 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1516/2755] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:02:31 2022] DELETE /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:32.249045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984fced0d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:32.251189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:32.251815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:32.258668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.259126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:32.259883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.260321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:32.272988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:02:32.273623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 721f2499-8744-4993-8c4d-5825dbe02977 not found {{(pid=137462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:02:32.274537 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.274537 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 HTTP/1.1 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '721f2499-8744-4993-8c4d-5825dbe02977'} Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:02:32.289107 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-d7c5128a-16b8-4c93-bbc5-a88efbef55a5'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-370824bd-72ed-41c2-bf33-e793b26a9e6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977" status: 404 len: 194 microversion: 2.1 time: 0.046201 Jun 25 21:02:32.294090 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1240/2756] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:02:32 2022] GET /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:32.302131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a403de09-5277-4c5a-9936-a1230a7b4f10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984f700ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-60639227", "description": "tempest-description-676865348"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:32.408167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:32.417279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89233565-a1a7-4d30-8545-80fbcb291b02 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.169903 Jun 25 21:02:32.418078 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1517/2757] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:32 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:32.424317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:32.425734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:32.433079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.434339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:32.435321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.435756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:32.617460 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a403de09-5277-4c5a-9936-a1230a7b4f10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.319072 Jun 25 21:02:32.619548 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1241/2758] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:32 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:32.632655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4fadf4f1-cd6d-4e24-aead-7be7016efa6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984f714e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1789947442", "description": "tempest-description-178186477"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:32.713528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:32.730119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:32.732505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:32.734327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a19bd47-7895-45e9-ba0a-cf6e9cc46673 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1552 microversion: 2.26 time: 0.314774 Jun 25 21:02:32.735271 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1518/2759] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:32 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1552 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:32.813957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:32.814973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:32.828588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.829046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:32.829824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:32.830257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.014104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:33.023550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4dc3771-e469-4332-bdf5-2135ea4eb49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.213912 Jun 25 21:02:33.024856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1519/2760] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:32 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:33.030328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:33.030900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] [instance: 17e0aff9-29f8-49d4-8575-a32fa04d681d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:33.038215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.038672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.039646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.040085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.056568 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] HTTP exception thrown: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Request method failure captured: Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d HTTP/1.1 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eC48llsnD-KgiyIXpg-xUKSIowKDXBwQRQx3JaLDNXgCLJ_2uC9OrE3dIDRcH7Tlnr8ESF6xHD_XK1BTS8aADdB3WlgVEPM_SJrA_31TiqT4I1vCHyIIB7YXqGfTa5H7M1im9mETg4NOXeX6vgnQRehBdmnzXvWwTORE-LFRceDWk Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_aa04ed2c6ea14438b506a2b7f4e3f377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/aa04ed2c6ea14438b506a2b7f4e3f377"}]}] Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: aa04ed2c6ea14438b506a2b7f4e3f377 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1172796659 Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5a80f9c350664a839bdada41c1973b1e Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ImagesOneServerTestJSON-1172796659-project Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '17e0aff9-29f8-49d4-8575-a32fa04d681d'} Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:33.058545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] Returning 404 to user: Instance 17e0aff9-29f8-49d4-8575-a32fa04d681d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-050a0629-6772-4cc6-9743-df1cfe25c8f7 tempest-ImagesOneServerTestJSON-1172796659 tempest-ImagesOneServerTestJSON-1172796659-project] 10.222.0.39 "GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d" status: 404 len: 111 microversion: 2.1 time: 0.034378 Jun 25 21:02:33.062738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1520/2761] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:33 2022] GET /compute/v2.1/servers/17e0aff9-29f8-49d4-8575-a32fa04d681d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:33.228216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:33.229073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:33.240027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.241146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.243344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.243814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.349045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4fadf4f1-cd6d-4e24-aead-7be7016efa6f tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.721172 Jun 25 21:02:33.350895 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1242/2762] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:02:33.361636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dda8f604-d1f8-4a30-849d-e93200d85b58 req-8901addc-bc6d-4778-86e1-69471b9ec2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e0aff9-29f8-49d4-8575-a32fa04d681d", "name": "network-vif-deleted", "tag": "3af271e1-50c7-4632-9427-3eae5ceae71b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:33.373930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dda8f604-d1f8-4a30-849d-e93200d85b58 req-8901addc-bc6d-4778-86e1-69471b9ec2a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.374903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dda8f604-d1f8-4a30-849d-e93200d85b58 req-8901addc-bc6d-4778-86e1-69471b9ec2a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.396071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dda8f604-d1f8-4a30-849d-e93200d85b58 req-8901addc-bc6d-4778-86e1-69471b9ec2a0 service nova] Creating event network-vif-deleted:3af271e1-50c7-4632-9427-3eae5ceae71b for instance 17e0aff9-29f8-49d4-8575-a32fa04d681d on nch2-master-1 Jun 25 21:02:33.405249 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dda8f604-d1f8-4a30-849d-e93200d85b58 req-8901addc-bc6d-4778-86e1-69471b9ec2a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052155 Jun 25 21:02:33.406353 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1243/2763] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:33.412868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:33.413887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a44a5732-a42b-43de-a826-d2c8bf83aefb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984f714af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-691733181", "description": "tempest-description-456640102"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:33.423227 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59fe6be7-d545-45d7-9780-ee4bfb47db61 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.199574 Jun 25 21:02:33.424058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1521/2764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:33 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:33.435793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:33.436662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:33.443684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.444619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.445656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.446275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.604724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:33.615736 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2420b770-a02e-4665-83a3-021d34dbfa05 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.185081 Jun 25 21:02:33.616484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1522/2765] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:33 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:33.621140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b0dd5cd2-7fa1-4f83-ab57-9515ddf55de1 req-cbbba6bc-f7ac-4a8d-8c15-675b622464f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:33.631025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b0dd5cd2-7fa1-4f83-ab57-9515ddf55de1 req-cbbba6bc-f7ac-4a8d-8c15-675b622464f0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.631768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b0dd5cd2-7fa1-4f83-ab57-9515ddf55de1 req-cbbba6bc-f7ac-4a8d-8c15-675b622464f0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.647501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b0dd5cd2-7fa1-4f83-ab57-9515ddf55de1 req-cbbba6bc-f7ac-4a8d-8c15-675b622464f0 service nova] Creating event network-vif-plugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:02:33.654563 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b0dd5cd2-7fa1-4f83-ab57-9515ddf55de1 req-cbbba6bc-f7ac-4a8d-8c15-675b622464f0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036863 Jun 25 21:02:33.655317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1523/2766] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:33.787997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:33.789693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:33.851732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.855995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.857707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:33.860074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:33.955211 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a44a5732-a42b-43de-a826-d2c8bf83aefb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.546988 Jun 25 21:02:33.955952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1244/2767] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:33.968818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12783ae5-b07f-42b8-8f5b-661c3a19f72a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f692550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.002778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.017121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.019391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.021506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f66791e5-d8d3-4070-8a35-8adf1b8b6f5a tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1510 microversion: 2.26 time: 0.261386 Jun 25 21:02:34.022810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1524/2768] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:33 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:34.042078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.043173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:34.053778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.054720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.056130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.057661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.234207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.244039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fec1e939-aec9-4d54-8215-341cba4dba8f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.206473 Jun 25 21:02:34.245016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1525/2769] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:34 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:34.259334 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12783ae5-b07f-42b8-8f5b-661c3a19f72a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1828 microversion: 2.1 time: 0.294703 Jun 25 21:02:34.260183 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1245/2770] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:02:33 2022] GET /compute/v2.1/os-security-groups => generated 1828 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:34.273057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-447ac496-e741-4a9c-82a7-e1cfd107d766 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984ff67f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.443682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.444741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:34.454666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.455596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.456471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.456978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.491002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-447ac496-e741-4a9c-82a7-e1cfd107d766 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f" status: 202 len: 0 microversion: 2.1 time: 0.221872 Jun 25 21:02:34.493246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1526/2771] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:02:34 2022] DELETE /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:02:34.504905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984fc98f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.636708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.644594 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9cfc8836-670c-4e31-988d-2bd51e930bb8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.206078 Jun 25 21:02:34.654074 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1246/2772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:34 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:34.659409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:34.659972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:34.667182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.667879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.668877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:34.669315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:34.846674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:34.855965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85dd029d-a0f7-438c-a5ad-650d2157dfd2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.200683 Jun 25 21:02:34.857864 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1247/2773] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:34 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:34.905819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:02:34.907239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group ababe856-75fe-4332-a781-f196895d3d4f not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:02:34.907968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.907968 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f HTTP/1.1 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ababe856-75fe-4332-a781-f196895d3d4f'} Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:02:34.911061 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-b82457b1-2ec3-4e12-900b-b2384f19db67'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:34.915396 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c23df40a-eb88-4b83-88eb-3942d2dffb38 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f" status: 404 len: 194 microversion: 2.1 time: 0.414428 Jun 25 21:02:34.918722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1527/2774] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:02:34 2022] GET /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f => generated 194 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:02:34.922247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fef2f51a-6ebe-4b5b-b8cf-914d20ba9edf tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f700940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.037036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:35.041550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.042385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:35.051088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.051580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.052332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.052931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.122744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:35.124461 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fef2f51a-6ebe-4b5b-b8cf-914d20ba9edf tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca" status: 202 len: 0 microversion: 2.1 time: 0.206648 Jun 25 21:02:35.126381 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1248/2775] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:02:34 2022] DELETE /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:35.134799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f985c4a3550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.135976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:35.137809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:35.146203 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a30c9133-a9c6-4050-8812-f3e48c589831 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1510 microversion: 2.26 time: 0.109880 Jun 25 21:02:35.149437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1528/2776] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:02:35.167693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:02:35.168459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca not found {{(pid=137462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:02:35.169050 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.169050 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca HTTP/1.1 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4ee41957-e9db-491f-bf4b-cc8b8a8c67ca'} Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:02:35.171349 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-4c292e12-60c8-49bc-8a4c-ef212e5f581b'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ecf5706-fbef-41e9-ab5d-266714f43a16 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca" status: 404 len: 194 microversion: 2.1 time: 0.042841 Jun 25 21:02:35.175678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1249/2777] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:02:35.183508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eafacaba-e524-4667-bc8b-59da86be6a9e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984fc98700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.261668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.262353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:35.270409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.271085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.271912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.272669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.388737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eafacaba-e524-4667-bc8b-59da86be6a9e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b" status: 202 len: 0 microversion: 2.1 time: 0.209763 Jun 25 21:02:35.390678 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1529/2778] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:02:35 2022] DELETE /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:35.425305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f985c81d670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.437307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:35.452598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8ebd80b-7a4b-4a18-ac75-34cd7d2400e6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.194796 Jun 25 21:02:35.453480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:35.454758 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1250/2779] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:35.456496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:02:35.458263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:02:35.459037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.459037 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.460473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-935f9cad-7359-4c9d-8dde-e737d4f87cd1 req-b6ee274e-363c-4660-9860-899e6b1855a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8", "name": "network-vif-deleted", "tag": "a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b HTTP/1.1 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5e5acfb7-3597-4057-81e4-9f61c85c4e1b'} Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:02:35.462111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-92ef5988-6dba-4cb2-92ba-c6d27f05720b'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6157a4a-1617-4d6c-a77e-2b39607757c2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b" status: 404 len: 194 microversion: 2.1 time: 0.069969 Jun 25 21:02:35.470385 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1530/2780] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:02:35.473366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-935f9cad-7359-4c9d-8dde-e737d4f87cd1 req-b6ee274e-363c-4660-9860-899e6b1855a6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.473366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-935f9cad-7359-4c9d-8dde-e737d4f87cd1 req-b6ee274e-363c-4660-9860-899e6b1855a6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.481405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9941206a-9ba0-4f0b-bb67-87f4ac085dc7 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984fc959d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.490722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-935f9cad-7359-4c9d-8dde-e737d4f87cd1 req-b6ee274e-363c-4660-9860-899e6b1855a6 service nova] Creating event network-vif-deleted:a2b26f42-d6dc-4bcd-97a5-0a4a4d0f8c38 for instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 on nch2-master-1 Jun 25 21:02:35.496393 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-935f9cad-7359-4c9d-8dde-e737d4f87cd1 req-b6ee274e-363c-4660-9860-899e6b1855a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040176 Jun 25 21:02:35.497145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1251/2781] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:35.663619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.664357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:35.670929 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9941206a-9ba0-4f0b-bb67-87f4ac085dc7 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.194884 Jun 25 21:02:35.671475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.671579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.672246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1531/2782] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:35.672408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.672878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.686373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b45bb17-5b86-4155-973a-509aa3a9f230 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984fc98c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1745518323", "description": "tempest-description-233536313"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:35.848718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:35.858114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7528f064-84ee-4230-9c4d-b26f2a34b01d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.199957 Jun 25 21:02:35.859188 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1252/2783] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:35.872940 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b45bb17-5b86-4155-973a-509aa3a9f230 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.190642 Jun 25 21:02:35.874782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:35.875470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:35.875800 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1532/2784] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:35 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:35.882234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.882776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.883482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:35.883912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:35.887234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8299ed5-a8fb-458e-8de4-27ddcef81453 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f9861ebb8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-602422509", "description": "tempest-description-88628270"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:36.038780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:36.050293 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-731e7498-cd8d-4af2-955f-04697ffc1a0a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.179558 Jun 25 21:02:36.051446 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8299ed5-a8fb-458e-8de4-27ddcef81453 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.169932 Jun 25 21:02:36.052008 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1253/2785] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:35 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:36.066398 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1533/2786] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:02:35 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:36.171301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.173116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:36.186638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.190010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.191017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.191457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.193412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-834774851", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "155055c1-4914-4551-857d-2818fd5d2a3f"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:36.265192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] validate_networks() for [('155055c1-4914-4551-857d-2818fd5d2a3f', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:02:36.316015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:36.329654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:36.332311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22302e87c7c141829fe04c06684650a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58851e54cb214793b2e9ab09d0b3dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:36.334015 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64de315e-15ce-4ec4-ba32-26e77d35eba2 tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 200 len: 1346 microversion: 2.26 time: 0.169163 Jun 25 21:02:36.334929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1254/2787] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 1346 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:02:36.475269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.476059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:36.485501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:36.496200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.497592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.498601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.499204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.722872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:36.733175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:36.733839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:36.733940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4de21ffc-0d6a-4beb-9541-60d6ad234381 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.265846 Jun 25 21:02:36.734061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:36.734555 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1255/2788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:36.734853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:36.735120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:36.738388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:36.747074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.747676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.748505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.748946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.749371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16a6277d-2e80-451b-9da0-67ae44887558 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f692670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.777288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Getting quotas for project 663694278b344fe7896f524fac12ffcc. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:02:36.791086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Getting quotas for user 1253f8908e434038b07f5e2ed7d15d30 and project 663694278b344fe7896f524fac12ffcc. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:02:36.805698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:02:36.808266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:02:36.839058 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16a6277d-2e80-451b-9da0-67ae44887558 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c" status: 200 len: 662 microversion: 2.1 time: 0.099463 Jun 25 21:02:36.844336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1256/2789] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c => generated 662 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:36.855021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5caeacc4-8296-4102-9274-aacba77b77ee tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.904082 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5f514ec-cd8f-4ac4-a8c2-d86f9c88308d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713427 Jun 25 21:02:36.910847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1534/2790] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:02:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:02:36.917959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.918822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:36.928513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.929499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.930665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:36.931702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:36.931966 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5caeacc4-8296-4102-9274-aacba77b77ee tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c" status: 200 len: 662 microversion: 2.1 time: 0.080945 Jun 25 21:02:36.932596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1257/2791] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c => generated 662 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:36.944556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16bf6e38-7bb2-497b-a436-6c27f2db7313 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:36.947717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16bf6e38-7bb2-497b-a436-6c27f2db7313 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:37.117222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16bf6e38-7bb2-497b-a436-6c27f2db7313 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:37.127860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16bf6e38-7bb2-497b-a436-6c27f2db7313 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1215 microversion: 2.1 time: 0.194167 Jun 25 21:02:37.137575 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1258/2792] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:37.142600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:37.143221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:37.161694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.162494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.168870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.169691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.272477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:37.285009 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d79e9701-6e92-4562-a4c1-6e5beb9c3c67 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.372460 Jun 25 21:02:37.286690 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1535/2793] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:36 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:37.361308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:37.363156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] [instance: 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:37.389195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.389621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.390583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.391198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.391894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:37.404259 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8ca902a-9f63-462e-aea5-6ec7234b606b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.264872 Jun 25 21:02:37.405150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1259/2794] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:37 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:37.450659 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] HTTP exception thrown: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Request method failure captured: Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 HTTP/1.1 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fDwT5UbUSFeFqwCrkBF43Dm_rLmx9zqvdL6ip6RzyYOSuq4GnPFto7WkCbUDFTwZdneeE78nNMjMdrSUCF6pOW7YIwyfnAzzyLHywbgeSHpm59mC6gP1KcUR5P4-0b5kuvautpQliQVrzZ9wy9A1ZjxaZjrNKaTToKHus-SBFidsA Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.26 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 58851e54cb214793b2e9ab09d0b3dac6 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerTagsTestJSON-542005435 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/58851e54cb214793b2e9ab09d0b3dac6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/58851e54cb214793b2e9ab09d0b3dac6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_58851e54cb214793b2e9ab09d0b3dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/58851e54cb214793b2e9ab09d0b3dac6"}]}] Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerTagsTestJSON-542005435 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 58851e54cb214793b2e9ab09d0b3dac6 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerTagsTestJSON-542005435 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerTagsTestJSON-542005435-project Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 22302e87c7c141829fe04c06684650a5 Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerTagsTestJSON-542005435-project Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8'} Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:37.453077 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. Jun 25 21:02:37.457982 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:02:37.460060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] Returning 404 to user: Instance 7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:37.461188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9f243ac-3138-4ce0-adff-85f48030198c tempest-ServerTagsTestJSON-542005435 tempest-ServerTagsTestJSON-542005435-project] 10.222.0.39 "GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8" status: 404 len: 111 microversion: 2.26 time: 0.110816 Jun 25 21:02:37.462484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1536/2795] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:02:37 2022] GET /compute/v2.1/servers/7ac3e3d8-a79d-46d2-82ba-eccc6f0b96f8 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:02:37.752495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:37.753662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:37.767002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.767995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.768936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:37.769462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:37.951174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:37.965169 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0da950f5-fe57-42bc-bcc9-77a1c80fc67a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.216904 Jun 25 21:02:37.979581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1260/2796] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:37 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:38.157659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:38.158516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:38.170149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.170780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.172823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.173794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.296575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:38.309757 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90897bac-3383-4c55-aa88-737032fa30f6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1267 microversion: 2.1 time: 0.167972 Jun 25 21:02:38.310728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:38.311332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1537/2797] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:38 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:38.312360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:38.320227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.320900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.321686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.322126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.424743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:38.425793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:38.441017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.442690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.443994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:38.446566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:38.795947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:38.811073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c13cd9a0-2fde-4443-916f-ebc21878ac7a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.392591 Jun 25 21:02:38.813847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1538/2798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:38 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:38.824075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b4dc3a4-dbd3-4ce4-a592-0b950ab2e63d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f913040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:38.914752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b4dc3a4-dbd3-4ce4-a592-0b950ab2e63d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58" status: 200 len: 662 microversion: 2.1 time: 0.098381 Jun 25 21:02:38.915388 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1539/2799] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:38 2022] GET /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58 => generated 662 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:38.935995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3f46d4ed-8362-4a60-8c21-d9e859337eaf tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f8a4790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:39.028529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:39.039869 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce82c089-113f-44bd-abdb-4009c6a2cf66 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.740347 Jun 25 21:02:39.041575 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1261/2800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:38 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:39.064379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5a8972b9-9bf5-48b6-ac4d-68ee786f4251 req-c840de7c-a1f2-4583-867b-8ad14862e629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def3f120-ac80-4b2f-8cad-7d7859fc5246", "name": "network-vif-plugged", "status": "completed", "tag": "4e6556ec-82c5-4ce6-8c04-2b5bfade04b6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:39.064879 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3f46d4ed-8362-4a60-8c21-d9e859337eaf tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58" status: 200 len: 662 microversion: 2.1 time: 0.138792 Jun 25 21:02:39.071746 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1540/2801] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:38 2022] GET /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58 => generated 662 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:39.082941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:39.093053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:39.095511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5a8972b9-9bf5-48b6-ac4d-68ee786f4251 req-c840de7c-a1f2-4583-867b-8ad14862e629 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.096035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5a8972b9-9bf5-48b6-ac4d-68ee786f4251 req-c840de7c-a1f2-4583-867b-8ad14862e629 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.122251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.125815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.134914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.135871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.145992 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5a8972b9-9bf5-48b6-ac4d-68ee786f4251 req-c840de7c-a1f2-4583-867b-8ad14862e629 service nova] Creating event network-vif-plugged:4e6556ec-82c5-4ce6-8c04-2b5bfade04b6 for instance def3f120-ac80-4b2f-8cad-7d7859fc5246 on nch2-master-1 Jun 25 21:02:39.173258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5a8972b9-9bf5-48b6-ac4d-68ee786f4251 req-c840de7c-a1f2-4583-867b-8ad14862e629 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129649 Jun 25 21:02:39.178628 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1262/2802] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:39.329547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:39.330258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:39.344360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.350725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.352034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.352884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.547380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:39.562905 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba17aa84-5ebc-4397-afe0-9026833711c5 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1273 microversion: 2.1 time: 0.238187 Jun 25 21:02:39.564141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1263/2803] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:39 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:39.640020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:39.657498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e75a8103-660e-4549-b415-374321786d63 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.588181 Jun 25 21:02:39.658524 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1541/2804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:39 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:39.831624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:39.832526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:39.849036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.849745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:39.850728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:39.851385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.059928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:40.062036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:40.097086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.097481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.098418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.099101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.396512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:40.410237 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ccb7a97-50f1-44ae-97aa-72cecded8b9c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1508 microversion: 2.1 time: 0.583541 Jun 25 21:02:40.421911 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1264/2805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:39 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1508 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:40.587158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:40.588323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:40.607704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.609159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.610553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.611858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.769372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:40.787939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1ee527b-e421-4201-820a-96e2f88d04e6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1313 microversion: 2.1 time: 0.732486 Jun 25 21:02:40.798155 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1542/2806] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:40 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1313 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:40.807081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:40.809452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:40.825830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.834344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:40.835444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:40.836634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:41.152301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:41.161320 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-169d63ab-97e0-4ce7-809e-77ad854b5bc4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.585685 Jun 25 21:02:41.167296 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1265/2807] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:40 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:41.174580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-484621bc-fada-4dc2-9de4-fc405b9e285d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696040>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:41.288626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-484621bc-fada-4dc2-9de4-fc405b9e285d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7" status: 200 len: 662 microversion: 2.1 time: 0.119738 Jun 25 21:02:41.290036 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1266/2808] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:41 2022] GET /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7 => generated 662 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:41.319271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:41.323909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ccbd1aa-f53d-4e9f-85e9-6a8041867e2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f711430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:41.337646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e53b731a-4fce-432f-869d-08be1c7de89b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.537684 Jun 25 21:02:41.342813 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1543/2809] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:40 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:41.407940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ccbd1aa-f53d-4e9f-85e9-6a8041867e2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7" status: 200 len: 662 microversion: 2.1 time: 0.108909 Jun 25 21:02:41.409347 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1267/2810] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:02:41 2022] GET /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7 => generated 662 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:41.428867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:41.429495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:41.450339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:41.454520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:41.455437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:41.460337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:41.516947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-359537400", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:41.543612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:41.642462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:02:41.865730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:41.875391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-855c130b-e787-4884-be01-60c043060095 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1529 microversion: 2.1 time: 0.451600 Jun 25 21:02:41.893017 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1544/2811] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:41 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1529 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:41.911211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:41.913148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:41.935495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:41.936968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:41.938121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:41.939828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.191079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:42.191504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:42.192168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:42.192755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:42.193310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:42.226451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.228657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.229715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.234885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.274670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:42.292098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Getting quotas for project c08f52307dc24b5bacaea02af2fe64da. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:02:42.301157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Getting quotas for user e6fb1f340fc243f4ae0f4f11f90c1f5d and project c08f52307dc24b5bacaea02af2fe64da. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:02:42.325514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:02:42.334195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:02:42.391777 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59ee7ff1-02f1-42f6-b7c6-ab0bf8a3c056 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878993 Jun 25 21:02:42.403334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1268/2812] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:02:42.410161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4fb8132b-8785-4b38-b9a1-6b3a802e07a9 req-254e884c-bdbb-4f09-bbdc-061aaf38aa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da10d17-4377-4694-bcc0-ac85f9fa4cb6", "tag": "651df448-87ad-4128-8444-15ea68f94d21"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:42.424851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4fb8132b-8785-4b38-b9a1-6b3a802e07a9 req-254e884c-bdbb-4f09-bbdc-061aaf38aa17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.425754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4fb8132b-8785-4b38-b9a1-6b3a802e07a9 req-254e884c-bdbb-4f09-bbdc-061aaf38aa17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.458653 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4fb8132b-8785-4b38-b9a1-6b3a802e07a9 req-254e884c-bdbb-4f09-bbdc-061aaf38aa17 service nova] Creating event network-changed:651df448-87ad-4128-8444-15ea68f94d21 for instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 on nch2-master-1 Jun 25 21:02:42.474091 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4fb8132b-8785-4b38-b9a1-6b3a802e07a9 req-254e884c-bdbb-4f09-bbdc-061aaf38aa17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065290 Jun 25 21:02:42.474822 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1269/2813] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:42.491694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:42.496665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:42.512567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.513061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.519117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.519688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.586152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:42.597552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0357dcb2-f4ca-4085-93c2-9525e01915b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1463 microversion: 2.1 time: 0.701195 Jun 25 21:02:42.608572 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1545/2814] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:41 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1463 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:42.615663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:42.616609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:42.642166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.647001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.648221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:42.648932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:42.957801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:42.983747 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-21fb7689-5ef1-4740-b239-5a46d562d77e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.504377 Jun 25 21:02:42.991673 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1270/2815] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:42 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:43.003795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1961213742", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:43.111406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:43.125947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfdfed7d-9e83-404b-8192-e8e7e4c41e5b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.515712 Jun 25 21:02:43.129446 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1546/2816] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:42 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:43.144591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:43.146278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:43.165457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:43.166313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:43.178698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:43.180862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:43.255443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:02:43.630930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:43.639621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Old instance type m1.heat2, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:02:43.666289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:43.667429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:43.668954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:43.669876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:43.671765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:43.921066 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b86fbbc-ebef-4aca-adee-9fe6f7c56946 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246/action" status: 202 len: 0 microversion: 2.1 time: 0.789342 Jun 25 21:02:43.933324 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1547/2817] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:43 2022] POST /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:43.940927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:43.948395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:43.957707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:43.957707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:43.961059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:43.969623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.438883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:44.450113 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-592a76f7-e999-4977-acee-98c40e699c3f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.514689 Jun 25 21:02:44.451016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1548/2818] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:43 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:44.456903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:44.458098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:44.468521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.469871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.470896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.471913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.607291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:02:44.607780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:02:44.608321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:02:44.608808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:02:44.609276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:02:44.627848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.632756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.634098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.635322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.696366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Getting quotas for project c08f52307dc24b5bacaea02af2fe64da. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:02:44.712247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Getting quotas for user e6fb1f340fc243f4ae0f4f11f90c1f5d and project c08f52307dc24b5bacaea02af2fe64da. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:02:44.745601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:02:44.750984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:02:44.875393 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d47c685d-24aa-4438-97cb-daff880df08e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.878190 Jun 25 21:02:44.885486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1271/2819] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:02:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:02:44.901888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:44.927802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:44.976454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.977240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:44.979998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:44.982166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:45.026149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:45.039910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a382f92b-f0fa-40d8-946c-9ec1cd826931 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1472 microversion: 2.1 time: 0.587588 Jun 25 21:02:45.059675 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1549/2820] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:44 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1472 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:45.078716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:45.080969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:45.101251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:45.102899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:45.103959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:45.106898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:45.636441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:45.650079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-626b401f-e83c-4915-bd67-8b8a0866fb8a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.586243 Jun 25 21:02:45.663104 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1550/2821] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:45 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:45.670039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-baccd0c8-185f-46d2-bc82-5e9937502e20 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:45.673507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-baccd0c8-185f-46d2-bc82-5e9937502e20 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:45.843668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-baccd0c8-185f-46d2-bc82-5e9937502e20 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:45.865365 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-baccd0c8-185f-46d2-bc82-5e9937502e20 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1218 microversion: 2.1 time: 0.197364 Jun 25 21:02:45.867644 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1551/2822] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:45 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1218 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:45.886980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:45.889671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:45.898907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:45.931855 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d9a765f-e09e-4c61-a9eb-7e6f36cb79a6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 1.035373 Jun 25 21:02:45.933000 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1272/2823] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:44 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:45.936232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:45.937137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:45.938256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:45.939583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:46.067240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:46.082191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:46.102181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:46.104849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:46.105901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:46.111130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:46.486918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:46.498957 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad371f22-0db5-447b-9eaa-43aa4616400e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.627035 Jun 25 21:02:46.501991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1552/2824] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:45 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:46.679112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:46.680972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:46.705252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:46.705821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:46.706652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:46.707091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:46.802789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:47.128895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:47.142818 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb11b4db-8ef4-490c-a5f1-be9531575fc9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1472 microversion: 2.1 time: 1.082661 Jun 25 21:02:47.147796 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1273/2825] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:46 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1472 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:47.163696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:47.180913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:47.182526 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa75c808-2704-4870-8e80-f594f6d74ba1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.515339 Jun 25 21:02:47.183127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1553/2826] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:46 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:47.189046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:47.193597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:47.193756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:47.201445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.202274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.203472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.204849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.207310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.209013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.211099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.215339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.583649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:47.599645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd9a4422-b90e-4e92-8f11-b2e5d0bff815 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.413336 Jun 25 21:02:47.600579 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1554/2827] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:47 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:47.624214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:47.627819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:47.628543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:47.657257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.657721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.662297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:47.663455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:47.664689 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-943e2e1f-f47c-4745-a631-95ec7ca59a12 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1278 microversion: 2.1 time: 0.515365 Jun 25 21:02:47.669545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1274/2828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:47 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1278 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:48.170450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:48.181433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:48.196915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.197872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.199613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.201335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.492714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:48.505370 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0395f4e-ed0e-4ccc-900a-5ff092fc9760 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.902460 Jun 25 21:02:48.505992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1555/2829] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:47 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:48.525726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:48.532286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:48.556059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.556578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.560766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.566437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.852190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:48.867644 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1962f07a-416b-4708-b67e-913461ed4c7c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.350864 Jun 25 21:02:48.868960 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1556/2830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:48 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:48.881068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-211194c9-42b3-453e-9958-2fb0af1d1d61 req-86645ae5-ba50-40c3-a31a-78dd9f030d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c803ec-b4b8-4e7f-abb4-0729fafb8747", "name": "network-vif-plugged", "status": "completed", "tag": "a576aa0f-a7a6-4575-821b-527e7754fe55"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:48.899787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-211194c9-42b3-453e-9958-2fb0af1d1d61 req-86645ae5-ba50-40c3-a31a-78dd9f030d46 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.900241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-211194c9-42b3-453e-9958-2fb0af1d1d61 req-86645ae5-ba50-40c3-a31a-78dd9f030d46 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.929660 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-211194c9-42b3-453e-9958-2fb0af1d1d61 req-86645ae5-ba50-40c3-a31a-78dd9f030d46 service nova] Creating event network-vif-plugged:a576aa0f-a7a6-4575-821b-527e7754fe55 for instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 on nch1-master-1 Jun 25 21:02:48.942477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-211194c9-42b3-453e-9958-2fb0af1d1d61 req-86645ae5-ba50-40c3-a31a-78dd9f030d46 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071985 Jun 25 21:02:48.945069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:48.945956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1557/2831] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:48.956448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:48.959874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:48.965403 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55356f5a-6f0f-4e92-9b02-ceaa51553d8d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1472 microversion: 2.1 time: 0.804766 Jun 25 21:02:48.969217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.969953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.970952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:48.971558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:48.973281 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1275/2832] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:48 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1472 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:48.990982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:48.991746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:49.023923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.024376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:49.031045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.031565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:49.267292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:49.281717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2b71453a-3e4f-4344-9f18-68ef5648b521 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.330464 Jun 25 21:02:49.284937 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1558/2833] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:48 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:49.297940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:49.313244 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b58c50df-48ef-4db1-9b59-4b2481fbc11d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1276 microversion: 2.1 time: 0.326520 Jun 25 21:02:49.323393 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1276/2834] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:48 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1276 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:49.530176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:49.531544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:49.544440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.545345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:49.548070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.548932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:49.886862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:49.887944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:49.900603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.901595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:49.902632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:49.912020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:50.527300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:50.542113 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d642d665-7d0f-4479-84f4-348d14671fa0 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.657254 Jun 25 21:02:50.547072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1277/2835] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:49 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:02:50.559991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:50.560649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:50.591298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:50.591985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:50.595491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:50.597484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:51.295450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:51.309606 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-df248d36-d54e-4e1e-af03-d599f9833272 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1472 microversion: 2.1 time: 0.760339 Jun 25 21:02:51.312698 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1278/2836] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:50 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1472 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:51.328540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:51.330615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:51.349661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:51.350193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:51.351079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:51.371165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:51.552043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:51.572105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73f93c4c-f3e7-45e9-a72d-463d9b91f683 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 2.042539 Jun 25 21:02:51.573830 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1559/2837] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:49 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 2049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:51.595012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:51.595934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:51.619729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:51.621696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:51.625763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:51.627805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:52.172950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:52.210335 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2cb4a79-e3ea-4403-b1a9-7b359cdfc1ea tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.895973 Jun 25 21:02:52.212069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:52.215932 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1279/2838] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:51 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:52.230525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-06010f9b-2af4-422a-9e90-69f58692f836 req-7815bf52-db14-4ca6-a690-6bbc186e6bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da10d17-4377-4694-bcc0-ac85f9fa4cb6", "name": "network-vif-plugged", "status": "completed", "tag": "651df448-87ad-4128-8444-15ea68f94d21"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:52.235006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90fc76b2-c519-44d7-874d-63f7f5c0e623 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.658892 Jun 25 21:02:52.236177 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1560/2839] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:51 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:52.255913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:52.259779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-06010f9b-2af4-422a-9e90-69f58692f836 req-7815bf52-db14-4ca6-a690-6bbc186e6bdb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:52.260325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-06010f9b-2af4-422a-9e90-69f58692f836 req-7815bf52-db14-4ca6-a690-6bbc186e6bdb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:52.263229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:52.293129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:52.293867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:52.297859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:52.298631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:52.305335 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-06010f9b-2af4-422a-9e90-69f58692f836 req-7815bf52-db14-4ca6-a690-6bbc186e6bdb service nova] Creating event network-vif-plugged:651df448-87ad-4128-8444-15ea68f94d21 for instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 on nch2-master-1 Jun 25 21:02:52.325761 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-06010f9b-2af4-422a-9e90-69f58692f836 req-7815bf52-db14-4ca6-a690-6bbc186e6bdb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108352 Jun 25 21:02:52.334668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1280/2840] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:52.361085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:52.362380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:52.389767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:52.400237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:52.402324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:52.405409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:52.407573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:53.251033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:53.261647 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-15600762-544c-4e4b-8b97-6155e8fa7436 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 1.023647 Jun 25 21:02:53.276782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1561/2841] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:52 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:53.285957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:53.294127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:53.318871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:53.320606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:53.324698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:53.325616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:53.738948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:53.748284 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5cbbc959-9885-4e23-b440-f61165e282b1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 1.407624 Jun 25 21:02:53.758631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1281/2842] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:52 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:53.765099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:53.777388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:53.806827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:53.807537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:53.808545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:53.809173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:53.910564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:53.933811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91fcbc61-c5be-484b-95dd-2f6d23e02672 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.658312 Jun 25 21:02:53.936646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1562/2843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:53 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:53.951419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:53.972187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:54.005947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.018717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.026055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.026512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.304227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:54.315746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-158878ee-6e30-4e3c-aecb-ffb0ff6f54ff tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1315 microversion: 2.1 time: 0.555654 Jun 25 21:02:54.320725 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1282/2844] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:53 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:54.326063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-db569830-fe9c-4cd8-9f5d-d12d80e7511d req-70284ce9-d3a3-40e1-97d9-2ffb492ca1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e72e2c9-4a63-4c9f-be80-3f461b1c7da9", "tag": "ac8eb736-810d-4469-9657-015ffde22a44"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:54.348937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-db569830-fe9c-4cd8-9f5d-d12d80e7511d req-70284ce9-d3a3-40e1-97d9-2ffb492ca1d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.349829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-db569830-fe9c-4cd8-9f5d-d12d80e7511d req-70284ce9-d3a3-40e1-97d9-2ffb492ca1d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.382426 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-db569830-fe9c-4cd8-9f5d-d12d80e7511d req-70284ce9-d3a3-40e1-97d9-2ffb492ca1d4 service nova] Creating event network-changed:ac8eb736-810d-4469-9657-015ffde22a44 for instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 on nch2-master-1 Jun 25 21:02:54.392175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-db569830-fe9c-4cd8-9f5d-d12d80e7511d req-70284ce9-d3a3-40e1-97d9-2ffb492ca1d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069809 Jun 25 21:02:54.396969 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1283/2845] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:54.410390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:54.416244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:54.430677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.436980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.438695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.442603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.664671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:54.738700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:54.770034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:54.788199 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52ad066f-19fc-4624-85f9-98d720211c7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.845984 Jun 25 21:02:54.801391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1563/2846] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:53 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:54.828223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-51f105e6-1586-44df-8345-f18d71866ae1 req-48e6edb5-291d-4d66-adbe-fb2b69415aae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:54.870244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-51f105e6-1586-44df-8345-f18d71866ae1 req-48e6edb5-291d-4d66-adbe-fb2b69415aae service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.882177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-51f105e6-1586-44df-8345-f18d71866ae1 req-48e6edb5-291d-4d66-adbe-fb2b69415aae service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.923952 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-51f105e6-1586-44df-8345-f18d71866ae1 req-48e6edb5-291d-4d66-adbe-fb2b69415aae service nova] Creating event network-changed:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:02:54.936343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-51f105e6-1586-44df-8345-f18d71866ae1 req-48e6edb5-291d-4d66-adbe-fb2b69415aae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132156 Jun 25 21:02:54.942314 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1564/2847] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:54.954405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:54.957622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:54.979823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.982975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:54.985409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:54.994921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:55.797875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:55.806988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2825ab8f-2eb6-429e-a771-c3bb166b85ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 1.403179 Jun 25 21:02:55.811045 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1284/2848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:54 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:55.840175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:55.841570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:55.849659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:55.857882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:55.864410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:55.868483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:55.873971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:55.877967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:55.881901 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-442ccca4-6972-45a3-a561-efaab4800ca4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.932684 Jun 25 21:02:55.891686 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1565/2849] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:54 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:55.897955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:55.901809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:55.929178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:55.929638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:55.930458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:55.930950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:56.502045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:56.506710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:56.515310 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27ec96b4-013c-4d31-b716-468031624c45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.693324 Jun 25 21:02:56.524319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1285/2850] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:55 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:56.534975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e3633e0-24fe-479f-8ec8-bf34adeee094 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1503 microversion: 2.1 time: 0.650432 Jun 25 21:02:56.540785 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1566/2851] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:55 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1503 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:56.542216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:56.543086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:56.565993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1745518323"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:56.566609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:56.574458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:56.574916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:56.578892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:56.582670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:56.592201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:56.600905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:56.609612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:56.614465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:56.919797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:56.942270 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a36d7bc-a12b-4d6f-a627-fc0f7611b692 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.412621 Jun 25 21:02:56.948439 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1286/2852] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:56 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:56.966693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:56.978959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:56.994940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.003938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:57.006595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.009491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:57.099738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Adding security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb to port 651df448-87ad-4128-8444-15ea68f94d21 Jun 25 21:02:57.408996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:57.422808 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2e818876-3eff-4fff-b63d-de02422186c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.469867 Jun 25 21:02:57.426905 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1287/2853] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:56 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:57.432561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:57.438297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:57.457401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.458142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:57.462667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.463309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:57.468582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:02:57.935619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:57.944165 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ed98120d-7330-41f0-962f-e69b0f3a93f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.515265 Jun 25 21:02:57.948786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1288/2854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:57 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:57.961451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:57.965655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:57.983697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.984676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:57.985704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:57.986477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:58.322390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:58.332213 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0cbc525e-a433-43c2-89d4-aeed7c0b3072 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.381926 Jun 25 21:02:58.336237 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1289/2855] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:57 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:58.350211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:58.357444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:58.372973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:58.373753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:58.374631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:58.375349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:58.588347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a103ba9-13e6-4e60-ba55-9798bdb80dad tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action" status: 202 len: 0 microversion: 2.1 time: 2.038380 Jun 25 21:02:58.590199 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1567/2856] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:02:56 2022] POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action => generated 0 bytes in 2041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:02:58.598095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:58.598874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:58.622290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:58.626599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:58.627723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:58.628958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:59.087735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:02:59.097676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb8b679c-a1f2-4b95-a5ac-81c72e6759f6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.758094 Jun 25 21:02:59.114904 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1290/2857] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:58 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:02:59.126511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f7145e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:59.384795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use.", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:02:59.386183 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.386183 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb HTTP/1.1 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: exception: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '477ce0ac-d6ce-48ea-a3d5-48519f74b2cb'} Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:02:59.389457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] Jun 25 21:02:59.394156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:02:59.402266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 400 to user: Security Group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb in use. Jun 25 21:02:59.402266 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-3579f58f-fa54-4d01-a379-d236fe184de4'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:02:59.403631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9782262b-c1ed-4d05-86d4-c01d7d84cde8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb" status: 400 len: 185 microversion: 2.1 time: 0.287731 Jun 25 21:02:59.404568 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1291/2858] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:02:59 2022] DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb => generated 185 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:02:59.416995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8f1aaf15-22b4-4e4d-8313-a8adffa62d2d req-2fbc0a53-1b99-417c-92a6-9f2fe85a6c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da10d17-4377-4694-bcc0-ac85f9fa4cb6", "tag": "651df448-87ad-4128-8444-15ea68f94d21"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:02:59.447418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8f1aaf15-22b4-4e4d-8313-a8adffa62d2d req-2fbc0a53-1b99-417c-92a6-9f2fe85a6c4c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:59.448542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8f1aaf15-22b4-4e4d-8313-a8adffa62d2d req-2fbc0a53-1b99-417c-92a6-9f2fe85a6c4c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:59.472338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8f1aaf15-22b4-4e4d-8313-a8adffa62d2d req-2fbc0a53-1b99-417c-92a6-9f2fe85a6c4c service nova] Creating event network-changed:651df448-87ad-4128-8444-15ea68f94d21 for instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 on nch2-master-1 Jun 25 21:02:59.490304 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8f1aaf15-22b4-4e4d-8313-a8adffa62d2d req-2fbc0a53-1b99-417c-92a6-9f2fe85a6c4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084085 Jun 25 21:02:59.492505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1292/2859] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:02:59.509845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:02:59.510987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:02:59.533559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:59.534050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:59.537357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:02:59.538669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:02:59.986415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:00.006948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32b38171-5ab9-45b6-88cd-72da3fbe79bd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 1.410412 Jun 25 21:03:00.010176 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1568/2860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:58 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:00.022557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:00.026465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:00.042002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.045406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.050677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.051365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.303612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:00.318322 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc2345a0-240d-49fc-a6c2-34113ce9dae2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.823357 Jun 25 21:03:00.324020 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1293/2861] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:02:59 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:00.329892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:00.335797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:00.352809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.353657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.355097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.365044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.539302 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdfb0410-04a3-4e47-9e93-08689a7e2c4a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action" status: 202 len: 0 microversion: 2.1 time: 0.213161 Jun 25 21:03:00.540805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1294/2862] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:00 2022] POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:00.551534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:00.552942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:00.568024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:00.570719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.571418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.573954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.576849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.918228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:00.934059 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae04698f-c49b-46e1-b384-ceadd8b8b867 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.922723 Jun 25 21:03:00.935263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1569/2863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:00 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:00.941569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:00.942574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:00.951214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.951903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.953342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:00.957035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:00.997531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:01.013704 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c7c2a35-6cfe-41c8-8534-d920bed874f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.471269 Jun 25 21:03:01.028687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1295/2864] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:00 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:01.038299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:01.043347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:01.056724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.057590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.059475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.060247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.286818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:01.302172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a30a3af0-46ad-4dd9-8a03-5a880d2fdff3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1682 microversion: 2.1 time: 0.365637 Jun 25 21:03:01.306220 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1570/2865] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:00 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1682 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:01.312608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:01.313506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:01.320587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.321256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.322184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.322771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.500136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:01.517951 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d29af3e0-60df-4563-884b-912a484bb13e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1574 microversion: 2.1 time: 0.487468 Jun 25 21:03:01.519078 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1296/2866] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:01 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1574 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:01.523703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:01.524446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:01.543078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.543808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.544655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.545184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.604603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:01.631701 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2211eee4-55b2-4bae-95ae-9982ce90faad tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.324095 Jun 25 21:03:01.632951 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1571/2867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:01 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:01.877363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:01.886217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b34973fa-524c-4148-b4b6-08fdaec16a99 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.365958 Jun 25 21:03:01.894495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1297/2868] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:01 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:01.952103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:01.953296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:01.966727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.967554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:01.969869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:01.972254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.030921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:02.031939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:02.052605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.054523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.055524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.062523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.231776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:02.244095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbcf6530-1f48-4780-8605-2ad48cf69270 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.296731 Jun 25 21:03:02.257062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1572/2869] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:01 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:02.324608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:02.326160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:02.346701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.347416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.350343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.354719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.464489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:02.476993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-812274e7-d646-4d90-b9d8-436c8f6e4106 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.449998 Jun 25 21:03:02.486815 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1298/2870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:02 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:02.538756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:02.540457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:02.554151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.557068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.560674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.561710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.779834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:02.806608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7dcfbde6-87fe-4862-a719-f6192a84fb3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.487307 Jun 25 21:03:02.811842 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1573/2871] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:02 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:02.829617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:02.831699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:02.853381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.853871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:02.857862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:02.859124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.021891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:03.038248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70ad6eba-b005-4669-99cf-9226f05ce9f2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1574 microversion: 2.1 time: 0.503875 Jun 25 21:03:03.039784 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1299/2872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:02 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1574 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:03.049310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-264640269"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:03.051966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:03.070022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.072119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.073023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.074845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.208740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:03.224578 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a58a7a8-551b-42ff-94c8-3006415de49c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1503 microversion: 2.1 time: 0.407418 Jun 25 21:03:03.225692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1574/2873] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:02 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:03.238762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:03.239442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:03.253617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.258695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.265227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.266089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.585797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6400c8b7-5278-4e82-a106-30edbd543af3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.540240 Jun 25 21:03:03.604445 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1300/2874] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:03 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jun 25 21:03:03.629777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "082cefb0-a9d8-47c3-9aba-5fc73d24ea5d"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:03.633834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:03.651660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.653664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.656230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.657166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.675569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:03.698430 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8b06223-02e6-4df4-af09-5e59c1442084 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.471351 Jun 25 21:03:03.710367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1575/2875] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:03 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:03.719970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:03.720978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:03.723851 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Cannot 'attach_volume' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state rescued Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/os-volume_attachments HTTP/1.1 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 74 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: {"volumeAttachment": {"volumeId": "082cefb0-a9d8-47c3-9aba-5fc73d24ea5d"}} Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'attach_volume' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state rescued Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': 'a104cd86-0a2f-45ec-8047-c581153d539c', 'body': {'volumeAttachment': {'volumeId': '082cefb0-a9d8-47c3-9aba-5fc73d24ea5d'}}} Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a104cd86-0a2f-45ec-8047-c581153d539c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 25 21:03:03.728775 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state rescued Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state rescued Jun 25 21:03:03.734302 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:03.735987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 409 to user: Cannot 'attach_volume' instance a104cd86-0a2f-45ec-8047-c581153d539c while it is in vm_state rescued {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:03.737956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.738589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.739528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.739962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8301198-255f-4f71-bbc9-4f19cecc1e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.128490 Jun 25 21:03:03.740339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.745158 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1301/2876] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:03:03 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/os-volume_attachments => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:03:03.755120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:03.756573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:03.771820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.772888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:03.776028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:03.776674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.029242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:04.043408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9bd7c2b9-3bc0-4d8b-8e5c-75e3e94148ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.296220 Jun 25 21:03:04.044502 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1302/2877] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:03 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:04.049942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:04.057467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:04.065085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:04.073328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.076005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.077459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.078922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.082576 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c0f0ec6-e3c8-4217-aeb3-9208c0b5b97b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.367639 Jun 25 21:03:04.083238 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1576/2878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:03 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:04.099719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:04.100565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:04.115835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:04.120955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.122355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.123618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.124216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.257041 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96f709f9-adcd-4602-aa9c-f467456c074f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action" status: 202 len: 0 microversion: 2.1 time: 0.170260 Jun 25 21:03:04.258083 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1577/2879] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:04 2022] POST /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:04.264232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:04.265182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:04.273515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.273972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.275410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.275853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.307907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:04.347326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:04.358093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f79aba7-db82-466e-bf24-85924e9f2d6a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.312537 Jun 25 21:03:04.371770 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1303/2880] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:04 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:04.377739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2484cc05-d2e1-4c69-bcd8-b4077d9ce7dc req-1d75bcfe-4765-454c-bdee-e71ccdb14f87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:04.386805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2484cc05-d2e1-4c69-bcd8-b4077d9ce7dc req-1d75bcfe-4765-454c-bdee-e71ccdb14f87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.387268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2484cc05-d2e1-4c69-bcd8-b4077d9ce7dc req-1d75bcfe-4765-454c-bdee-e71ccdb14f87 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.402735 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2484cc05-d2e1-4c69-bcd8-b4077d9ce7dc req-1d75bcfe-4765-454c-bdee-e71ccdb14f87 service nova] Creating event network-vif-unplugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:03:04.416495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2484cc05-d2e1-4c69-bcd8-b4077d9ce7dc req-1d75bcfe-4765-454c-bdee-e71ccdb14f87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042940 Jun 25 21:03:04.417838 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1304/2881] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:04.424230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:04.425006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:04.434133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.434591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.435502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.435993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.488936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:04.630928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:04.640013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71341731-a768-4ab3-bd16-ad4a611b57fc tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1572 microversion: 2.1 time: 0.380028 Jun 25 21:03:04.644323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1578/2882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:04 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1572 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:04.656243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:04.667947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:04.673957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Searching by: {'deleted': False, 'project_id': '7f998f8bc87c4e009254746816812231'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:03:04.690658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.691904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.693001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.693858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.765157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:03:04.872344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c2f68774-3596-4409-95f3-51649f8b4f42 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.226641 Jun 25 21:03:04.881714 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1579/2883] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:03:04 2022] GET /compute/v2.1/servers => generated 343 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:04.887119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-602422509"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:04.887833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:04.895289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.895954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:04.896891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:04.897479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-787d7326-927c-41ea-9a7f-a157a48d7ef8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1511 microversion: 2.1 time: 0.634191 Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1305/2884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:04 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1511 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:05.099599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:05.511265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:05.526980 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-62839869-837f-489f-9b24-647d00c98954 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.466802 Jun 25 21:03:05.538106 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1306/2885] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:05 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:05.566219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:05.575225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:05.576590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Searching by: {'deleted': False, 'project_id': '7f998f8bc87c4e009254746816812231'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:03:05.587159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:05.588085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:05.591398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:05.593606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:05.640078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:03:05.742103 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Adding security group 582aff79-7ecc-48b4-92b5-384210c77bf0 to port 651df448-87ad-4128-8444-15ea68f94d21 Jun 25 21:03:05.793316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:05.826845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:05.827396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.134221 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b6f3a7b-03e3-4a1f-a554-09d7bcd8dfa4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.579840 Jun 25 21:03:06.140600 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1307/2886] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:03:05 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:06.140600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.141173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:06.158942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.162905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.164231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.165992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.463823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:06.475184 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-195c12d0-3026-427c-b5d9-0e044c2d6f27 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.338612 Jun 25 21:03:06.476640 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1308/2887] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:06.483033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.484035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:06.492910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.493535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.494674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.495329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.629814 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5536bec6-bbd3-4f18-9058-a7cb4e14d32a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action" status: 202 len: 0 microversion: 2.1 time: 1.746664 Jun 25 21:03:06.631000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1580/2888] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:04 2022] POST /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6/action => generated 0 bytes in 1749 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:06.636032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.636700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:06.647762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.648216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.649169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.649615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.697524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:06.712174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a972bb16-5e13-4166-b7c8-c4f8838dedab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1524 microversion: 2.1 time: 0.234072 Jun 25 21:03:06.716790 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1309/2889] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1524 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:06.730274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.733788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:06.742336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.742948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.743853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.744578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:06.908500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:06.917682 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce33196f-b6d7-43b3-9462-a5d9921ff329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.285539 Jun 25 21:03:06.929107 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1581/2890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:06.942619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-446f5f95-7294-4ef9-a730-980a8839fe3e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.954098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-446f5f95-7294-4ef9-a730-980a8839fe3e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023353 Jun 25 21:03:06.962092 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1582/2891] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:06.964353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-446f5f95-7294-4ef9-a730-980a8839fe3e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:06.966419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-446f5f95-7294-4ef9-a730-980a8839fe3e tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002480 Jun 25 21:03:06.967002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1583/2892] 10.222.0.39 () {56 vars in 885 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 25 21:03:06.973700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72e2c9-4a63-4c9f-be80-3f461b1c7da9", "name": "network-vif-plugged", "status": "completed", "tag": "ac8eb736-810d-4469-9657-015ffde22a44"}, {"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-plugged", "status": "completed", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:06.990308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:06.991050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.022650 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] Creating event network-vif-plugged:ac8eb736-810d-4469-9657-015ffde22a44 for instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 on nch2-master-1 Jun 25 21:03:07.023171 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] Creating event network-vif-plugged:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:03:07.062727 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b5c03b4b-2f2a-4f76-8c9a-f34e9ab08f6b req-4f9d436c-1947-47a4-9de3-644caf9d68f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091675 Jun 25 21:03:07.067730 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1584/2893] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:07.074084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:07.086394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1e3027d5-4ae0-4641-8246-3d217c964484 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1511 microversion: 2.1 time: 0.367387 Jun 25 21:03:07.087006 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1310/2894] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:06 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:07.097652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:07.097652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:07.113364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f7269d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:07.144547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.144812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.154550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.155014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.423645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use.", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:07.424981 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.424981 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0 HTTP/1.1 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: exception: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '582aff79-7ecc-48b4-92b5-384210c77bf0'} Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:07.427343 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] Jun 25 21:03:07.431727 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:07.434959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 400 to user: Security Group 582aff79-7ecc-48b4-92b5-384210c77bf0 in use. Jun 25 21:03:07.434959 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-5f52db7f-0a20-4a8a-9dfb-1c5ed7750c5b'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:07.436190 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c3b46de-d1f7-459d-93dc-881ab0f25e0e tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0" status: 400 len: 185 microversion: 2.1 time: 0.336713 Jun 25 21:03:07.437393 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1311/2895] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:07 2022] DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0 => generated 185 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:03:07.446886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-244ea333-aab5-49f2-8b93-75f3f02f5e16 req-17923b94-d65d-4d23-8e41-0cc377cc0440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3da10d17-4377-4694-bcc0-ac85f9fa4cb6", "tag": "651df448-87ad-4128-8444-15ea68f94d21"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:07.458006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-244ea333-aab5-49f2-8b93-75f3f02f5e16 req-17923b94-d65d-4d23-8e41-0cc377cc0440 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.458751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-244ea333-aab5-49f2-8b93-75f3f02f5e16 req-17923b94-d65d-4d23-8e41-0cc377cc0440 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.472146 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-244ea333-aab5-49f2-8b93-75f3f02f5e16 req-17923b94-d65d-4d23-8e41-0cc377cc0440 service nova] Creating event network-changed:651df448-87ad-4128-8444-15ea68f94d21 for instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 on nch2-master-1 Jun 25 21:03:07.484441 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-244ea333-aab5-49f2-8b93-75f3f02f5e16 req-17923b94-d65d-4d23-8e41-0cc377cc0440 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035354 Jun 25 21:03:07.485921 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1312/2896] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:07.493320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:07.494078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:07.501829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.502560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.503614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.504206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.537116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:03:07.641963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:07.656075 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a3ac169-9b5b-487c-8459-76fb6f69dbe2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.581135 Jun 25 21:03:07.658026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1585/2897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:07 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:07.664964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:07.666817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:07.685365 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-865a603c-fa04-473b-be15-8ded2f3a0be2 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "DELETE /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 204 len: 0 microversion: 2.1 time: 0.197097 Jun 25 21:03:07.686642 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1313/2898] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:03:07 2022] DELETE /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:03:07.693232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:07.697456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:07.710759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.717276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.718549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.719150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.723325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.724348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.728513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:07.731197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:07.817001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:03:07.993576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:08.004089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-135982b0-2654-4891-9623-762c9d57afa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 204 len: 0 microversion: 2.1 time: 0.344130 Jun 25 21:03:08.010062 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1272c25c-ac9c-4218-9b4d-d244de088675 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.321212 Jun 25 21:03:08.013856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1314/2899] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:07 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:08.022861 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1586/2900] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:03:07 2022] DELETE /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:03:08.033730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:08.035503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:08.043973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.044438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.045220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.045657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.045775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:08.046776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:08.063741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.065576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.072832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.073407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.447319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:08.459461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a31c92b7-69a5-473b-9553-5eb3cfd9bee9 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1506 microversion: 2.1 time: 0.435959 Jun 25 21:03:08.461081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1587/2901] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:08 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:08.474169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:08.474830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:08.485616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.486051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.487528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.487963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.721315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:08.738444 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41960cf3-7523-4291-bb97-10c188b2e5d8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1687 microversion: 2.1 time: 0.270261 Jun 25 21:03:08.742194 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1588/2902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:08 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1687 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:08.759009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:08.759943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:08.772598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.773841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.775497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.776602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.819331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:08.829422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-998f7ec5-0d3d-484d-bdd1-c3fbc4bbef5d tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1608 microversion: 2.1 time: 0.813953 Jun 25 21:03:08.831350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1315/2903] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:08 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1608 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:08.836152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:08.837000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:08.846645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.847112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:08.847901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:08.848342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.077413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:09.088917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:09.102314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3475e47b-ea56-4f95-b161-09b846c3e08c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1646 microversion: 2.1 time: 0.355445 Jun 25 21:03:09.103338 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1589/2904] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:08 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1646 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:09.115653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:09.116488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:09.121265 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f19c2424-7b2c-400a-81a3-bfe4987dd0ff tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1517 microversion: 2.1 time: 0.286619 Jun 25 21:03:09.122121 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1316/2905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:08 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1517 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:09.144560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:09.145255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:09.150965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.151784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.153353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.153853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.154803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.155269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.157599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.160083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.596237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:09.609675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9326a346-7952-4876-8ed2-b267b788c04f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.500899 Jun 25 21:03:09.611701 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1590/2906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:09 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:09.618576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:09.619670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:09.620459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:09.630592 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-58bb2b46-befd-4b4f-becf-94bd0a08e56b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1318 microversion: 2.1 time: 0.503027 Jun 25 21:03:09.633020 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1317/2907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:09 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:09.681279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.681783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.684634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.686717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.759462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:09.760504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:09.775882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.776878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.777928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:09.782042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:09.987745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.007757 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d20b8853-c1f8-4f00-8a03-7315e765d346 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1506 microversion: 2.1 time: 0.393067 Jun 25 21:03:10.009134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1591/2908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:09 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:10.014209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:10.015015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:10.024060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.024923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.025891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.026513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.244735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.260623 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bcf4d7fb-3f36-43f6-a425-9202471f4613 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1687 microversion: 2.1 time: 0.505211 Jun 25 21:03:10.263783 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1318/2909] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:09 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1687 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:10.282686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6886d6e5-048d-412b-b33d-28132e69185f req-184adc7b-b289-4ec7-952a-2f842ce19453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-plugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:10.287331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.297102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ee66c23-dbd9-4d09-ba5d-c826241badd4 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1608 microversion: 2.1 time: 0.286331 Jun 25 21:03:10.297320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6886d6e5-048d-412b-b33d-28132e69185f req-184adc7b-b289-4ec7-952a-2f842ce19453 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.297935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6886d6e5-048d-412b-b33d-28132e69185f req-184adc7b-b289-4ec7-952a-2f842ce19453 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.307548 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1592/2910] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:10 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1608 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:10.313102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:10.313730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:10.320861 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6886d6e5-048d-412b-b33d-28132e69185f req-184adc7b-b289-4ec7-952a-2f842ce19453 service nova] Creating event network-vif-plugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:03:10.321095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.321348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.322135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.323820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.327224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6886d6e5-048d-412b-b33d-28132e69185f req-184adc7b-b289-4ec7-952a-2f842ce19453 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049639 Jun 25 21:03:10.332346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1319/2911] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:10.628969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.630506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:10.631274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:10.640562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.642996 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0983af1-25e9-4247-a619-c9568a058fb6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1646 microversion: 2.1 time: 0.334128 Jun 25 21:03:10.643786 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1593/2912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:10 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1646 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:10.645139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.645985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.646433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.649638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:10.650318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:10.656744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.657479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.658322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.658843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.784693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.793409 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7405a970-5905-451b-ba8d-7d7625369029 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.168169 Jun 25 21:03:10.803154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1320/2913] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:10 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:10.856035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fe015a8-c92e-4859-b4ee-ef7a0d9df5af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: .version_select at 0x7f984f714b80>, body: {"keypair": {"name": "tempest-keypair-1804782989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6kP8wwmV+aGj7IufuU2CFMME3pEHaRNVA+tlEVYZWkkGPcbiOIuiN7jMDIzBoYsdpkTuFUp7iG2Q5bzLNpH6/A0U2uQLpdK2fsh7NlvMFrU+IqMcjmI5ZNwIK9tvRwBA=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:10.870705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fe015a8-c92e-4859-b4ee-ef7a0d9df5af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:10.875519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8fe015a8-c92e-4859-b4ee-ef7a0d9df5af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for user a6a15dadfd0448fab9e84a89173ed7d1 and project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:10.884889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:10.893529 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c9b6fc5-5d92-4892-ac0b-a4667bf06526 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1468 microversion: 2.1 time: 0.247519 Jun 25 21:03:10.894289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1594/2914] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:10 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:10.904168 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fe015a8-c92e-4859-b4ee-ef7a0d9df5af tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052103 Jun 25 21:03:10.904970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1321/2915] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:03:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:03:10.916908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:10.917910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:10.924795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.925494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:10.926444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:10.927033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.025272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.026378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.038134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.039098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.041489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.042212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.155146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:11.158386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:11.171493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a39e06c6-0fb5-423b-b0fb-d6e3519af784 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1467 microversion: 2.1 time: 0.258701 Jun 25 21:03:11.182738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1595/2916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:10 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:11.192216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1991909419"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:11.193377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.206434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.206961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.207689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.208165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.290603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:11.297482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:11.305456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b245e265-4e72-47a6-adc6-4d70b9b24f71 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1506 microversion: 2.1 time: 0.284132 Jun 25 21:03:11.306752 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1322/2917] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:11.342132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.343081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.355939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.356694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.364457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.365583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.548985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:11.568854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3e38a04-e0f8-4537-9d56-9a51974fa78d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1687 microversion: 2.1 time: 0.260812 Jun 25 21:03:11.569485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1323/2918] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:11.574359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.585941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.594634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.595329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.596371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.597005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.658106 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1b7a3db3-b3c5-434f-b0d2-6aa8007f1ac1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "POST /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc/action" status: 202 len: 0 microversion: 2.1 time: 0.470679 Jun 25 21:03:11.660006 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1596/2919] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:11 2022] POST /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:03:11.666540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.667543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.675319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.676025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.677122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.677758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.815175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:11.835003 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-606d1645-9af7-4db8-8644-0a3e777e62be tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1608 microversion: 2.1 time: 0.264247 Jun 25 21:03:11.835714 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1324/2920] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1608 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:11.848847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eacc8325-024e-4b4b-8e2d-4027ad3517cd tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f726310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.923035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eacc8325-024e-4b4b-8e2d-4027ad3517cd tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 200 len: 1455 microversion: 2.1 time: 0.086199 Jun 25 21:03:11.924342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1325/2921] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:11.930224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:11.931235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:11.946052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.948551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:11.952154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:11.953066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.392286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:12.410372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d5702b6-efea-45fc-b8f9-1aa7c8da6cb6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.483567 Jun 25 21:03:12.420319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1326/2922] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:12.420319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:12.421090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:12.431281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.432588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.434025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.434800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.525018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:12.544876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68489029-4b4e-44a2-9f16-64c4db5df080 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1646 microversion: 2.1 time: 0.883065 Jun 25 21:03:12.546091 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1597/2923] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:11 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1646 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:12.552701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-083af88c-ccf0-45d3-9269-03d78555d9e9 req-a5a5303a-b464-42ab-8cec-f603e7588cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c803ec-b4b8-4e7f-abb4-0729fafb8747", "name": "network-vif-unplugged", "status": "completed", "tag": "a576aa0f-a7a6-4575-821b-527e7754fe55"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:12.571367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-083af88c-ccf0-45d3-9269-03d78555d9e9 req-a5a5303a-b464-42ab-8cec-f603e7588cb6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.573142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-083af88c-ccf0-45d3-9269-03d78555d9e9 req-a5a5303a-b464-42ab-8cec-f603e7588cb6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.593492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_external_events [req-083af88c-ccf0-45d3-9269-03d78555d9e9 req-a5a5303a-b464-42ab-8cec-f603e7588cb6 service nova] Unable to find a host for instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747. Dropping event network-vif-unplugged {{(pid=137461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:03:12.594534 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-083af88c-ccf0-45d3-9269-03d78555d9e9 req-a5a5303a-b464-42ab-8cec-f603e7588cb6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.046596 Jun 25 21:03:12.595158 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1598/2924] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 49 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:03:12.600700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:12.601643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:12.611538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.612311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.613352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.613959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.744972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:12.754643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-721b0e0c-a49e-4493-aa71-4bb73fba53e1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 200 len: 1449 microversion: 2.1 time: 0.341370 Jun 25 21:03:12.755757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1327/2925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:12 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 1449 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:12.772041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:12.772659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:12.779445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.779979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.781016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.781519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.825464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:03:12.834866 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Working on deleting snapshot d9027bf7-fdfa-426a-9a96-d3840ee789fd from shelved instance... Jun 25 21:03:12.870972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:12.887401 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a04efc0-7e00-4c02-a0ee-c7a6a47a729f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1687 microversion: 2.1 time: 0.290896 Jun 25 21:03:12.897110 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1599/2926] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:12 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1687 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:12.897110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:12.897110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:12.904121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.904831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:12.906848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:12.907457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:13.193165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:13.210494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2909ffeb-0dae-47bc-ac72-0872a9c6e1ca tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1608 microversion: 2.1 time: 0.320859 Jun 25 21:03:13.211792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1600/2927] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:12 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1608 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:13.217621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4668c00b-57a3-4e5d-b160-49c3a63a3b38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ff19940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:13.299394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4668c00b-57a3-4e5d-b160-49c3a63a3b38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 200 len: 1455 microversion: 2.1 time: 0.085526 Jun 25 21:03:13.305547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1601/2928] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:13 2022] GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:13.428169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:13.428825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:13.441253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:13.445060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:13.446387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:13.447495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:13.827007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Doing local delete in cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137462) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 25 21:03:13.827859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:13.828298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:13.828751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 25 21:03:13.832666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] deallocate_for_instance() {{(pid=137462) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 25 21:03:13.897887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:13.908295 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9e7e675-0d8d-4014-8506-8f9831289594 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1477 microversion: 2.1 time: 0.484564 Jun 25 21:03:13.908983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1602/2929] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:13 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1477 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:13.922940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:13.923619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:13.938129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:13.938791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:13.939761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:13.940193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.281156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:14.290852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-586059df-bd8d-4d57-9f32-32645c3d5662 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 200 len: 1646 microversion: 2.1 time: 0.380458 Jun 25 21:03:14.292301 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1603/2930] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:13 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 1646 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:14.297501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:14.298369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:14.306342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.306943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.307875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.308571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.489772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:14.502478 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ee209d2-3c9c-4924-bc29-13cc3cbca3dd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1687 microversion: 2.1 time: 0.208376 Jun 25 21:03:14.503794 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1604/2931] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:14 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1687 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:14.511180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:14.512808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:14.522040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.523941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.525071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.525722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.602649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9abc0f22f944a95a70b23e50bafdccb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f998f8bc87c4e009254746816812231', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:14.611821 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ee6d29d-0b7b-4444-9ced-2a40ced6e1a9 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 200 len: 1540 microversion: 2.1 time: 0.106238 Jun 25 21:03:14.612441 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1605/2932] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:14 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 1540 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:14.618097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3413d1a6-ade5-4344-aaa6-6eebc256ee73 req-1e80fd10-e0db-4f8e-8381-b3c96632618e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3da10d17-4377-4694-bcc0-ac85f9fa4cb6", "name": "network-vif-deleted", "tag": "651df448-87ad-4128-8444-15ea68f94d21"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:14.626904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3413d1a6-ade5-4344-aaa6-6eebc256ee73 req-1e80fd10-e0db-4f8e-8381-b3c96632618e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.627354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3413d1a6-ade5-4344-aaa6-6eebc256ee73 req-1e80fd10-e0db-4f8e-8381-b3c96632618e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.639506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3413d1a6-ade5-4344-aaa6-6eebc256ee73 req-1e80fd10-e0db-4f8e-8381-b3c96632618e service nova] Creating event network-vif-deleted:651df448-87ad-4128-8444-15ea68f94d21 for instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 on nch2-master-1 Jun 25 21:03:14.644749 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3413d1a6-ade5-4344-aaa6-6eebc256ee73 req-1e80fd10-e0db-4f8e-8381-b3c96632618e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030955 Jun 25 21:03:14.645372 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1606/2933] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:14.650539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-504ba045-380c-4ce5-bd66-cad378fbf13f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f5879d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:14.703759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-504ba045-380c-4ce5-bd66-cad378fbf13f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 200 len: 1455 microversion: 2.1 time: 0.057052 Jun 25 21:03:14.704498 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1607/2934] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:14 2022] GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:14.926935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:14.928383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:14.931411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:14.950030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.951555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:14.953563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:14.954164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:15.314734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:15.324666 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f62dce6d-34ad-4b61-8784-4a5eff8919ad tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1476 microversion: 2.1 time: 0.402148 Jun 25 21:03:15.331827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1608/2935] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:14 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1476 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:15.338345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:15.339177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:15.357061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:15.357528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:15.358324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:15.358812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:15.383312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 HTTP/1.1 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3da10d17-4377-4694-bcc0-ac85f9fa4cb6'} Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:15.385081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:15.389617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cdfc1cac-9681-4dbe-a03a-125394f785e6 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.053386 Jun 25 21:03:15.390295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1609/2936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:15 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:15.397289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b29f3c52-9747-495f-a839-62af1b906d10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f62fdc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:15.609531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:16.642912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b29f3c52-9747-495f-a839-62af1b906d10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb" status: 202 len: 0 microversion: 2.1 time: 1.249281 Jun 25 21:03:16.643828 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1610/2937] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:15 2022] DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:16.652185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:16.654805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:16.698705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:16.703461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:16.707190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:16.709795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:17.333040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:17.350553 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b67ee21-8736-4bb3-8d30-980a48606325 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1682 microversion: 2.1 time: 0.705496 Jun 25 21:03:17.354546 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1611/2938] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:16 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1682 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:17.364273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:17.377108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] [instance: 54bfd505-2b77-4e11-a800-c92a473a73e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:17.390249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:17.391907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:17.392967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:17.393688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:17.428107 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] HTTP exception thrown: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Request method failure captured: Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 HTTP/1.1 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3edFbR-E5RICgNnWak7kQOkfycw48s7c71stobUIrITQ-4HriDHYd2o3Z5kXaWKt_SKrp2Uxirm5j8caiNdN4S1EGIEzRNnMJvJx0w3WlIfYfI05TJdibSuW5wXEzPVTm_C84RodMIqje0Ymqm3LP5xpHia8l1UJS5CMuWnpCfCvLQ Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7f998f8bc87c4e009254746816812231 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestBootFromVolume-1548263687 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7f998f8bc87c4e009254746816812231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7f998f8bc87c4e009254746816812231"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7f998f8bc87c4e009254746816812231"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7f998f8bc87c4e009254746816812231"}]}] Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestBootFromVolume-1548263687 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7f998f8bc87c4e009254746816812231 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1548263687 Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestBootFromVolume-1548263687-project Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f9abc0f22f944a95a70b23e50bafdccb Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestBootFromVolume-1548263687-project Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '54bfd505-2b77-4e11-a800-c92a473a73e6'} Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:17.429998 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. Jun 25 21:03:17.433957 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:17.437348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Returning 404 to user: Instance 54bfd505-2b77-4e11-a800-c92a473a73e6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:17.438422 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa371d5e-8570-4561-b8ac-1a6e286f2b51 tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6" status: 404 len: 111 microversion: 2.1 time: 0.078152 Jun 25 21:03:17.447407 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1612/2939] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:17 2022] GET /compute/v2.1/servers/54bfd505-2b77-4e11-a800-c92a473a73e6 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:17.452515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3d74dec1-c5fa-469c-9ca0-dc5dae48f0e6 req-f7b61808-fa30-451d-b2da-d45905ae4844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54bfd505-2b77-4e11-a800-c92a473a73e6", "name": "network-vif-deleted", "tag": "d8dadee9-cfd0-4802-908a-a00de6cb54eb"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:17.470418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3d74dec1-c5fa-469c-9ca0-dc5dae48f0e6 req-f7b61808-fa30-451d-b2da-d45905ae4844 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:17.471131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3d74dec1-c5fa-469c-9ca0-dc5dae48f0e6 req-f7b61808-fa30-451d-b2da-d45905ae4844 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:17.480412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Updating instance_info_cache with network_info: [] {{(pid=137462) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:03:17.500475 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3d74dec1-c5fa-469c-9ca0-dc5dae48f0e6 req-f7b61808-fa30-451d-b2da-d45905ae4844 service nova] Creating event network-vif-deleted:d8dadee9-cfd0-4802-908a-a00de6cb54eb for instance 54bfd505-2b77-4e11-a800-c92a473a73e6 on nch2-master-1 Jun 25 21:03:17.512549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3d74dec1-c5fa-469c-9ca0-dc5dae48f0e6 req-f7b61808-fa30-451d-b2da-d45905ae4844 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063566 Jun 25 21:03:17.519311 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1613/2940] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:17.531522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ad42114-42a6-45b9-ab51-bf4f45452f19 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f599d30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:17.934867 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b0c192e1-ecc9-4e05-a1e7-dd3f05ba81be tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 204 len: 0 microversion: 2.1 time: 5.165626 Jun 25 21:03:17.935192 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1328/2941] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:03:12 2022] DELETE /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 0 bytes in 5167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:03:17.946480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:17.947415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:17.970579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:17.971223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:17.974391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:17.975800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:18.279989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:18.291944 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8a8c28d-8114-4ada-940d-e49b3838c6f8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1474 microversion: 2.1 time: 0.355469 Jun 25 21:03:18.293222 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1329/2942] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:17 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1474 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:18.301594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef596641-ae51-4ea9-aac1-8e6081bd06cd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f601310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:18.836221 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef596641-ae51-4ea9-aac1-8e6081bd06cd tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0" status: 202 len: 0 microversion: 2.1 time: 0.541387 Jun 25 21:03:18.837221 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1330/2943] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:18 2022] DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:18.855643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1381294560", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e6c48141-958b-44ae-a71f-6d79ebb54dbf"}], "security_groups": [{"name": "tempest-securitygroup--686434201"}], "key_name": "tempest-keypair-1804782989", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:20.882349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:27.470235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:27.476741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:27.544255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ad42114-42a6-45b9-ab51-bf4f45452f19 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 200 len: 1464 microversion: 2.1 time: 10.023317 Jun 25 21:03:27.544994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1614/2944] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:17 2022] GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 1464 bytes in 10025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:27.549416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c04213a4-bd0e-4c67-82e2-2dd85328b3fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] Calling method '.version_select at 0x7f984f738e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:27.572191 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c04213a4-bd0e-4c67-82e2-2dd85328b3fe tempest-ServersTestBootFromVolume-1548263687 tempest-ServersTestBootFromVolume-1548263687-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-984844796" status: 202 len: 0 microversion: 2.1 time: 0.026072 Jun 25 21:03:27.573171 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1615/2945] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-984844796 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:27.578053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:27.578865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:27.586270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:27.586840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:27.588307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:27.588883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:27.608453 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 HTTP/1.1 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '01c803ec-b4b8-4e7f-abb4-0729fafb8747'} Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:27.610310 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:27.615128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:27.615733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] validate_networks() for [('e6c48141-958b-44ae-a71f-6d79ebb54dbf', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:03:27.616209 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c144c511-09c6-4077-a31a-bc788d838f73 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 404 len: 111 microversion: 2.1 time: 0.039896 Jun 25 21:03:27.616823 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1616/2946] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:27 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:27.635753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:27.637168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:27.646929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:27.647870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:27.648915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:27.649648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:27.912339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:27.921183 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2738439b-a2fe-4e62-af76-27dafd03e46d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1682 microversion: 2.1 time: 0.303504 Jun 25 21:03:27.921913 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1617/2947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:27 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1682 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:27.926827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def3f120-ac80-4b2f-8cad-7d7859fc5246", "name": "network-vif-unplugged", "status": "completed", "tag": "4e6556ec-82c5-4ce6-8c04-2b5bfade04b6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:27.935755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:27.936302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:27.949095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] Creating event network-vif-unplugged:4e6556ec-82c5-4ce6-8c04-2b5bfade04b6 for instance def3f120-ac80-4b2f-8cad-7d7859fc5246 on nch2-master-1 Jun 25 21:03:27.956046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:03:27.962514 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7f2f2387-4208-4c4f-8c2d-ed8a85a581f3 req-bc47d804-ce76-41d2-a502-c4e693c0dc42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039379 Jun 25 21:03:27.963391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1618/2948] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:27.969226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23af4f74-125a-44ba-ac6a-4f4732e3fac2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'create', calling method: .version_select at 0x7f984fc9e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1915571775", "description": "tempest-description-1422280800"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:28.136022 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23af4f74-125a-44ba-ac6a-4f4732e3fac2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.171517 Jun 25 21:03:28.137796 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1619/2949] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:03:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:28.139114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23af4f74-125a-44ba-ac6a-4f4732e3fac2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:28.140324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23af4f74-125a-44ba-ac6a-4f4732e3fac2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001550 Jun 25 21:03:28.141143 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1620/2950] 10.222.0.39 () {56 vars in 885 bytes} [Sat Jun 25 21:03:28 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 25 21:03:28.146898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:28.147804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:28.157238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:28.157735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:28.158836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:28.159434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:28.285846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:28.341266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:28.358454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67c26747-b9bb-46de-8686-3ba53bda1208 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1471 microversion: 2.1 time: 0.210412 Jun 25 21:03:28.359299 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1621/2951] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:28 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:28.368043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d9a3a417-7dcc-426a-9f44-1babac9d9c47 req-bf006dd3-6a50-4bd7-827c-3687840545f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c803ec-b4b8-4e7f-abb4-0729fafb8747", "name": "network-vif-deleted", "tag": "a576aa0f-a7a6-4575-821b-527e7754fe55"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:28.377779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d9a3a417-7dcc-426a-9f44-1babac9d9c47 req-bf006dd3-6a50-4bd7-827c-3687840545f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:28.378223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d9a3a417-7dcc-426a-9f44-1babac9d9c47 req-bf006dd3-6a50-4bd7-827c-3687840545f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:28.390737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_external_events [req-d9a3a417-7dcc-426a-9f44-1babac9d9c47 req-bf006dd3-6a50-4bd7-827c-3687840545f2 service nova] Unable to find a host for instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747. Dropping event network-vif-deleted {{(pid=137461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:03:28.391737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d9a3a417-7dcc-426a-9f44-1babac9d9c47 req-bf006dd3-6a50-4bd7-827c-3687840545f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031264 Jun 25 21:03:28.392804 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1622/2952] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:03:28.397538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b78e953e-7399-4271-860f-4c82094393be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984edbb9d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:28.455940 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b78e953e-7399-4271-860f-4c82094393be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 200 len: 1464 microversion: 2.1 time: 0.061927 Jun 25 21:03:28.465365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1623/2953] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:28 2022] GET /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 1464 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:28.470848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1196451851", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:28.551346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:03:28.553647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:03:28.554153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:03:28.554573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:03:28.556982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:03:28.558932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:03:28.576202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:28.576738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:28.577633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:28.578075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:28.602024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:28.605798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:28.610002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Getting quotas for user a6a15dadfd0448fab9e84a89173ed7d1 and project b3349ed72f824bcb9d1ce52d238bc870. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:28.627609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:03:28.631727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:03:28.692655 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae99cc84-9307-4ec3-8677-9e37e1889ee2 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 9.854290 Jun 25 21:03:28.693590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1331/2954] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:03:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 9856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:03:28.698633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8c267e2-bdf1-42ce-aeed-36bcbd9ff5b0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Action: 'update', calling method: .version_select at 0x7f984f601a60>, body: {"security_group": {"name": "tempest-sg-hth-1722694032", "description": "tempest-description-hth-1999189237"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:29.144475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8c267e2-bdf1-42ce-aeed-36bcbd9ff5b0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e" status: 200 len: 218 microversion: 2.1 time: 0.449561 Jun 25 21:03:29.152281 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1332/2955] 10.222.0.39 () {60 vars in 1289 bytes} [Sat Jun 25 21:03:28 2022] PUT /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e => generated 218 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:29.157748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:29.158289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:29.167152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.167595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.168711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.173641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.331267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-513a9a96-864b-452b-8082-cb8853ba846e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246/action" status: 204 len: 0 microversion: 2.1 time: 0.177654 Jun 25 21:03:29.346687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:03:29.347292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:03:29.348063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:03:29.348790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:03:29.351952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1333/2956] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:29 2022] POST /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246/action => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:03:29.354990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:29.355882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:29.357486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:03:29.377723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.378561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.380105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.380876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.388723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.391499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.392619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.394493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.454956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:29.475463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:29.493687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:03:29.496841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:03:29.619597 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df775036-97dd-4504-98b7-8ebec816b55d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152725 Jun 25 21:03:29.633669 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1624/2957] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:03:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:03:29.649000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:29.651611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:29.667107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.669030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.672517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.674507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.800347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:29.828234 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc252480-a415-4214-bada-b3b7ef685c26 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1242 microversion: 2.1 time: 0.190403 Jun 25 21:03:29.829668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1625/2958] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:29 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1242 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:29.843376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:29.845126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:29.859107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.859781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.862329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:29.863835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:29.951674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:29.961237 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b0317057-ba6c-44e6-948d-5a118d01eae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1467 microversion: 2.1 time: 0.610694 Jun 25 21:03:29.962581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1334/2959] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:29 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1467 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:29.980058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77c85cc9-32cd-48af-a863-90517db47b58 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f64b0d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:30.071191 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77c85cc9-32cd-48af-a863-90517db47b58 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e" status: 200 len: 218 microversion: 2.1 time: 0.107122 Jun 25 21:03:30.072026 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1335/2960] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:03:29 2022] GET /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e => generated 218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:30.095068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:30.099877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:30.111867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:30.115577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:30.117929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:30.118854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:30.121470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:30.126417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7fb3e63-fb29-453c-a5db-9cef735daa4b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.294594 Jun 25 21:03:30.139401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1626/2961] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:29 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:30.142154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75ac6380-8875-41eb-a214-4c27eed0f6c6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:30.147093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75ac6380-8875-41eb-a214-4c27eed0f6c6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:30.260919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-75ac6380-8875-41eb-a214-4c27eed0f6c6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:30.269557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75ac6380-8875-41eb-a214-4c27eed0f6c6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1215 microversion: 2.1 time: 0.138849 Jun 25 21:03:30.273492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1627/2962] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:30 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:30.286260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-864686028"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:30.288046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:30.318092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:30.320144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:30.321901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:30.323468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:30.822777 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbde7d18-f16e-4aee-a41d-e9b8159db95d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "POST /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9/action" status: 202 len: 0 microversion: 2.1 time: 0.547770 Jun 25 21:03:30.823457 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1628/2963] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:30 2022] POST /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:03:30.829165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-plugged", "status": "completed", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}, {"server_uuid": "def3f120-ac80-4b2f-8cad-7d7859fc5246", "name": "network-vif-plugged", "status": "completed", "tag": "4e6556ec-82c5-4ce6-8c04-2b5bfade04b6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:30.838734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:30.839182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:30.856380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Creating event network-vif-plugged:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:03:30.856919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Creating event network-vif-plugged:4e6556ec-82c5-4ce6-8c04-2b5bfade04b6 for instance def3f120-ac80-4b2f-8cad-7d7859fc5246 on nch2-master-1 Jun 25 21:03:30.862468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:03:30.872354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4abdd2ea-d295-454c-9444-c5c27a4c6a41 req-2d78d60c-08c6-4564-b1ff-5c0248537428 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047421 Jun 25 21:03:30.873221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1629/2964] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:30.878553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-292aee8b-f580-450f-946c-494f3c75f3e2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f9e6550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:30.976946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:31.008613 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc554d43-88c9-43e5-9cbf-5a87af3b6885 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1471 microversion: 2.1 time: 0.925654 Jun 25 21:03:31.009797 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1336/2965] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:30 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1471 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:31.019001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.020570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:31.033286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.034142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.051534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.052212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.145702 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-292aee8b-f580-450f-946c-494f3c75f3e2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e" status: 202 len: 0 microversion: 2.1 time: 0.271183 Jun 25 21:03:31.146798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1630/2966] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:30 2022] DELETE /compute/v2.1/os-security-groups/0507f966-4d36-4732-a4f5-8565afae0c3e => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:31.148415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-292aee8b-f580-450f-946c-494f3c75f3e2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.150226 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-292aee8b-f580-450f-946c-494f3c75f3e2 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001876 Jun 25 21:03:31.150822 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1631/2967] 10.222.0.39 () {56 vars in 885 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 25 21:03:31.155692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94dd16d5-eb05-427c-a94d-75a589b8b853 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ff27820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.208831 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94dd16d5-eb05-427c-a94d-75a589b8b853 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.056667 Jun 25 21:03:31.209633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1632/2968] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:31.214161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.215312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:31.223527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.224057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.224926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.225434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.293267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:31.302504 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf5bfc61-debc-4aac-9d5d-cf52d183594a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1304 microversion: 2.1 time: 0.091784 Jun 25 21:03:31.312710 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1633/2969] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:31.312710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.312710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:31.331519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.331871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.333116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.334242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.350706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 HTTP/1.1 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3da10d17-4377-4694-bcc0-ac85f9fa4cb6'} Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:31.353755 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.358382 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.360588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.361721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.057338 Jun 25 21:03:31.363014 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1634/2970] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.364671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.366076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c596a789-afcb-4f7c-995e-c919bedc6b10 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001859 Jun 25 21:03:31.367606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1635/2971] 10.222.0.39 () {54 vars in 1034 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jun 25 21:03:31.376636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.378780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:31.391606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.392056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.393060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.393728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.472559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:31.484720 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4478adc-250a-4da8-9d01-83808249f2a4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1285 microversion: 2.1 time: 0.115759 Jun 25 21:03:31.485631 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1636/2972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:31.490695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.491303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: 3da10d17-4377-4694-bcc0-ac85f9fa4cb6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:31.500335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.500837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.501631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:31.502105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:31.517263 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 HTTP/1.1 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3da10d17-4377-4694-bcc0-ac85f9fa4cb6'} Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.519059 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Instance 3da10d17-4377-4694-bcc0-ac85f9fa4cb6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6" status: 404 len: 111 microversion: 2.1 time: 0.033741 Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1637/2973] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/servers/3da10d17-4377-4694-bcc0-ac85f9fa4cb6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.522694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.524116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a617bf6-7403-4b74-854c-b14bb1d75702 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001216 Jun 25 21:03:31.524379 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1638/2974] 10.222.0.39 () {54 vars in 1040 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:31.534332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f9e6dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.559405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:31.560535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 582aff79-7ecc-48b4-92b5-384210c77bf0 not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:31.561252 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.561252 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0 HTTP/1.1 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '582aff79-7ecc-48b4-92b5-384210c77bf0'} Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:31.563515 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 582aff79-7ecc-48b4-92b5-384210c77bf0 does not exist Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c7b283e5-2167-4b7b-87a7-f2689d128589'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.568581 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0" status: 404 len: 194 microversion: 2.1 time: 0.038887 Jun 25 21:03:31.575458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1639/2975] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/582aff79-7ecc-48b4-92b5-384210c77bf0 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.575458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.575458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37cd030f-1d27-4af7-9df4-5443f41eb74c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001245 Jun 25 21:03:31.575458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1640/2976] 10.222.0.39 () {56 vars in 885 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jun 25 21:03:31.583000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f9861ebb8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.613412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:31.614019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:31.614545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.614545 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb HTTP/1.1 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '477ce0ac-d6ce-48ea-a3d5-48519f74b2cb'} Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:31.616460 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 477ce0ac-d6ce-48ea-a3d5-48519f74b2cb does not exist Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cd4a0fd2-e5be-4d10-aeee-104589f815f7'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.620812 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86b2cc71-27c6-4720-a54d-c95087e1d545 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb" status: 404 len: 194 microversion: 2.1 time: 0.044385 Jun 25 21:03:31.624753 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1641/2977] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/477ce0ac-d6ce-48ea-a3d5-48519f74b2cb => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.627317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f9e6dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.667815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:31.668446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:31.669314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.669314 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b HTTP/1.1 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5e5acfb7-3597-4057-81e4-9f61c85c4e1b'} Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:31.671064 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 5e5acfb7-3597-4057-81e4-9f61c85c4e1b does not exist Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cf0f5d37-f78c-411a-9bfe-38035eed0a36'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.674617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c5f70a3-107d-4eb1-aa0d-79505323d35d tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b" status: 404 len: 194 microversion: 2.1 time: 0.049085 Jun 25 21:03:31.677883 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1642/2978] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/5e5acfb7-3597-4057-81e4-9f61c85c4e1b => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.701531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f59cf70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.817193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:31.818803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:31.819428 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.819428 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca HTTP/1.1 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '4ee41957-e9db-491f-bf4b-cc8b8a8c67ca'} Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:31.822445 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 4ee41957-e9db-491f-bf4b-cc8b8a8c67ca does not exist Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-cdbc603a-627f-4266-a9ea-fb3f203d628b'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.827819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08078d7f-4d7b-4fc9-92cd-c54ca02712c1 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca" status: 404 len: 194 microversion: 2.1 time: 0.138405 Jun 25 21:03:31.832152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1643/2979] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/4ee41957-e9db-491f-bf4b-cc8b8a8c67ca => generated 194 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.842638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f9861f1b940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:31.850931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:31.859554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7706bb81-a1b3-4c4e-a73d-7cbe1563f225 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.848519 Jun 25 21:03:31.860149 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1337/2980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:31 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:31.916504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:31.917309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group ababe856-75fe-4332-a781-f196895d3d4f not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:31.917844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.917844 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f HTTP/1.1 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ababe856-75fe-4332-a781-f196895d3d4f'} Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:31.919685 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] Jun 25 21:03:31.924168 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:03:31.928730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group ababe856-75fe-4332-a781-f196895d3d4f does not exist Jun 25 21:03:31.928730 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-63a6c850-8913-41f3-81fe-75303d6a9589'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:31.930520 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d70c5b6-1096-4d11-9379-a9235e02716a tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f" status: 404 len: 194 microversion: 2.1 time: 0.095186 Jun 25 21:03:31.931747 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1644/2981] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/ababe856-75fe-4332-a781-f196895d3d4f => generated 194 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:31.940334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f65fa60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.027870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.028622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:32.050136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.050723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.051678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.052179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.077574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:03:32.078709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Neutron security group 721f2499-8744-4993-8c4d-5825dbe02977 not found {{(pid=137462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:03:32.079394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.079394 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 HTTP/1.1 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '721f2499-8744-4993-8c4d-5825dbe02977'} Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:03:32.081733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] Jun 25 21:03:32.086019 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:32.091125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Security group 721f2499-8744-4993-8c4d-5825dbe02977 does not exist Jun 25 21:03:32.091125 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-414657f6-f86b-4488-ae7f-ab7a4f98c20d'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:32.092482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b20a1d0-c907-419d-887b-9e0d0bdcfb18 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977" status: 404 len: 194 microversion: 2.1 time: 0.156179 Jun 25 21:03:32.093364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1338/2982] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:31 2022] DELETE /compute/v2.1/os-security-groups/721f2499-8744-4993-8c4d-5825dbe02977 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:32.104193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.113244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:32.142245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.142801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.143666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.144170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.195659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:03:32.357093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a02db5b-6248-44bd-8534-cafa0df75aa0 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 204 len: 0 microversion: 2.1 time: 0.256576 Jun 25 21:03:32.363925 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1339/2983] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:03:32 2022] DELETE /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:03:32.372146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a09a604-53bd-4974-8cac-9197ea5d7d06 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f613820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.397923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:32.408325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c2ba4dd7-f71b-4113-8f46-40219314e584 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1463 microversion: 2.1 time: 0.384650 Jun 25 21:03:32.412122 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1645/2984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1463 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:32.421986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.424533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:32.439555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.440005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.440815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.441251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.471465 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a09a604-53bd-4974-8cac-9197ea5d7d06 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.107651 Jun 25 21:03:32.472805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1340/2985] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:32.481016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.481971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:32.503167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.503843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.504719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.506635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.614339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:32.630686 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c5ca400-7b61-4849-bda3-5d708eab3eb4 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1304 microversion: 2.1 time: 0.209573 Jun 25 21:03:32.632036 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1646/2986] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1304 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:32.644411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:32.645060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:32.663238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.664037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.665112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:32.665762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:32.967918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:32.981808 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-46f444c8-8162-4f8a-9cde-1a4a8f8b729c tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1646 microversion: 2.1 time: 0.503829 Jun 25 21:03:32.991848 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1341/2987] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1646 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:33.008892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:33.009534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:33.016364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.016868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.017661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.018099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.135636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:33.145319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2126d266-7441-44d7-b63f-62fd2fdc23b7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1463 microversion: 2.1 time: 0.510573 Jun 25 21:03:33.147620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1647/2988] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:33.163960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-unplugged", "status": "completed", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}, {"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:33.180660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.183073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.222248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] Creating event network-vif-unplugged:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:03:33.223613 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] Creating event network-vif-unplugged:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:03:33.236335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b133e020-1962-4648-b50c-ec42a1c7b038 req-91592dae-fefd-436f-a1c5-a132a70a8caa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.085233 Jun 25 21:03:33.237452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1648/2989] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:33.243768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e2c08d3-7f13-4cd7-9b18-548915e830d3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'create', calling method: .version_select at 0x7f984f62f670>, body: {"keypair": {"name": "tempest-keypair-1812992911", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvRLgFUo4gw6a96vvDCIe7KsXCpNkX4g/LJmkktdEgw+Eq75CbSvNGMcZaGFP+p/K9mnFYwUVjCS/mbKpwwBf/0u2HsZS3nQ+Vdq3Hvpr1f85KTsPtkF5sGWEVuMbioXw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:33.262556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1e2c08d3-7f13-4cd7-9b18-548915e830d3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:33.269885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1e2c08d3-7f13-4cd7-9b18-548915e830d3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:33.306176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e2c08d3-7f13-4cd7-9b18-548915e830d3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.067249 Jun 25 21:03:33.307008 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1649/2990] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:03:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:33.499956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-866fb705-f2ce-42b9-863c-6f883af844ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984fd198b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:33.554243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:33.600294 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c6d3d45c-8a2b-4855-9d67-84ff6996423d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.605148 Jun 25 21:03:33.602846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1342/2991] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:32 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:33.604685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-866fb705-f2ce-42b9-863c-6f883af844ec tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.122591 Jun 25 21:03:33.613868 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1650/2992] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:33 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:33.658833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:33.659563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:33.690515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.694380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.695470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.697556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.737157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:33.739161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:33.758123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.763841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:33.764865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:33.770887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:34.354314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:34.369718 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35fdd1c7-527a-4dfc-8136-a40690b63066 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.716866 Jun 25 21:03:34.381194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1343/2993] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:33 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:34.386636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:34.387251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:34.408478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:34.409331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:34.412108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:34.412735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:34.648148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:34.657873 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-20e8d9e3-9e3a-4f31-ae1a-df339fd48d60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.925452 Jun 25 21:03:34.659428 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1651/2994] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:33 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:34.705174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:34.706306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:34.713629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:34.715918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:34.717531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:34.718482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.083790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:35.092020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:35.095590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad634ae0-1c7c-43be-b920-9c6edb47b6cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.434725 Jun 25 21:03:35.097037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1652/2995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:34 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:35.104049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75022ffd-119e-493f-8636-519ae5f71b21 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f620c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:35.167801 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75022ffd-119e-493f-8636-519ae5f71b21 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.069165 Jun 25 21:03:35.169520 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1653/2996] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:35 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:35.177151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:35.178208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:35.187336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.190060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.191181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.192977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.523450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:35.545046 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee20b55b-2d48-4949-93e1-a584dfd72f09 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.370056 Jun 25 21:03:35.546213 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1654/2997] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:35 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:35.556304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:35.566630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:35.567337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:35.575835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.576289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.577890 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c62b617-e5f9-43ec-a610-ba03e0bb4ff4 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1646 microversion: 2.1 time: 1.194132 Jun 25 21:03:35.581474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.582229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.582731 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1344/2998] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:34 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1646 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:35.592653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:35.595149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:35.606084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.608530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:35.615544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:35.616447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.101275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:36.156216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-730735e1-ad67-4526-8063-e58f3b5670d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.598168 Jun 25 21:03:36.163459 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1655/2999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:35 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:36.203124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e46edd25-4f31-4436-a5da-aed208395a2c req-beab8bef-0479-4f41-a0e9-59977ad186c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1c5eb40-ad52-46be-ab5c-9e1ada217b56", "tag": "5415fdc0-f3ed-4eea-9edd-564b84af7331"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:36.234345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e46edd25-4f31-4436-a5da-aed208395a2c req-beab8bef-0479-4f41-a0e9-59977ad186c4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.234825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e46edd25-4f31-4436-a5da-aed208395a2c req-beab8bef-0479-4f41-a0e9-59977ad186c4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.268154 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e46edd25-4f31-4436-a5da-aed208395a2c req-beab8bef-0479-4f41-a0e9-59977ad186c4 service nova] Creating event network-changed:5415fdc0-f3ed-4eea-9edd-564b84af7331 for instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 on nch2-master-1 Jun 25 21:03:36.275259 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e46edd25-4f31-4436-a5da-aed208395a2c req-beab8bef-0479-4f41-a0e9-59977ad186c4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105808 Jun 25 21:03:36.276352 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1656/3000] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:36.299383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:36.301587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:36.329230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:36.332352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.333045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.334333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.335316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.347525 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-74c028d3-1565-4ed8-b478-938e73337614 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.763412 Jun 25 21:03:36.358539 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1345/3001] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:35 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:36.372278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ce0bf4cb-3e29-4bad-809f-59267aeec79a req-53676b4f-847f-4a86-be74-ce7365d86c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b7f128-174d-4e0d-b5d1-7c575e73ef4a", "name": "network-vif-deleted", "tag": "5324ff71-996c-4e38-ae82-0a8264ef5901"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:36.412047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ce0bf4cb-3e29-4bad-809f-59267aeec79a req-53676b4f-847f-4a86-be74-ce7365d86c68 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.413672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ce0bf4cb-3e29-4bad-809f-59267aeec79a req-53676b4f-847f-4a86-be74-ce7365d86c68 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.459000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ce0bf4cb-3e29-4bad-809f-59267aeec79a req-53676b4f-847f-4a86-be74-ce7365d86c68 service nova] Creating event network-vif-deleted:5324ff71-996c-4e38-ae82-0a8264ef5901 for instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a on nch1-master-1 Jun 25 21:03:36.464152 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ce0bf4cb-3e29-4bad-809f-59267aeec79a req-53676b4f-847f-4a86-be74-ce7365d86c68 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104041 Jun 25 21:03:36.465246 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1346/3002] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:36.518861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12e0059f-dc0e-4d52-be6e-c334a82fb673 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f65a5e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:36.609171 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12e0059f-dc0e-4d52-be6e-c334a82fb673 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.104291 Jun 25 21:03:36.610901 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1347/3003] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:36 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:36.620996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:36.622693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:36.631657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.632599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.633651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.634303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.786035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:36.797300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5d350da9-0be5-4291-9e6a-4a3c9d292eef tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.517605 Jun 25 21:03:36.798889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1657/3004] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:36 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:36.826778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:36.827551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:36.840188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.840656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.841443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.841940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.899396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.899854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.900327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lazy-loading 'fault' on Instance uuid c7b7f128-174d-4e0d-b5d1-7c575e73ef4a {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:03:36.906893 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5b92f79-f97e-4601-9d9c-46998242ad14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.294500 Jun 25 21:03:36.908035 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1348/3005] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:36 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:36.916409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:36.922158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:36.928848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.929310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.930100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:36.930544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:36.969857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1253f8908e434038b07f5e2ed7d15d30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663694278b344fe7896f524fac12ffcc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:36.982885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-484103cb-0263-4464-97eb-13758cfdeb87 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 200 len: 1306 microversion: 2.1 time: 0.176650 Jun 25 21:03:36.992148 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1658/3006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:36 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:37.182790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:37.187650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:37.199831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:37.200489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:37.201680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:37.202287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:37.345730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:37.359245 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68d49269-e23c-4080-bb67-9e79e2ce1ba8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.447224 Jun 25 21:03:37.363519 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1349/3007] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:36 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:37.455238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:37.470239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32aefe3f-760e-434c-abbc-92d3bb878f9a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.290272 Jun 25 21:03:37.482000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1659/3008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:37.623081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbab29fc-ae58-4b10-ac15-2e4e066d38bc tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861ed35e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:37.671810 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbab29fc-ae58-4b10-ac15-2e4e066d38bc tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.052577 Jun 25 21:03:37.677258 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1350/3009] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:37.815218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:37.819194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:37.828860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:37.829317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:37.830220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:37.830526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:37.861608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-490a1022-7242-4c54-8c60-e9e1503d1d07 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '.version_select at 0x7f984f65af70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:37.864888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-490a1022-7242-4c54-8c60-e9e1503d1d07 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:37.866104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-490a1022-7242-4c54-8c60-e9e1503d1d07 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:37.868324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:37.892217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-490a1022-7242-4c54-8c60-e9e1503d1d07 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.035436 Jun 25 21:03:37.912449 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1351/3010] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:37.920101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2fcf83d9-7230-46b7-a83d-f1b12d159e68 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:37.937071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2fcf83d9-7230-46b7-a83d-f1b12d159e68 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021686 Jun 25 21:03:37.945261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1352/3011] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:03:37.957092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61a8aea5-cb3b-478e-a724-e906866f781d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-484007914", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:37.958987 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:03:37.958987 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:03:37.985646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61a8aea5-cb3b-478e-a724-e906866f781d tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.032823 Jun 25 21:03:37.992264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1353/3012] 10.222.0.39 () {60 vars in 1145 bytes} [Sat Jun 25 21:03:37 2022] POST /compute/v2.1/flavors => generated 498 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:38.002549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3314c3b-81b7-49af-998d-8399f4dc97a0 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:38.038258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e3314c3b-81b7-49af-998d-8399f4dc97a0 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045317 Jun 25 21:03:38.048618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1354/3013] 10.222.0.39 () {58 vars in 1181 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:03:38.075291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:38.076480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] [instance: c7b7f128-174d-4e0d-b5d1-7c575e73ef4a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:38.091526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.093156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.095293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.096211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.099536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:38.108824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1acb2ceb-e22d-4166-8620-d4a62c3405ab tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.297634 Jun 25 21:03:38.111935 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1660/3014] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:37 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:38.131385 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] HTTP exception thrown: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Request method failure captured: Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a HTTP/1.1 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fLPqhsEIk7BXZMJfXDJLW2dNohorDQuhQ3CRsG4TVpwTovyzs1lmZ4VQshMbNld-JW0BZjHPuqQVT-EqnyHu1jMjoqS40qUJDPO448fJV3W6DXvt4v050zewmQLLdHpc8OoP4X16nnn9ui_hoGP69HJbLVJZMuSxhRM5O-6k-LLx8 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/663694278b344fe7896f524fac12ffcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_663694278b344fe7896f524fac12ffcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/663694278b344fe7896f524fac12ffcc"}]}] Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 663694278b344fe7896f524fac12ffcc Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-2029902659 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1253f8908e434038b07f5e2ed7d15d30 Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupsTestJSON-2029902659-project Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c7b7f128-174d-4e0d-b5d1-7c575e73ef4a'} Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:03:38.133646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Returning 404 to user: Instance c7b7f128-174d-4e0d-b5d1-7c575e73ef4a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-763faad4-2d4f-4fb4-a913-42effc3088fb tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a" status: 404 len: 111 microversion: 2.1 time: 0.070050 Jun 25 21:03:38.137460 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1355/3015] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:38 2022] GET /compute/v2.1/servers/c7b7f128-174d-4e0d-b5d1-7c575e73ef4a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:03:38.147969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-279ae099-12b2-416a-b4e9-0cf523ab3df8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f9861ea7040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:38.165788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-92b96e50-afac-4fb1-afdd-992b355686a5 req-e2094ae6-f56d-458f-ae7d-1c599b4caf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72e2c9-4a63-4c9f-be80-3f461b1c7da9", "name": "network-vif-plugged", "status": "completed", "tag": "ac8eb736-810d-4469-9657-015ffde22a44"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:38.183505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-92b96e50-afac-4fb1-afdd-992b355686a5 req-e2094ae6-f56d-458f-ae7d-1c599b4caf19 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.185290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-92b96e50-afac-4fb1-afdd-992b355686a5 req-e2094ae6-f56d-458f-ae7d-1c599b4caf19 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.212118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-92b96e50-afac-4fb1-afdd-992b355686a5 req-e2094ae6-f56d-458f-ae7d-1c599b4caf19 service nova] Creating event network-vif-plugged:ac8eb736-810d-4469-9657-015ffde22a44 for instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 on nch2-master-1 Jun 25 21:03:38.234075 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-92b96e50-afac-4fb1-afdd-992b355686a5 req-e2094ae6-f56d-458f-ae7d-1c599b4caf19 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072551 Jun 25 21:03:38.235586 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1356/3016] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:38.242149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-629176233", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "7ed90451-3018-4c10-80e5-7c1f636fd8d3"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:38.324628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:03:38.593556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:38.620494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-279ae099-12b2-416a-b4e9-0cf523ab3df8 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/37ed41cb-ba14-4438-8f8a-b6aba8b16cfa" status: 202 len: 0 microversion: 2.1 time: 0.480081 Jun 25 21:03:38.624212 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1661/3017] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:38 2022] DELETE /compute/v2.1/os-security-groups/37ed41cb-ba14-4438-8f8a-b6aba8b16cfa => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:38.626762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:38.629914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:38.631171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:38.638636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.639735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.641396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.642900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.666755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:03:38.667305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:03:38.667952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:03:38.668671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:03:38.669819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:03:38.692345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.693046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.693869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.694304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.728907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:38.735160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:38.748674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:03:38.751226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:03:38.800346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d521be8e-e374-4180-8cee-a646a8cc68b2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563430 Jun 25 21:03:38.801046 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1357/3018] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:03:38.812463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:38.822041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:38.830271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.831137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.832127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.832751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.900171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:38.909895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6e7a5d0-9102-4223-9ceb-7146a656a6c2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.287124 Jun 25 21:03:38.914243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1662/3019] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:38 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:38.930244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5d6cfdf8-4b95-4e9a-8e9e-936c9d81726c req-38726aeb-09b5-4531-9037-391ef251f2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:38.943742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5d6cfdf8-4b95-4e9a-8e9e-936c9d81726c req-38726aeb-09b5-4531-9037-391ef251f2ff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:38.944400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5d6cfdf8-4b95-4e9a-8e9e-936c9d81726c req-38726aeb-09b5-4531-9037-391ef251f2ff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:38.963064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5d6cfdf8-4b95-4e9a-8e9e-936c9d81726c req-38726aeb-09b5-4531-9037-391ef251f2ff service nova] Creating event network-changed:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:03:38.987289 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5d6cfdf8-4b95-4e9a-8e9e-936c9d81726c req-38726aeb-09b5-4531-9037-391ef251f2ff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061303 Jun 25 21:03:38.992172 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1663/3020] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:39.004256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b34dec22-9a6e-4f87-91bd-b5628c453597 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] Calling method '.version_select at 0x7f984f620c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:39.057593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:39.071378 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d39e8fad-0a1a-43a3-be43-09241903f58d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.269045 Jun 25 21:03:39.084095 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1358/3021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:38 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:39.090342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-afac5c70-7ac0-48f1-884f-8993619b9dc3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f601ca0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:39.158504 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-afac5c70-7ac0-48f1-884f-8993619b9dc3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.073164 Jun 25 21:03:39.160004 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1359/3022] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:39 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:39.174660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-763b9cd1-93b5-408f-9cff-ed78095f756c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:39.175858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-763b9cd1-93b5-408f-9cff-ed78095f756c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:39.293782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-763b9cd1-93b5-408f-9cff-ed78095f756c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:39.308454 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-763b9cd1-93b5-408f-9cff-ed78095f756c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1278 microversion: 2.1 time: 0.143943 Jun 25 21:03:39.317234 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1360/3023] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:39 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:39.325941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:39.329787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:39.337236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:39.338006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:39.338965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:39.339556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:39.385270 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b34dec22-9a6e-4f87-91bd-b5628c453597 tempest-SecurityGroupsTestJSON-2029902659 tempest-SecurityGroupsTestJSON-2029902659-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/439b87bf-e0a0-4d62-aa29-c416bc049805" status: 202 len: 0 microversion: 2.1 time: 0.385087 Jun 25 21:03:39.386608 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1664/3024] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:03:38 2022] DELETE /compute/v2.1/os-security-groups/439b87bf-e0a0-4d62-aa29-c416bc049805 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:39.630722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:39.651724 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bbfb9257-4de8-4204-89d7-0eb40d9c4d32 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.333090 Jun 25 21:03:39.659918 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1361/3025] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:39 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:39.933390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:39.934854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:39.938075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:39.945343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:39.946030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:39.947003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:39.947650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.094267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:40.095454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:40.109373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.111428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.112558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.113514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.151854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:40.162301 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52a595a9-8645-4613-8722-f9cb070a6c60 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.234825 Jun 25 21:03:40.165155 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1665/3026] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:39 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:40.175345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-423ca756-1d0d-45b4-8519-4bc00f6b31da tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ed78160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:40.246598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-423ca756-1d0d-45b4-8519-4bc00f6b31da tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.076668 Jun 25 21:03:40.248005 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1666/3027] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:40 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:40.326177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:40.327481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:40.336478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.337247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.338430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.338927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.418883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:40.433504 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de0fa210-f324-42a2-9c44-6e8ed1b903e9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1336 microversion: 2.1 time: 0.111163 Jun 25 21:03:40.435069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1667/3028] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:40 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:40.652136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:40.662972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e32654d5-8b10-4d31-9550-a31bd8788d6a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.575692 Jun 25 21:03:40.664157 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1362/3029] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:40 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:40.679233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:40.681302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:40.687827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:40.694839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.695574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:40.702114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:40.702838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.006511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:41.040033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f8ee424-eae3-4483-a164-07d9e36a3093 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.369054 Jun 25 21:03:41.049461 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1668/3030] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:40 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:41.183044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:41.183926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:41.194548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.195325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.197080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.197818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.264688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de910990-b4f7-4dc7-83a1-d6f1811048ac tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebc8b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:41.318993 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de910990-b4f7-4dc7-83a1-d6f1811048ac tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.062550 Jun 25 21:03:41.320831 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1669/3031] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:41 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:41.451498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:41.452210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:41.465040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.465502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.466296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.466739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.644587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:41.656709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17141719-8384-44bd-8560-8fa3bed3f4f5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1336 microversion: 2.1 time: 0.207085 Jun 25 21:03:41.657857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1670/3032] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:41 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1336 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:41.683378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:41.685287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:41.698337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.698820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.699632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:41.700083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:41.761974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:41.771005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f504d4de-7512-42cd-aafd-dd3ce69df94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.592294 Jun 25 21:03:41.771590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1363/3033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:41 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:42.031244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:42.040021 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da322a12-8fdb-4565-8e04-5b7685bfda57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.361899 Jun 25 21:03:42.055331 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1671/3034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:41 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:42.057190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:42.057809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:42.067744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:42.068111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:42.068917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:42.069368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:42.337112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f75e3ccc-f092-45f7-b181-5da0e1b28ae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ed78310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:42.419778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f75e3ccc-f092-45f7-b181-5da0e1b28ae4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.089325 Jun 25 21:03:42.421785 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1672/3035] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:42 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:42.676053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:42.676996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:42.695322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:42.697239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:42.702454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:42.702951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:43.062547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:43.077450 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b1e41df-6bcf-419f-b6c9-11fd61aeeec4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 1.023890 Jun 25 21:03:43.085548 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1364/3036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:42 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:43.097939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:43.100493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:43.122045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:43.125566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:43.126938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:43.127999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:43.282139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:43.721982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:43.734083 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9aab7ec7-f5d1-4491-836b-7633020291a7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.644171 Jun 25 21:03:43.736494 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1365/3037] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:43 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:43.749118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:43.749743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:43.767751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:43.769051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:43.771773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:43.772664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:44.011985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:44.025673 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d60aadff-7212-43a6-94cf-c5865fbe68eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 1.354186 Jun 25 21:03:44.038697 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1673/3038] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:42 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:44.058713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85fbbe78-9921-4393-af16-5eab86c8051d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f599820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:44.168407 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85fbbe78-9921-4393-af16-5eab86c8051d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.126808 Jun 25 21:03:44.169050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1674/3039] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:44 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:44.190123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:44.190792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:44.219410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:44.226098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:44.227047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:44.227509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:44.886481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:44.902928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0fb2419-dc72-481f-896b-22422dcace42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.726170 Jun 25 21:03:44.904096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1675/3040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:44 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:44.921823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:44.923678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:44.946812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:44.949558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:44.967321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:44.969439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:45.249589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:45.263005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a80759c-8863-4e1e-9d4e-8e1cae995e4b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 1.524115 Jun 25 21:03:45.270019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1366/3041] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:43 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:45.288027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:45.293183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:45.317328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:45.320082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:45.324760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:45.325706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:45.578215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:45.592930 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed2bf862-0a96-4539-b682-334038f0bd0a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.683891 Jun 25 21:03:45.593637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1676/3042] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:44 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:45.609685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76e71918-d4c3-4c77-a121-cad0f0e38082 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f5cc550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:45.707827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76e71918-d4c3-4c77-a121-cad0f0e38082 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.109762 Jun 25 21:03:45.711361 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1677/3043] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:45 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:45.920400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:45.921380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:45.930673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:45.937216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:45.941217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:45.942633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:45.972868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:46.503493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:46.521089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-222d5a2b-4a00-4e5b-bbf3-d13bda6182cc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.604771 Jun 25 21:03:46.522166 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1678/3044] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:45 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:46.539277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c8aa6bb1-9422-4b0c-bda3-e035395a4d82 req-707072b7-1fde-4c8d-9794-78c8db367143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c5eb40-ad52-46be-ab5c-9e1ada217b56", "name": "network-vif-plugged", "status": "completed", "tag": "5415fdc0-f3ed-4eea-9edd-564b84af7331"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:46.548692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c8aa6bb1-9422-4b0c-bda3-e035395a4d82 req-707072b7-1fde-4c8d-9794-78c8db367143 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:46.549407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c8aa6bb1-9422-4b0c-bda3-e035395a4d82 req-707072b7-1fde-4c8d-9794-78c8db367143 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:46.565248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c8aa6bb1-9422-4b0c-bda3-e035395a4d82 req-707072b7-1fde-4c8d-9794-78c8db367143 service nova] Creating event network-vif-plugged:5415fdc0-f3ed-4eea-9edd-564b84af7331 for instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 on nch2-master-1 Jun 25 21:03:46.573561 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c8aa6bb1-9422-4b0c-bda3-e035395a4d82 req-707072b7-1fde-4c8d-9794-78c8db367143 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038228 Jun 25 21:03:46.574953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1679/3045] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:46.588644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:46.590047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:46.597481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:46.598181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:46.599133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:46.599789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:47.166143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:47.180468 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6e7ba2b-c82a-427a-899a-11bb06c926eb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 1.906735 Jun 25 21:03:47.187664 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1367/3046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:45 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:47.216940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:47.217980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:47.244118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:47.245049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:47.249593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:47.251847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:47.525944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:47.539121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-997a29b0-af04-430b-b170-93d069b515b3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.960977 Jun 25 21:03:47.539747 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1680/3047] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:46 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:47.554089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bec7467b-e2b0-429a-9ff7-62af2b00e783 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ff27700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:47.629424 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bec7467b-e2b0-429a-9ff7-62af2b00e783 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.086719 Jun 25 21:03:47.630460 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1681/3048] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:47 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:47.640707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:47.641570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:47.660695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:47.663944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:47.666347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:47.668156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.048693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:48.068354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2eea9621-3c1a-4e90-93fa-54ef774dfe4a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 0.432816 Jun 25 21:03:48.070015 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1682/3049] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:47 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:48.103970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:48.125811 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-999028f3-f294-491b-961e-2fbd8702d5de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.933756 Jun 25 21:03:48.142485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1368/3050] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:47 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:48.197785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:48.198418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:48.214101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:48.214570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.224453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:48.224975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.279146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f4fe367c-53d3-47ff-906c-21cf53867ebc req-6e914a57-77f7-4e14-b15a-fcff7370e107 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:48.305365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f4fe367c-53d3-47ff-906c-21cf53867ebc req-6e914a57-77f7-4e14-b15a-fcff7370e107 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:48.305816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f4fe367c-53d3-47ff-906c-21cf53867ebc req-6e914a57-77f7-4e14-b15a-fcff7370e107 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.345271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f4fe367c-53d3-47ff-906c-21cf53867ebc req-6e914a57-77f7-4e14-b15a-fcff7370e107 service nova] Creating event network-changed:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:03:48.361912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f4fe367c-53d3-47ff-906c-21cf53867ebc req-6e914a57-77f7-4e14-b15a-fcff7370e107 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091907 Jun 25 21:03:48.362546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1369/3051] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:48.558474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:48.559621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:48.574753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:48.578218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.581956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:48.586447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:48.716305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:48.779158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:48.792717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bdafc5e-ab74-4ea2-90ca-4bb200950a1f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.598552 Jun 25 21:03:48.793810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1683/3052] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:48 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:48.809339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a13627e1-ca43-43ae-8447-2c93a72b3c13 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f9e6550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:48.891718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a13627e1-ca43-43ae-8447-2c93a72b3c13 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.094387 Jun 25 21:03:48.892535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1684/3053] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:48 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:49.086191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:49.087212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:49.098822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:49.101053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:49.108696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:49.109689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:49.299455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:49.429600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:49.445966 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04cb2a3d-ae4a-41d7-bda8-14a8b9de61fc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.890411 Jun 25 21:03:49.463929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1370/3054] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:48 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:49.497459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:49.499847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:49.516322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:49.516987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:49.518274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:49.520552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:50.149247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:50.186643 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25b3d96e-bc66-4944-8abc-6de5ecd79991 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1315 microversion: 2.1 time: 1.101749 Jun 25 21:03:50.206975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1685/3055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:49 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1315 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:50.223077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:50.225075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:50.235478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:50.236209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:50.237262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:50.237923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:50.536600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:50.591361 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3d7feed3-733f-49af-9032-0fbc15b3b91d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 1.125124 Jun 25 21:03:50.617793 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1371/3056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:49 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:50.639214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f5db4875-915d-477f-a697-bcb07be2efd4 req-67414942-7dbe-408e-ba5f-2282fc06cf6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "name": "network-vif-plugged", "status": "completed", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:50.711389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f5db4875-915d-477f-a697-bcb07be2efd4 req-67414942-7dbe-408e-ba5f-2282fc06cf6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:50.712278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f5db4875-915d-477f-a697-bcb07be2efd4 req-67414942-7dbe-408e-ba5f-2282fc06cf6c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:50.738920 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f5db4875-915d-477f-a697-bcb07be2efd4 req-67414942-7dbe-408e-ba5f-2282fc06cf6c service nova] Creating event network-vif-plugged:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:03:50.747777 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f5db4875-915d-477f-a697-bcb07be2efd4 req-67414942-7dbe-408e-ba5f-2282fc06cf6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126812 Jun 25 21:03:50.751485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1372/3057] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:50.771675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8828d6c7-6d26-41f0-85d4-cca048ad2d83 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f6965e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:50.858937 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8828d6c7-6d26-41f0-85d4-cca048ad2d83 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.102198 Jun 25 21:03:50.860873 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1373/3058] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:50 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:50.876868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:50.878585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:50.907419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:50.914322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:50.937188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7586a167-ef3c-41cf-ad94-9864c6f5cc16 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.725663 Jun 25 21:03:50.937795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:50.939156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:50.942646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1686/3059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:50 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:50.943679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:50.953639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:51.208161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:51.209523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:51.223524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:51.227671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:51.229007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:51.231169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:51.658709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:51.667886 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b510e915-d7d7-49d7-83fc-8aee3d9979fa tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.805684 Jun 25 21:03:51.673260 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1374/3060] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:50 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:51.699056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:51.706404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:51.731560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:51.732162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:51.733985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:51.734537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.362110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:52.381540 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-01780aa5-941b-428a-8054-57570fb2c831 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.696903 Jun 25 21:03:52.383431 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1375/3061] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:51 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:52.390409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb151b51-8c86-41bd-96ba-868b5d17fa2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696e50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:52.510617 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb151b51-8c86-41bd-96ba-868b5d17fa2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.124976 Jun 25 21:03:52.511377 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1376/3062] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:52 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:52.516530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:52.529216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:52.557483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:52.562540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:52.563244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.566580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:52.567050 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30cf887e-5710-4f00-a246-521dfaf509d3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1502 microversion: 2.1 time: 1.365204 Jun 25 21:03:52.567202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.583664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1687/3063] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:51 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1502 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:52.590473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:52.596875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:52.613497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:52.614085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.615367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:52.616051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.753419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8559ebc-d40b-414e-9839-96946e2896c7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 200 len: 324 microversion: 2.1 time: 0.167278 Jun 25 21:03:52.755985 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1688/3064] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:52 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 324 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:52.768812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22090602-2bc8-437d-a488-bd9abd9a009e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:52.791662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22090602-2bc8-437d-a488-bd9abd9a009e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:52.794675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22090602-2bc8-437d-a488-bd9abd9a009e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:52.913996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22090602-2bc8-437d-a488-bd9abd9a009e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:03:53.025293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22090602-2bc8-437d-a488-bd9abd9a009e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56/action" status: 202 len: 0 microversion: 2.1 time: 0.267307 Jun 25 21:03:53.026246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1689/3065] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:03:52 2022] POST /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:03:53.036855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:53.041826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:53.083946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.084756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.095538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.096606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.489622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:53.501619 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a039fbf-98be-4478-ac3c-e9a04af643b9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1371 microversion: 2.1 time: 0.473167 Jun 25 21:03:53.503561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1690/3066] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:53 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1371 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:53.521709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:53.522476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:53.546542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.547305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.548154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.550795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.802514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:53.832622 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29cbf1b9-2f8d-4a35-b03a-288f4433269c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 1.319186 Jun 25 21:03:53.833631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1377/3067] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:52 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:53.840573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:53.841441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:53.855525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.861573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.865465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:53.865917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:53.894478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:53.907162 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2304be5e-1c80-436a-81a2-b8fbc67313cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.399905 Jun 25 21:03:53.922651 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1691/3068] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:53 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:53.936575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07340fe9-610c-4de2-a378-613115576389 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ed788b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:54.026651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07340fe9-610c-4de2-a378-613115576389 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.102295 Jun 25 21:03:54.029576 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1692/3069] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:53 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:54.312621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:54.314906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:54.326034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-944c0dd9-fe01-48f5-87e5-d96aab27ae8a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.491019 Jun 25 21:03:54.336107 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1378/3070] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:53 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:54.336107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:54.336107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:54.359300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.359761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:54.360604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.361042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:54.642792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1d514f65-ae9b-4cbf-954f-db6a0aab8c11 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Action: 'create', calling method: .version_select at 0x7f984ebdc040>, body: {"keypair": {"name": "tempest-keypair-1817383597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDfRnWNUxOq4xd/20RgcDjm2i23RUSYNu+mGYwTuk7FSEZXk/krYI0ogz6L0PVn/bav0yl+Ekcz/gykxkZpwaKPoXULwPo0l69JtlSB89zjiaasism6wq/YaM9Zt6MKAxQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:54.664987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1d514f65-ae9b-4cbf-954f-db6a0aab8c11 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Getting quotas for project 109c4d190ac748b68b97b317d63a909a. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:03:54.675380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1d514f65-ae9b-4cbf-954f-db6a0aab8c11 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Getting quotas for user f46fff9b561e4959975edfffe24e1397 and project 109c4d190ac748b68b97b317d63a909a. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:03:54.733358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1d514f65-ae9b-4cbf-954f-db6a0aab8c11 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.701771 Jun 25 21:03:54.734011 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1693/3071] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:03:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:54.741843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:54.743754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:54.762692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.763167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:54.763962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.764760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:54.890429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:54.899342 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43b456e3-a296-4a12-8dd5-70ca2d984ef0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.570009 Jun 25 21:03:54.912491 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1379/3072] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:54 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:54.921385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:54.924307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:54.948627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.950543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:54.952353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:54.953628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.329565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:55.344182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-00f40ea0-847d-4125-b84f-341aadd032a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1566 microversion: 2.1 time: 0.608983 Jun 25 21:03:55.345703 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1694/3073] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:54 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1566 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:55.352164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:55.354854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:55.374485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.375280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.376287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.378343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.477803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:55.507426 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51ecfa9f-7488-4f20-ac7e-071e4d602114 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.602378 Jun 25 21:03:55.512571 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1380/3074] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:54 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:55.517986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-644c90c2-a798-4e44-be26-855b7bf44110 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f675820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:55.619418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-644c90c2-a798-4e44-be26-855b7bf44110 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.105265 Jun 25 21:03:55.621627 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1381/3075] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:55 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:55.633023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:55.633669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:55.659764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.660650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.662928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.663699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.705884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:55.723524 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d135f661-2cda-4efd-bfb5-ad426d9b9d3f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.376220 Jun 25 21:03:55.724134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1695/3076] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:55 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:55.731724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:55.733016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:55.745794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.746417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.747851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.748467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.909428 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3998c080-9e35-4fad-8b86-256c7ee3167f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181646 Jun 25 21:03:55.913591 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1696/3077] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:03:55 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:55.922645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:55.924352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:55.935453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.938278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:55.940609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:55.942731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:56.015887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:56.039643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3900d62-2648-4c8d-bdd8-581837ca8326 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.415280 Jun 25 21:03:56.039643 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1382/3078] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:55 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:56.526582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:56.527527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:56.587698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:56.588383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:56.590354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:56.601890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:56.881542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:56.901043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5045c35b-c330-44a7-9128-4b46441db32f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.984379 Jun 25 21:03:56.912460 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1697/3079] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:55 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:56.921241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2644b911-ebd3-434b-af4d-85fe72c7525d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb88f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:57.023700 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2644b911-ebd3-434b-af4d-85fe72c7525d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.117555 Jun 25 21:03:57.043119 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1698/3080] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:56 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:57.066863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:57.070114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:57.103124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:57.107286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:57.108387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:57.109649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:57.163352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:57.200318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13043a9c-903b-4802-8aed-4ff732771148 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.678060 Jun 25 21:03:57.203116 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1383/3081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:56 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:57.223765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1514257400", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:57.349554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] validate_networks() for [('4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:03:57.843763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:57.857314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-599f49f7-f3b6-4013-bd27-f33d3ac48c18 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.802409 Jun 25 21:03:57.858894 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1699/3082] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:57 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:58.045965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09efaf51-9b09-49b3-ade8-ca9e4b32a070 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ed78c10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:58.196937 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09efaf51-9b09-49b3-ade8-ca9e4b32a070 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.158522 Jun 25 21:03:58.198090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1700/3083] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:58 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:03:58.221422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:58.222382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:58.259814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:58.267889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:58.268778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:58.274467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:58.327571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:03:58.538232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:58.551473 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fe151ee-c5d5-4ec7-aa2b-0a87533c5e3a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.335396 Jun 25 21:03:58.554393 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1701/3084] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:58 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:58.567711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-30d79d56-85db-427b-b28b-8c28ca9ec3b1 req-b0e0df6e-6b04-4623-b862-f40f0154a2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:58.591345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-30d79d56-85db-427b-b28b-8c28ca9ec3b1 req-b0e0df6e-6b04-4623-b862-f40f0154a2e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:58.592313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-30d79d56-85db-427b-b28b-8c28ca9ec3b1 req-b0e0df6e-6b04-4623-b862-f40f0154a2e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:58.611609 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-30d79d56-85db-427b-b28b-8c28ca9ec3b1 req-b0e0df6e-6b04-4623-b862-f40f0154a2e9 service nova] Creating event network-changed:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:03:58.620340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-30d79d56-85db-427b-b28b-8c28ca9ec3b1 req-b0e0df6e-6b04-4623-b862-f40f0154a2e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064068 Jun 25 21:03:58.621414 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1702/3085] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:58.880643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:58.881860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:58.895369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:58.899713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:58.903569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:58.904410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:59.429170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:03:59.453464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc75b28f-712f-4f33-ada0-8d4ce8f8c0db tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.577967 Jun 25 21:03:59.454465 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1703/3086] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:58 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:59.470607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2cc6aa51-6fb1-43aa-a4a4-0c267ef5b0a4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f9e6dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:59.598367 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2cc6aa51-6fb1-43aa-a4a4-0c267ef5b0a4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.142422 Jun 25 21:03:59.600409 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1704/3087] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:03:59 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:03:59.614780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-bf43ba9c-4a66-430d-8285-77fb893605f2 req-33a4f9ea-dfc1-424b-852a-541ac4cf0326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-plugged", "status": "completed", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:03:59.651726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf43ba9c-4a66-430d-8285-77fb893605f2 req-33a4f9ea-dfc1-424b-852a-541ac4cf0326 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:59.657193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf43ba9c-4a66-430d-8285-77fb893605f2 req-33a4f9ea-dfc1-424b-852a-541ac4cf0326 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:59.701779 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-bf43ba9c-4a66-430d-8285-77fb893605f2 req-33a4f9ea-dfc1-424b-852a-541ac4cf0326 service nova] Creating event network-vif-plugged:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:03:59.715911 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-bf43ba9c-4a66-430d-8285-77fb893605f2 req-33a4f9ea-dfc1-424b-852a-541ac4cf0326 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112923 Jun 25 21:03:59.718211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1705/3088] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:03:59.738395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:03:59.739873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:03:59.769876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:59.770914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:03:59.776541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:03:59.777705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:00.384476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:00.386524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:00.387186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:00.388060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:00.388698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:00.414090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:00.415661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:00.416890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:00.418054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:00.438065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:00.450759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dd15045d-e59b-4645-84fa-0c82ec84f8e0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.729575 Jun 25 21:04:00.461029 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1706/3089] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:03:59 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:00.470433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:00.471740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:00.472376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:00.479473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:00.487523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:00.487973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:00.488797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:00.489232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:00.497422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:00.505093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:00.616803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb339145-25e1-4f2a-9088-22a0f0af051e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.411463 Jun 25 21:04:00.617472 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1384/3090] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:03:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:04:00.627187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13d921bc-7328-471c-aa47-09d6cffb6f6f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:00.740234 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13d921bc-7328-471c-aa47-09d6cffb6f6f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.121469 Jun 25 21:04:00.741163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1385/3091] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:00 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:00.751704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-423410f8-c2f3-4305-a258-331cf4e3309f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:00.759779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-423410f8-c2f3-4305-a258-331cf4e3309f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:00.876619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:00.887429 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42f2a0a8-9491-4496-9991-b25aa823460a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.419940 Jun 25 21:04:00.897672 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1707/3092] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:00 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:01.041506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-423410f8-c2f3-4305-a258-331cf4e3309f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:01.053076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-423410f8-c2f3-4305-a258-331cf4e3309f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1215 microversion: 2.1 time: 0.310611 Jun 25 21:04:01.053670 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1386/3093] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:00 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1215 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:01.470720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:01.471781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:01.492583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:01.493046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:01.501936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:01.502874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:01.684896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "39aa8a96-8285-40ef-97e3-f3d0764c0481"}], "security_groups": [{"name": "tempest-securitygroup--1708452807"}], "key_name": "tempest-keypair-1817383597", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:01.918762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] validate_networks() for [('39aa8a96-8285-40ef-97e3-f3d0764c0481', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:04:02.234654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:02.249392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-509f4b3b-311b-424d-bbd0-417f92502b96 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1378 microversion: 2.1 time: 0.784349 Jun 25 21:04:02.252308 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1708/3094] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:01 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1378 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:02.265006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30a0db5a-c23d-4669-9b79-da456138d9db tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebc8a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:02.391204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30a0db5a-c23d-4669-9b79-da456138d9db tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.137654 Jun 25 21:04:02.392435 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1709/3095] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:02 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:02.406350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:02.410112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:02.435184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:02.435653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:02.441283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:02.444370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:02.924701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:02.939019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ba209ad-4e17-4f06-a2f2-3cd2deb039c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.545325 Jun 25 21:04:02.950930 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1710/3096] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:02 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:02.950930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:02.950930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:02.982177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:02.983198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:02.984772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:02.985664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.191996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:03.212758 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce83f819-d338-43db-b7a6-45f7ce29569b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1273 microversion: 2.1 time: 0.261283 Jun 25 21:04:03.213868 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1711/3097] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:02 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:03.269157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:03.269941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:03.285118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.287876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.291259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.292987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.457771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:03.457771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:03.458522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:03.459164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:03.459668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:03.491910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.494574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.498274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.500045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.558241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Getting quotas for project 109c4d190ac748b68b97b317d63a909a. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:03.572322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Getting quotas for user f46fff9b561e4959975edfffe24e1397 and project 109c4d190ac748b68b97b317d63a909a. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:03.599108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:03.604181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:03.697768 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f35e8b80-bd8a-43b0-9de5-b38b1db19422 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.015089 Jun 25 21:04:03.704869 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1387/3098] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:04:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:04:03.719929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3225d6b-cff9-46df-8622-465e7e762166 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9862012790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:03.796070 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3225d6b-cff9-46df-8622-465e7e762166 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.087578 Jun 25 21:04:03.797402 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1388/3099] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:03 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:03.803928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-118632d1-3e0d-495b-a15a-28c24d4dca55 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:03.804805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-118632d1-3e0d-495b-a15a-28c24d4dca55 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:03.901603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:03.910951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30fb0c78-dd4a-47ac-bb9e-bc95e71a5f56 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1528 microversion: 2.1 time: 0.646009 Jun 25 21:04:03.918910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1712/3100] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:03 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1528 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:03.939057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:03.940459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:03.963759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.964216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.965398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:03.966003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:03.992513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-118632d1-3e0d-495b-a15a-28c24d4dca55 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:04.021084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-118632d1-3e0d-495b-a15a-28c24d4dca55 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1226 microversion: 2.1 time: 0.222334 Jun 25 21:04:04.026827 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1389/3101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:03 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1226 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:04.040885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:04.044823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:04.067012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:04.074462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:04.078644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:04.082106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:04.432264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:04.460030 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e2e0d06-221b-404a-b757-dbbbcd1bec20 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1528 microversion: 2.1 time: 0.528430 Jun 25 21:04:04.474771 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1713/3102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:03 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1528 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:04.488145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:04.489605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:04.519214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:04.522237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:04.523087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:04.523530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:04.650523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:04.670382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9441834-7b2d-435b-8d22-a4efe2fdfa46 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.638475 Jun 25 21:04:04.674966 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1390/3103] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:04 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:04.686727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d77ece3-2c1b-4fbe-b939-dca069181dbd tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:04.689198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:04.707419 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:04:04.707419 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:04:04.721249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:04.755231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c02a69d0-2dd3-4607-b2d1-50c2d1c1a28c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1273 microversion: 2.1 time: 0.287794 Jun 25 21:04:04.755866 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1714/3104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:04 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1273 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:04.810544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51bd5bf9-fb73-41e4-8334-ae8d03c2de6e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb96310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:04.818874 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d77ece3-2c1b-4fbe-b939-dca069181dbd tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/7ed90451-3018-4c10-80e5-7c1f636fd8d3" status: 202 len: 0 microversion: 2.1 time: 0.141190 Jun 25 21:04:04.820864 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1391/3105] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:04 2022] DELETE /compute/v2.1/flavors/7ed90451-3018-4c10-80e5-7c1f636fd8d3 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:04:04.843197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d76676e1-7bf3-4016-868d-e619de0bf97f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:04.902256 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51bd5bf9-fb73-41e4-8334-ae8d03c2de6e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.095942 Jun 25 21:04:04.903154 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1715/3106] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:04 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:04.962504 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d76676e1-7bf3-4016-868d-e619de0bf97f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.133805 Jun 25 21:04:04.963030 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1392/3107] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:04:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:04.980206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:04.981505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:05.003225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.003974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.007761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.010210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.043717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:05.044725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:05.052034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.057119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.058144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.074484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.113418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:05.147703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Old instance type tempest-test_resize_flavor_-484007914, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:04:05.164774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:05.168000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:05.169885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:05.170596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:05.173006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:05.269052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:05.284957 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f76edcd-a458-4d23-b8f9-1ed7b010eb6e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1222 microversion: 2.1 time: 0.244375 Jun 25 21:04:05.287219 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1393/3108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:05 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:05.373346 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69b8ade1-58a7-47b3-9526-8dcef35837f0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e/action" status: 202 len: 0 microversion: 2.1 time: 0.398942 Jun 25 21:04:05.373965 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1716/3109] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:04 2022] POST /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:04:05.388459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:05.390840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:05.408605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.408605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.409957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.411415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.702995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:05.703557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:05.718458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.718907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:05.719700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:05.720133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:06.411741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:06.426692 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba8644b1-a498-43cb-980a-ed6625c1a54a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1537 microversion: 2.1 time: 1.044418 Jun 25 21:04:06.436181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1394/3110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:05 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1537 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:06.441322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:06.441957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:06.457199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:06.457664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:06.458469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:06.459086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:07.076835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:07.104005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d23778b-4a3c-44d6-b536-b95f73c31c57 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.668431 Jun 25 21:04:07.106103 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1395/3111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:06 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:07.124832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f526304e-82d4-4cf1-9005-503aed37c464 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f7781f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:07.255118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f526304e-82d4-4cf1-9005-503aed37c464 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.147829 Jun 25 21:04:07.255721 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1396/3112] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:07 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:07.268337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:07.269188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:07.285741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:07.292552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:07.293688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:07.294292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:07.332655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:07.341044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a016678-4832-4072-9bce-beb3011fab9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 1.647415 Jun 25 21:04:07.356582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1717/3113] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:05 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:07.444184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:07.445045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:07.463191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:07.463961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:07.465318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:07.465917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:07.513826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:07.523252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7696522b-0ecf-4917-8c6c-b421d265c382 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1284 microversion: 2.1 time: 0.266222 Jun 25 21:04:07.527949 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1397/3114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:07 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:07.733033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:07.750314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b34539b9-056e-4115-8742-8f8f05b8241f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1537 microversion: 2.1 time: 0.310721 Jun 25 21:04:07.751657 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1718/3115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:07 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1537 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:08.125593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:08.127472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:08.164840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.165311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.169137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.169137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.268529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac50bf7b-4d0e-47e9-8c39-aa93c39e155b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f599550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:08.332299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ac50bf7b-4d0e-47e9-8c39-aa93c39e155b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1454 microversion: 2.1 time: 0.067503 Jun 25 21:04:08.333527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1719/3116] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:08 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1454 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:08.358207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:08.358951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:08.369303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.369754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.370656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.370957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.685810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:08.715569 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa21bcf3-e69e-4275-af25-744c907fef22 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.360772 Jun 25 21:04:08.727725 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1720/3117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:08 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:08.734259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:08.741519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:08.748627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.749803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.751148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.752007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.867693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:08.883454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80da878d-f6af-4315-a4a1-73b534108b5b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1284 microversion: 2.1 time: 0.153268 Jun 25 21:04:08.885150 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1721/3118] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:08 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:08.901935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:08.902936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:08.910766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.911588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.912632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:08.913220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:08.918225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:08.992014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:09.003508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dfe3921c-6442-453b-a7d3-b33a4ffdbed9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.884544 Jun 25 21:04:09.004122 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1398/3119] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:08 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:09.021247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-67834ee3-4c6e-47bd-ad22-321e833fd94c req-039eaf8d-e8b4-4489-b951-e7421b25211b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11695f4e-7b8a-49a5-8a8d-91845bd2495d", "tag": "56ed3ccf-28f5-45f5-a62e-f65c63bf03ab"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:09.058887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-67834ee3-4c6e-47bd-ad22-321e833fd94c req-039eaf8d-e8b4-4489-b951-e7421b25211b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.059379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-67834ee3-4c6e-47bd-ad22-321e833fd94c req-039eaf8d-e8b4-4489-b951-e7421b25211b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.097232 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-67834ee3-4c6e-47bd-ad22-321e833fd94c req-039eaf8d-e8b4-4489-b951-e7421b25211b service nova] Creating event network-changed:56ed3ccf-28f5-45f5-a62e-f65c63bf03ab for instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d on nch1-master-1 Jun 25 21:04:09.114625 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-67834ee3-4c6e-47bd-ad22-321e833fd94c req-039eaf8d-e8b4-4489-b951-e7421b25211b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109031 Jun 25 21:04:09.115934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1399/3120] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:09.348247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06381dfc-ad8a-4f3d-a5c4-50504b8269c6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696e50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:09.429931 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-06381dfc-ad8a-4f3d-a5c4-50504b8269c6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1463 microversion: 2.1 time: 0.086819 Jun 25 21:04:09.431409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1400/3121] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:09 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1463 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:09.444596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ac99ee5-5419-4fa7-b0e7-66630902e274 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:09.483217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:09.492764 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-518fbe5a-64b6-45ae-bf25-086541067d8b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1537 microversion: 2.1 time: 0.606199 Jun 25 21:04:09.500120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1722/3122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:08 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1537 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:09.522682 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ac99ee5-5419-4fa7-b0e7-66630902e274 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 200 len: 1463 microversion: 2.1 time: 0.082637 Jun 25 21:04:09.523901 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1401/3123] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:09 2022] GET /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 1463 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:09.537253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:09.540063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:09.556162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.558962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.565121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.566230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.734603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:09.735517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:09.748097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.748908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.749729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.752345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.869889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:09.881343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ad98dd2-4e48-43b9-aa56-c6270d7e3b7c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1468 microversion: 2.1 time: 0.349336 Jun 25 21:04:09.883613 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1723/3124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:09 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1468 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:09.906890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:09.908301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:09.916063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:09.933139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.934460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:09.937193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:09.939861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.231331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:10.240020 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-05f571b1-9948-47f2-aae9-0e5b03a217b1 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.510096 Jun 25 21:04:10.250344 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1402/3125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:09 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:10.255802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1857580844"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:10.261802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:10.270922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.271310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:10.271933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.273000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.273656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.289208 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d0e1d72-bc12-4e46-9741-12995148bbe8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.390818 Jun 25 21:04:10.290717 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1724/3126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:09 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:10.307745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:10.310320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:10.326041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.326905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.328077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.328627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.624702 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1391b9ef-c536-40fa-b968-752458cb73a6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "POST /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc/action" status: 202 len: 0 microversion: 2.1 time: 0.372535 Jun 25 21:04:10.632616 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1403/3127] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:10 2022] POST /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:04:10.640523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:10.641622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:10.652782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.653589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.655841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:10.656547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:10.710212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:10.722995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4cd5e796-940f-444a-8388-2ce281a9c1a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.428896 Jun 25 21:04:10.734665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1725/3128] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:10 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:10.741007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f88d74b-d5d3-4d56-bbe5-fc312c59cc2a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb88940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:10.796461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f88d74b-d5d3-4d56-bbe5-fc312c59cc2a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.060190 Jun 25 21:04:10.797082 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1726/3129] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:10 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:11.258862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:11.259496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:11.271064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.271431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.275155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.275627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.423823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:11.435119 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88bb46ac-286a-4673-aef9-83f7d4a543d1 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1537 microversion: 2.1 time: 0.800193 Jun 25 21:04:11.435614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1404/3130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:10 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1537 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:11.445888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:11.446980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:11.455800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.456464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.457485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.458159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.530261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:11.543305 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-851274ad-f685-45cd-8ea4-e3a00b51bc45 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.289557 Jun 25 21:04:11.553051 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1727/3131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:11 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:11.709857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:11.724977 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f2ffd45-33f1-49ef-b88d-1a8eee5b4b22 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.286907 Jun 25 21:04:11.725894 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1405/3132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:11 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:11.741372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:11.741995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:11.749230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.749688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.753640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:11.765199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:11.770188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:11.934708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4333a643-e06f-476a-bcfe-89c1de72051d tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Action: 'create', calling method: .version_select at 0x7f984ebebaf0>, body: {"keypair": {"name": "tempest-keypair-1057412166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArcYclMzrA4mPcTYzZ9f5sJjs2UjB3MZCemkznLt4D4YAaHep6GwZXtvhyXXeu/xgnUuzznOYn6YjLYVFwd/PeZwyMUBuBzFnwTmD3EUoFjhinkH8VOgrc2gWMwsN+aZA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:11.971676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4333a643-e06f-476a-bcfe-89c1de72051d tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for project 9a930bf73f9845e6b079820ec7b14906. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:11.987939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4333a643-e06f-476a-bcfe-89c1de72051d tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for user fcef2a65be9443dda5cbe7c3d77d6295 and project 9a930bf73f9845e6b079820ec7b14906. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:12.029733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4333a643-e06f-476a-bcfe-89c1de72051d tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.484123 Jun 25 21:04:12.040334 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1728/3133] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:04:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:12.046075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfcc87f1-6d3c-4f2d-9a10-8df354703ea0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebdc790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:12.077435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:12.089296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-669f6573-3c78-4783-b914-cc3befea335f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.351803 Jun 25 21:04:12.090599 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1406/3134] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:11 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:12.129699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dfcc87f1-6d3c-4f2d-9a10-8df354703ea0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.088024 Jun 25 21:04:12.133397 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1729/3135] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:12 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:12.260856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f9bfa4fc-818a-4bbf-92fe-55abececf594 req-24cedc12-69a4-4ce2-997b-fde7902c7fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a", "tag": "57876bb0-6089-4268-b6e1-d27d339e3c67"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:12.276895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f9bfa4fc-818a-4bbf-92fe-55abececf594 req-24cedc12-69a4-4ce2-997b-fde7902c7fed service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.277704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f9bfa4fc-818a-4bbf-92fe-55abececf594 req-24cedc12-69a4-4ce2-997b-fde7902c7fed service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.292149 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f9bfa4fc-818a-4bbf-92fe-55abececf594 req-24cedc12-69a4-4ce2-997b-fde7902c7fed service nova] Creating event network-changed:57876bb0-6089-4268-b6e1-d27d339e3c67 for instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a on nch2-master-1 Jun 25 21:04:12.298146 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f9bfa4fc-818a-4bbf-92fe-55abececf594 req-24cedc12-69a4-4ce2-997b-fde7902c7fed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041098 Jun 25 21:04:12.299299 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1407/3136] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:12.459655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:12.461845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:12.473978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.481704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.482770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.483290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.562711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:12.563437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:12.586537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.586951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.587733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.588182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.839035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:12.867307 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db793b80-14ec-497e-94b5-2e3cb0a07e57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1537 microversion: 2.1 time: 0.401606 Jun 25 21:04:12.872243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1730/3137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:12 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1537 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:12.887004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:12.891230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:12.913896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.916554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:12.919574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:12.920701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:13.305525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:13.316570 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8795e364-8055-404e-af9c-f22d8fa976e3 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.759410 Jun 25 21:04:13.317735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1408/3138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:12 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:13.328521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:13.336052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:13.346255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:13.346814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:13.347499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:13.348530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:13.349176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:13.367424 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9c2193bf-4c6d-401c-80e1-71e31627fc6a tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.484429 Jun 25 21:04:13.368062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1731/3139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:12 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:13.382817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7309063b-bef3-4270-87dc-4d3cec96958a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984fd34ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:13.485303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7309063b-bef3-4270-87dc-4d3cec96958a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.110652 Jun 25 21:04:13.494719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1732/3140] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:13 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:13.542291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:13.667323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:13.687640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b418a890-d6ab-4a9e-8d70-e64be8b6ed47 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.368769 Jun 25 21:04:13.688250 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1409/3141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:13 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:13.814853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-184c3304-e1c9-4c5e-b3c8-44576eded925 req-01fd76a0-1225-4a0c-b5d8-5cad717121a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72e2c9-4a63-4c9f-be80-3f461b1c7da9", "name": "network-vif-unplugged", "status": "completed", "tag": "ac8eb736-810d-4469-9657-015ffde22a44"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:13.840194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-184c3304-e1c9-4c5e-b3c8-44576eded925 req-01fd76a0-1225-4a0c-b5d8-5cad717121a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:13.840812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-184c3304-e1c9-4c5e-b3c8-44576eded925 req-01fd76a0-1225-4a0c-b5d8-5cad717121a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:13.852582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-184c3304-e1c9-4c5e-b3c8-44576eded925 req-01fd76a0-1225-4a0c-b5d8-5cad717121a0 service nova] Creating event network-vif-unplugged:ac8eb736-810d-4469-9657-015ffde22a44 for instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 on nch2-master-1 Jun 25 21:04:13.859990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-184c3304-e1c9-4c5e-b3c8-44576eded925 req-01fd76a0-1225-4a0c-b5d8-5cad717121a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049062 Jun 25 21:04:13.861364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1733/3142] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:13.892634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:13.893357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:13.904659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:13.905342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:13.906325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:13.906962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.021107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=16 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:14.065286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:14.073925 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82c2a4d1-62dd-41ab-a576-ef76d8d157a6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.186927 Jun 25 21:04:14.075102 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1410/3143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:13 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:14.336568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:14.337661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:14.345972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.347136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.348563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.349154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.385490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:14.386661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:14.405193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.405838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.406814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.407257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.646470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:14.657958 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-676f1cf5-f14a-4f9a-b715-777241180460 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.327730 Jun 25 21:04:14.659471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1734/3144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:14 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:14.665532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e87ecd84-78ab-4b09-8e1a-d81e6a82f21e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb47790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:14.720798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:14.728085 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e87ecd84-78ab-4b09-8e1a-d81e6a82f21e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.067110 Jun 25 21:04:14.728724 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1735/3145] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:14 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:14.734186 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e816d8cb-9225-4a71-8045-93c0d4a2cf89 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.349963 Jun 25 21:04:14.734186 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1411/3146] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:14 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:14.741158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:14.742217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:14.749564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.750114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.751108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:14.751212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-236664225", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "122acf8e-6d73-43ee-a2f5-64bc1989c2c1"}], "security_groups": [{"name": "tempest-securitygroup--295643580"}], "key_name": "tempest-keypair-1057412166", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:14.751958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:14.762172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:14.930484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] validate_networks() for [('122acf8e-6d73-43ee-a2f5-64bc1989c2c1', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:04:14.935804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:14.946760 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf1697ff-2817-4825-a721-78e6e5364c27 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.210015 Jun 25 21:04:14.947813 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1736/3147] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:14 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:15.092769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:15.093463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:15.101135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.114751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.116633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.117338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.411075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:15.425536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-223c31df-8005-43a1-9c25-47910ab6255c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.337557 Jun 25 21:04:15.436063 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1737/3148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:15 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:15.525139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for project 9a930bf73f9845e6b079820ec7b14906. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:15.531293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for user fcef2a65be9443dda5cbe7c3d77d6295 and project 9a930bf73f9845e6b079820ec7b14906. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:15.555423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:15.555864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:15.556401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:15.556887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:15.557313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:15.569817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.570586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.571559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.571978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.592936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for project 9a930bf73f9845e6b079820ec7b14906. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:15.598356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Getting quotas for user fcef2a65be9443dda5cbe7c3d77d6295 and project 9a930bf73f9845e6b079820ec7b14906. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:15.611699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:15.614157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:15.675526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75540f7f-da65-4ea1-bd8d-84d27d1b1da1 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.942714 Jun 25 21:04:15.676002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:15.681315 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1412/3149] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:04:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:04:15.682345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:15.687643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8f10807-450c-42f9-b43f-9229986e75b0 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:15.688273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8f10807-450c-42f9-b43f-9229986e75b0 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:15.691778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.692510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.693562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.694204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.801045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8f10807-450c-42f9-b43f-9229986e75b0 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:15.813622 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8f10807-450c-42f9-b43f-9229986e75b0 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1277 microversion: 2.1 time: 0.130851 Jun 25 21:04:15.814577 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1413/3150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:15 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:15.819257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82e8731f-303d-4cad-b0b1-37bf5300efb2 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696b80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:15.893024 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82e8731f-303d-4cad-b0b1-37bf5300efb2 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.077190 Jun 25 21:04:15.894372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1414/3151] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:15 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:15.905024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:15.906243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:15.930133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.930732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:15.931713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:15.932165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.053469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:16.072372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10bc3ba1-e452-468c-a340-62d06b058289 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.399152 Jun 25 21:04:16.093144 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1738/3152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:15 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:16.099609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:16.100505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:16.111529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.112315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.113577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.114170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.272898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:16.287629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ea8aa1c1-5bd0-4ca9-bff7-f478d3735ad0 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.391947 Jun 25 21:04:16.299440 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1415/3153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:15 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:16.444271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:16.445167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:16.460702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.464556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.466210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.466880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.511461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:16.523274 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e84e24cc-482d-4a80-8cb4-e5a297888851 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.426559 Jun 25 21:04:16.533569 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1739/3154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:16 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:16.565545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6509498e-6035-4193-98ff-e1c78bb41d81 req-c1e004ab-f38c-461b-b283-7cae7a42e7e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-plugged", "status": "completed", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:16.586855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6509498e-6035-4193-98ff-e1c78bb41d81 req-c1e004ab-f38c-461b-b283-7cae7a42e7e3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.590173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6509498e-6035-4193-98ff-e1c78bb41d81 req-c1e004ab-f38c-461b-b283-7cae7a42e7e3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.626533 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6509498e-6035-4193-98ff-e1c78bb41d81 req-c1e004ab-f38c-461b-b283-7cae7a42e7e3 service nova] Creating event network-vif-plugged:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:04:16.636122 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6509498e-6035-4193-98ff-e1c78bb41d81 req-c1e004ab-f38c-461b-b283-7cae7a42e7e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074953 Jun 25 21:04:16.637357 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1740/3155] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:16.836152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:16.837031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:16.860529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.860929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.861740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:16.862169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:16.958469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:16.977372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cf50de6-a98a-400d-b412-d3624dfafd6e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.537882 Jun 25 21:04:16.977989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1416/3156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:16 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:16.997951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc8d8e3c-5d6a-46bf-8653-29d8fed84563 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f6ff160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:17.086718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:17.102165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5049c85-3807-4dda-8b51-9159d88421f3 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1273 microversion: 2.1 time: 0.273681 Jun 25 21:04:17.103120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1741/3157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:16 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:17.116545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:17.117458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:17.125149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.125976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.126992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.127760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.214046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc8d8e3c-5d6a-46bf-8653-29d8fed84563 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.224588 Jun 25 21:04:17.215585 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1417/3158] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:16 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:17.317739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:17.318557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:17.340860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.341780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.348848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.349471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.457048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:17.468920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-054578e6-b2cd-4444-9763-44a00bf3c06f tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.363703 Jun 25 21:04:17.470149 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1742/3159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:17 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:17.542627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:17.544066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:17.566316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.567576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.571804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:17.573513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:17.655352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:17.667280 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a954bda-7511-4de1-b46a-3c545f0135e5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.360582 Jun 25 21:04:17.668513 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1418/3160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:17 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:17.866506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:17.875782 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c56c251-ef8d-491a-a968-e67539d58b84 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 0.338318 Jun 25 21:04:17.880479 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1743/3161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:17 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:17.995416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:17.996114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:18.005057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.005438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.008647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.009387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.120009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:18.120780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:18.130853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.131934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.133165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.135909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.265225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:18.273670 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a2b7f59-e396-46b6-bda2-e6a5712c1718 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1335 microversion: 2.1 time: 0.158317 Jun 25 21:04:18.277982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1744/3162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:18 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1335 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:18.298249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e30d700e-4d12-4073-820f-3ea4542e5d2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f59cf70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:18.334928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:18.353806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-395eb67e-b201-46e6-9caf-a19a0a97bc5a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.361762 Jun 25 21:04:18.357138 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1419/3163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:17 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:18.422458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e30d700e-4d12-4073-820f-3ea4542e5d2f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.141539 Jun 25 21:04:18.428733 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1745/3164] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:18 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:18.492231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:18.493986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:18.515433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.533414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.534325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.536876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.688275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:18.690048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:18.703608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.705357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.708370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.708899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.720838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:18.845602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:18.862134 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82eb6d35-a175-453b-a8ec-16800aacbf8c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.378825 Jun 25 21:04:18.863122 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1420/3165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:18 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:18.875831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-69e7a6a9-d136-4b91-bf67-9151b4738ca3 req-63bb506e-ca8b-457d-b3f2-77883da75af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11695f4e-7b8a-49a5-8a8d-91845bd2495d", "name": "network-vif-plugged", "status": "completed", "tag": "56ed3ccf-28f5-45f5-a62e-f65c63bf03ab"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:18.895640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-69e7a6a9-d136-4b91-bf67-9151b4738ca3 req-63bb506e-ca8b-457d-b3f2-77883da75af4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.896092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-69e7a6a9-d136-4b91-bf67-9151b4738ca3 req-63bb506e-ca8b-457d-b3f2-77883da75af4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.944747 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-69e7a6a9-d136-4b91-bf67-9151b4738ca3 req-63bb506e-ca8b-457d-b3f2-77883da75af4 service nova] Creating event network-vif-plugged:56ed3ccf-28f5-45f5-a62e-f65c63bf03ab for instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d on nch1-master-1 Jun 25 21:04:18.954675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-69e7a6a9-d136-4b91-bf67-9151b4738ca3 req-63bb506e-ca8b-457d-b3f2-77883da75af4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089937 Jun 25 21:04:18.955698 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1421/3166] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:18.977327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:18.978649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:18.988041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.988810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:18.989963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:18.990618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:19.020078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:19.038116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-942b67f3-787a-4040-94af-f6be160be3e6 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.355377 Jun 25 21:04:19.041125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1746/3167] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:18 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:19.300810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:19.301428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:19.313743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:19.318064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:19.319143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:19.322807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:19.632228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:19.645287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3844ae7f-7137-418f-a78c-2afa9c80f383 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.349827 Jun 25 21:04:19.646356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1747/3168] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:19 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:19.651644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:19.652859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:19.660502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:19.661312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:19.662351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:19.663070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:19.895715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:19.904146 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-782317bc-e07c-405d-bbf7-b100457aee0c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.256495 Jun 25 21:04:19.906485 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1748/3169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:19 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:19.925119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84324c44-7418-4244-bf87-34916267f787 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f985c6239d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:19.969111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:19.979651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84324c44-7418-4244-bf87-34916267f787 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.071333 Jun 25 21:04:19.980621 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d7edaaa7-bb79-4c1a-90ed-4b2249d4c2eb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1315 microversion: 2.1 time: 1.010708 Jun 25 21:04:19.980742 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1749/3170] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:19 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:19.982846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1422/3171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:18 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1315 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:19.995558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:19.996404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:20.005091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.005582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.006625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.007215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.064818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:20.066443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:20.120766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.120766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.125576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.126280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.232496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:20.242557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b1430363-54a2-4c42-85c5-5dbac9864c9a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.259243 Jun 25 21:04:20.243734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1750/3172] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:19 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:20.549988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:20.567255 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-37a6a8ac-bf09-43c9-bd46-3c6a0798c931 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.511617 Jun 25 21:04:20.568914 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1423/3173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:20 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:20.665012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:20.665641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:20.676406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.676902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.677694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.678134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.923611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5b0f0288-5ec0-455a-ad25-ab48e771ed21 req-cf257e24-241f-4a3d-8081-c01517f35410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045b0e1a-24df-4171-8698-7292fcb8e00c", "tag": "2d470ff3-e6a1-40a4-9d92-681025b6c9c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:20.957344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5b0f0288-5ec0-455a-ad25-ab48e771ed21 req-cf257e24-241f-4a3d-8081-c01517f35410 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:20.961517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:20.967036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5b0f0288-5ec0-455a-ad25-ab48e771ed21 req-cf257e24-241f-4a3d-8081-c01517f35410 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:20.983320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad6d157a-50bc-4e90-a918-2e27e2c52963 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.322241 Jun 25 21:04:20.989422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1751/3174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:20 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:21.005983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.007515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:21.012303 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5b0f0288-5ec0-455a-ad25-ab48e771ed21 req-cf257e24-241f-4a3d-8081-c01517f35410 service nova] Creating event network-changed:2d470ff3-e6a1-40a4-9d92-681025b6c9c2 for instance 045b0e1a-24df-4171-8698-7292fcb8e00c on nch1-master-1 Jun 25 21:04:21.019224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5b0f0288-5ec0-455a-ad25-ab48e771ed21 req-cf257e24-241f-4a3d-8081-c01517f35410 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103281 Jun 25 21:04:21.020691 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1424/3175] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:04:21.027544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-173541ca-831d-4fe7-8ea8-005f534ea0c0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696e50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.027938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.028809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.032190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.032877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.105872 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-173541ca-831d-4fe7-8ea8-005f534ea0c0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.083476 Jun 25 21:04:21.108990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1425/3176] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:21.124756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.126041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:21.137059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.137925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.139813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.140494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.330985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:21.343040 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c4012ce-9a80-45f2-be7a-4d1bd8454825 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.350318 Jun 25 21:04:21.346577 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1752/3177] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:20 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:21.357438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.360073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:21.374729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.377595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.379229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.380845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.491095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:21.500206 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef4f227b-c547-4f98-9220-6cfb7bfd8412 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1502 microversion: 2.1 time: 0.389422 Jun 25 21:04:21.507636 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1426/3178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:21.535312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5ef2489-b6a4-43c8-9045-014d0e78b004 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:21.544395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5ef2489-b6a4-43c8-9045-014d0e78b004 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.551545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5ef2489-b6a4-43c8-9045-014d0e78b004 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.591500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5ef2489-b6a4-43c8-9045-014d0e78b004 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Going to try to stop instance {{(pid=137462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:04:21.688276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:21.698151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ac957c5-ff26-4dcd-8b87-5b59fd75bd70 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.350156 Jun 25 21:04:21.699543 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1753/3179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:21.704890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.705783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:21.712745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.713616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.715388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.718885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.735286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5ef2489-b6a4-43c8-9045-014d0e78b004 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d/action" status: 202 len: 0 microversion: 2.1 time: 0.206505 Jun 25 21:04:21.743856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1427/3180] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:21 2022] POST /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:04:21.754489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c0289a4a-9391-4a83-9dbf-c838f7798922 req-a00a338c-02aa-41b4-bc14-8d9b5c1ff9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a", "name": "network-vif-plugged", "status": "completed", "tag": "57876bb0-6089-4268-b6e1-d27d339e3c67"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:21.795954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c0289a4a-9391-4a83-9dbf-c838f7798922 req-a00a338c-02aa-41b4-bc14-8d9b5c1ff9a7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.796638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c0289a4a-9391-4a83-9dbf-c838f7798922 req-a00a338c-02aa-41b4-bc14-8d9b5c1ff9a7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.814037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c0289a4a-9391-4a83-9dbf-c838f7798922 req-a00a338c-02aa-41b4-bc14-8d9b5c1ff9a7 service nova] Creating event network-vif-plugged:57876bb0-6089-4268-b6e1-d27d339e3c67 for instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a on nch2-master-1 Jun 25 21:04:21.821743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c0289a4a-9391-4a83-9dbf-c838f7798922 req-a00a338c-02aa-41b4-bc14-8d9b5c1ff9a7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076470 Jun 25 21:04:21.823817 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1428/3181] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:21.830490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:21.844327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:21.860695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.862280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.866178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:21.867168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:21.895750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:21.954691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:21.971610 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e71d8f9-7144-463b-b177-13713a6d925f tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.270679 Jun 25 21:04:21.983695 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1754/3182] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:22.004790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:22.005709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:22.017463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:22.022231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.022968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.024698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.025439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.112233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:22.123001 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1bb23097-2ace-441b-88dc-3dd12fc9fcd5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.297724 Jun 25 21:04:22.124002 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1429/3183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:22.129062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52d3011a-9544-4c13-a498-b6de0c865117 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861eb4700>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:22.186007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52d3011a-9544-4c13-a498-b6de0c865117 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.060529 Jun 25 21:04:22.190016 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1430/3184] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:22 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:22.302427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:22.313469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1cc0198e-48d3-4fed-8aa3-cab64af1bb60 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.315871 Jun 25 21:04:22.325115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1755/3185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:21 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:22.361050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:22.361677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:22.370674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.371135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.371953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.372373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.546251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:22.556765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e5fbefa-36df-47da-bede-e505d78c4549 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.198930 Jun 25 21:04:22.573879 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1431/3186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:22 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:22.717596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:22.718629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:22.725801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.726549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.727426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:22.728073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:22.958768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:22.974799 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6808137a-637d-454d-a2b7-37391b511d82 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1512 microversion: 2.1 time: 0.262438 Jun 25 21:04:22.977563 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1756/3187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:22 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:22.991115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:22.992370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:23.000201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.001345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.002432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.003931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.142382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:23.143232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:23.151255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.151715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.152519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.152949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.289064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:23.297528 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-33c1cd3c-6e81-4095-b2aa-8c642b8dd585 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1352 microversion: 2.1 time: 0.312976 Jun 25 21:04:23.308342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1432/3188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:22 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1352 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:23.314694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-490577f4-db4b-4669-8fd1-b8fa1b1ddd8b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f660040>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:23.430194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:23.430978 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-490577f4-db4b-4669-8fd1-b8fa1b1ddd8b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.119170 Jun 25 21:04:23.431742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1433/3189] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:23 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:23.437914 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed2fea9a-b7e4-4d1c-9ae5-a43b311d1db1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.299545 Jun 25 21:04:23.438499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1757/3190] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:23 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:23.442547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:23.445171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:23.468908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.469722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.470772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.471408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.577226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:23.577850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:23.585533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.585984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.588900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:23.592309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:23.838151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:23.850367 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8c951a4-72d5-4e2c-8793-9d56dcf55813 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.417283 Jun 25 21:04:23.851230 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1434/3191] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:23 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:23.941784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:23.950943 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc3d2188-d82f-4388-b6fe-ea9fe8854334 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.380472 Jun 25 21:04:23.956692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1758/3192] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:23 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:23.995385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:23.996438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.004195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.004991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.006034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.006689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.199525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:24.208128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cf159ef-dd64-4703-bcec-f6a71f05507e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1489 microversion: 2.1 time: 0.218073 Jun 25 21:04:24.222355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1435/3193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:23 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1489 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:24.227339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.228172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.242052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.242633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.243417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.243849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.291149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:04:24.315206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.315834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.332210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.333006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.333799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.334242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.419044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b88d4e12-9b7c-4904-aa38-b4eca7b295a6 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 204 len: 0 microversion: 2.1 time: 0.195490 Jun 25 21:04:24.419423 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1759/3194] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:24 2022] DELETE /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:24.431884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.432148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.440767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.441507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.442364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.443215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.525646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:24.534589 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6e7226e-6b2b-47f3-bc6a-46941157dc19 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1542 microversion: 2.1 time: 0.223294 Jun 25 21:04:24.537395 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1436/3195] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1542 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:24.543213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a418606-a0f0-4e65-b87e-c5e9738c14ee tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f64bd30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.593366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a418606-a0f0-4e65-b87e-c5e9738c14ee tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.054638 Jun 25 21:04:24.594476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1437/3196] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:24.599555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.600464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.607698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.608413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.609544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.609985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.784850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:24.788278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:24.793626 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-865712ac-dc2f-4045-a963-9fb16ee6ed39 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1495 microversion: 2.1 time: 0.369781 Jun 25 21:04:24.801110 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1760/3197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1495 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:24.809281 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f54988f-7bd1-4412-a4cc-d035bbbd0d86 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.212890 Jun 25 21:04:24.809901 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1438/3198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:24.827965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.831455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.837725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.838177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.838947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.839374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.867638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.868569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.878568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.879297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.881335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.881932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.933575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d70abc6-b0e9-4911-9f82-9e422045b62b tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131503 Jun 25 21:04:24.934365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1761/3199] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:24.977376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:24.977990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:24.989307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.989747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:24.990514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:24.990941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:25.013831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:25.110862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:25.120413 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47a2a5c3-411b-45e6-abd1-a8baef51fd74 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.257076 Jun 25 21:04:25.129834 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1439/3200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:25.290251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:25.301684 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bf4e8ca-720e-46e9-8a59-a686fe5d9cbf tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.327215 Jun 25 21:04:25.307153 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1762/3201] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:24 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:25.609565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b5bd3da-309b-43c5-bb14-5c6c5e997548 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f985c4a33a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:25.626762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:25.682225 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b5bd3da-309b-43c5-bb14-5c6c5e997548 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.078425 Jun 25 21:04:25.688508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1440/3202] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:25 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:25.813086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:25.813932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:25.825662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:25.827391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:25.827570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:25.828326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:25.829193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:25.830410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:25.830532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:25.841901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:25.842489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:25.843305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:25.846326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:26.155766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:26.173456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2f272370-f9dc-40bd-bc89-a915cd9e98c9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.351045 Jun 25 21:04:26.175654 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1441/3203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:25 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:26.184352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:26.197064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-382158d8-e33c-4f7f-a902-824dad5886c0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1495 microversion: 2.1 time: 0.390254 Jun 25 21:04:26.197974 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1763/3204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:25 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1495 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:26.198811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:26.201767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:26.234257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:26.237587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:26.243108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:26.244617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:26.324095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:26.325153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:26.346079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:26.359082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:26.365046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:26.365865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:26.836651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:26.850316 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b887c76e-66a6-48b4-b748-9233e32e6c46 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.530995 Jun 25 21:04:26.862087 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1764/3205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:26 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:26.876721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c9b3ce1-bc8f-4dd5-95d0-f38bd389f5c7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f50ac10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:26.990738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c9b3ce1-bc8f-4dd5-95d0-f38bd389f5c7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.127158 Jun 25 21:04:26.991990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1765/3206] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:26 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:27.001567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d4d8f0fe-7ed6-4059-909f-18566c3222cf req-afc9248b-b4f6-4634-ae4f-c94ee1c0ab86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1c5eb40-ad52-46be-ab5c-9e1ada217b56", "name": "network-vif-deleted", "tag": "5415fdc0-f3ed-4eea-9edd-564b84af7331"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:27.031424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d4d8f0fe-7ed6-4059-909f-18566c3222cf req-afc9248b-b4f6-4634-ae4f-c94ee1c0ab86 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.032890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d4d8f0fe-7ed6-4059-909f-18566c3222cf req-afc9248b-b4f6-4634-ae4f-c94ee1c0ab86 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.057319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d4d8f0fe-7ed6-4059-909f-18566c3222cf req-afc9248b-b4f6-4634-ae4f-c94ee1c0ab86 service nova] Creating event network-vif-deleted:5415fdc0-f3ed-4eea-9edd-564b84af7331 for instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 on nch2-master-1 Jun 25 21:04:27.063800 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d4d8f0fe-7ed6-4059-909f-18566c3222cf req-afc9248b-b4f6-4634-ae4f-c94ee1c0ab86 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070268 Jun 25 21:04:27.064614 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1766/3207] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:27.124002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:27.143966 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7bd89109-02f2-402b-9bc7-68b2ad3aa7bb tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.965220 Jun 25 21:04:27.145802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0515288a-d92a-4014-9708-9d07b91631ec req-0d77f061-4800-4ecf-a4ce-0541b1f158e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a", "tag": "57876bb0-6089-4268-b6e1-d27d339e3c67"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:27.147757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1442/3208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:26 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:27.168286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0515288a-d92a-4014-9708-9d07b91631ec req-0d77f061-4800-4ecf-a4ce-0541b1f158e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.169003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0515288a-d92a-4014-9708-9d07b91631ec req-0d77f061-4800-4ecf-a4ce-0541b1f158e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.185628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0515288a-d92a-4014-9708-9d07b91631ec req-0d77f061-4800-4ecf-a4ce-0541b1f158e6 service nova] Creating event network-changed:57876bb0-6089-4268-b6e1-d27d339e3c67 for instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a on nch2-master-1 Jun 25 21:04:27.193001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:27.193387 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0515288a-d92a-4014-9708-9d07b91631ec req-0d77f061-4800-4ecf-a4ce-0541b1f158e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053092 Jun 25 21:04:27.193857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:27.197795 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1767/3209] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:04:27.206154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.208279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.210612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.216082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.216693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:27.217514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:27.238416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.241403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.245158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.248718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.335715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.338365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.339459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'fault' on Instance uuid c1c5eb40-ad52-46be-ab5c-9e1ada217b56 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:04:27.493905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:27.506536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-20a48229-5ae5-4045-83fc-45411f25ac52 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 200 len: 1305 microversion: 2.1 time: 0.291830 Jun 25 21:04:27.507859 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1768/3210] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:27 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 1305 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:27.599454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:27.611012 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ff1abc7-b567-4a9b-a5c1-52c42b64196b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.421440 Jun 25 21:04:27.623298 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1443/3211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:27 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:27.870084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:27.870729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:27.880510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.880952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:27.883874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:27.884343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.004809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a53e8bd-a9f2-4ce8-a3ef-2cf7368def08 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861f24a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:28.067550 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a53e8bd-a9f2-4ce8-a3ef-2cf7368def08 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.066746 Jun 25 21:04:28.076339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1444/3212] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:27 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:28.163585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:28.166049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:28.184096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.184992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.188976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.189613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.215604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:28.243598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e763c819-6817-40a5-b2c2-7d8479f1cda3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.378141 Jun 25 21:04:28.245123 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1769/3213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:27 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:28.525034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:28.533772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:28.545293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:28.555720 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3892c3b7-61dd-414c-8c4a-5615b98e4aff tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.396010 Jun 25 21:04:28.557894 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1445/3214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:28 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:28.566994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.566994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.566994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.566994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.586500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cda63f09-0cbc-4453-b62e-7d0f4579058d req-e7b3ca48-ffb2-4aa1-b6a0-6bb14daa9e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045b0e1a-24df-4171-8698-7292fcb8e00c", "name": "network-vif-plugged", "status": "completed", "tag": "2d470ff3-e6a1-40a4-9d92-681025b6c9c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:28.595797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cda63f09-0cbc-4453-b62e-7d0f4579058d req-e7b3ca48-ffb2-4aa1-b6a0-6bb14daa9e28 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.596545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cda63f09-0cbc-4453-b62e-7d0f4579058d req-e7b3ca48-ffb2-4aa1-b6a0-6bb14daa9e28 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.604138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 HTTP/1.1 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c1c5eb40-ad52-46be-ab5c-9e1ada217b56'} Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:28.606200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:28.610912 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:28.616017 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cda63f09-0cbc-4453-b62e-7d0f4579058d req-e7b3ca48-ffb2-4aa1-b6a0-6bb14daa9e28 service nova] Creating event network-vif-plugged:2d470ff3-e6a1-40a4-9d92-681025b6c9c2 for instance 045b0e1a-24df-4171-8698-7292fcb8e00c on nch1-master-1 Jun 25 21:04:28.622002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cda63f09-0cbc-4453-b62e-7d0f4579058d req-e7b3ca48-ffb2-4aa1-b6a0-6bb14daa9e28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039368 Jun 25 21:04:28.622879 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1446/3215] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:28.623007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:28.625070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72881354-fb2a-4fef-9054-7243fbdefa66 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 404 len: 111 microversion: 2.1 time: 0.105294 Jun 25 21:04:28.627199 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1770/3216] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:28 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:28.631803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:28.638120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:28.666860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.667792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.669723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:28.670577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:28.893896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-775133087", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "314d8137-a9a2-40db-b299-46db022855b2"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:28.962032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] validate_networks() for [('314d8137-a9a2-40db-b299-46db022855b2', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:04:29.218136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:29.240320 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83898e45-560b-48af-9ae2-a874634f16b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.615050 Jun 25 21:04:29.241989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1447/3217] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:28 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:29.252957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39c1ad75-8280-49e2-8062-ef04d7210d5f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f696280>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:29.332812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39c1ad75-8280-49e2-8062-ef04d7210d5f tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.089459 Jun 25 21:04:29.333411 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1448/3218] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:29 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:29.373440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:29.376034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:29.397451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.405444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.406500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.408197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.537929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:29.540039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:29.540736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:29.541310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:29.541905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:29.547314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:29.556992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.557609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.558577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.559354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.584314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:29.592401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Getting quotas for user 259fbe1886a644c28632dc5c8a3c3568 and project e2076d2f07d34d44b9431dc1e9e78e14. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:29.605252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:29.607838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:29.635298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:29.649499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5398829b-cd6a-4e17-9695-cdaca524b002 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.311628 Jun 25 21:04:29.650509 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1449/3219] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:29 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:29.656555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:29.657451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:29.663914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.664833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.665974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:29.666624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:29.683313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54e8bcbd-10de-4c83-a003-66d48fbbfdfc tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793389 Jun 25 21:04:29.688808 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1771/3220] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:04:29.694399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff433f10-c65e-4b95-9c19-5cf3870d3610 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:29.695275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ff433f10-c65e-4b95-9c19-5cf3870d3610 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:29.772681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ff433f10-c65e-4b95-9c19-5cf3870d3610 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:29.791831 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff433f10-c65e-4b95-9c19-5cf3870d3610 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1214 microversion: 2.1 time: 0.101388 Jun 25 21:04:29.798482 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1772/3221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:29 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:29.917808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:29.926613 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35269d13-5820-40c1-bca3-0ec3a1b88181 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1402 microversion: 2.1 time: 0.274596 Jun 25 21:04:29.927808 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1450/3222] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:29 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1402 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:30.258455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:30.259757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:30.268455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.269270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.270402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.271053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.347090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa6cf517-a63a-4f80-b698-12de0aab314b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f985c4a3550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:30.437125 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa6cf517-a63a-4f80-b698-12de0aab314b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.094037 Jun 25 21:04:30.437868 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1451/3223] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:30 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:30.451240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:30.465394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-56f504bf-6de4-4085-889b-24796c24e230 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.210749 Jun 25 21:04:30.474287 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1773/3224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:30 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:30.667589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:30.668220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:30.677040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.677729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.679324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.680218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.817005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:30.817633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:30.838791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.839247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.840400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:30.840873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:30.929294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:30.937905 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7717d76a-5f15-4ac5-87fe-39df4392fdb7 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1266 microversion: 2.1 time: 0.125837 Jun 25 21:04:30.944625 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1774/3225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:30 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:31.010145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:31.019659 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-58d81e54-a72c-44de-9ff6-0a2ddb35fe57 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.356367 Jun 25 21:04:31.020180 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1452/3226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:30 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:31.025150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.026051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:31.034215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.035018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.035987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.036631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.054561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:31.231985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Calling method '.version_select at 0x7f984ebebaf0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.233787 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:04:31.233787 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:04:31.235489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.236190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.245984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:31.253940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-277eb0d1-5e51-4764-a52c-298927766b85 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1589 microversion: 2.1 time: 0.232427 Jun 25 21:04:31.254781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.256845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.269738 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1453/3227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:31 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1589 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:31.272128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.275627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.278638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.283348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:31.293556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.294013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.294853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.295294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.295600 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dadca37-329a-4b67-a048-c379a1f11f9e tempest-PortsAdminExtendedAttrsTestJSON-1396191052 tempest-PortsAdminExtendedAttrsTestJSON-1396191052-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.347396 Jun 25 21:04:31.297081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1775/3228] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:04:30 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:31.451246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fdbb2b84-d83a-4911-aa17-a1f93280e861 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebb0280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.472886 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3998b50-d4bf-432d-857f-8dd94f4b4c10 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.201587 Jun 25 21:04:31.473499 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1454/3229] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:04:31 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:31.491308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.492054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:31.501380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.501849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.502620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.503064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.505294 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fdbb2b84-d83a-4911-aa17-a1f93280e861 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1455 microversion: 2.1 time: 0.058206 Jun 25 21:04:31.506040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1776/3230] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:31 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:31.940059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:31.955342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:31.956058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:31.961691 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3dc74ca9-fdf9-4aa2-9565-b1c24ae103d7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.474349 Jun 25 21:04:31.964501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.965279 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1455/3231] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:31 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:31.965887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:31.966973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:31.967478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:32.052706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:32.052706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:32.066245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:32.066732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:32.067532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:32.067961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:32.139039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:32.174578 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee90afd9-d3b0-4031-a5a6-67fb8ba1ef06 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1272 microversion: 2.1 time: 0.223039 Jun 25 21:04:32.181364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1777/3232] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:31 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1272 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:32.519764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc2a75e4-5c04-443a-9841-454e494c57e7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb7f940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:32.570115 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc2a75e4-5c04-443a-9841-454e494c57e7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1464 microversion: 2.1 time: 0.054224 Jun 25 21:04:32.571007 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1778/3233] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1464 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:32.583117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e619dab5-792f-425d-b009-b2b77e94b289 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb60040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:32.644154 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e619dab5-792f-425d-b009-b2b77e94b289 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 200 len: 1464 microversion: 2.1 time: 0.065454 Jun 25 21:04:32.645561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1779/3234] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 1464 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:32.657575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:32.658473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:32.667841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:32.668608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:32.669657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:32.670532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:32.879045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:32.888325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d963f49e-a0ad-4e21-a107-a6f9293f4d38 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1467 microversion: 2.1 time: 0.235640 Jun 25 21:04:32.901118 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1780/3235] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1467 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:32.908619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a9f613d-7599-4e11-8839-5594969c2ee7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebfa700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:32.926682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:32.934933 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac21681d-116c-472f-adce-770472af7cee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.899825 Jun 25 21:04:32.935573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1456/3236] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:33.009903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.010948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:33.040852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.041313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:33.042113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.042549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:33.061545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a9f613d-7599-4e11-8839-5594969c2ee7 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?changes-since=2022-06-25T21%3A02%3A39Z" status: 200 len: 1903 microversion: 2.1 time: 0.157105 Jun 25 21:04:33.062914 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1781/3237] 10.222.0.39 () {58 vars in 1198 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/images?changes-since=2022-06-25T21%3A02%3A39Z => generated 1903 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:33.076791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ebd14ca-0b81-4cd8-9a94-a60c1b913e42 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebb0700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.155848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ebd14ca-0b81-4cd8-9a94-a60c1b913e42 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1765810016" status: 200 len: 485 microversion: 2.1 time: 0.084522 Jun 25 21:04:33.157475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1782/3238] 10.222.0.39 () {58 vars in 1230 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1765810016 => generated 485 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:33.168304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c491d199-e2c0-4263-bf13-e79060a85a37 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb69f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.289893 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c491d199-e2c0-4263-bf13-e79060a85a37 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?server=f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 958 microversion: 2.1 time: 0.125525 Jun 25 21:04:33.290655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1783/3239] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?server=f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 958 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:04:33.299875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.300895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:33.307780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.308242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:33.309057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.309497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:33.400223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:33.409660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:33.422567 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-016767f2-82c6-4c0b-ac4b-7d53c91e0c49 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.424616 Jun 25 21:04:33.423174 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1457/3240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:32 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:33.429648 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8157e666-586e-42fc-8ae2-ff3003b3bfbe tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1272 microversion: 2.1 time: 0.137290 Jun 25 21:04:33.434374 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1784/3241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:33.435827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf3a4025-f55f-4e87-b759-be92e927bb18 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f778dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.499936 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf3a4025-f55f-4e87-b759-be92e927bb18 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 484 microversion: 2.1 time: 0.073648 Jun 25 21:04:33.512476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81238ff0-7e5e-4bea-a601-5de01fec18e5 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb69b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.519100 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1458/3242] 10.222.0.39 () {58 vars in 1316 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 484 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:33.571538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81238ff0-7e5e-4bea-a601-5de01fec18e5 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 484 microversion: 2.1 time: 0.063319 Jun 25 21:04:33.581227 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1785/3243] 10.222.0.39 () {58 vars in 1302 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 484 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:33.586186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e69e25c-0470-4e7d-8b5a-23dae559468c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f605dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.735843 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e69e25c-0470-4e7d-8b5a-23dae559468c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3282 microversion: 2.1 time: 0.154230 Jun 25 21:04:33.746391 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1459/3244] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3282 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:33.749664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba56833b-7d55-47e3-8622-a3b94de078f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb67160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.841920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba56833b-7d55-47e3-8622-a3b94de078f3 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.096085 Jun 25 21:04:33.851131 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1786/3245] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:33.855649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18a6aa41-a578-49bc-9199-8bac82fc4f04 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f700c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.909746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18a6aa41-a578-49bc-9199-8bac82fc4f04 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.058489 Jun 25 21:04:33.910527 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1460/3246] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:04:33.922479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85292d32-28d2-42ba-8a46-274b28bfebbc tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb69f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.961414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:33.962583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:33.972294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.973203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:33.975194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:33.975804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.012827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85292d32-28d2-42ba-8a46-274b28bfebbc tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?changes-since=2022-06-25T21%3A02%3A35Z" status: 200 len: 6335 microversion: 2.1 time: 0.094637 Jun 25 21:04:34.013859 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1787/3247] 10.222.0.39 () {58 vars in 1219 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/images/detail?changes-since=2022-06-25T21%3A02%3A35Z => generated 6335 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:34.033904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e19895ad-a01c-40ee-bb48-c3c16755a7c4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb880d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.100310 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e19895ad-a01c-40ee-bb48-c3c16755a7c4 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1765810016" status: 200 len: 665 microversion: 2.1 time: 0.074819 Jun 25 21:04:34.102098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1788/3248] 10.222.0.39 () {58 vars in 1251 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1765810016 => generated 665 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:34.117270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7ba680d-c759-4c17-aa16-9044c893b47a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f50ac10>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.201184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7ba680d-c759-4c17-aa16-9044c893b47a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1466 microversion: 2.1 time: 0.088306 Jun 25 21:04:34.203544 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1789/3249] 10.222.0.39 () {58 vars in 1337 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fv2.1%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1466 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:34.217205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.218126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:34.226411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.227075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.228067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.228891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.350667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:34.359379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-656ae1b3-3e72-4004-9a1e-8b146b8e8d2b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1542 microversion: 2.1 time: 0.410879 Jun 25 21:04:34.369033 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1461/3250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:33 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1542 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:34.376832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8ec3e90-a248-4c8f-a6d6-16a92c54e955 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861f24dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.448225 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8ec3e90-a248-4c8f-a6d6-16a92c54e955 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1466 microversion: 2.1 time: 0.077709 Jun 25 21:04:34.449934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1462/3251] 10.222.0.39 () {58 vars in 1323 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.39%2Fcompute%2Fservers%2F9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1466 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:34.461874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dd89d29d-60df-4680-b292-8321fbe18a30 req-93954803-de6a-427b-a0e3-e48c0e616701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045b0e1a-24df-4171-8698-7292fcb8e00c", "tag": "2d470ff3-e6a1-40a4-9d92-681025b6c9c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:34.479096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:34.483418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dd89d29d-60df-4680-b292-8321fbe18a30 req-93954803-de6a-427b-a0e3-e48c0e616701 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.483874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dd89d29d-60df-4680-b292-8321fbe18a30 req-93954803-de6a-427b-a0e3-e48c0e616701 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.497870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:34.499677 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dd89d29d-60df-4680-b292-8321fbe18a30 req-93954803-de6a-427b-a0e3-e48c0e616701 service nova] Creating event network-changed:2d470ff3-e6a1-40a4-9d92-681025b6c9c2 for instance 045b0e1a-24df-4171-8698-7292fcb8e00c on nch1-master-1 Jun 25 21:04:34.505489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dd89d29d-60df-4680-b292-8321fbe18a30 req-93954803-de6a-427b-a0e3-e48c0e616701 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054329 Jun 25 21:04:34.506572 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1463/3252] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:34.512298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.513738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:34.514002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-042542be-df71-4c07-99f8-b90211b5cd31 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1589 microversion: 2.1 time: 0.303372 Jun 25 21:04:34.515151 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1790/3253] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1589 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:34.521195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.521868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.522852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.523467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.533166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:34.543280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:34.553250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.556837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.557795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:34.558303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:34.880530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:34.893221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e341d329-605d-40d9-a3d6-3f1799d49d8b tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.363908 Jun 25 21:04:34.894445 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1791/3254] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:34.902006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21f65f3b-ecdd-401d-b6da-99e3b9b1c036 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ff19940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:35.054391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21f65f3b-ecdd-401d-b6da-99e3b9b1c036 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7110 microversion: 2.1 time: 0.158368 Jun 25 21:04:35.055872 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1792/3255] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7110 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:35.072361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3685e73-407f-4f60-a45b-48b17023ca11 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebb0700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:35.081782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:35.097036 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-861d6c0f-37bb-441c-89b3-d18021bc827f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.588991 Jun 25 21:04:35.104485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1464/3256] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:34 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:35.246319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3685e73-407f-4f60-a45b-48b17023ca11 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.178636 Jun 25 21:04:35.247469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1793/3257] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 21:04:35 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:35.266259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3dcb5f9c-290d-44be-940b-530c14b290a0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861f0fee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:35.330083 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3dcb5f9c-290d-44be-940b-530c14b290a0 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795" status: 200 len: 784 microversion: 2.1 time: 0.072926 Jun 25 21:04:35.334323 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1465/3258] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:35 2022] GET /compute/v2.1/images/c5741eca-b932-4865-b29a-bd2a12a73795 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:35.346875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0bd9700-38ce-427b-bbee-1a6665bac749 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb60790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:35.378505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:35.379550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:35.389101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:35.390304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:35.391388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:35.392532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:35.461429 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0bd9700-38ce-427b-bbee-1a6665bac749 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.119203 Jun 25 21:04:35.462321 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1794/3259] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:04:35 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:35.475940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8bad365d-14f6-4f68-aa47-b6af2478c6a1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984ebfa790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:36.370304 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8bad365d-14f6-4f68-aa47-b6af2478c6a1 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb" status: 204 len: 0 microversion: 2.1 time: 0.897410 Jun 25 21:04:36.372121 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1795/3260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:35 2022] DELETE /compute/v2.1/images/d79ba089-251e-4283-b04a-500b58a02efb => generated 0 bytes in 901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:04:36.378242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:36.379427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:36.401248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:36.402171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:36.403460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:36.404488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:36.419754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:36.433611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2579e365-c96e-4d3a-adbb-34079bbb64f3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1541 microversion: 2.1 time: 1.061013 Jun 25 21:04:36.434634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1466/3261] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:35 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1541 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:36.444252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:36.445182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:36.453851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:36.454381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:36.455354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:36.455805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:36.927816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:36.941847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47b3ea3b-4b7a-475f-a865-e2cc7cac471e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.503679 Jun 25 21:04:36.943048 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1467/3262] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:36 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:36.957156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70708036-2199-4436-af96-8b2186ab8bd8 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f9861f0c4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:37.209948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:37.225699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed0fdd04-ed91-46bc-92ad-78b057d65345 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.851349 Jun 25 21:04:37.226922 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1796/3263] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:36 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:37.239625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b57541cb-852c-4878-b386-b8d5ddb6af93 req-daf17864-4033-4623-8647-3c6312b4544c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-unplugged", "status": "completed", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:37.253873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b57541cb-852c-4878-b386-b8d5ddb6af93 req-daf17864-4033-4623-8647-3c6312b4544c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.254409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b57541cb-852c-4878-b386-b8d5ddb6af93 req-daf17864-4033-4623-8647-3c6312b4544c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.268847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b57541cb-852c-4878-b386-b8d5ddb6af93 req-daf17864-4033-4623-8647-3c6312b4544c service nova] Creating event network-vif-unplugged:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:04:37.289787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b57541cb-852c-4878-b386-b8d5ddb6af93 req-daf17864-4033-4623-8647-3c6312b4544c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060591 Jun 25 21:04:37.290956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1797/3264] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:37.300989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-71053fd5-e7f4-4c88-bf06-6c131d149c48 req-66382d4c-a318-42c0-904c-7b5ad00378bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1f0d044-b411-49f2-9c19-971453cdc1c6", "tag": "06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:37.311510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-71053fd5-e7f4-4c88-bf06-6c131d149c48 req-66382d4c-a318-42c0-904c-7b5ad00378bd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.312530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-71053fd5-e7f4-4c88-bf06-6c131d149c48 req-66382d4c-a318-42c0-904c-7b5ad00378bd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.328850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-71053fd5-e7f4-4c88-bf06-6c131d149c48 req-66382d4c-a318-42c0-904c-7b5ad00378bd service nova] Creating event network-changed:06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd for instance c1f0d044-b411-49f2-9c19-971453cdc1c6 on nch2-master-1 Jun 25 21:04:37.335676 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-71053fd5-e7f4-4c88-bf06-6c131d149c48 req-66382d4c-a318-42c0-904c-7b5ad00378bd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042329 Jun 25 21:04:37.337288 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1798/3265] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:37.451614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:37.453041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:37.460374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.460972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.461633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.462076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.521222 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70708036-2199-4436-af96-8b2186ab8bd8 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c" status: 204 len: 0 microversion: 2.1 time: 0.575132 Jun 25 21:04:37.521853 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1468/3266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:36 2022] DELETE /compute/v2.1/images/5a329e2f-dd1b-466d-a9e6-7e8dfbc4525c => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:37.529446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3be3c3c-8cbb-4d66-89c0-18592483b665 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f6131f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:37.663980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:37.667689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:37.673501 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f6380544-7806-4258-b2cb-ed514bd27325 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1473 microversion: 2.1 time: 0.226305 Jun 25 21:04:37.674197 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1799/3267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:37 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1473 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:37.959304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:37.959925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:37.967182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.967564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.968518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.969114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.974751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3be3c3c-8cbb-4d66-89c0-18592483b665 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834" status: 204 len: 0 microversion: 2.1 time: 0.448765 Jun 25 21:04:37.975673 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1469/3268] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:37 2022] DELETE /compute/v2.1/images/26870b8e-d584-4fd8-9495-672eae584834 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:37.983789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:37.984302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:37.991605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.992345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:37.993383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:37.993875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.025175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:04:38.112326 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a6a93e2-d734-43c7-a5bf-a1280eab1e6b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 204 len: 0 microversion: 2.1 time: 0.131930 Jun 25 21:04:38.116258 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1470/3269] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:37 2022] DELETE /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:04:38.125113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:38.125317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:38.126155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:38.132544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.133583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.133723 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0e80a28a-77b8-4023-9b43-b2ea54dd11fa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.177929 Jun 25 21:04:38.134017 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1800/3270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:37 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:38.134199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.134823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.243361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:38.243917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:38.250400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.250848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.251611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.252039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.379171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:38.387854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52b53a29-645e-40db-a053-85a1967b7ea6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1474 microversion: 2.1 time: 0.269604 Jun 25 21:04:38.388693 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1471/3271] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:38 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1474 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:38.392017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:38.401095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04e20894-c988-437c-8651-778148c49ea8 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.161681 Jun 25 21:04:38.401709 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1801/3272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:38 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:38.691362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:38.692083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:38.699484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.700021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.700901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:38.701424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:38.875972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:38.884238 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-805aee3c-f398-49fc-89c5-1429364415f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1473 microversion: 2.1 time: 0.197212 Jun 25 21:04:38.884833 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1472/3273] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:38 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1473 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:39.151357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:39.153056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:39.160632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.161091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.162229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.162825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.312655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-unplugged", "status": "completed", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:39.312943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:39.322013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c770835-9b5d-403a-972e-566d7d582efe tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.175537 Jun 25 21:04:39.322941 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1802/3274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:39 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:39.326291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.326743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.344882 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] Creating event network-vif-unplugged:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:04:39.351727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] Instance 33feb928-6172-447e-90e8-14f32251ca9e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:04:39.358080 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b84ba194-a23a-4f81-b8ed-de9235f06dd4 req-675bd46b-ca36-4de5-a6c8-5000470f4ddb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049238 Jun 25 21:04:39.358702 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1473/3275] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:39.405601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:39.406215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:39.418857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:39.419576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:39.422890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.423585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.424619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.425042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.427068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.427645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.428516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.429143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.566938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:39.570121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:39.577220 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3fe2d8ea-475e-4b62-ac07-1f66158d0873 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.162996 Jun 25 21:04:39.578346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1474/3276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:39 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:39.610437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:39.621264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30706f45-d7c5-4bd3-82e7-7fb4c8d03b1d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1474 microversion: 2.1 time: 0.219647 Jun 25 21:04:39.622617 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1803/3277] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:39 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1474 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:39.902243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:39.906049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:39.910329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.910788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:39.911564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:39.911995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.108381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:40.117944 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39a10830-55b9-41f1-b6a4-17f8580c6581 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1470 microversion: 2.1 time: 0.220158 Jun 25 21:04:40.118534 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1475/3278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:39 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:40.134442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:40.134978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:40.136894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:40.142653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.143100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.143868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.144302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.184809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.185453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.186121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.186472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.209298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:40.214034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:40.333706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af9de688-97d6-4305-914e-85f1f743151e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e/action" status: 202 len: 0 microversion: 2.1 time: 0.202672 Jun 25 21:04:40.334896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1804/3279] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:40 2022] POST /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:04:40.339924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:40.340657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:40.344009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:40.344975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:40.352211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.353742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.353985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.354590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.355872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.356487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.357352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.358621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.570669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:40.589509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fe7d077-2fa6-458b-95e3-0b89e8cbe305 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1469 microversion: 2.1 time: 0.250480 Jun 25 21:04:40.590660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1805/3280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:40 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1469 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:40.595212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:40.595814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:40.604972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.605348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.606135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.606667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.631598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:40.634296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:40.641782 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-941537bc-753a-4b8b-b10b-6faa98e9a24f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.306808 Jun 25 21:04:40.642372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1476/3281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:40 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:40.647108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:40.647718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:40.654686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.655142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.656157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:40.656773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:40.759527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:40.768630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4124db37-8520-450a-9308-ba5ce3f54c0c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.176832 Jun 25 21:04:40.769781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1806/3282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:40 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:40.919611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:40.936763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b1585ab-31b4-406a-81d6-7733bf3219e6 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1474 microversion: 2.1 time: 0.292962 Jun 25 21:04:40.937726 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1477/3283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:40 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1474 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:41.609800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:41.611724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:41.623889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.625018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.626040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.626931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.659232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:41.659862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:41.667459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.668140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.669111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.669746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.844865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:41.852830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3e3eebc-df0d-42ad-baf3-583e81594ed7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1469 microversion: 2.1 time: 0.249322 Jun 25 21:04:41.853584 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1807/3284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:41 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1469 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:41.858301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:41.858911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:41.865073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.865523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.866318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:41.866755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:41.991129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:42.005268 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4c20c17-90bb-480d-bad2-549d78a3d915 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.349793 Jun 25 21:04:42.006085 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1478/3285] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:41 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:42.019727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:42.020533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:42.027423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.028368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:42.029150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.029694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:42.052382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:42.062334 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e150fff2-e8b5-4cfc-bd03-ae99501cbbad tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.207551 Jun 25 21:04:42.063405 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1808/3286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:41 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:42.245952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:42.258943 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b63b9094-de0b-40a7-b4a4-5aa56bc9b0ae tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1474 microversion: 2.1 time: 0.249570 Jun 25 21:04:42.259946 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1479/3287] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:42 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1474 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:42.648807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-plugged", "status": "completed", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:42.661009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.661935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:42.681994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] Creating event network-vif-plugged:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:04:42.689886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] Instance 33feb928-6172-447e-90e8-14f32251ca9e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:04:42.700040 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6c003f6e-5513-44eb-b39d-d32e200b1823 req-92b2fa38-81a6-4aaa-bebe-8bc9e4817928 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055157 Jun 25 21:04:42.702295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1809/3288] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:42.826842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1c2ccdb8-57cf-4279-834f-abeb854ebb3c req-0a1d0cd6-6ce1-41c6-be3e-474077ef246e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e72e2c9-4a63-4c9f-be80-3f461b1c7da9", "name": "network-vif-deleted", "tag": "ac8eb736-810d-4469-9657-015ffde22a44"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:42.835612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1c2ccdb8-57cf-4279-834f-abeb854ebb3c req-0a1d0cd6-6ce1-41c6-be3e-474077ef246e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.836064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1c2ccdb8-57cf-4279-834f-abeb854ebb3c req-0a1d0cd6-6ce1-41c6-be3e-474077ef246e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:42.847672 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1c2ccdb8-57cf-4279-834f-abeb854ebb3c req-0a1d0cd6-6ce1-41c6-be3e-474077ef246e service nova] Creating event network-vif-deleted:ac8eb736-810d-4469-9657-015ffde22a44 for instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 on nch2-master-1 Jun 25 21:04:42.852779 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1c2ccdb8-57cf-4279-834f-abeb854ebb3c req-0a1d0cd6-6ce1-41c6-be3e-474077ef246e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029884 Jun 25 21:04:42.853399 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1480/3289] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:42.871020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:42.871729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:42.878814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.879297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:42.880384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:42.881147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.024373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:43.025121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:43.042428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.043119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.043860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.044530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.076498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:43.086927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08b2327d-4e68-439e-94cd-a9dbb0d1b68f tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1469 microversion: 2.1 time: 0.220202 Jun 25 21:04:43.098823 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1810/3290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:42 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1469 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:43.106313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:43.107271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:43.115292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.118692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.119857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.120535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.296117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:43.305818 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92384a22-1655-425a-8b33-28ac6bfb3938 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.205362 Jun 25 21:04:43.306874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1811/3291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:43 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:43.322393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:43.323014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:43.331500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.332000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.332821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.333255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.374941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:43.375717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:43.376402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lazy-loading 'fault' on Instance uuid 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:04:43.426377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:43.436256 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ac3ab2e-a7d1-4f17-8799-4d0d8e92294b tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 200 len: 1308 microversion: 2.1 time: 0.117525 Jun 25 21:04:43.437211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1812/3292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:43 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 1308 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:43.741258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:43.749705 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-224a44aa-3909-49e2-9ead-2986896688de tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.729678 Jun 25 21:04:43.754489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1481/3293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:43 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:44.107024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.108666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.117141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.117589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.118513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.119180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.138577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:44.256761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:44.264738 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-018278e4-0d50-4f6a-9f43-d867020d56bb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1535 microversion: 2.1 time: 0.162597 Jun 25 21:04:44.274719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1813/3294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:44 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1535 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:44.323340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.324198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.332111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.332610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.333397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.333989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.454197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.454907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.461629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.462072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.462843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.463284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.480638 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] HTTP exception thrown: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Request method failure captured: Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 HTTP/1.1 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3fqjHIRq0VNuBbSgh_kghAt8GQ_DJCQ3rhDv6GCcDM-35D6GjINTTmpnTommnfKQe3tUSee9-WS1HbYRFchnECTdqeDWd5gcb1peOJ0pwsG98a-R8dqfBWeV1UC9XlCs0N_-9CAyOJs-JGHHxWkI_xont-ZrPduEFhNL6hZx59sgVQ Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c08f52307dc24b5bacaea02af2fe64da Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c08f52307dc24b5bacaea02af2fe64da"}]}] Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c08f52307dc24b5bacaea02af2fe64da Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListImageFiltersTestJSON-1971300738-project Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e6fb1f340fc243f4ae0f4f11f90c1f5d Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListImageFiltersTestJSON-1971300738-project Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '9e72e2c9-4a63-4c9f-be80-3f461b1c7da9'} Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:44.482439 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Returning 404 to user: Instance 9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a400636e-b003-4005-aa88-f7a5a074706e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9" status: 404 len: 111 microversion: 2.1 time: 0.033813 Jun 25 21:04:44.486440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1814/3295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:44 2022] GET /compute/v2.1/servers/9e72e2c9-4a63-4c9f-be80-3f461b1c7da9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:44.492323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.492862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.499294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.499755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.500557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.500977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.525995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:04:44.609330 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-745540e3-80fc-4055-9690-10a791f62f1c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 204 len: 0 microversion: 2.1 time: 0.120141 Jun 25 21:04:44.613035 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1815/3296] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:44 2022] DELETE /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:44.618720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.619495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.625838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.626288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.627057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.627509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.692261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:44.702355 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d97be58-ebab-46ea-b227-3e857e80742a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.382700 Jun 25 21:04:44.702952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1482/3297] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:44 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:44.721130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5e614a4e-40b9-4ad7-89c9-54cc28f83402 req-944eec8b-b879-4941-8a97-6007f03a827b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f0d044-b411-49f2-9c19-971453cdc1c6", "name": "network-vif-plugged", "status": "completed", "tag": "06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:44.729837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5e614a4e-40b9-4ad7-89c9-54cc28f83402 req-944eec8b-b879-4941-8a97-6007f03a827b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.730281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5e614a4e-40b9-4ad7-89c9-54cc28f83402 req-944eec8b-b879-4941-8a97-6007f03a827b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.742627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5e614a4e-40b9-4ad7-89c9-54cc28f83402 req-944eec8b-b879-4941-8a97-6007f03a827b service nova] Creating event network-vif-plugged:06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd for instance c1f0d044-b411-49f2-9c19-971453cdc1c6 on nch2-master-1 Jun 25 21:04:44.748192 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5e614a4e-40b9-4ad7-89c9-54cc28f83402 req-944eec8b-b879-4941-8a97-6007f03a827b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030834 Jun 25 21:04:44.749200 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1483/3298] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:44.768621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:44.769485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:44.773182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:44.781390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.781954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.782817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:44.783328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:44.790987 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4766371e-1cf5-4107-a998-b54d63340454 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1473 microversion: 2.1 time: 0.176661 Jun 25 21:04:44.793870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1816/3299] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:44 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1473 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:45.023374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:45.031546 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d1c5e701-2b52-4f10-b083-a95fa8e3b20d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.267852 Jun 25 21:04:45.032129 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1484/3300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:44 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:45.283198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:45.283876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:45.286797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:45.294812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.295452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.296310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.297249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.449398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:45.457904 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06670392-4880-4ea3-9b95-d18a5081d344 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1535 microversion: 2.1 time: 0.179539 Jun 25 21:04:45.458623 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1817/3301] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:45 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1535 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:45.719981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:45.720665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:45.727952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.728407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.729215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.729656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.812972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:45.813848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:45.820713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.821247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.822535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:45.822770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:45.933206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:45.947253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-576db155-4d14-4525-a7f0-f962641bf70c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1314 microversion: 2.1 time: 0.231071 Jun 25 21:04:45.948072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1485/3302] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:45 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:45.959655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:45.967935 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d77fb6f4-c466-4a2a-a801-ead06bf30aad tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1473 microversion: 2.1 time: 0.161466 Jun 25 21:04:45.968555 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1818/3303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:45 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1473 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:46.050825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:46.052217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:46.059421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.060139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.061259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.061910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.328283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:46.337484 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-890daa3b-6050-4aa6-9a97-666192dae7ff tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.291449 Jun 25 21:04:46.340585 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1486/3304] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:46 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:46.478447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:46.479863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:46.498369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.500375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.501925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.503814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.689312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:46.697938 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cba9b084-808e-452f-9496-47e22b82666c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1535 microversion: 2.1 time: 0.224610 Jun 25 21:04:46.698854 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1819/3305] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:46 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1535 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:46.764803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-unplugged", "status": "completed", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:46.774478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.774937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.788554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] Creating event network-vif-unplugged:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:04:46.794957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] Instance 33feb928-6172-447e-90e8-14f32251ca9e is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:04:46.801717 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c8c50ac5-9695-4b7b-bdef-eae9727b2195 req-86df4a10-fc68-4b42-8113-a694bf7f2a5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041049 Jun 25 21:04:46.803604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1487/3306] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:46.965401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:46.966045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:46.972928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.973454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.974298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.974805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.985567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:46.986601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:46.993415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.993870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:46.994655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:46.995094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.117677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:47.126231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4935967c-8d2c-4a8a-b5de-96ad386742cb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1500 microversion: 2.1 time: 0.164991 Jun 25 21:04:47.127104 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1820/3307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:46 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:47.145136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:47.145684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:47.151967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.152442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.153267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.153708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.227404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:47.238580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ff7b9eb-f164-4d7a-ab0c-e86acda616be tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1473 microversion: 2.1 time: 0.257178 Jun 25 21:04:47.239171 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1488/3308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:46 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:47.357994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:47.359847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:47.368655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.369202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.370152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.370699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.448758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'flavor' on Instance uuid c1f0d044-b411-49f2-9c19-971453cdc1c6 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:04:47.513643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:47.524939 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ad4f3941-d3da-4df5-8517-a1f4b475d9a9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.171301 Jun 25 21:04:47.526996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1489/3309] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:47 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:47.528454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b501a0bd-cded-4fbf-a7b8-c0a2f42e3993 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "POST /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6/action" status: 202 len: 0 microversion: 2.1 time: 0.387343 Jun 25 21:04:47.529430 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1821/3310] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:47 2022] POST /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:04:47.540229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:47.541001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:47.548830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.549432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.550316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.550831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.684088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:47.692435 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-062ad091-cfff-4e5a-8953-fcae0ef3e60d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1508 microversion: 2.1 time: 0.157497 Jun 25 21:04:47.693277 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1490/3311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:47 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:47.721055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:47.722285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:47.728770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.729365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.730171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:47.730614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:47.957520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:47.967184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-465c9dcd-cd0c-4c4c-bc25-b45ed9454af6 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1535 microversion: 2.1 time: 0.252277 Jun 25 21:04:47.968330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1822/3312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:47 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1535 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:48.255472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:48.256743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:48.269396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.269854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.270637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.271073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.498957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6fb1f340fc243f4ae0f4f11f90c1f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08f52307dc24b5bacaea02af2fe64da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:48.513443 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b74255d2-43e0-4ea6-aa7f-b68fc551a158 tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 200 len: 1473 microversion: 2.1 time: 0.261752 Jun 25 21:04:48.514094 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1491/3313] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:48 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:48.542819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:48.543483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:48.550811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.551267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.552034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.552804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.574251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9eeddacf-ae24-44e1-9fce-a264e5d353b8 req-0f4956da-a695-47ac-90df-ebe4f797c09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d9ae83-77f4-4f0d-b36e-d276afd502cc", "name": "network-vif-deleted", "tag": "7d5bc837-d399-459e-91b4-a3587f2a3ae7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:48.591151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9eeddacf-ae24-44e1-9fce-a264e5d353b8 req-0f4956da-a695-47ac-90df-ebe4f797c09d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.591619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9eeddacf-ae24-44e1-9fce-a264e5d353b8 req-0f4956da-a695-47ac-90df-ebe4f797c09d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.610497 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9eeddacf-ae24-44e1-9fce-a264e5d353b8 req-0f4956da-a695-47ac-90df-ebe4f797c09d service nova] Creating event network-vif-deleted:7d5bc837-d399-459e-91b4-a3587f2a3ae7 for instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc on nch1-master-1 Jun 25 21:04:48.617537 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9eeddacf-ae24-44e1-9fce-a264e5d353b8 req-0f4956da-a695-47ac-90df-ebe4f797c09d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046982 Jun 25 21:04:48.618329 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1492/3314] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:48.710526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:48.711262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:48.720210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.721038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.722037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.722684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.867677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:48.874005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:48.885062 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c457b8f-fb0c-4dd6-bbc3-0d01073d3ada tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.346105 Jun 25 21:04:48.885655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1823/3315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:48 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:48.889716 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-456d06f5-dfcf-4f33-bedb-301260650256 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1491 microversion: 2.1 time: 0.183468 Jun 25 21:04:48.901559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1493/3316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:48 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1491 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:48.907781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:48.908285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:48.914620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.915071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.915858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:48.916292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:48.945243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:04:48.986308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:48.987320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:49.000463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.001508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.002625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.003146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.081366 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8da871c5-0e07-4eae-94da-c328c0968b5a tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 204 len: 0 microversion: 2.1 time: 0.177800 Jun 25 21:04:49.082567 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1824/3317] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:48 2022] DELETE /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:49.094828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:49.096456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:49.105738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.106331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.107523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.108292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.200852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:49.211516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18f2efc5-1dae-459c-8996-d842ba18d82b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1528 microversion: 2.1 time: 0.229433 Jun 25 21:04:49.211516 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1494/3318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:48 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:49.230156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:49.233055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:49.244759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.245597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.246867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.247471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.282230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:49.287008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:49.292279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-530f8d6e-eefc-4f1b-87a9-b29e71b75d42 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1497 microversion: 2.1 time: 0.203804 Jun 25 21:04:49.292932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1825/3319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:49 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:49.395895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:49.398610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:49.406727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e25f97cf-fb28-4e3d-ab12-9a7a7c1fd7f7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1528 microversion: 2.1 time: 0.182394 Jun 25 21:04:49.408099 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1495/3320] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:49 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1528 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:49.425169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-411ea946-7da5-4f2f-bc7c-11486a707cc6 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:49.426155 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:04:49.426155 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:04:49.433636 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-411ea946-7da5-4f2f-bc7c-11486a707cc6 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] HTTP exception thrown: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-411ea946-7da5-4f2f-bc7c-11486a707cc6 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Request method failure captured: Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/flavors/7ed90451-3018-4c10-80e5-7c1f636fd8d3 HTTP/1.1 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eV7SaXZCzU3fjAnzcw1VOmLf_skW1kCfk5w9WVN_ElrN4G_pUtf7PEDCsQRx0IuDkecLJg_BjMmvev9crJj0zM929pwGmkCwMYk7wYXQuxy6y5M-c6AyE9KTKKH5vVapemcYKFb8A4gVJfPrlS2OxRn6_oNylaxYR3AK_NPhvrzBI Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4e758e68d8094b8bb4d528182ef10a3a Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MigrationsAdminTest-711022390 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e758e68d8094b8bb4d528182ef10a3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e758e68d8094b8bb4d528182ef10a3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e758e68d8094b8bb4d528182ef10a3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e758e68d8094b8bb4d528182ef10a3a"}]}] Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MigrationsAdminTest-711022390 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4e758e68d8094b8bb4d528182ef10a3a Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MigrationsAdminTest-711022390 Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MigrationsAdminTest-711022390-project-admin Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f6e3d3212ab942feb30bae5b2fd9885d Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MigrationsAdminTest-711022390-project-admin Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '7ed90451-3018-4c10-80e5-7c1f636fd8d3'} Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi flavor.destroy() Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.458074 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-411ea946-7da5-4f2f-bc7c-11486a707cc6 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Returning 404 to user: Flavor 7ed90451-3018-4c10-80e5-7c1f636fd8d3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-411ea946-7da5-4f2f-bc7c-11486a707cc6 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/7ed90451-3018-4c10-80e5-7c1f636fd8d3" status: 404 len: 109 microversion: 2.1 time: 0.040574 Jun 25 21:04:49.476099 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1826/3321] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:49 2022] DELETE /compute/v2.1/flavors/7ed90451-3018-4c10-80e5-7c1f636fd8d3 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:49.530188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:49.530410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] [instance: f7d9ae83-77f4-4f0d-b36e-d276afd502cc] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:49.537348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.537816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.538611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.539054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.556140 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] HTTP exception thrown: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Request method failure captured: Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc HTTP/1.1 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3fqjHIRq0VNuBbSgh_kghAt8GQ_DJCQ3rhDv6GCcDM-35D6GjINTTmpnTommnfKQe3tUSee9-WS1HbYRFchnECTdqeDWd5gcb1peOJ0pwsG98a-R8dqfBWeV1UC9XlCs0N_-9CAyOJs-JGHHxWkI_xont-ZrPduEFhNL6hZx59sgVQ Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c08f52307dc24b5bacaea02af2fe64da Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c08f52307dc24b5bacaea02af2fe64da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c08f52307dc24b5bacaea02af2fe64da"}]}] Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c08f52307dc24b5bacaea02af2fe64da Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1971300738 Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ListImageFiltersTestJSON-1971300738-project Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e6fb1f340fc243f4ae0f4f11f90c1f5d Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ListImageFiltersTestJSON-1971300738-project Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f7d9ae83-77f4-4f0d-b36e-d276afd502cc'} Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:49.558132 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Returning 404 to user: Instance f7d9ae83-77f4-4f0d-b36e-d276afd502cc could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2335cb8d-63ae-4b8c-b32a-a7333f182d3c tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc" status: 404 len: 111 microversion: 2.1 time: 0.033908 Jun 25 21:04:49.562664 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1496/3322] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:49 2022] GET /compute/v2.1/servers/f7d9ae83-77f4-4f0d-b36e-d276afd502cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:49.571451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44e0b775-d309-4590-a889-adcc1d9fd23a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984eb60d30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:49.590012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1890862624", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:49.649976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:04:49.923323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:49.923831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:49.924448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:49.924974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:49.925605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:49.935454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.935977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.937233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:49.937740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:49.957126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:49.962066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Getting quotas for user 5d3257db63ed4bf0861abc735c1e83ee and project b5e11266f1884df8b0f27ebc2f4133d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:49.974728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:49.977205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:49.980300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44e0b775-d309-4590-a889-adcc1d9fd23a tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7" status: 204 len: 0 microversion: 2.1 time: 0.415302 Jun 25 21:04:49.981143 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1827/3323] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:49 2022] DELETE /compute/v2.1/images/00e9c584-d418-455b-955a-4a3ee03c14d7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:50.009613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:50.010320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:50.017601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:50.018059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:50.018929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:50.019367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:50.024465 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-583907cd-0014-4f83-9eff-bd082b9e5c81 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442003 Jun 25 21:04:50.025219 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1497/3324] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:04:50.030402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86f2b94e-a811-4027-8a3d-c5449ff0c17d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984fe59ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:50.198266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:50.276392 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86f2b94e-a811-4027-8a3d-c5449ff0c17d tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58" status: 204 len: 0 microversion: 2.1 time: 0.249923 Jun 25 21:04:50.277026 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1498/3325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:50 2022] DELETE /compute/v2.1/images/4fcd98e5-6056-4fd6-a350-91b995841a58 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:50.282152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-750ca06c-bb7b-4457-b1af-9d5e249f089d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:50.283026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-750ca06c-bb7b-4457-b1af-9d5e249f089d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:50.351755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-750ca06c-bb7b-4457-b1af-9d5e249f089d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:50.359799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-750ca06c-bb7b-4457-b1af-9d5e249f089d tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1213 microversion: 2.1 time: 0.081672 Jun 25 21:04:50.360413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1499/3326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:50 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:50.369649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2252d180-0984-4157-a2b8-a888d657c41e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] Calling method '.version_select at 0x7f984f605550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:50.671801 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2252d180-0984-4157-a2b8-a888d657c41e tempest-ListImageFiltersTestJSON-1971300738 tempest-ListImageFiltersTestJSON-1971300738-project] 10.222.0.39 "DELETE /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c" status: 204 len: 0 microversion: 2.1 time: 0.310170 Jun 25 21:04:50.675794 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1500/3327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:50 2022] DELETE /compute/v2.1/images/7335aeae-1087-4469-b865-e7550ad1403c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:04:50.681741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:50.682262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:50.682746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:50.690658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:50.691111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:50.691919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:50.692301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:50.697231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecbf7c9b-8ddd-49f8-bb9f-b3b3a6c30458 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.711946 Jun 25 21:04:50.698361 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1828/3328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:49 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:50.887793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:50.896282 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c221e17-047f-43f7-9db0-6aa9ff29a863 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1497 microversion: 2.1 time: 0.219266 Jun 25 21:04:50.897220 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1501/3329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:50 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:51.377817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:51.378528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:51.385212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.385665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.386435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.387099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.489726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:51.499043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d36c02f8-c627-4b51-b70c-f4b0ba89c8a5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1271 microversion: 2.1 time: 0.126491 Jun 25 21:04:51.499607 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1829/3330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:51 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:51.721896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:51.723612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:51.735170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.735644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.736690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.737168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.878658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5acfabc1-481e-4bf7-828a-e012b6625a7b req-42ab55a0-a914-4405-845e-b8b893e52508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1f0d044-b411-49f2-9c19-971453cdc1c6", "name": "network-vif-deleted", "tag": "06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:51.919872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5acfabc1-481e-4bf7-828a-e012b6625a7b req-42ab55a0-a914-4405-845e-b8b893e52508 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.920796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5acfabc1-481e-4bf7-828a-e012b6625a7b req-42ab55a0-a914-4405-845e-b8b893e52508 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.935886 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5acfabc1-481e-4bf7-828a-e012b6625a7b req-42ab55a0-a914-4405-845e-b8b893e52508 service nova] Creating event network-vif-deleted:06f1ae26-13d8-43c5-a94a-c7f3c79bfdfd for instance c1f0d044-b411-49f2-9c19-971453cdc1c6 on nch2-master-1 Jun 25 21:04:51.944070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5acfabc1-481e-4bf7-828a-e012b6625a7b req-42ab55a0-a914-4405-845e-b8b893e52508 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070217 Jun 25 21:04:51.945739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1830/3331] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:51.969973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:51.971511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:51.998025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:51.998551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:51.999379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:52.005899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:52.044581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:52.072021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba9c299d-54a6-4ce5-a2ca-051e56aeb717 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.359781 Jun 25 21:04:52.072671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1502/3332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:51 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:52.098794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:52.099623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:52.100313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lazy-loading 'fault' on Instance uuid c1f0d044-b411-49f2-9c19-971453cdc1c6 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:04:52.165800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '259fbe1886a644c28632dc5c8a3c3568', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2076d2f07d34d44b9431dc1e9e78e14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:52.175630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79934606-62ad-4be3-a898-10ca7a08abb4 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 200 len: 1304 microversion: 2.1 time: 0.227141 Jun 25 21:04:52.182670 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1831/3333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:51 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 1304 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:52.527420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:52.528845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:52.545529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:52.548346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:52.550503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:52.552916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:52.879365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:52.893103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0367faf-3267-4016-af1e-1e19797d428c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.379645 Jun 25 21:04:52.895423 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1503/3334] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:52 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:53.007310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b3a783b-c1d5-4914-a204-990d41e367e4 tempest-ListImageFiltersNegativeTestJSON-2126945038 tempest-ListImageFiltersNegativeTestJSON-2126945038-project] Calling method '.version_select at 0x7f984eb5da60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.031217 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7b3a783b-c1d5-4914-a204-990d41e367e4 tempest-ListImageFiltersNegativeTestJSON-2126945038 tempest-ListImageFiltersNegativeTestJSON-2126945038-project] HTTP exception thrown: Image not found. Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b3a783b-c1d5-4914-a204-990d41e367e4 tempest-ListImageFiltersNegativeTestJSON-2126945038 tempest-ListImageFiltersNegativeTestJSON-2126945038-project] Request method failure captured: Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/images/1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd HTTP/1.1 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3h0DQnR9_HJ7Omo-plyAnVHWRqlrf8isPyVfTxJYCHom0iV-YEUyLqv0U4BQ93etQAnOkMiplmW28sZvLfEOyG_RVCNvPA3k1sryRTjd39GKZDn8XryrsgWxU20LqFpYIYZctNLUqPMU2tRlmxQiVwQcmaTYG_0uuqcpFlh0mmh3kY Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 95fe24504ce84cd5a6436e591103af6c Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-2126945038 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/95fe24504ce84cd5a6436e591103af6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/95fe24504ce84cd5a6436e591103af6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_95fe24504ce84cd5a6436e591103af6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/95fe24504ce84cd5a6436e591103af6c"}]}] Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-2126945038 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 95fe24504ce84cd5a6436e591103af6c Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-2126945038 Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ListImageFiltersNegativeTestJSON-2126945038-project Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e4efda3eb68e444b8efdbdc10216e6bd Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-2126945038-project Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: exception: Image not found. Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd'} Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jun 25 21:04:53.033545 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd could not be found. Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jun 25 21:04:53.038367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.044838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b3a783b-c1d5-4914-a204-990d41e367e4 tempest-ListImageFiltersNegativeTestJSON-2126945038 tempest-ListImageFiltersNegativeTestJSON-2126945038-project] Returning 404 to user: Image not found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.052041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d1d0a092-cda9-40ff-8e9e-b5d6e0936ef3 req-43c50f97-f0c4-4a2e-a6e2-a386ee506565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-plugged", "status": "completed", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:53.058239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b3a783b-c1d5-4914-a204-990d41e367e4 tempest-ListImageFiltersNegativeTestJSON-2126945038 tempest-ListImageFiltersNegativeTestJSON-2126945038-project] 10.222.0.39 "GET /compute/v2.1/images/1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd" status: 404 len: 62 microversion: 2.1 time: 0.244441 Jun 25 21:04:53.062049 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1832/3335] 10.222.0.39 () {58 vars in 1232 bytes} [Sat Jun 25 21:04:52 2022] GET /compute/v2.1/images/1ec3a6ef-ac37-45b1-bedb-3a5a8f6097dd => generated 62 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:04:53.072348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d1d0a092-cda9-40ff-8e9e-b5d6e0936ef3 req-43c50f97-f0c4-4a2e-a6e2-a386ee506565 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.074407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d1d0a092-cda9-40ff-8e9e-b5d6e0936ef3 req-43c50f97-f0c4-4a2e-a6e2-a386ee506565 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.091594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.092597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.110345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.110798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.116144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.119187 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d1d0a092-cda9-40ff-8e9e-b5d6e0936ef3 req-43c50f97-f0c4-4a2e-a6e2-a386ee506565 service nova] Creating event network-vif-plugged:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:04:53.120635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.141958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d1d0a092-cda9-40ff-8e9e-b5d6e0936ef3 req-43c50f97-f0c4-4a2e-a6e2-a386ee506565 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095527 Jun 25 21:04:53.145909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1504/3336] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:53.202871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.204127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.219262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.222516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.222914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.223374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.249754 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 HTTP/1.1 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c1f0d044-b411-49f2-9c19-971453cdc1c6'} Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.252491 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.257342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.272867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.280300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ac4d210-cc7b-460f-967e-c2f878e06ea2 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 404 len: 111 microversion: 2.1 time: 0.077844 Jun 25 21:04:53.281136 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1505/3337] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.297803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.312955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.344303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.352063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.358578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.362980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.397615 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 HTTP/1.1 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c1f0d044-b411-49f2-9c19-971453cdc1c6'} Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.399437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.403923 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.405868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.407076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64e33192-3487-43c7-b552-073dc68bef7e tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 404 len: 111 microversion: 2.1 time: 0.116354 Jun 25 21:04:53.415632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:53.417443 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1506/3338] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:53 2022] DELETE /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.427196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.428087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1f0d044-b411-49f2-9c19-971453cdc1c6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.430605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:04:53.431254 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6cb36a6c-e9f9-439e-a84e-605451deab6b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1512 microversion: 2.1 time: 0.345818 Jun 25 21:04:53.436033 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1833/3339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:53.437260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.437896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.438846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.439474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.487921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 HTTP/1.1 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c1f0d044-b411-49f2-9c19-971453cdc1c6'} Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.491416 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1f0d044-b411-49f2-9c19-971453cdc1c6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d5feb92-25f2-4d5e-9840-27274222adff tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6" status: 404 len: 111 microversion: 2.1 time: 0.071816 Jun 25 21:04:53.496318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1507/3340] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/c1f0d044-b411-49f2-9c19-971453cdc1c6 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:53.506614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.507155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.519715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.521943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.522823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.523671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.541290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 HTTP/1.1 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c1c5eb40-ad52-46be-ab5c-9e1ada217b56'} Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.544160 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-087bbfc5-3610-4f35-9088-18d217afb8eb tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 404 len: 111 microversion: 2.1 time: 0.045895 Jun 25 21:04:53.548101 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1834/3341] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:53 2022] DELETE /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:53.554832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.555395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: c1c5eb40-ad52-46be-ab5c-9e1ada217b56] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.567130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.567879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.568724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.569630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.588846 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 HTTP/1.1 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c1c5eb40-ad52-46be-ab5c-9e1ada217b56'} Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.591377 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. Jun 25 21:04:53.596173 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.597592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance c1c5eb40-ad52-46be-ab5c-9e1ada217b56 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.599071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee315c41-9c1d-44e1-bb01-bab9e414fa72 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56" status: 404 len: 111 microversion: 2.1 time: 0.048456 Jun 25 21:04:53.600139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1508/3342] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/c1c5eb40-ad52-46be-ab5c-9e1ada217b56 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.611696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ae48e8ac-7d8f-4669-9c0c-4026f3e4a3f2 req-cff1cac6-dfc3-4f21-b626-8a8bd7f50f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:53.613194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.614918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.623776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ae48e8ac-7d8f-4669-9c0c-4026f3e4a3f2 req-cff1cac6-dfc3-4f21-b626-8a8bd7f50f65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.624232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ae48e8ac-7d8f-4669-9c0c-4026f3e4a3f2 req-cff1cac6-dfc3-4f21-b626-8a8bd7f50f65 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.629643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.631817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.632795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.633452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.639918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ae48e8ac-7d8f-4669-9c0c-4026f3e4a3f2 req-cff1cac6-dfc3-4f21-b626-8a8bd7f50f65 service nova] Creating event network-changed:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch1-master-1 Jun 25 21:04:53.648417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ae48e8ac-7d8f-4669-9c0c-4026f3e4a3f2 req-cff1cac6-dfc3-4f21-b626-8a8bd7f50f65 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041901 Jun 25 21:04:53.649538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1835/3343] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:53.655412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 HTTP/1.1 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '01c803ec-b4b8-4e7f-abb4-0729fafb8747'} Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.657871 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.661695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.664213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.665141 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ad205a8-5998-4f65-b330-9bf0e72bb962 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 404 len: 111 microversion: 2.1 time: 0.060962 Jun 25 21:04:53.666228 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1509/3344] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:53 2022] DELETE /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.677660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.678632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 01c803ec-b4b8-4e7f-abb4-0729fafb8747] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.691507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.695905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.696818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.697268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.734303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 HTTP/1.1 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '01c803ec-b4b8-4e7f-abb4-0729fafb8747'} Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.736058 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 01c803ec-b4b8-4e7f-abb4-0729fafb8747 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8c2f625-e2a4-4d06-86f5-f7468a2942ee tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747" status: 404 len: 111 microversion: 2.1 time: 0.066680 Jun 25 21:04:53.744015 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1836/3345] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/01c803ec-b4b8-4e7f-abb4-0729fafb8747 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.752982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.753814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.763142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.765793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.766893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.767507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.786653 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d HTTP/1.1 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '17a04f94-7a5c-4ddd-9702-de720634c98d'} Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.788697 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.793192 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.795429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.796918 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a6d8ef6a-55ed-4352-8f84-800cb54c391c tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 404 len: 111 microversion: 2.1 time: 0.048780 Jun 25 21:04:53.809333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.809333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 17a04f94-7a5c-4ddd-9702-de720634c98d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.816469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1510/3346] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:53 2022] DELETE /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.818305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.818954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.819920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.820535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.837791 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d HTTP/1.1 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '17a04f94-7a5c-4ddd-9702-de720634c98d'} Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.839362 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 17a04f94-7a5c-4ddd-9702-de720634c98d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bae318a-57df-44bf-9cd0-6d59a01af293 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d" status: 404 len: 111 microversion: 2.1 time: 0.039964 Jun 25 21:04:53.844335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1837/3347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/17a04f94-7a5c-4ddd-9702-de720634c98d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:53.850816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.851342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.867301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.868108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.869121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.869952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.896459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e HTTP/1.1 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '208e5ac3-fb1b-4b65-a587-c87e366c7c9e'} Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.899098 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.902833 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.905446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.906419 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-412e69ee-77e3-4c55-9734-1b91f6183c27 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e" status: 404 len: 111 microversion: 2.1 time: 0.059746 Jun 25 21:04:53.907072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1511/3348] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:53 2022] DELETE /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:53.913781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.914394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.917089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:53.917970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 208e5ac3-fb1b-4b65-a587-c87e366c7c9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:53.927509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.927770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.928414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.929279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.929731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.931993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.932873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:53.933326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:53.962952 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e HTTP/1.1 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '208e5ac3-fb1b-4b65-a587-c87e366c7c9e'} Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:53.964956 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 208e5ac3-fb1b-4b65-a587-c87e366c7c9e could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d40e9b95-d187-4785-8612-2d54127e6e7d tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e" status: 404 len: 111 microversion: 2.1 time: 0.053849 Jun 25 21:04:53.969927 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1512/3349] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/208e5ac3-fb1b-4b65-a587-c87e366c7c9e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:54.259966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:54.270755 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4648d27b-5333-47da-a122-fc35984aa98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.363103 Jun 25 21:04:54.272140 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1838/3350] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:53 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:54.454958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:54.455726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:54.469855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.470695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.471808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.472324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.701651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:54.711458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dbd922b1-2f3d-452d-8f23-80947023da77 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1489 microversion: 2.1 time: 0.261572 Jun 25 21:04:54.712262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1513/3351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:54 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1489 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:54.729858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:54.730918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:54.737731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.738187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.739381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.739991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.794996 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09907804-3947-4a82-946a-4477598a4a7e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 200 len: 115 microversion: 2.1 time: 0.069330 Jun 25 21:04:54.799898 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1839/3352] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:04:54 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 115 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:04:54.805783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:54.806649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:54.814865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.815378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.816214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:54.816872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:54.973994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:54.985250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef93d53c-a4ec-4690-bb7b-839eb3c78917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.182840 Jun 25 21:04:54.986770 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1514/3353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:54 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:55.013244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.014157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.025052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.025690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.026858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.027525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.195398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.196058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.203438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.204178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.205297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.205791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c HTTP/1.1 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4f130496-e0ba-47fb-a347-f26f1100ec2c'} Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:55.226985 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:55.230924 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a86d84c-cb22-48ca-9d62-dab2d568f5e0 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 404 len: 111 microversion: 2.1 time: 0.036757 Jun 25 21:04:55.234515 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1515/3354] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:55 2022] DELETE /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:04:55.238770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.239467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 4f130496-e0ba-47fb-a347-f26f1100ec2c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.245920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.246437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.247654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.248735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.267201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c HTTP/1.1 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4f130496-e0ba-47fb-a347-f26f1100ec2c'} Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.269077 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 4f130496-e0ba-47fb-a347-f26f1100ec2c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:55.274210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7c8ba65e-2deb-4728-ab27-665ac03aa149 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c" status: 404 len: 111 microversion: 2.1 time: 0.037498 Jun 25 21:04:55.274969 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1516/3355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/4f130496-e0ba-47fb-a347-f26f1100ec2c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:55.279963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.280881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.288042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.288529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.289469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.289914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.299530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:55.309319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67e16ca3-74df-41be-bf4c-00966243981d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.301222 Jun 25 21:04:55.316891 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 HTTP/1.1 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '86255422-6b4c-4316-add7-40685858aba3'} Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:55.319045 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.324164 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.325521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1840/3356] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:55.326438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:55.327811 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40d4f2ad-43aa-4e0b-9967-7d1327711a77 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "DELETE /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 404 len: 111 microversion: 2.1 time: 0.052277 Jun 25 21:04:55.327944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.328564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.329459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1517/3357] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:04:55 2022] DELETE /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:55.337858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.338088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.338625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.339112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.340746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.341865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.346060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.346523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.347416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.348707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.646989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:55.656156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ccde1bb7-ef8b-4c4c-b1da-29536e49c27c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.324629 Jun 25 21:04:55.657395 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1518/3358] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:55.662330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.663037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] [instance: 86255422-6b4c-4316-add7-40685858aba3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.668320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:55.670354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.671117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.672130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.672824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.682967 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7449ccad-2573-4036-81ff-7afc1ce599dd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.360402 Jun 25 21:04:55.683582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1841/3359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:55.689237 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] HTTP exception thrown: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.690775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:55.691407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Request method failure captured: Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 HTTP/1.1 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dbQuuxDkn3AChpVfcVZDkcs_43WLwwtq86ywvoODaUWhbyoN-kDefhgKB8tqsnxe-IjadXJe9bkI_NnWMRp8EnFOf_czsHU76ugujGw_y9u7uFwh2nNrMOIGTlMO6o_k1xh66bO8gVxqwpIvCGlejS3Y97EFVQRFGI_B7c1Bv44jk Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e2076d2f07d34d44b9431dc1e9e78e14"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e2076d2f07d34d44b9431dc1e9e78e14"}]}] Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e2076d2f07d34d44b9431dc1e9e78e14 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1854442856 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 259fbe1886a644c28632dc5c8a3c3568 Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1854442856-project Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '86255422-6b4c-4316-add7-40685858aba3'} Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:04:55.692256 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. Jun 25 21:04:55.696161 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:04:55.698270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] Returning 404 to user: Instance 86255422-6b4c-4316-add7-40685858aba3 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:04:55.699249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.699401 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-185b4eca-9bf2-49f6-a070-78d56f0a7155 tempest-DeleteServersTestJSON-1854442856 tempest-DeleteServersTestJSON-1854442856-project] 10.222.0.39 "GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3" status: 404 len: 111 microversion: 2.1 time: 0.040715 Jun 25 21:04:55.699961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:55.700671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1519/3360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/86255422-6b4c-4316-add7-40685858aba3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:04:55.701067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:55.701555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:56.118951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:56.126983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ac2d96f-a724-4216-8592-d247652017d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.442393 Jun 25 21:04:56.127572 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1842/3361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:55 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:56.235532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-905142978", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:04:56.293134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] validate_networks() for [('4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:04:56.678246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:04:56.678731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:04:56.679330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:04:56.679825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:04:56.680265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:04:56.689845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:56.690536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:56.691345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:56.692549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:56.700258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:56.700991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:56.707914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:56.708506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:56.709440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:56.709908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:56.712831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:04:56.719927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:04:56.734041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:04:56.736608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:04:56.782822 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b8920f7-64e0-4c9f-b48c-d7e5d3a90d32 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551509 Jun 25 21:04:56.783742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1520/3362] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:04:56.794995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7fc68ccb-820f-4678-9856-b938f4bdd5bd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:56.796119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7fc68ccb-820f-4678-9856-b938f4bdd5bd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:56.873753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7fc68ccb-820f-4678-9856-b938f4bdd5bd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:56.886010 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7fc68ccb-820f-4678-9856-b938f4bdd5bd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1214 microversion: 2.1 time: 0.095374 Jun 25 21:04:56.887613 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1521/3363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:56 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:57.141871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:57.158756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58e96521-f357-4813-b205-297463c00f22 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.461246 Jun 25 21:04:57.161170 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1843/3364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:56 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:57.903999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:57.904678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:57.921859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:57.922542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:57.923868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:57.927443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:58.178062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:58.178620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:58.196928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:58.197505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:58.198326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:58.198795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:58.402513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:58.426482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-877e7d6e-e89e-4929-9449-44d63bbd74b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1266 microversion: 2.1 time: 0.526905 Jun 25 21:04:58.427447 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1522/3365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:57 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1266 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:58.732250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:58.746782 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d64212ce-e7b3-4713-b4db-615960959410 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.574364 Jun 25 21:04:58.748938 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1844/3366] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:58 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:04:59.444740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:59.446096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:59.455643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:59.456286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:59.457291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:59.457891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:59.648196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:04:59.669075 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2660cb60-5d95-45de-96d6-b9dcfdeb2cc2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1272 microversion: 2.1 time: 0.224674 Jun 25 21:04:59.679760 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1523/3367] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:59 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1272 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:04:59.765392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:04:59.766211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:04:59.782623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:59.783205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:04:59.784125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:04:59.785760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:00.366510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:00.378846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6455b1ab-e2ca-4b63-a907-e952ca79e367 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.619282 Jun 25 21:05:00.379473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1845/3368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:04:59 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:00.688208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:00.689041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:00.716941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:00.717841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:00.718723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:00.719204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:01.194902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:01.196334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-440ca5ff-55f2-462c-9a87-f4b437a904a7 req-800f1ae4-262b-4e2f-8490-1b3af876376c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "name": "network-vif-plugged", "status": "completed", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:01.206441 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b7a95d4-dfda-48d5-8b83-fca15b92ba82 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.523525 Jun 25 21:05:01.208646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1524/3369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:00 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:01.222077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-440ca5ff-55f2-462c-9a87-f4b437a904a7 req-800f1ae4-262b-4e2f-8490-1b3af876376c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:01.222520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-440ca5ff-55f2-462c-9a87-f4b437a904a7 req-800f1ae4-262b-4e2f-8490-1b3af876376c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:01.252728 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-440ca5ff-55f2-462c-9a87-f4b437a904a7 req-800f1ae4-262b-4e2f-8490-1b3af876376c service nova] Creating event network-vif-plugged:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch1-master-1 Jun 25 21:05:01.261414 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-440ca5ff-55f2-462c-9a87-f4b437a904a7 req-800f1ae4-262b-4e2f-8490-1b3af876376c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068617 Jun 25 21:05:01.262855 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1846/3370] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:05:01.399167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:01.399814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:01.409063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:01.409523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:01.413556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:01.415331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:01.846819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:01.861117 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-514d20fd-fa74-4199-a258-c5fbb5a26db2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.469591 Jun 25 21:05:01.871265 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1525/3371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:01 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:02.226712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:02.227571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:02.239049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:02.239883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:02.240958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:02.241635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:02.878463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:02.879845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:02.893012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:02.900797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:02.901873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:02.902477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:03.111012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:03.125050 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73a6483a-873b-4db4-890c-3dc32eada22b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.902740 Jun 25 21:05:03.127447 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1847/3372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:02 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:03.328122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:03.342334 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7ff2b7b-01e4-4600-894b-b97f12580f9e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1313 microversion: 2.1 time: 0.467962 Jun 25 21:05:03.342954 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1526/3373] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:02 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:03.496323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-32eb5168-1162-4ec0-85e4-e0899e79de36 req-35342ec5-5794-4d11-a424-d1f9fa6961af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6755692c-81cd-4719-af0a-424a7ae0e2b9", "tag": "afece301-cf9e-4ea4-9fd3-f2ce342f225f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:03.540786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-32eb5168-1162-4ec0-85e4-e0899e79de36 req-35342ec5-5794-4d11-a424-d1f9fa6961af service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:03.542128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-32eb5168-1162-4ec0-85e4-e0899e79de36 req-35342ec5-5794-4d11-a424-d1f9fa6961af service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:03.565740 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-32eb5168-1162-4ec0-85e4-e0899e79de36 req-35342ec5-5794-4d11-a424-d1f9fa6961af service nova] Creating event network-changed:afece301-cf9e-4ea4-9fd3-f2ce342f225f for instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 on nch2-master-1 Jun 25 21:05:03.577633 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-32eb5168-1162-4ec0-85e4-e0899e79de36 req-35342ec5-5794-4d11-a424-d1f9fa6961af service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090663 Jun 25 21:05:03.578279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1848/3374] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:04.144588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:04.145956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:04.160652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.161119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:04.161918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.162363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:04.196485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:04.360225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:04.361211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:04.368222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.369122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:04.369908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.370346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:04.423791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:04.431893 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-579e8a53-a2aa-4af5-b179-a72a089d34bc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.292802 Jun 25 21:05:04.432389 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1527/3375] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:04 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:04.915647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:04.926184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a743c359-0a8b-442b-bb8f-4d2aa58e725b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1463 microversion: 2.1 time: 0.570514 Jun 25 21:05:04.927032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1849/3376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:04 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1463 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:04.943096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:04.943997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:04.950560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.951299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:04.952256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:04.952936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.129145 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2fdbd2c-7609-493c-96c7-c69027c0047f tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1614 microversion: 2.1 time: 0.189637 Jun 25 21:05:05.130919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1528/3377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:04 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1614 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:05.147256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:05.148307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:05.158511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.159474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.160905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.161744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.208816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:05.345405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f6e3d3212ab942feb30bae5b2fd9885d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e758e68d8094b8bb4d528182ef10a3a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:05.346528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] flavor_id is None. Assuming migration. {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 25 21:05:05.347571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:05:05.462534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:05.468025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:05.508053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.509007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.510386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.511216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.762340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:05.775290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71b6634e-20bd-4a9b-9499-719c224c352d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.325623 Jun 25 21:05:05.781120 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1529/3378] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:05 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:05.890278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d63db188-2aff-4712-bff1-f6e7f6f737e7 tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01/action" status: 202 len: 0 microversion: 2.1 time: 0.746893 Jun 25 21:05:05.890919 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1850/3379] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:05 2022] POST /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:05.899392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:05.900069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:05.906467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.907226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:05.908207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:05.908866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:06.065542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:06.073594 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd1f219f-1f12-4a87-b85e-16fb172a8458 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1472 microversion: 2.1 time: 0.178258 Jun 25 21:05:06.084342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1530/3380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:05 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:06.802276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:06.803054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:06.818699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:06.819569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:06.820638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:06.823726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:07.091570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:07.092273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:07.098380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:07.099754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=16 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:07.102637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:07.103212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:07.104089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:07.104715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:07.304268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:07.318621 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77ae3587-0d9c-4b35-9275-ee50081f65b3 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1472 microversion: 2.1 time: 0.231360 Jun 25 21:05:07.332123 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1531/3381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:07 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:07.414937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:07.426520 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bec4687c-f9a8-45b9-be32-1d601847b67d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.632895 Jun 25 21:05:07.428626 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1851/3382] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:06 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:07.583652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1d61873-5bd7-4b62-9c3c-d6cc3e69733e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f9861f24dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1070133815", "description": "tempest-description-1104298609"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:07.871545 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d1d61873-5bd7-4b62-9c3c-d6cc3e69733e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.361142 Jun 25 21:05:07.873125 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1532/3383] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:05:07 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:07.887179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b5d66e6b-34a1-4d31-a956-0bddb14b749f tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f984ebb0280>, body: {"security_group_rule": {"parent_group_id": "04e31ded-dc66-4d19-b1c1-5b99085fef23", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:08.338587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:08.341405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:08.363115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:08.363893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:08.365000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:08.365602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:09.047061 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b5d66e6b-34a1-4d31-a956-0bddb14b749f tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.166529 Jun 25 21:05:09.047694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1852/3384] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:07 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:05:09.066458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:09.081516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3178fe0-a38a-4bca-8cd9-ccf3cec09d9a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1472 microversion: 2.1 time: 0.748089 Jun 25 21:05:09.082131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1533/3385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:08 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1472 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:09.099618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bc53c2f-ec19-4b1c-8a2d-de5344f2c3e0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985c520280>, body: {"security_group_rule": {"parent_group_id": "04e31ded-dc66-4d19-b1c1-5b99085fef23", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:09.224371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0bc53c2f-ec19-4b1c-8a2d-de5344f2c3e0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bc53c2f-ec19-4b1c-8a2d-de5344f2c3e0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 138 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "04e31ded-dc66-4d19-b1c1-5b99085fef23", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: exception: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': '04e31ded-dc66-4d19-b1c1-5b99085fef23', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:09.226403 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bc53c2f-ec19-4b1c-8a2d-de5344f2c3e0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: This rule already exists in group 04e31ded-dc66-4d19-b1c1-5b99085fef23 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bc53c2f-ec19-4b1c-8a2d-de5344f2c3e0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.132452 Jun 25 21:05:09.231858 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1534/3386] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:09 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:09.241015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0622c022-82fd-4db1-9558-0bfac09346a8 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f985c31e5e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:09.354617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:09.355293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:09.369663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:09.370231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:09.371105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:09.371619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:09.723879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:09.739216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7434d865-f508-4212-b52b-c1cf9d33778e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.689650 Jun 25 21:05:09.742298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1853/3387] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:09 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:09.775377 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0622c022-82fd-4db1-9558-0bfac09346a8 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/d4ad5f77-13d0-4722-ae0b-e938f6a0f1e5" status: 202 len: 0 microversion: 2.1 time: 0.541826 Jun 25 21:05:09.776416 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1535/3388] 10.222.0.39 () {58 vars in 1286 bytes} [Sat Jun 25 21:05:09 2022] DELETE /compute/v2.1/os-security-group-rules/d4ad5f77-13d0-4722-ae0b-e938f6a0f1e5 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:09.788675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4c3909f-1679-4926-8bc7-018d69b7be5e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f984ebb0e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-770021968", "description": "tempest-description-856700905"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:10.100446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:10.101512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:10.109311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.110130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.111165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.111831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.291477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:10.301904 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d496886-6623-458d-9975-0844b9f2607a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.206288 Jun 25 21:05:10.303488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1536/3389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:10 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:10.662688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4c3909f-1679-4926-8bc7-018d69b7be5e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.878411 Jun 25 21:05:10.663530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1854/3390] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:05:09 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:10.674980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e0c6ae9-e480-43a0-9b91-5d7d6228ac32 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f984f6139d0>, body: {"security_group_rule": {"parent_group_id": "a1e536ef-9ecb-4e9a-b633-b9762941bf31", "ip_protocol": "tcp", "from_port": 1761275595, "to_port": 22}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:10.757106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:10.758068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:10.778964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.780398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.783620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.785199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.809021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6e0c6ae9-e480-43a0-9b91-5d7d6228ac32 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Invalid port range 1761275595:22. Former value cannot be greater than the later Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e0c6ae9-e480-43a0-9b91-5d7d6228ac32 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 146 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "a1e536ef-9ecb-4e9a-b633-b9762941bf31", "ip_protocol": "tcp", "from_port": 1761275595, "to_port": 22}} Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid port range 1761275595:22. Former value cannot be greater than the later Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a1e536ef-9ecb-4e9a-b633-b9762941bf31', 'ip_protocol': 'tcp', 'from_port': 1761275595, 'to_port': 22}}} Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1761275595:22. Former value cannot be greater than the later Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1761275595:22. Former value cannot be greater than the later Jun 25 21:05:10.810642 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1761275595:22. Former value cannot be greater than the later Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e0c6ae9-e480-43a0-9b91-5d7d6228ac32 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: Invalid port range 1761275595:22. Former value cannot be greater than the later {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e0c6ae9-e480-43a0-9b91-5d7d6228ac32 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.141150 Jun 25 21:05:10.815287 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1537/3391] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:10 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:10.835071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca0ee1ba-6e4d-44c5-9f2e-89fa051ef926 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985c85c820>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1230972590", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:10.836906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ca0ee1ba-6e4d-44c5-9f2e-89fa051ef926 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Security group id should be uuid Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca0ee1ba-6e4d-44c5-9f2e-89fa051ef926 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 131 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1230972590", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group id should be uuid Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1230972590', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:10.839230 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:10.844411 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jun 25 21:05:10.844411 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:10.844411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca0ee1ba-6e4d-44c5-9f2e-89fa051ef926 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: Security group id should be uuid {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:10.844907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca0ee1ba-6e4d-44c5-9f2e-89fa051ef926 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.013700 Jun 25 21:05:10.851320 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1538/3392] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:10.856557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:10.860091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:10.860947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Searching by: {'deleted': False, 'project_id': '9a930bf73f9845e6b079820ec7b14906'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:05:10.866801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.867267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.868094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:10.868603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:10.908683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:05:10.948685 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b1c50c1-17bf-42d2-bcb5-96a0f61d4431 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.096105 Jun 25 21:05:10.949668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1539/3393] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:05:10 2022] GET /compute/v2.1/servers => generated 339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:10.959626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69f2062a-89cd-4ff7-9acd-a4dfd41e0cc0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f9861eb48b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-187201374", "description": "tempest-description-891781475"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:11.167212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:11.176288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c693a09-7f38-4a30-b5ee-2b0992194d52 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.424876 Jun 25 21:05:11.181615 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1855/3394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:10 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:11.186840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:11.200880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:11.202417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Searching by: {'deleted': False, 'project_id': '9a930bf73f9845e6b079820ec7b14906'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:05:11.211472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:11.211931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:11.212765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:11.213195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:11.252525 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69f2062a-89cd-4ff7-9acd-a4dfd41e0cc0 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.301590 Jun 25 21:05:11.259907 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1540/3395] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:05:10 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:11.266787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e17daa7-ba96-4f5d-9156-d231f2923c1e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985ca9d0d0>, body: {"security_group_rule": {"parent_group_id": "13f594d5-4d9b-4631-ba3e-fd19b45d7807", "ip_protocol": "tempest-999-1188920658", "from_port": 22, "to_port": 22}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:11.273248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:05:11.331746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0e17daa7-ba96-4f5d-9156-d231f2923c1e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Invalid IP protocol tempest-999-1188920658. Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e17daa7-ba96-4f5d-9156-d231f2923c1e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 157 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "13f594d5-4d9b-4631-ba3e-fd19b45d7807", "ip_protocol": "tempest-999-1188920658", "from_port": 22, "to_port": 22}} Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid IP protocol tempest-999-1188920658. Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': '13f594d5-4d9b-4631-ba3e-fd19b45d7807', 'ip_protocol': 'tempest-999-1188920658', 'from_port': 22, 'to_port': 22}}} Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1188920658. Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1188920658. Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.333831 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1188920658. Jun 25 21:05:11.338305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.340277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e17daa7-ba96-4f5d-9156-d231f2923c1e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: Invalid IP protocol tempest-999-1188920658. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:11.341370 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e17daa7-ba96-4f5d-9156-d231f2923c1e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.079449 Jun 25 21:05:11.342432 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1541/3396] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:11 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 21:05:11.349981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:11.351474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:11.352369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:11.357972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:11.358479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:11.361439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:11.362103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:11.363071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:11.363662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:11.520794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:11.531579 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-934fa11b-a8f6-4c24-8b95-87393f5a3ae9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.187823 Jun 25 21:05:11.532747 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1542/3397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:11 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:11.539281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e40694e-61d7-40d2-a905-5c05db2cf215 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985c85c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-912088968", "description": "tempest-description-263387204"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:11.661590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dfcf7bca-b891-4f3e-8b23-810337f0e803 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.478464 Jun 25 21:05:11.663572 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1856/3398] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:05:11 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:11.681572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35cdaffa-d96e-4e3b-9bea-23bd8a781a75 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:11.690599 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35cdaffa-d96e-4e3b-9bea-23bd8a781a75 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013682 Jun 25 21:05:11.691482 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1857/3399] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:05:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:05:11.740447 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e40694e-61d7-40d2-a905-5c05db2cf215 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.206048 Jun 25 21:05:11.741492 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1543/3400] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:05:11 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:11.758904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4815ba04-fb29-4298-bf30-d95e2cfb38df tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f984eb60e50>, body: {"security_group_rule": {"parent_group_id": "487b994d-2d9b-4957-ab76-2c126cfbcff0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:11.920408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4815ba04-fb29-4298-bf30-d95e2cfb38df tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4815ba04-fb29-4298-bf30-d95e2cfb38df tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 138 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: {"security_group_rule": {"parent_group_id": "487b994d-2d9b-4957-ab76-2c126cfbcff0", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'security_group_rule': {'parent_group_id': '487b994d-2d9b-4957-ab76-2c126cfbcff0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jun 25 21:05:11.922152 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4815ba04-fb29-4298-bf30-d95e2cfb38df tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4815ba04-fb29-4298-bf30-d95e2cfb38df tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.168795 Jun 25 21:05:11.926632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1858/3401] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:11 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:11.935513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acce187a-384a-4ce8-a08d-ef432ffbca2e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985c785a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1352354475", "description": "tempest-description-1852241066"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:12.027407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:12.028761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:12.049025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.049633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.050552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.051253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.123515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:05:12.241790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d476290f-0a15-4c13-a951-d0f76ee8f083 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "DELETE /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 204 len: 0 microversion: 2.1 time: 0.219433 Jun 25 21:05:12.243452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1859/3402] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:05:12 2022] DELETE /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:05:12.252541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-92d9db67-66d2-426f-b6df-a35391d69e7a req-bbb5b7cf-f322-437d-baa9-04ec6e7a254f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755692c-81cd-4719-af0a-424a7ae0e2b9", "name": "network-vif-plugged", "status": "completed", "tag": "afece301-cf9e-4ea4-9fd3-f2ce342f225f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:12.262612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-92d9db67-66d2-426f-b6df-a35391d69e7a req-bbb5b7cf-f322-437d-baa9-04ec6e7a254f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.263399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-92d9db67-66d2-426f-b6df-a35391d69e7a req-bbb5b7cf-f322-437d-baa9-04ec6e7a254f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.277800 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-92d9db67-66d2-426f-b6df-a35391d69e7a req-bbb5b7cf-f322-437d-baa9-04ec6e7a254f service nova] Creating event network-vif-plugged:afece301-cf9e-4ea4-9fd3-f2ce342f225f for instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 on nch2-master-1 Jun 25 21:05:12.283858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-92d9db67-66d2-426f-b6df-a35391d69e7a req-bbb5b7cf-f322-437d-baa9-04ec6e7a254f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038726 Jun 25 21:05:12.285092 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1860/3403] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:12.291643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:12.292621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:12.303758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.304637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.305609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.306212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.360906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-acce187a-384a-4ce8-a08d-ef432ffbca2e tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.429271 Jun 25 21:05:12.361764 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1544/3404] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:05:11 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:12.367274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:12.368618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:12.387030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.387715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.388523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.389141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.664013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:12.679901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-11a7f79d-a0ad-40ac-9e1b-f0688c97953a tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1714 microversion: 2.1 time: 0.316832 Jun 25 21:05:12.691511 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1545/3405] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:12 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1714 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:12.699627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04dfe203-431c-4be2-abb0-23a1cbf194e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985ca9d3a0>, body: {"security_group_rule": {"parent_group_id": "fe92ba28-c73b-4c36-aea5-e16ef60ab760", "ip_protocol": "tcp", "from_port": 22, "to_port": 133625161}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:12.802096 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-04dfe203-431c-4be2-abb0-23a1cbf194e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04dfe203-431c-4be2-abb0-23a1cbf194e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 145 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "fe92ba28-c73b-4c36-aea5-e16ef60ab760", "ip_protocol": "tcp", "from_port": 22, "to_port": 133625161}} Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fe92ba28-c73b-4c36-aea5-e16ef60ab760', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 133625161}}} Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 Jun 25 21:05:12.805217 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 Jun 25 21:05:12.810091 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:12.816974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04dfe203-431c-4be2-abb0-23a1cbf194e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 400 to user: Invalid port range 22:133625161. Valid TCP ports should be between 1-65535 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:12.818354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04dfe203-431c-4be2-abb0-23a1cbf194e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.125344 Jun 25 21:05:12.827792 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1546/3406] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:12 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:12.834320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:12.835913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:12.846356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.847069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.848991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.850329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.950799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:12.959537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-028751c5-2c93-4e40-9ffb-9afc0ad37b96 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.673097 Jun 25 21:05:12.960367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1861/3407] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:12 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:12.966229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "070f896c-fc3e-40df-8fe0-538d88646485"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:12.967541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:12.976114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.977410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:12.979352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:12.980138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:13.090150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:13.101786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-62941cc0-355d-4c46-824e-0aa646d59c95 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.272240 Jun 25 21:05:13.102431 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1547/3408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:12 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:13.110028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Action: 'create', calling method: .version_select at 0x7f985c31ec10>, body: {"security_group_rule": {"parent_group_id": "664cf43b-1775-46e5-ac3d-c6adff7b32b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:13.162170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:05:13.163522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Neutron security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 not found {{(pid=137462) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:05:13.164222 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.164222 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 138 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: {"security_group_rule": {"parent_group_id": "664cf43b-1775-46e5-ac3d-c6adff7b32b3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'security_group_rule': {'parent_group_id': '664cf43b-1775-46e5-ac3d-c6adff7b32b3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:05:13.168062 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] Jun 25 21:05:13.172757 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.181395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 404 to user: Security group 664cf43b-1775-46e5-ac3d-c6adff7b32b3 does not exist Jun 25 21:05:13.181395 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-e9c8e446-99a9-4916-aa10-9cd5867f7a19'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:13.181395 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf7d59ab-fafb-4cbe-bbf8-18c645cfcf30 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.069462 Jun 25 21:05:13.181395 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1548/3409] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:05:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:05:13.186167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f985c785ca0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:13.258744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG neutronclient.v2_0.client [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist", "detail": ""}} {{(pid=137462) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:05:13.259356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Neutron security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c not found {{(pid=137462) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jun 25 21:05:13.261144 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] HTTP exception thrown: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.261144 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Request method failure captured: Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-security-group-rules/8e1bd8bb-a889-4481-9eeb-0d464e925b1c HTTP/1.1 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iDP_GlT-SeEGaMEcCxdqXHnLk2WQyGVQA8fNd_NFf7Dlxv6G-GY8sTalPBF_9-uWIthOMvZo76mwzlNJhWPtjSflhMe9tWIcP5j3aF1ubULySmDUjbPopFqdzPdH8gLLObSIHHOa6PZwCGGSC1wF9Zhds0EylTTionQASKn__SqUA Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_455d6b7ba6994dd3ad89208b9856bad6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/455d6b7ba6994dd3ad89208b9856bad6"}]}] Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 455d6b7ba6994dd3ad89208b9856bad6 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e16ebf76a8644979b53d2d8fe5ffa688 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-530993624-project Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: exception: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8e1bd8bb-a889-4481-9eeb-0d464e925b1c'} Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:05:13.265739 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] Jun 25 21:05:13.270268 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:13.276070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Returning 404 to user: Security group rule 8e1bd8bb-a889-4481-9eeb-0d464e925b1c does not exist Jun 25 21:05:13.276070 ncdv-master-1 devstack@n-api.service[137462]: Neutron server returns request_ids: ['req-09c00af2-29db-411c-9efd-7f9258245357'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:13.279006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc15ca2c-0750-4c4a-87e0-93ecdfae3be6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/8e1bd8bb-a889-4481-9eeb-0d464e925b1c" status: 404 len: 199 microversion: 2.1 time: 0.097334 Jun 25 21:05:13.280389 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1549/3410] 10.222.0.39 () {58 vars in 1286 bytes} [Sat Jun 25 21:05:13 2022] DELETE /compute/v2.1/os-security-group-rules/8e1bd8bb-a889-4481-9eeb-0d464e925b1c => generated 199 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:05:13.295036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c14e97b-a1e5-4672-9d3a-b438f8d53d15 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f985c31ec10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:13.490076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83727b5f-eac9-49c2-8054-229dffcd0d3f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.528033 Jun 25 21:05:13.492744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1862/3411] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:05:12 2022] POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments => generated 194 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:13.699231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:13.700311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:13.704464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:13.709511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:13.710817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:13.711950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:13.712985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:13.981922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:13.993232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-03d4d55c-56e5-4d35-b817-2349188c77bd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1714 microversion: 2.1 time: 0.298677 Jun 25 21:05:13.993854 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1863/3412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:13 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1714 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:14.008780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:14.009409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:14.018161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:14.018674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:14.024095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:14.024510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:14.269641 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c14e97b-a1e5-4672-9d3a-b438f8d53d15 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/fe92ba28-c73b-4c36-aea5-e16ef60ab760" status: 202 len: 0 microversion: 2.1 time: 0.983820 Jun 25 21:05:14.273450 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1550/3413] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:05:13 2022] DELETE /compute/v2.1/os-security-groups/fe92ba28-c73b-4c36-aea5-e16ef60ab760 => generated 0 bytes in 985 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:14.275495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:14.276219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:14.287716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:14.294741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:14.295784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:14.296410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:14.388894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:14.397253 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6e8c41d-c6b1-47ca-8968-b5d952616266 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1314 microversion: 2.1 time: 0.402174 Jun 25 21:05:14.401085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1864/3414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:13 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:14.427039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4490c20f-6a49-494b-9dcd-51aed46ef1b1 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f98620c6ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:14.821236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4490c20f-6a49-494b-9dcd-51aed46ef1b1 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/487b994d-2d9b-4957-ab76-2c126cfbcff0" status: 202 len: 0 microversion: 2.1 time: 0.417839 Jun 25 21:05:14.824593 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1865/3415] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:05:14 2022] DELETE /compute/v2.1/os-security-groups/487b994d-2d9b-4957-ab76-2c126cfbcff0 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:14.834091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86fbe68d-3caf-4cd6-94b2-89bcebe045c8 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f984f505ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:14.944459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:14.956286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-edc5d7f7-b0ad-4e56-9059-6681d0276444 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.684629 Jun 25 21:05:14.957488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1551/3416] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:14 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:15.021723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:15.026380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:15.041865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.042598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.043572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.045553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.462540 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86fbe68d-3caf-4cd6-94b2-89bcebe045c8 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/13f594d5-4d9b-4631-ba3e-fd19b45d7807" status: 202 len: 0 microversion: 2.1 time: 0.636612 Jun 25 21:05:15.466854 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1866/3417] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:05:14 2022] DELETE /compute/v2.1/os-security-groups/13f594d5-4d9b-4631-ba3e-fd19b45d7807 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:15.479043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:15.479803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:15.480778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:15.493494 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47ca70c2-9cb5-42f6-a4a5-7a69ed3d4118 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1714 microversion: 2.1 time: 0.486579 Jun 25 21:05:15.494315 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1552/3418] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:15 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1714 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:15.509064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-194b8d82-bd40-44bf-868d-93f9347cc6e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f985c2f0670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:15.521546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.523255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.526354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.526889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.829681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:15.842642 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de61b2f2-9914-4006-beb6-03e3355d1073 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1500 microversion: 2.1 time: 0.376744 Jun 25 21:05:15.847211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1867/3419] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:15 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1500 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:15.863673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:15.865503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:15.873940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.874899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.875931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.876546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.882076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:15.956012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-15a1e09e-6fb5-4172-8c22-44214a2a2e13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.096362 Jun 25 21:05:15.960512 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1868/3420] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:15 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:15.973027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-194b8d82-bd40-44bf-868d-93f9347cc6e6 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/a1e536ef-9ecb-4e9a-b633-b9762941bf31" status: 202 len: 0 microversion: 2.1 time: 0.477338 Jun 25 21:05:15.975964 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1553/3421] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:05:15 2022] DELETE /compute/v2.1/os-security-groups/a1e536ef-9ecb-4e9a-b633-b9762941bf31 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:15.977061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:15.978655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:15.987998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06710473-7d44-4c0b-8fd6-8a94d8fe67f3 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] Calling method '.version_select at 0x7f9862012d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:15.994159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.994621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:15.995411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:15.995853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:16.389217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:16.398169 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3613b87f-ce94-4fd9-8056-327b1b86a9a4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.427105 Jun 25 21:05:16.399171 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1869/3422] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:15 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:16.514105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:16.514884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:16.524952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:16.525778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:16.527965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:16.529880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:16.633840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcef2a65be9443dda5cbe7c3d77d6295', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a930bf73f9845e6b079820ec7b14906', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:16.643409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-195d536f-8279-4748-9b93-ec667a2efeee tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 200 len: 1647 microversion: 2.1 time: 0.134363 Jun 25 21:05:16.646600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1870/3423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:16 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 1647 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:16.718765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-06710473-7d44-4c0b-8fd6-8a94d8fe67f3 tempest-SecurityGroupRulesNegativeTestJSON-530993624 tempest-SecurityGroupRulesNegativeTestJSON-530993624-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/04e31ded-dc66-4d19-b1c1-5b99085fef23" status: 202 len: 0 microversion: 2.1 time: 0.737598 Jun 25 21:05:16.720051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1554/3424] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:05:15 2022] DELETE /compute/v2.1/os-security-groups/04e31ded-dc66-4d19-b1c1-5b99085fef23 => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:05:16.774330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-784478497", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "cf628f47-a5f3-44d6-b476-4394f768b5e7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:16.878698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] validate_networks() for [('cf628f47-a5f3-44d6-b476-4394f768b5e7', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:05:16.924332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ba870e48-d8af-4708-b563-037ad248913d req-2cc0da15-c006-429b-a004-bc1adeee5e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045b0e1a-24df-4171-8698-7292fcb8e00c", "name": "network-vif-deleted", "tag": "2d470ff3-e6a1-40a4-9d92-681025b6c9c2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:16.939557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ba870e48-d8af-4708-b563-037ad248913d req-2cc0da15-c006-429b-a004-bc1adeee5e4b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:16.940000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ba870e48-d8af-4708-b563-037ad248913d req-2cc0da15-c006-429b-a004-bc1adeee5e4b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:16.970514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ba870e48-d8af-4708-b563-037ad248913d req-2cc0da15-c006-429b-a004-bc1adeee5e4b service nova] Creating event network-vif-deleted:2d470ff3-e6a1-40a4-9d92-681025b6c9c2 for instance 045b0e1a-24df-4171-8698-7292fcb8e00c on nch1-master-1 Jun 25 21:05:16.998684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ba870e48-d8af-4708-b563-037ad248913d req-2cc0da15-c006-429b-a004-bc1adeee5e4b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077916 Jun 25 21:05:16.999518 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1555/3425] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:05:17.005471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:17.006720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:17.019722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:17.029654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:17.030509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:17.030946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:17.451267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ffb6e7d-2e1c-4dee-9fa2-04707036728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.449944 Jun 25 21:05:17.452103 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1556/3426] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:16 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:17.482089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:17.483172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:17.546911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:17.553195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:17.556735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:17.559949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.180730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:18.189972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6eedf775-30fd-462f-87d7-c7d3c252b67c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.730170 Jun 25 21:05:18.191233 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1557/3427] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:17 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:18.197130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:18.203289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] [instance: 045b0e1a-24df-4171-8698-7292fcb8e00c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:18.212505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.213318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.214338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.215565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.230387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:05:18.231932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:05:18.232779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:05:18.233369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:05:18.233491 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] HTTP exception thrown: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. Jun 25 21:05:18.234066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Request method failure captured: Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c HTTP/1.1 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3hL2KVi4b1X35dMIg19PXvX9c8wu2RYadZ0welUBrKuUp50STB3ugQ1yZRIvRd8r7tkKfLi_W0viUdaG_D1QJ4z1FoV-S8LUJ-Gqn3W0Hkea2YH7Z_rWI6Caoq3gT7ew98nuqGTyrUEkP2FzUCRnyf4Wr6cDhxeDKnLkB2guxp6FVc Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 9a930bf73f9845e6b079820ec7b14906 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestManualDisk-1889032176 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9a930bf73f9845e6b079820ec7b14906"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a930bf73f9845e6b079820ec7b14906"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9a930bf73f9845e6b079820ec7b14906"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9a930bf73f9845e6b079820ec7b14906"}]}] Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestManualDisk-1889032176 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 9a930bf73f9845e6b079820ec7b14906 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestManualDisk-1889032176 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestManualDisk-1889032176-project Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: fcef2a65be9443dda5cbe7c3d77d6295 Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestManualDisk-1889032176-project Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '045b0e1a-24df-4171-8698-7292fcb8e00c'} Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:18.236053 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Returning 404 to user: Instance 045b0e1a-24df-4171-8698-7292fcb8e00c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f373d2e5-dcff-4ad4-a873-073d254e5463 tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c" status: 404 len: 111 microversion: 2.1 time: 0.045030 Jun 25 21:05:18.244249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1558/3428] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:18 2022] GET /compute/v2.1/servers/045b0e1a-24df-4171-8698-7292fcb8e00c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:05:18.245633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:18.246045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:18.252753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.253209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.253986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.254437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.283897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.284357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.287887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.288340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.292250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'flavor' on Instance uuid ded86d25-8dab-4fbf-a377-2d30b193dc59 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:05:18.320269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:18.334263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Getting quotas for project ec20b1038c9240bd8c66c092f0581206. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:05:18.346066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Getting quotas for user 368aeda4e4d744daa5aa45b4eff5aa8f and project ec20b1038c9240bd8c66c092f0581206. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:05:18.373376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:05:18.375772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:05:18.483011 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c10d8ff-b284-4010-ad89-14377952074b tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.834839 Jun 25 21:05:18.485050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1871/3429] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:05:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:05:18.500066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94fc5334-26de-49c9-ae23-bfd1c0a5b0dd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] Calling method '.version_select at 0x7f984ff27670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:18.532978 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94fc5334-26de-49c9-ae23-bfd1c0a5b0dd tempest-ServersTestManualDisk-1889032176 tempest-ServersTestManualDisk-1889032176-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057412166" status: 202 len: 0 microversion: 2.1 time: 0.045600 Jun 25 21:05:18.537967 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1872/3430] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:05:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057412166 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:18.554799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:18.560230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:18.561325 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f8d0b4e-9185-443f-b0eb-a6fe62feff0b tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/action" status: 200 len: 32 microversion: 2.1 time: 0.306186 Jun 25 21:05:18.565298 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1559/3431] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:18 2022] POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:18.576998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.577442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.581432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.582306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:18.583299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:18.584326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.647746 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf1766ab-6e3a-4b77-9fda-adb7cfb084d0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.108069 Jun 25 21:05:18.649602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1873/3432] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:18 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:18.662062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:18.666134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:18.683740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.689534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.693374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:18.694050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:18.953391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:18.974103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:18.991870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:18.999366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e411e55e-1bc9-469c-a5e9-8f4f9f6f60c8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1258 microversion: 2.21 time: 0.430981 Jun 25 21:05:19.000444 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1560/3433] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:18 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1258 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:19.187936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:19.207956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:19.208882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:19.212982 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01ea1cc9-0a66-426b-b2c7-79dbb0a7bd2a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.561881 Jun 25 21:05:19.217418 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1874/3434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:18 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:19.219364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:19.220385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:19.221698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:19.223649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:19.662933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:19.664236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:19.679979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:19.680690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:19.682896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:19.685244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:19.813872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:19.836439 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92cb7885-7776-4696-8914-2624052104b8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.633006 Jun 25 21:05:19.837477 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1561/3435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:19 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:19.868956 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b23285b-0ada-49c5-b325-911d635e6490 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.212246 Jun 25 21:05:19.870541 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1875/3436] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:19 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:20.018363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:20.019343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:20.029689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.030522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.033155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.033809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.241973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:20.243047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:20.253277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:20.259640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.266030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:20.267034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.268087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.269959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:20.271513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.273703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20dde67b-eb8e-444c-a429-3763edc79f03 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1318 microversion: 2.21 time: 0.259685 Jun 25 21:05:20.278745 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1562/3437] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:20 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:20.662666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:20.690780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b8249e4-a88d-4d55-8fce-0264790de13c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.453707 Jun 25 21:05:20.706612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1876/3438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:20 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:20.859773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:20.860403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:20.866177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:20.871729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.872446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.873659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.874266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.882488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:20.883781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:20.895886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:20.903274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.904007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.908660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:20.909334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:20.991345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3f071a3-2661-4184-a1a2-67a871ac6fdd tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.113837 Jun 25 21:05:20.992848 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1877/3439] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:20 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:21.310013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:21.317966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:21.332656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:21.338561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:21.341101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:21.341798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:21.707092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:21.724740 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48f65b97-187c-4144-baf9-53f84ca687d2 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.871036 Jun 25 21:05:21.732293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1563/3440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:20 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:21.738262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:21.739563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:21.740603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:21.752662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:21.753844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:21.754902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:21.755494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:21.755776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:21.757360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:21.758521 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89534860-53f5-4002-9698-b75436a6741e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1316 microversion: 2.21 time: 0.467144 Jun 25 21:05:21.763970 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1878/3441] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:21 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:05:22.006118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:22.007365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:22.020522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.022909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:22.025759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.026787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:22.093088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6f80812-4811-42fb-9850-3b9ea0c36857 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.093234 Jun 25 21:05:22.094387 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1879/3442] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:21 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:22.202258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:22.213853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-344a1215-426f-481a-9f18-beb560804492 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.480010 Jun 25 21:05:22.214993 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1564/3443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:21 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:22.751315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:22.752887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:22.761686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.762402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:22.763991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.764663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:22.788274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:22.789607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:22.808806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.814699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:22.818961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:22.819653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:23.191272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:23.204295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:23.206523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:23.209110 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-212554ea-26f1-468c-92b4-a0560522f196 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.428704 Jun 25 21:05:23.224446 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1565/3444] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:22 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:23.224446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:23.229255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:23.243374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:23.244254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:23.245161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:23.245695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:23.257682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:23.270111 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-66db6904-047c-4e05-ae80-64cf7df46df4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.523371 Jun 25 21:05:23.280296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1880/3445] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:22 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:23.285279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:23.285900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:23.295225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:23.296253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:23.297637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:23.298431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:23.303606 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-282978d5-4814-4cb8-a1b9-2a7a8ebc0044 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.086262 Jun 25 21:05:23.306900 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1566/3446] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:23 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:23.798961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:23.841788 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a10623ca-ac71-44e1-ba62-28fbdb201249 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.560194 Jun 25 21:05:23.843597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1881/3447] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:23 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:24.235980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:24.238172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:24.252257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.252741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.253505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.253943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.287375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:24.288005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:24.304571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.304999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.306015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.306826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.727714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:24.736028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:24.744754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a7d665d-c221-4ceb-a757-bff5bb3b02bd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.461246 Jun 25 21:05:24.746438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:24.755336 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1882/3448] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:24 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:24.755835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:24.757206 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6de90097-e26b-44c2-8750-9132e5c4cb1e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.525560 Jun 25 21:05:24.758437 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1567/3449] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:24 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:24.760990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:24.762322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:24.766129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c9e3dcb1-5231-409a-8126-cd00787a4646 req-54184d88-54d2-4726-bd8d-6ab6fd177b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a975706-e379-419b-b2f4-e10b30a568ca", "tag": "fddd5336-3e5c-43b7-9c4f-6134048d25f6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:24.769665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.770182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.771109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.771707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.788240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c9e3dcb1-5231-409a-8126-cd00787a4646 req-54184d88-54d2-4726-bd8d-6ab6fd177b4d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.788623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c9e3dcb1-5231-409a-8126-cd00787a4646 req-54184d88-54d2-4726-bd8d-6ab6fd177b4d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.807404 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c9e3dcb1-5231-409a-8126-cd00787a4646 req-54184d88-54d2-4726-bd8d-6ab6fd177b4d service nova] Creating event network-changed:fddd5336-3e5c-43b7-9c4f-6134048d25f6 for instance 1a975706-e379-419b-b2f4-e10b30a568ca on nch2-master-1 Jun 25 21:05:24.816717 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c9e3dcb1-5231-409a-8126-cd00787a4646 req-54184d88-54d2-4726-bd8d-6ab6fd177b4d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053912 Jun 25 21:05:24.818154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1568/3450] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:24.834873 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ef80ec5-9aec-4200-aaa4-6daf4c03ea62 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 14 microversion: 2.1 time: 0.078095 Jun 25 21:05:24.838329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1883/3451] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:24 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:05:24.860650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:24.862817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:24.870504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.871322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:24.874591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:24.875640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:25.311309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:25.331057 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ab8834c-6d99-4086-b487-6550a7e68115 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.472958 Jun 25 21:05:25.334260 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1569/3452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:24 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:25.765048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:25.766988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:25.776680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:25.778157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:25.779800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:25.780606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:25.783096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:25.784225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:25.788164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:25.788648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:25.794686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:25.795348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:26.038512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:26.049990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1685766-c054-4ec3-b404-af610b88c232 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1477 microversion: 2.1 time: 0.291257 Jun 25 21:05:26.060766 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1884/3453] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:25 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1477 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:26.070452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:26.071696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:26.080086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:26.080908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:26.082710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:26.083649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:26.365147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:26.377405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:26.379019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:26.380231 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d557b170-5d9e-40be-8c13-82528f23ba70 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.609055 Jun 25 21:05:26.385348 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1570/3454] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:25 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:05:26.391437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:26.392819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:26.400313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:26.401220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:26.402179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:26.402628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:26.668841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:26.682888 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4f939a60-5129-4ef6-9d87-0d152c6f55d1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.296182 Jun 25 21:05:26.683625 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1571/3455] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:26 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:27.068847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:27.069480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:27.076091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.076780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:27.078448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.079173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:27.259937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:27.273076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bfd5de29-5c4b-43a4-901d-6dde58cdbacd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1476 microversion: 2.1 time: 0.204018 Jun 25 21:05:27.274325 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1572/3456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:27 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1476 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:27.399085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:27.400258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:27.407123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.407864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:27.409160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.410456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:27.575696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:27.585081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:27.587515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:27.589009 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-efe4f000-c51a-4762-a469-e44ef91561b3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.195156 Jun 25 21:05:27.595745 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1573/3457] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:27 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:27.706875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:27.707544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:27.722910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.729091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:27.731094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:27.733109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.061647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:28.073262 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07a3ca27-7377-40bf-b0c0-4ace016f60b5 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.376450 Jun 25 21:05:28.076476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1574/3458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:27 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:28.097511 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89c09cc0-3bbd-4cc2-a692-8aae36f703be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action" status: 200 len: 8207 microversion: 2.1 time: 2.034685 Jun 25 21:05:28.098152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1885/3459] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:26 2022] POST /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9/action => generated 8207 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:28.107973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:28.108956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:28.121523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.121984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.122845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.123326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.291036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:28.291738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:28.299396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.299859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.300659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.301267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.320714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:28.363410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:28.640223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:28.648448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d59fea57-864a-4c15-a823-99dcbb297d14 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.544582 Jun 25 21:05:28.649176 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1575/3460] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:28 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:28.655750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:28.656742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:28.668797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.670175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.671407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.672324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.708139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:28.722858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d34de8d4-63a8-48e6-a0cf-8a19d6b5b1cb tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1476 microversion: 2.1 time: 0.435615 Jun 25 21:05:28.723640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1886/3461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:28 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:28.739066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:28.739888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:28.747787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.748450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.749412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:28.750125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:28.970862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:29.044606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.051453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:29.061771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.066745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.069287 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79a1ff4c-5368-45a4-b65b-90f50b97fc68 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.418917 Jun 25 21:05:29.069986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1576/3462] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:28 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:29.099374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:29.100402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:29.109250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.110202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.111575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.112377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.127348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.142175 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aecfa164-c1e2-49a9-9414-d69a1a3aa065 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.407047 Jun 25 21:05:29.142693 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1887/3463] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:28 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:29.158216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:29.158832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:29.165311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.165756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.170024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.170620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.370637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.387175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-54f82858-6dea-475c-a25d-a9d5b1ca693f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.293129 Jun 25 21:05:29.388131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1577/3464] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:29 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:29.502248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "name": "network-vif-unplugged", "status": "completed", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:29.519017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.519611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.533254 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] Creating event network-vif-unplugged:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch2-master-1 Jun 25 21:05:29.539910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:05:29.553428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1129de63-fb6b-499e-b777-05bc51c1cf80 req-29bea6ec-c147-418c-bf59-0176e33d5b63 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055723 Jun 25 21:05:29.554118 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1578/3465] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:05:29.743445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:29.744161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:29.752603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.753077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.753868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.754309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.916209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.922154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:29.928476 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2eb5a1c9-2033-48ee-8950-0059e35030b0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.774243 Jun 25 21:05:29.930207 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1888/3466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:29 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:29.945829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:29.946055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:29.946375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:29.953389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.954056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.955032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:29.955157 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c7bf2c3b-2a72-4767-a47a-ed92af7da665 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1476 microversion: 2.1 time: 0.216400 Jun 25 21:05:29.955732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:29.957199 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1579/3467] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:29 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:30.088623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:30.089246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:30.097290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.098006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.098942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.099529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.337808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:30.350169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:30.352379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:30.357521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66535e83-2265-435a-be89-2b2a2ad52303 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.270956 Jun 25 21:05:30.358670 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1580/3468] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:30 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:05:30.381026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:30.390344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a8d2e58-27ae-455f-a4cf-4e840fe0e846 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.448844 Jun 25 21:05:30.390824 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1889/3469] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:29 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:30.406232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:30.406861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:30.415754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:30.419282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.419743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.421275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:30.422691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.423160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.433513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.434226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.435720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.436395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.502246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Locking {{(pid=137461) lock /opt/stack/nova/nova/compute/api.py:4700}} Jun 25 21:05:30.581737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee089c48-a4ff-4879-b633-7b8c4f0ee646 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.170004 Jun 25 21:05:30.582639 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1890/3470] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:30 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:30.591703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:30.598746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:30.599928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:30.602348 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b8d0f82-7ed9-4f0b-8d7a-71c682978f52 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.199673 Jun 25 21:05:30.608514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.609179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.609955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.610390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.613283 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1581/3471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:30 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:30.976162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:30.977587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:30.996225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.996747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:30.997791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:30.998405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.208241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:31.230954 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b3d271d-4b5f-4fdb-9b10-c742cd1488b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.643733 Jun 25 21:05:31.235007 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1891/3472] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:30 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:31.253593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:31.263574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.265375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.299569 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action HTTP/1.1 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: {"os-stop": {}} Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb', 'body': {'os-stop': {}}} Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked Jun 25 21:05:31.301691 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:31.310121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 409 to user: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb is locked {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:31.312100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10643377-261e-4c5e-8062-21aa5fd9bb79 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 409 len: 107 microversion: 2.1 time: 0.067432 Jun 25 21:05:31.313440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1892/3473] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:31 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 107 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:05:31.324849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:31.326686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:31.344036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.344830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.345874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.346708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.422128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Unlocking {{(pid=137461) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 25 21:05:31.500469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f9e069a-46c2-4ea6-864e-647206f68205 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.182353 Jun 25 21:05:31.503291 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1893/3474] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:31 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:31.512294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:31.514094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:31.523047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.523938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.524882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.525396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.610443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:31.623408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-91d7c341-9d8c-4a6a-8824-3b6c5cd9c345 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1476 microversion: 2.1 time: 0.654887 Jun 25 21:05:31.624687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1582/3475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:30 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1476 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:31.634601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ebf34e5-8485-44d3-8172-9873c00a9d78 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:31.648740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ebf34e5-8485-44d3-8172-9873c00a9d78 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.649513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ebf34e5-8485-44d3-8172-9873c00a9d78 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.677725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ebf34e5-8485-44d3-8172-9873c00a9d78 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Going to try to stop instance {{(pid=137462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:05:31.741433 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ebf34e5-8485-44d3-8172-9873c00a9d78 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.114025 Jun 25 21:05:31.742431 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1583/3476] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:31 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:31.752087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:31.753045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:31.762187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.763717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:31.765228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:31.765834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.012154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:32.030127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:32.035546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:32.036930 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a521fb42-2aeb-477d-98b7-7ff8b3e4d12e tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.532219 Jun 25 21:05:32.038245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1894/3477] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:31 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:32.045351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:32.046968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:32.063221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.064000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.065304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.067243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.144974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:32.155495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab49a426-dbf1-4f0f-b268-8af40c1ed942 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.407991 Jun 25 21:05:32.166036 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1584/3478] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:31 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:32.171536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:32.180764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.181384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.196164 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] Creating event network-changed:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch2-master-1 Jun 25 21:05:32.203723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:05:32.221627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e482ae8d-c7a5-4267-a610-ec3637e20b71 req-9e8e669c-fc9a-4dc7-8c0e-d4a88d3752cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053395 Jun 25 21:05:32.223230 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1585/3479] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:32.231127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-96624343-3a25-49cb-ac11-120eb9b0f8ad req-97779e40-ba95-4e7d-bf44-681914296031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a975706-e379-419b-b2f4-e10b30a568ca", "name": "network-vif-plugged", "status": "completed", "tag": "fddd5336-3e5c-43b7-9c4f-6134048d25f6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:32.246146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-96624343-3a25-49cb-ac11-120eb9b0f8ad req-97779e40-ba95-4e7d-bf44-681914296031 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.247152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-96624343-3a25-49cb-ac11-120eb9b0f8ad req-97779e40-ba95-4e7d-bf44-681914296031 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.266103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-96624343-3a25-49cb-ac11-120eb9b0f8ad req-97779e40-ba95-4e7d-bf44-681914296031 service nova] Creating event network-vif-plugged:fddd5336-3e5c-43b7-9c4f-6134048d25f6 for instance 1a975706-e379-419b-b2f4-e10b30a568ca on nch2-master-1 Jun 25 21:05:32.273098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-96624343-3a25-49cb-ac11-120eb9b0f8ad req-97779e40-ba95-4e7d-bf44-681914296031 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047958 Jun 25 21:05:32.274460 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1586/3480] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:32.581778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:32.598984 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-581b019a-307d-4188-9cb4-7a68575ea956 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.559400 Jun 25 21:05:32.599586 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1895/3481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:32 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:32.643880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:32.644914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:32.654262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.655176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:32.656301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:32.657057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.055589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:33.056516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:33.077904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.078651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.081140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.081751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.133079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:33.142307 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39e7250d-ca2b-467c-9d26-de933c5110fe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1476 microversion: 2.1 time: 0.504735 Jun 25 21:05:33.159039 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1587/3482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:32 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1476 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:33.174257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:33.175230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:33.185751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.186728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.188084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.189946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.467115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:33.511523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:33.515691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:33.521745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bbe4e66-7c49-4960-82c0-2bbc8eea15e6 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.470285 Jun 25 21:05:33.525464 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1896/3483] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:33 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:33.626577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:33.628499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:33.662946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.664304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.665571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:33.666388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:33.723211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:33.738345 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc24369c-e8ea-4b37-9a02-896f07c57304 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.569423 Jun 25 21:05:33.739407 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1588/3484] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:33 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:34.162787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:34.166172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:34.166804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:34.173782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.174633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.175581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.176166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.179871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4904ff6b-bbc5-489e-9dcc-5e74e6b6e015 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.564767 Jun 25 21:05:34.190457 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1897/3485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:33 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:34.397103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:34.410319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b133dba-ca1c-4aaf-a77f-46e8f285a567 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1474 microversion: 2.1 time: 0.247598 Jun 25 21:05:34.422727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1589/3486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:34 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1474 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:34.549749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:34.555291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:34.566930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.568235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.569510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.570137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.771707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:34.772798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:34.780461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.780994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.781982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:34.782583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:34.955335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:34.963700 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f724f0ff-f0d8-4ece-aa22-e1d58b3684e1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.210337 Jun 25 21:05:34.970040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1590/3487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:34 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:35.050737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:35.059869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:35.061418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:35.062754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a95e9852-d579-427b-94c1-892bbdba07d4 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.524853 Jun 25 21:05:35.073157 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1898/3488] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:34 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:35.197940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:35.198558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:35.205532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:35.206269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:35.207206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:35.207644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:35.369006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:35.379108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9501bca7-b216-419f-b584-4ce9f93ee37a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.185239 Jun 25 21:05:35.387134 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1591/3489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:35 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:35.429256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:35.430534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:35.438154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:35.439148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:35.440259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:35.441690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:35.899532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:35.913002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c72f06e2-81a5-4d24-b67d-a8ee7c22a288 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1474 microversion: 2.1 time: 0.487736 Jun 25 21:05:35.914943 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1899/3490] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:35 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1474 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:35.988843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:35.989526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:36.003322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.003834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.004663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.005108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.088274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:36.089819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:36.100305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.100787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.101626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.102068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.221712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:36.230789 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-34bdf841-3785-4357-8d14-d3336a493294 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.246325 Jun 25 21:05:36.231567 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1592/3491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:35 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:36.398565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:36.400113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:36.412921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.414657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.415565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.417490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.583257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:36.588742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:36.595255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:36.596854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:36.598006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-530e5f3d-351e-4769-9bfe-bfc2f350a680 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1358 microversion: 2.21 time: 0.520335 Jun 25 21:05:36.598588 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1900/3492] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:36 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1358 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:36.728629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:36.731427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:36.741337 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-efbb7ac2-b8b7-438e-ba63-261149a0596b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.346972 Jun 25 21:05:36.744017 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1593/3493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:36 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:36.953432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:36.965906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:36.981295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.982094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:36.983232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:36.983821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.252232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:37.253660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:37.266539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.266999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.267780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.268215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.488710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:37.497141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccec9945-292c-46c0-aea5-e528215f677c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1474 microversion: 2.1 time: 0.569556 Jun 25 21:05:37.504095 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1901/3494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:36 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1474 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:37.548117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:37.561656 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-202a6acd-5486-4c66-9018-3e15a6a33bde tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.312739 Jun 25 21:05:37.574666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1594/3495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:37 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:37.618442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:37.619068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:37.629990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.630457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.631253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.639389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.759593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:37.760227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:37.768781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.769504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:37.770487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:37.771087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.138138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:38.149194 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c543ef0e-1f78-4421-b8f7-e175df401b8a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.393557 Jun 25 21:05:38.150015 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1595/3496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:37 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:38.515804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:38.516868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:38.526821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.528463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.529787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.530223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.597742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:38.617718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:38.619578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:38.621205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36b7682a-d13f-4025-8d21-6a44b14849f0 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1550 microversion: 2.21 time: 1.007144 Jun 25 21:05:38.622279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1902/3497] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:37 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1550 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:38.627016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:38.627842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:38.635030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.635739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.636854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.637453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.884888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:38.894643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70962f0d-5310-4653-8f6c-f0755a24392a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1471 microversion: 2.1 time: 0.383878 Jun 25 21:05:38.896257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1596/3498] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:38 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1471 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:38.902672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:38.903394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:38.912031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.913209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.915000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:38.918534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:38.958144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:05:39.065653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.079626 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2a60626-5042-4407-822b-d25a33d4d6ea tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.456019 Jun 25 21:05:39.081753 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1903/3499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:38 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:39.096411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:39.097082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:39.106083 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ea5554c-53b1-4810-b2fe-ebe07d9cbfc8 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 204 len: 0 microversion: 2.21 time: 0.208097 Jun 25 21:05:39.106909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1597/3500] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:05:38 2022] DELETE /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:05:39.110633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.111083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.117328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.118019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.131203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:39.132066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:39.148922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.152734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.156865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.158282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.340189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad2b4522-2962-4a94-a522-39baf02b4edd tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "POST /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01/action" status: 202 len: 0 microversion: 2.1 time: 0.254850 Jun 25 21:05:39.344512 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1904/3501] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:39 2022] POST /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:39.352162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:39.353021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:39.366816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:39.368877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.369342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.370820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.371675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.649523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.670668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.673018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.674804 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-243ab867-529b-4965-bc84-e757a1787571 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1556 microversion: 2.21 time: 0.563263 Jun 25 21:05:39.687226 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1598/3502] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:39 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1556 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:39.692315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.694142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:39.695000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:39.700817 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b0113c8-ae61-4be5-bcd8-99ebda65c82b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.354615 Jun 25 21:05:39.701428 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1905/3503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:39 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:39.703047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.703755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.704879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:39.705538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:39.909922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:39.922836 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b053c89-3fa6-491d-8713-2bd1fee2bc73 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.232945 Jun 25 21:05:39.924710 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1599/3504] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:39 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:40.098735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:40.099348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:40.117944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.118402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:40.119186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.119635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:40.378669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:40.391391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1f27b174-8c40-47ff-bafc-9d9076c5e272 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.293421 Jun 25 21:05:40.400459 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1906/3505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:40 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:40.473576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7167415-acdc-48cf-a7c5-3c9cb67299df tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Action: 'create', calling method: .version_select at 0x7f984f65f160>, body: {"keypair": {"name": "tempest-keypair-1680282942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcuMKjCzqgC9T3fKeW4lAsc7cRre6GXh8RzO3b8jZC6H3Hs2YVhsQVgKXfl35ybVADqeNcufnOF/vkTwzcTQr9PIGRXiD/lUgNtX98GTp9hKSxm1jrdznHRoljT5kj9hg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:40.509373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a7167415-acdc-48cf-a7c5-3c9cb67299df tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for project 034b90cc1b144b43b2aec3feaeb65f74. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:05:40.536993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a7167415-acdc-48cf-a7c5-3c9cb67299df tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for user 6b7cbda91af54f84a9432ddbf6abec2a and project 034b90cc1b144b43b2aec3feaeb65f74. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:05:40.587569 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7167415-acdc-48cf-a7c5-3c9cb67299df tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.297609 Jun 25 21:05:40.597103 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1600/3506] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:05:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:40.694007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:40.694619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:40.706362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.707107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:40.708068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.708679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:40.719234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:40.721261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:40.734130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.737853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:40.739842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:40.741556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.043308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.051555 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bd77eb4-fa53-4aeb-aa48-6db24a97aa3e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.337225 Jun 25 21:05:41.061481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1601/3507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:40 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:41.066674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:41.067518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:41.075346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:41.076057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.077105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:41.077693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.133506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.147593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.149580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.151266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8f2d162-3497-4dec-8bb7-cbb1a17c9a6c tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1556 microversion: 2.21 time: 0.461296 Jun 25 21:05:41.152492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1907/3508] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:40 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1556 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:41.416409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:41.417448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:41.429192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:41.430732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.432252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:41.434426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.540313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.562371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ae6064b-df92-4e38-b705-ebc41b1bb98b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.499392 Jun 25 21:05:41.564204 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1602/3509] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:41 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:41.569721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "name": "network-vif-plugged", "status": "completed", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:41.587790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:41.588483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:41.609838 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] Creating event network-vif-plugged:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch2-master-1 Jun 25 21:05:41.620069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:05:41.653183 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-960078da-578c-4f13-a773-1265523730ea req-c67c895a-4689-4d39-9650-2ca118462386 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074921 Jun 25 21:05:41.654699 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1603/3510] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:41.771783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:41.781689 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-088a7c88-c65d-4284-a3de-b866fe457ece tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.372384 Jun 25 21:05:41.782619 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1908/3511] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:41 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:42.069715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:42.075741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:42.086081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.093208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.094241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.094831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.171450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:42.172717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:42.195800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.197348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.201408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.202085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.785596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:42.803429 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1e5feb0-2fd9-4005-b534-104043616bb3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.735507 Jun 25 21:05:42.805204 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1604/3512] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:42 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:42.821084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:42.822154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:42.829388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:42.845581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:42.847008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:42.847569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:42.848985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-600a7583-02b2-4a24-b68f-a8d8321e7e77 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1556 microversion: 2.21 time: 0.683556 Jun 25 21:05:42.854492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.855637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.856762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.860751 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1909/3513] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:42 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1556 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:42.861683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.869805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:42.870863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:42.881196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.881928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:42.882894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:42.883487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:43.542635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:43.561222 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c7a1f35-769e-4bff-9ec8-00847fd3b3c8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1736 microversion: 2.1 time: 0.698101 Jun 25 21:05:43.563044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1910/3514] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:42 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1736 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:43.735842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:43.740556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:43.769865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:43.770700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:43.771686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:43.772537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:43.869077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:05:43.979347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:43.991626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ee8d824-0eca-48e8-ad45-a337be3c3591 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 1.185073 Jun 25 21:05:43.996079 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1605/3515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:42 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:44.003229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:44.013292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:44.027854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.028684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.029867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.030557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.086985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-923f198f-f5cb-46b6-b69c-a879fd9a14c5 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 204 len: 0 microversion: 2.1 time: 0.356768 Jun 25 21:05:44.087604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1911/3516] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:05:43 2022] DELETE /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:05:44.114627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:44.115351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:44.138302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.139001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.139946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.140571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.300821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.321280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.325911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.332325 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a00f65b6-26a0-49bd-b433-f39220f2e117 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1514 microversion: 2.21 time: 0.243402 Jun 25 21:05:44.333217 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1912/3517] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:44 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:44.339109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cd8fd176-9524-4a23-84de-9cb5d7772adc req-500640b1-e33b-4d98-989c-d13e960f5a2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a975706-e379-419b-b2f4-e10b30a568ca", "name": "network-vif-deleted", "tag": "fddd5336-3e5c-43b7-9c4f-6134048d25f6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:44.373682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cd8fd176-9524-4a23-84de-9cb5d7772adc req-500640b1-e33b-4d98-989c-d13e960f5a2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.375524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cd8fd176-9524-4a23-84de-9cb5d7772adc req-500640b1-e33b-4d98-989c-d13e960f5a2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.386449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.402914 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dda44df8-4e7e-47eb-bca2-19559e8f63b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.405247 Jun 25 21:05:44.404741 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1606/3518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:43 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:44.408642 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cd8fd176-9524-4a23-84de-9cb5d7772adc req-500640b1-e33b-4d98-989c-d13e960f5a2e service nova] Creating event network-vif-deleted:fddd5336-3e5c-43b7-9c4f-6134048d25f6 for instance 1a975706-e379-419b-b2f4-e10b30a568ca on nch2-master-1 Jun 25 21:05:44.418129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:44.420236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cd8fd176-9524-4a23-84de-9cb5d7772adc req-500640b1-e33b-4d98-989c-d13e960f5a2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084501 Jun 25 21:05:44.421930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:44.422627 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1913/3519] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:44.442741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.443288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.444100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.444583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.581035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:44.582273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:44.591198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.592090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.593784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:44.594642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:44.603865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.613453 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-305afaca-f17e-4c10-9362-30a71a28e3b1 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1667 microversion: 2.1 time: 0.205852 Jun 25 21:05:44.614301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1607/3520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:44 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1667 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:44.917382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:44.919931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:44.930362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14c10bd9-9fe1-435d-8376-ae12cb22bb8c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1716 microversion: 2.1 time: 0.354586 Jun 25 21:05:44.930957 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1914/3521] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:44 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1716 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:45.013557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:45.014890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:45.027997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.028840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.030974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.032535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.138686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:45.139426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:45.170900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.171524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.172252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.172704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.372278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Cannot 'detach_volume' instance ded86d25-8dab-4fbf-a377-2d30b193dc59 while it is in vm_state rescued Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments/070f896c-fc3e-40df-8fe0-538d88646485 HTTP/1.1 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'detach_volume' instance ded86d25-8dab-4fbf-a377-2d30b193dc59 while it is in vm_state rescued Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': 'ded86d25-8dab-4fbf-a377-2d30b193dc59', 'id': '070f896c-fc3e-40df-8fe0-538d88646485'} Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ded86d25-8dab-4fbf-a377-2d30b193dc59 while it is in vm_state rescued Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:45.382683 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ded86d25-8dab-4fbf-a377-2d30b193dc59 while it is in vm_state rescued Jun 25 21:05:45.387822 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:45.394689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 409 to user: Cannot 'detach_volume' instance ded86d25-8dab-4fbf-a377-2d30b193dc59 while it is in vm_state rescued {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:45.398292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b37ec7e8-06d1-48cf-9705-c25ba3ec7b3e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments/070f896c-fc3e-40df-8fe0-538d88646485" status: 409 len: 152 microversion: 2.1 time: 0.268758 Jun 25 21:05:45.399699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1915/3522] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:05:45 2022] DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments/070f896c-fc3e-40df-8fe0-538d88646485 => generated 152 bytes in 271 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:05:45.408691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:45.412047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:45.414497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:45.426787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-605bc005-6739-4f47-9dcf-1ef890f258c4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.418160 Jun 25 21:05:45.427905 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1608/3523] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:45 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:45.429934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.430572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.431375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.431806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.442827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:45.443374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:45.459601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.460061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.463427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.466079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.542346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:45.622422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e53e8e3-f726-4d71-970e-ba687b08c55e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/action" status: 202 len: 0 microversion: 2.1 time: 0.192945 Jun 25 21:05:45.625111 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1609/3524] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:45 2022] POST /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:45.637747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:45.642116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:45.653360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.656115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.658431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:45.666171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:45.968869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:45.978306 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49ee071c-8fc1-4d81-b838-12ad8234421c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.350940 Jun 25 21:05:45.981573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1610/3525] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:45 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:45.988202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:45.991642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:46.005741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.007844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.009026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.012141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.015112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.026754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.029903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '368aeda4e4d744daa5aa45b4eff5aa8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec20b1038c9240bd8c66c092f0581206', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.034471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b78a3ffc-dada-4d58-9571-7f7c4766fcd3 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 200 len: 1343 microversion: 2.21 time: 0.633079 Jun 25 21:05:46.037840 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1916/3526] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:45 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 1343 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:05:46.045211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:46.046123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:46.071408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.073687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.075053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.076976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.271737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.281789 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0dce30e5-ed32-41fa-aaba-ba4f2b5718dc tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1667 microversion: 2.1 time: 0.298886 Jun 25 21:05:46.282512 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1611/3527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:45 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1667 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:46.416247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2003381720", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e3345e11-5d04-4c1a-91b3-0b006841db02"}], "security_groups": [{"name": "tempest-securitygroup--1958589302"}], "key_name": "tempest-keypair-1680282942", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:46.427575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.453724 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36d81060-dec0-435c-8826-4800b7f775c1 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1724 microversion: 2.1 time: 0.414318 Jun 25 21:05:46.454333 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1917/3528] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:46 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:46.469695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:46.470332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:46.477740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.478520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.479689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:46.480383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:46.677096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] validate_networks() for [('e3345e11-5d04-4c1a-91b3-0b006841db02', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:05:46.696321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:46.705134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1d489ab-1122-40b3-bbb6-ad46ea6c727e tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.239436 Jun 25 21:05:46.705958 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1918/3529] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:46 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:47.012662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:47.015586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:47.037161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.038397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.039638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.040289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.615354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:47.624412 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93c6b17a-1f56-4910-8055-ed00382df8e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.625423 Jun 25 21:05:47.632230 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1919/3530] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:46 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:47.643356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:47.648380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:47.664375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.665348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.666390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.667694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.695847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for project 034b90cc1b144b43b2aec3feaeb65f74. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:05:47.704191 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] HTTP exception thrown: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Request method failure captured: Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca HTTP/1.1 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3iMz48Ry2pHaDG-A0fs7FFnNjsKUGlalTBmDpRh_bMfNd5lE_4QXIrG2T-6vKsZlvI2n9fGQPLlKWUrcEY-TNM9L6HHZO15EZHmS11tW52KIMLMiBaO7-7IjAafjFNhOBfgusoBRsmy_S9iJJb1g6t3_ujX6ZxPraT9mX4Cf4cts_Q Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.21 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}] Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 368aeda4e4d744daa5aa45b4eff5aa8f Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1a975706-e379-419b-b2f4-e10b30a568ca'} Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:47.705847 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:47.709828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Returning 404 to user: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:47.711809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e6af765-30ca-4c30-9b6d-be431c413660 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 404 len: 111 microversion: 2.21 time: 0.076541 Jun 25 21:05:47.712463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1920/3531] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:47 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:47.717229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for user 6b7cbda91af54f84a9432ddbf6abec2a and project 034b90cc1b144b43b2aec3feaeb65f74. Resources: dict_keys(['metadata_items']) {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:05:47.726282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:47.731494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:47.749232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.750466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.753530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.754233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.782162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:05:47.782507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:05:47.787672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:05:47.788259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:05:47.789106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:05:47.829499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.832564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.835882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:47.836406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:47.920983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for project 034b90cc1b144b43b2aec3feaeb65f74. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:05:47.930592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Getting quotas for user 6b7cbda91af54f84a9432ddbf6abec2a and project 034b90cc1b144b43b2aec3feaeb65f74. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:05:47.985221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:05:47.988898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:05:48.075315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9813cfb3-e18f-4800-a05b-c1a8c5de2ac0 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.668804 Jun 25 21:05:48.088477 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1612/3532] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:05:46 2022] POST /compute/v2.1/servers => generated 407 bytes in 1682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:05:48.106839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:48.108516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:48.119000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.122143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.123745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.124941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.588507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:48.601016 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b79a5681-9e5c-4d3d-ac2b-3922a6a86b16 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1667 microversion: 2.1 time: 0.882599 Jun 25 21:05:48.601649 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1921/3533] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:47 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1667 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:48.618603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '.version_select at 0x7f984ff190d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:48.619169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:48.651366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.653356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.656138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.656860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.887910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86068f15-6410-4253-9361-6e6e478f794f tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.283569 Jun 25 21:05:48.890873 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1922/3534] 10.222.0.39 () {60 vars in 1336 bytes} [Sat Jun 25 21:05:48 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca/os-instance-actions => generated 611 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:05:48.903696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:48.905275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:48.922587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.924060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.927085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:48.927861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:48.961116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:48.980145 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ea3851f-af23-4e63-a8f0-1403d5e1014f tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1724 microversion: 2.1 time: 0.886756 Jun 25 21:05:48.993314 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1613/3535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:48 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1724 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:49.007925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:49.011260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:49.028291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.031425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.032643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.033290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.239075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:49.260677 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30e32ee6-088c-4cda-a9fc-95490c970d06 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1274 microversion: 2.1 time: 0.265048 Jun 25 21:05:49.265924 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1614/3536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:48 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:49.292645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:49.293543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:49.319877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.326639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.328644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:49.330366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.330836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.343306 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ec2b4e6-daf4-4edb-886a-878e765d0795 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.446359 Jun 25 21:05:49.347991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1923/3537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:48 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:49.354258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:49.373968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:49.409566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.410058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.417319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.419231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.468615 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] HTTP exception thrown: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Request method failure captured: Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca HTTP/1.1 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3iMz48Ry2pHaDG-A0fs7FFnNjsKUGlalTBmDpRh_bMfNd5lE_4QXIrG2T-6vKsZlvI2n9fGQPLlKWUrcEY-TNM9L6HHZO15EZHmS11tW52KIMLMiBaO7-7IjAafjFNhOBfgusoBRsmy_S9iJJb1g6t3_ujX6ZxPraT9mX4Cf4cts_Q Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.21 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}] Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 368aeda4e4d744daa5aa45b4eff5aa8f Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1a975706-e379-419b-b2f4-e10b30a568ca'} Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:05:49.470592 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.474435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Returning 404 to user: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:49.476056 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-749cd25b-29fc-4dbc-a28f-c4763ae39091 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 404 len: 111 microversion: 2.21 time: 0.125313 Jun 25 21:05:49.480496 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1924/3538] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:05:49 2022] DELETE /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:49.490592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1016763103", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "45b82ad8-d283-4802-b745-0f011d752004"}, {"uuid": "b3dee9f1-a34a-4083-a233-f6ad9999d737"}, {"uuid": "45b82ad8-d283-4802-b745-0f011d752004"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:49.623843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] validate_networks() for [('45b82ad8-d283-4802-b745-0f011d752004', None, None, None, None, None), ('b3dee9f1-a34a-4083-a233-f6ad9999d737', None, None, None, None, None), ('45b82ad8-d283-4802-b745-0f011d752004', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:05:49.684235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:49.699953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f85cddf-8e1a-4c50-99d1-621bf9abc844 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1656 microversion: 2.1 time: 0.419366 Jun 25 21:05:49.701215 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1615/3539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:49 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1656 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:49.713978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:49.720170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] [instance: 1a975706-e379-419b-b2f4-e10b30a568ca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:49.752614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.753775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.754809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.759398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.795535 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] HTTP exception thrown: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Request method failure captured: Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca HTTP/1.1 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3iMz48Ry2pHaDG-A0fs7FFnNjsKUGlalTBmDpRh_bMfNd5lE_4QXIrG2T-6vKsZlvI2n9fGQPLlKWUrcEY-TNM9L6HHZO15EZHmS11tW52KIMLMiBaO7-7IjAafjFNhOBfgusoBRsmy_S9iJJb1g6t3_ujX6ZxPraT9mX4Cf4cts_Q Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.21 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ec20b1038c9240bd8c66c092f0581206"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ec20b1038c9240bd8c66c092f0581206"}]}] Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ec20b1038c9240bd8c66c092f0581206 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-147351728 Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 368aeda4e4d744daa5aa45b4eff5aa8f Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-InstanceActionsV221TestJSON-147351728-project Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1a975706-e379-419b-b2f4-e10b30a568ca'} Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.801190 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. Jun 25 21:05:49.805214 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:05:49.807235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] Returning 404 to user: Instance 1a975706-e379-419b-b2f4-e10b30a568ca could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:49.809393 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e36f5d0-e5e6-4b05-9556-d8410e8c7d99 tempest-InstanceActionsV221TestJSON-147351728 tempest-InstanceActionsV221TestJSON-147351728-project] 10.222.0.39 "GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca" status: 404 len: 111 microversion: 2.21 time: 0.106978 Jun 25 21:05:49.821414 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1616/3540] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:05:49 2022] GET /compute/v2.1/servers/1a975706-e379-419b-b2f4-e10b30a568ca => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:05:49.827913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:49.829673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:49.837074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.837816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:49.838979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:49.840129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:50.033458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46fff9b561e4959975edfffe24e1397', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109c4d190ac748b68b97b317d63a909a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:50.076084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3579f68-8c9c-475d-9a73-d2c30d138f2e tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 200 len: 1599 microversion: 2.1 time: 0.253056 Jun 25 21:05:50.076741 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1617/3541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:49 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 1599 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:50.103425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0a52ed6-ce3d-4075-a50c-562bdd6fdfb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:50.114541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0a52ed6-ce3d-4075-a50c-562bdd6fdfb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:50.115202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0a52ed6-ce3d-4075-a50c-562bdd6fdfb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:50.195285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0a52ed6-ce3d-4075-a50c-562bdd6fdfb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Going to try to start instance {{(pid=137462) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 21:05:50.315904 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0a52ed6-ce3d-4075-a50c-562bdd6fdfb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.217799 Jun 25 21:05:50.321149 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1618/3542] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:50 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:50.333745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "name": "network-vif-unplugged", "status": "completed", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:50.370610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:50.373906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:50.423011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] Creating event network-vif-unplugged:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch1-master-1 Jun 25 21:05:50.441394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:05:50.456137 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6430dd36-8235-48a1-a13f-8c4aa6a8bb7d req-ad3bc5ce-f9e3-4671-8ccc-5f665a1f70cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131813 Jun 25 21:05:50.457301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1619/3543] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:50.470098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:50.471278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:50.488525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:50.488984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:50.489771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:50.490214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:51.226634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:51.238262 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f714339-7cc4-416d-a746-d410a76b8a1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1724 microversion: 2.1 time: 0.779186 Jun 25 21:05:51.250369 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1620/3544] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:50 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1724 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:51.255928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:51.257011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:51.268782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:51.271437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:51.272575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:51.273545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:51.765417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:51.790242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43ec161d-f0e0-4e48-b927-aa74dbdbd64e tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1328 microversion: 2.1 time: 0.536882 Jun 25 21:05:51.793454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1621/3545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:51 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1328 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:51.801999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:51.810935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:51.826655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:51.826655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:51.827821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:51.829206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.235545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:53.256403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:05:53.258608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:05:53.261831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:05:53.262198 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87cd4ce3-9bec-4b42-ba39-8bf53e2ad730 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1665 microversion: 2.1 time: 1.466753 Jun 25 21:05:53.263194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1622/3546] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:51 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1665 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:53.274466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:05:53.276568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:05:53.279542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:53.283744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:53.302048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.302827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.303825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.305021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.327683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.328404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.329647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.330411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.337680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Getting quotas for project 1174772192cc45578b127d170fda4ebf. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:05:53.349685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Getting quotas for user 9c53269024eb4c238ec405606e36a049 and project 1174772192cc45578b127d170fda4ebf. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:05:53.370241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:05:53.373109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:05:53.481435 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a8bce84-e47f-4aca-a15e-ad6d06db37d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.999749 Jun 25 21:05:53.490917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1925/3547] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:05:53.501834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:53.502759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] [instance: e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:53.514552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.515473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.516128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.516799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.532897 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] HTTP exception thrown: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Request method failure captured: Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a HTTP/1.1 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3g5xyBwChrW0qFEl2zN6reMuuyeOCHGZ3eLJid9plTtObAgjxPRG12qKgM5V2ALlcb7dUaclz_vMk3HgaBuMwMvk7DJqtKsm_6KJHtSTCJ3oyGnTY4kGHK3vt0uISgSXrcqC5rNB0KMqtFaThKTdR_m77iLRyHZYLWrxqHYBz8SfzY Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 109c4d190ac748b68b97b317d63a909a Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestFqdnHostnames-1684511565 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/109c4d190ac748b68b97b317d63a909a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/109c4d190ac748b68b97b317d63a909a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_109c4d190ac748b68b97b317d63a909a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/109c4d190ac748b68b97b317d63a909a"}]}] Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestFqdnHostnames-1684511565 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 109c4d190ac748b68b97b317d63a909a Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1684511565 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestFqdnHostnames-1684511565-project Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f46fff9b561e4959975edfffe24e1397 Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestFqdnHostnames-1684511565-project Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a'} Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:05:53.535189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. Jun 25 21:05:53.539470 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:05:53.541541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Returning 404 to user: Instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:05:53.542676 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54b2595d-30a5-43ca-859d-0a121cbe48b8 tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a" status: 404 len: 111 microversion: 2.1 time: 0.050386 Jun 25 21:05:53.543459 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1926/3548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:53 2022] GET /compute/v2.1/servers/e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:05:53.551667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c964d480-45c5-460d-aa2a-6ffd3631cd62 req-f885008b-3ba0-4f9e-9bda-1307c937dc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a", "name": "network-vif-deleted", "tag": "57876bb0-6089-4268-b6e1-d27d339e3c67"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:53.561021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c964d480-45c5-460d-aa2a-6ffd3631cd62 req-f885008b-3ba0-4f9e-9bda-1307c937dc36 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.561926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c964d480-45c5-460d-aa2a-6ffd3631cd62 req-f885008b-3ba0-4f9e-9bda-1307c937dc36 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.579844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c964d480-45c5-460d-aa2a-6ffd3631cd62 req-f885008b-3ba0-4f9e-9bda-1307c937dc36 service nova] Creating event network-vif-deleted:57876bb0-6089-4268-b6e1-d27d339e3c67 for instance e69be79b-b2f7-4f7e-ac76-5c78c5adcc6a on nch2-master-1 Jun 25 21:05:53.585630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c964d480-45c5-460d-aa2a-6ffd3631cd62 req-f885008b-3ba0-4f9e-9bda-1307c937dc36 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037723 Jun 25 21:05:53.586767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1927/3549] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:53.592772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:53.593790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:53.602622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.603331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:53.604337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:53.605300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.069662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:54.113002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-068ed104-3402-4cd2-b1e3-00d2b4a1f58c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1730 microversion: 2.1 time: 0.522537 Jun 25 21:05:54.113664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1928/3550] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:53 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1730 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:54.142987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:54.182262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.186272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.246009 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] Creating event network-changed:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch1-master-1 Jun 25 21:05:54.275846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:05:54.314460 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-01d0ab80-ec9c-4e68-bd2a-5bba7291eefe req-a53d2677-7e0f-4f93-99a1-0963ae3c8225 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193134 Jun 25 21:05:54.315106 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1929/3551] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:54.320257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:54.320992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:54.336332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.347425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.348643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.349298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.489012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:54.502729 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a60b959-b2f5-44fe-aa05-527237e479d8 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 1.236924 Jun 25 21:05:54.505677 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1623/3552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:53 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:54.521830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:54.523131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:54.543803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.545905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.549354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.550211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.592747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:54.601785 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9492b60e-1945-492a-a96d-4d7ef42ad2c8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1328 microversion: 2.1 time: 0.285477 Jun 25 21:05:54.609061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1930/3553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:54 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1328 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:54.627653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff2eaa47-602e-4ed4-9472-6d450f496ced tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] Calling method '.version_select at 0x7f984fc9edc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:54.674479 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff2eaa47-602e-4ed4-9472-6d450f496ced tempest-ServersTestFqdnHostnames-1684511565 tempest-ServersTestFqdnHostnames-1684511565-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817383597" status: 202 len: 0 microversion: 2.1 time: 0.063921 Jun 25 21:05:54.676537 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1931/3554] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1817383597 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:05:54.683332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:54.684154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:54.691768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.692575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.693616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:54.694242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:54.984262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:54.993053 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a311cee4-1fc1-47a7-b304-f91ef4648eb6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1209 microversion: 2.1 time: 0.483019 Jun 25 21:05:54.997513 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1624/3555] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:54 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1209 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:55.002569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:55.012717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:55.023492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.024384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.025529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.026355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.054282 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5462c293-8630-4632-981b-4d95fa972f4c tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.375275 Jun 25 21:05:55.055122 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1932/3556] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:05:54 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-interface => generated 285 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:55.532957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:55.536712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:55.560284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.561699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.569188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.570081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.653571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:55.664953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ceaa8f4-0940-4e64-869f-03a9502fa4f6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1665 microversion: 2.1 time: 0.666007 Jun 25 21:05:55.666216 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1625/3557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:54 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1665 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:55.673681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:55.673681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:55.685023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.685477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.686269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:55.686700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:55.712364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:56.415599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:56.435557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1b0a23e8-3063-41aa-90d2-d12e758ba98a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1470 microversion: 2.1 time: 0.917156 Jun 25 21:05:56.437428 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1933/3558] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:55 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1470 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:56.455630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:56.456624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:56.470589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:56.472411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:56.473330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:56.475173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:56.641074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:56.652487 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-326e409f-6598-4c3b-a46f-bdd3c5410fb8 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.984718 Jun 25 21:05:56.653251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1626/3559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:55 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:56.684998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:56.686425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:56.695082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:56.696375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:56.697511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:56.698174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:56.749573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:56.759782 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78a2db7b-51a1-439f-a3f0-95b6e72b4a8e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1271 microversion: 2.1 time: 0.319630 Jun 25 21:05:56.761011 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1934/3560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:56 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1271 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:57.182495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:57.192779 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e44e9ee1-84b4-4fb6-b7c7-faca07a756ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.511834 Jun 25 21:05:57.194046 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1627/3561] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:56 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:05:57.210812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:57.211791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:57.220329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.221161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.222142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.222766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.455128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:57.455952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:57.478572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.479032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.479828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.480373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.607546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:57.616312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5e9fe80-a2d4-480b-a007-4f5e89315fda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.409420 Jun 25 21:05:57.617268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1935/3562] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:57 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:57.633509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:57.634344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:57.641215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.641975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.643122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.643710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.661257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:57.699509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Unlocking {{(pid=137461) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jun 25 21:05:57.772385 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecfadd8c-d5c2-4b97-af83-8f53d868a616 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.143075 Jun 25 21:05:57.774460 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1936/3563] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:05:57 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:05:57.779730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:57.780729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:57.788863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.789587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.790525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:57.791165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:57.870934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:57.967722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:58.217956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:58.229556 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e71384e2-6d3f-434c-9381-eae1cf08c8e4 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1463 microversion: 2.1 time: 0.779071 Jun 25 21:05:58.230217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1628/3564] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:57 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1463 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:58.235315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:58.236139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:58.243993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.244452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.245235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.245692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.395031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:58.404029 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d28a1050-bd35-4c1f-8100-c6a182f98e8f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.628036 Jun 25 21:05:58.404954 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1937/3565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:57 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:58.410797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:58.411776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:58.419376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.419784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.420863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.421354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.701592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:58.715675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a68e62d0-23f1-4b7d-aeaa-868e4eb40977 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.309301 Jun 25 21:05:58.717688 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1938/3566] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:58 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:58.723444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:58.724358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:58.742407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:58.751364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.752236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.753860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.754413 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d4ba40e6-ee4a-40f1-b74b-d5326f221a7c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1271 microversion: 2.1 time: 0.521521 Jun 25 21:05:58.755493 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1629/3567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:58 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1271 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:58.756171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.765835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-430e097e-b036-475f-b5da-e4fc317217b1 req-6c1ff1a6-da56-4757-ad41-3f86817eebfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:58.785335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-430e097e-b036-475f-b5da-e4fc317217b1 req-6c1ff1a6-da56-4757-ad41-3f86817eebfa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.789363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-430e097e-b036-475f-b5da-e4fc317217b1 req-6c1ff1a6-da56-4757-ad41-3f86817eebfa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.843854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-430e097e-b036-475f-b5da-e4fc317217b1 req-6c1ff1a6-da56-4757-ad41-3f86817eebfa service nova] Creating event network-changed:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:05:58.857424 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-430e097e-b036-475f-b5da-e4fc317217b1 req-6c1ff1a6-da56-4757-ad41-3f86817eebfa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095492 Jun 25 21:05:58.859443 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1630/3568] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:58.868037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:58.869131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:58.876908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.878143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:58.879161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:58.880325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.253821 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9952852e-9fee-454d-a6db-f21d57bac11c tempest-MigrationsAdminTest-711022390 tempest-MigrationsAdminTest-711022390-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1614 microversion: 2.1 time: 0.532845 Jun 25 21:05:59.255815 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1939/3569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:58 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1614 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:59.282990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:59.283935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:59.292492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.293360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.295003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.295719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.335335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:05:59.501218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a18d952d-eb8d-48a3-b33d-6bcb8fe76afe tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 204 len: 0 microversion: 2.1 time: 0.222542 Jun 25 21:05:59.502658 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1940/3570] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:05:59 2022] DELETE /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:05:59.509944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0effdbbe-ba34-447c-bebf-48c489e19fed req-f6578d8e-dc8f-4c8b-a9c4-7beff0ec4cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce", "tag": "ccec844b-2f94-4b02-9a20-be7e974fa196"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:05:59.518822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:05:59.524627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0effdbbe-ba34-447c-bebf-48c489e19fed req-f6578d8e-dc8f-4c8b-a9c4-7beff0ec4cbd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.526661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0effdbbe-ba34-447c-bebf-48c489e19fed req-f6578d8e-dc8f-4c8b-a9c4-7beff0ec4cbd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.547461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0effdbbe-ba34-447c-bebf-48c489e19fed req-f6578d8e-dc8f-4c8b-a9c4-7beff0ec4cbd service nova] Creating event network-changed:ccec844b-2f94-4b02-9a20-be7e974fa196 for instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce on nch1-master-1 Jun 25 21:05:59.556815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0effdbbe-ba34-447c-bebf-48c489e19fed req-f6578d8e-dc8f-4c8b-a9c4-7beff0ec4cbd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052366 Jun 25 21:05:59.558165 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1941/3571] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:05:59.566390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:59.567109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:59.573888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.574518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.575328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.576865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.686436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:05:59.700085 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c2c6cb82-8877-4115-9d80-3f90be41beac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.834602 Jun 25 21:05:59.701096 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1631/3572] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:58 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:05:59.713748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:05:59.714778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:05:59.736074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.737345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:05:59.738945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:05:59.739549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.030436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:00.040858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43ca3aa3-8e23-47a9-bdef-4d4624f56de5 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1469 microversion: 2.1 time: 0.337234 Jun 25 21:06:00.076492 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1632/3573] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:59 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1469 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:00.083482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:00.084634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:00.091908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:00.094768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.095481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.097401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.098098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.102146 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91ebf343-8801-4f43-a457-c86c4fc142ce tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.542551 Jun 25 21:06:00.105449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1942/3574] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:05:59 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:00.111973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:00.120952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:00.128075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.128791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.129839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.131242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.431544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:00.462351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3598228a-f163-4b9b-8fde-3954c1726df5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.384018 Jun 25 21:06:00.463405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1633/3575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:00 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:00.481596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:00.482472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:00.489188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.490533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.491498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.492702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.586035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c20c8b67-f021-4c62-adc2-adeb4beb94ac tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.107949 Jun 25 21:06:00.592985 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1634/3576] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:06:00 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:06:00.602393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:00.603844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:00.620463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.621431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.622933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:00.623545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:00.625233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:00.642233 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a87d81c-4565-4315-a1aa-9250ccae4c8b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1313 microversion: 2.1 time: 0.535000 Jun 25 21:06:00.643084 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1943/3577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:00 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:00.963975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f80213cc-2366-4c28-abd3-8ad706495128 req-baddadd2-017f-4530-885b-033e59b40b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:01.001567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f80213cc-2366-4c28-abd3-8ad706495128 req-baddadd2-017f-4530-885b-033e59b40b9a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.002731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f80213cc-2366-4c28-abd3-8ad706495128 req-baddadd2-017f-4530-885b-033e59b40b9a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.047043 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f80213cc-2366-4c28-abd3-8ad706495128 req-baddadd2-017f-4530-885b-033e59b40b9a service nova] Creating event network-changed:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:06:01.075216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f80213cc-2366-4c28-abd3-8ad706495128 req-baddadd2-017f-4530-885b-033e59b40b9a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124716 Jun 25 21:06:01.085116 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1944/3578] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:01.101756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:01.103663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:01.118393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.119257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.120905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.121738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.423186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:01.436063 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-73fdd8e5-79af-4965-b35b-dbcc1c5b1329 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1674 microversion: 2.1 time: 0.840060 Jun 25 21:06:01.437934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1635/3579] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:00 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1674 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:01.443289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:01.444214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:01.455599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.456513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.461238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.461760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.840110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:01.855617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e33a8009-efa5-4428-abee-e07af391d6c0 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1469 microversion: 2.1 time: 0.769028 Jun 25 21:06:01.856316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1945/3580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:01 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1469 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:01.861999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:01.862923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:01.869980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.870639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:01.871651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:01.872826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.250633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:02.260237 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a5e2349c-ef92-44c1-8eb9-494cd88d4783 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.820320 Jun 25 21:06:02.269742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:02.272719 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1636/3581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:01 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:02.285130 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6312781e-dd21-454a-93a4-75d298fae0b9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1334 microversion: 2.1 time: 0.427381 Jun 25 21:06:02.286028 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1946/3582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:01 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1334 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:02.454150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:02.455502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:02.462426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.462856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.464009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.465037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.823393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-df0f580f-5a06-4638-90b8-ad42fdc45e86 req-81f99abb-85c6-4cda-8626-537722a12a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01", "name": "network-vif-deleted", "tag": "695131cf-75ea-492c-835a-1011f1a579f3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:02.838013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:02.845028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-df0f580f-5a06-4638-90b8-ad42fdc45e86 req-81f99abb-85c6-4cda-8626-537722a12a8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.846003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-df0f580f-5a06-4638-90b8-ad42fdc45e86 req-81f99abb-85c6-4cda-8626-537722a12a8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.864458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3679d8a8-49ce-471d-a939-dd48941799d6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1654 microversion: 2.1 time: 0.403980 Jun 25 21:06:02.873998 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1637/3583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:02 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1654 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:02.886263 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-df0f580f-5a06-4638-90b8-ad42fdc45e86 req-81f99abb-85c6-4cda-8626-537722a12a8c service nova] Creating event network-vif-deleted:695131cf-75ea-492c-835a-1011f1a579f3 for instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 on nch1-master-1 Jun 25 21:06:02.892665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-df0f580f-5a06-4638-90b8-ad42fdc45e86 req-81f99abb-85c6-4cda-8626-537722a12a8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077184 Jun 25 21:06:02.893596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1947/3584] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:02.895252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:02.902103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:02.902942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:02.904834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:02.922917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.923380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.925901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.926891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.928317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.928593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:02.929430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:02.933924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.068706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4617e854-49c9-4acf-a8fa-976a9c22d337 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.173134 Jun 25 21:06:03.070058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1948/3585] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:06:02 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:06:03.094729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:03.095704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:03.123756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.124998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.126283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.126974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.150474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:03.158980 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3181159f-36b3-41e2-8180-214302f78b9c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 200 len: 1427 microversion: 2.1 time: 0.283468 Jun 25 21:06:03.162578 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1638/3586] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:02 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 1427 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:03.280629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:03.282067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:03.298696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.300956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.304180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.306299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.322466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:03.363239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:03.658223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:03.662995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:03.673205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2200de3a-ab62-4eb6-b5e9-455db936c04a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1661 microversion: 2.1 time: 0.586187 Jun 25 21:06:03.676023 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1949/3587] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:03 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1661 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:03.683295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:03.686009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:03.703787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.705261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:03.706251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:03.717367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.004000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:04.012298 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ea669fa-46e6-46f0-91f3-60199d598131 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.736988 Jun 25 21:06:04.017782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1639/3588] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:03 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:04.117621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:04.134346 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5997b11c-778f-4dfb-818a-9b771d72e44c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1334 microversion: 2.1 time: 0.451113 Jun 25 21:06:04.135902 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1950/3589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:03 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1334 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:04.179393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:04.180017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:04.191967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.192514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.201106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.201744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.267834 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] HTTP exception thrown: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Request method failure captured: Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 HTTP/1.1 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eU8y6Lwo4JusrB7QlSgp5M8JZYCdp7q10tsLXLhDeaMfMH-Qmmg1KQTMA0bho6G9lPtyVCPNo1HogvHnOUat3ks0H8oXq1ZT9gA9rtyL1SN0cDGWkMeUZRRjE_R6kisg-GqJTikFTys0nhnVshbB6LHDK-VUGRcSdOFWjpgl8qVsQ Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}] Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 5d3257db63ed4bf0861abc735c1e83ee Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01'} Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:04.275342 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:04.281903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Returning 404 to user: Instance c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:04.283337 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d01cb29-defc-4cad-b40d-750ee1811cf7 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01" status: 404 len: 111 microversion: 2.1 time: 0.107846 Jun 25 21:06:04.285309 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1640/3590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:04 2022] GET /compute/v2.1/servers/c2d001f7-e72a-4e29-bef5-c8ef4a7d1c01 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:04.292162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:04.299459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:04.307390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.311159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.312204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.312857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.361127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:04.455627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a08338ed-72ea-4ce6-8bb5-ffebffe8d688 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "DELETE /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 204 len: 0 microversion: 2.1 time: 0.166257 Jun 25 21:06:04.456491 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1951/3591] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:04 2022] DELETE /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:06:04.466008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:04.466919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:04.473365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.473817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.474577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.475007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.700837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:04.701547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:04.707893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.709227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.710165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:04.710612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:04.857617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:04.870939 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-094a570f-1426-47aa-a3ca-f224d6759d86 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1534 microversion: 2.1 time: 0.409692 Jun 25 21:06:04.884263 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1641/3592] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:04 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1534 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:05.000320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:05.014207 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3553fc01-db03-49a1-a93d-b06a13dd356b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.323421 Jun 25 21:06:05.015371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1952/3593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:04 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:05.034208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:05.034841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:05.035312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:05.035460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:05.047205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.047642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.047903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.049001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.050852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.051001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.051332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.051977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.408281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:05.420397 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9990a3c9-51ff-471a-969d-c7911991cd19 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.392486 Jun 25 21:06:05.440848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:05.448570 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1642/3594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:05 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:05.454629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a806e809-f65b-47b7-a7d7-6d16dc14fd38 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.424266 Jun 25 21:06:05.456724 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1953/3595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:05 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:05.459491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:05.462920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:05.468033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:05.470540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:05.475696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:05.481486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.482327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.483860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.485871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.486574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.490516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.491536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:05.492944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:05.546626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:06.348406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:06.357749 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f7877e8-2234-4919-bcdf-d868442656fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.899446 Jun 25 21:06:06.358528 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1954/3596] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:05 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:06.364018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:06.364659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:06.371547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.372243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.373087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.373527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.435209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:06.449440 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c1fd521-67c1-431b-bc3e-0b54d9a94075 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.999291 Jun 25 21:06:06.450553 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1643/3597] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:05 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:06.455573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:06.456207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:06.464715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.465477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.466704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.467440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.679472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:06.706383 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6db99367-4654-4ba5-888b-3734c1cd9650 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1534 microversion: 2.1 time: 0.334100 Jun 25 21:06:06.707101 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1955/3598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:06 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1534 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:06.731266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:06.737608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:06.745878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.747334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.748411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.749355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.908638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:06.927651 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce0c188a-f072-49ea-8e37-591a62230878 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.473199 Jun 25 21:06:06.940458 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1644/3599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:06 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:06.946856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-aa765252-ff28-4dd9-9247-d18eedf9c5e3 req-dbf6352b-3a94-4c3c-af96-a959165d314d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "tag": "4a6b941d-41da-4d2b-b381-9230a9d24c9c"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:06.956340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-aa765252-ff28-4dd9-9247-d18eedf9c5e3 req-dbf6352b-3a94-4c3c-af96-a959165d314d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:06.957009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-aa765252-ff28-4dd9-9247-d18eedf9c5e3 req-dbf6352b-3a94-4c3c-af96-a959165d314d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:06.981602 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-aa765252-ff28-4dd9-9247-d18eedf9c5e3 req-dbf6352b-3a94-4c3c-af96-a959165d314d service nova] Creating event network-changed:4a6b941d-41da-4d2b-b381-9230a9d24c9c for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:06.989339 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-aa765252-ff28-4dd9-9247-d18eedf9c5e3 req-dbf6352b-3a94-4c3c-af96-a959165d314d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050393 Jun 25 21:06:06.990562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1645/3600] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:06.998499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:06.999556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:07.007481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.008227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.010344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.011263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.264491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:07.281608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8848019b-cf8d-4306-aff8-f4bbba0035eb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.572991 Jun 25 21:06:07.293152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1956/3601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:06 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:07.389180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:07.405119 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20d17b32-3bba-46b7-a850-88bcbd06cb5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.412674 Jun 25 21:06:07.405727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1646/3602] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:06 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:07.422419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:07.423178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:07.434661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.436348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.438186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.440364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.467634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:07.468465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:07.479357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.481392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.486173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:07.486760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:07.921985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:07.935266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb4a1b38-5af6-44e9-8a43-4fc97d3dd023 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.517516 Jun 25 21:06:07.936406 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1957/3603] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:07 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:07.985317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:07.997541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-25eb5cf1-bbb0-445b-9de9-759849cdf272 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.534288 Jun 25 21:06:08.000739 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1647/3604] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:07 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:08.013723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:08.014539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:08.041525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:08.042030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:08.043189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:08.044025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:08.174365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:08.182695 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2415e39-6398-4c49-9454-1f1a37ae3215 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 200 len: 1363 microversion: 2.1 time: 0.244915 Jun 25 21:06:08.183455 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1958/3605] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:07 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:08.299375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:08.300054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:08.316484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:08.316928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:08.317727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:08.318167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.016900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:09.017522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:09.034906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.035544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.038922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.039712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.296480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:09.311301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a165786-4f2e-478b-a8c0-185f5c580d31 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 1.015196 Jun 25 21:06:09.324954 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1648/3606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:08 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:09.332312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e91df44c-5fe0-4952-9a25-19c1551856ae req-100c06ab-865d-45be-a72b-c305171b2409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33feb928-6172-447e-90e8-14f32251ca9e", "name": "network-vif-deleted", "tag": "9978699a-b3a0-45c9-8d85-118ee3fe9acf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:09.348322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e91df44c-5fe0-4952-9a25-19c1551856ae req-100c06ab-865d-45be-a72b-c305171b2409 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.349318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e91df44c-5fe0-4952-9a25-19c1551856ae req-100c06ab-865d-45be-a72b-c305171b2409 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.385303 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e91df44c-5fe0-4952-9a25-19c1551856ae req-100c06ab-865d-45be-a72b-c305171b2409 service nova] Creating event network-vif-deleted:9978699a-b3a0-45c9-8d85-118ee3fe9acf for instance 33feb928-6172-447e-90e8-14f32251ca9e on nch1-master-1 Jun 25 21:06:09.398257 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e91df44c-5fe0-4952-9a25-19c1551856ae req-100c06ab-865d-45be-a72b-c305171b2409 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070692 Jun 25 21:06:09.399202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1649/3607] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:09.647376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:09.659761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a476f6f-692c-4365-9282-2a27044d40ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.647484 Jun 25 21:06:09.668347 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1959/3608] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:09 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:09.701396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-77cce1f4-2a21-4aae-8cd0-8e425711a217 req-e26799e1-c531-45c4-83a4-6056a93a0660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce", "name": "network-vif-plugged", "status": "completed", "tag": "ccec844b-2f94-4b02-9a20-be7e974fa196"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:09.732721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-77cce1f4-2a21-4aae-8cd0-8e425711a217 req-e26799e1-c531-45c4-83a4-6056a93a0660 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.734835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-77cce1f4-2a21-4aae-8cd0-8e425711a217 req-e26799e1-c531-45c4-83a4-6056a93a0660 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.774472 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-77cce1f4-2a21-4aae-8cd0-8e425711a217 req-e26799e1-c531-45c4-83a4-6056a93a0660 service nova] Creating event network-vif-plugged:ccec844b-2f94-4b02-9a20-be7e974fa196 for instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce on nch1-master-1 Jun 25 21:06:09.790207 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-77cce1f4-2a21-4aae-8cd0-8e425711a217 req-e26799e1-c531-45c4-83a4-6056a93a0660 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094826 Jun 25 21:06:09.793694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1960/3609] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:09.841124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:09.841844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: 33feb928-6172-447e-90e8-14f32251ca9e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:09.858647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.859607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.861245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:09.862881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:09.897152 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] HTTP exception thrown: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Request method failure captured: Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e HTTP/1.1 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eU8y6Lwo4JusrB7QlSgp5M8JZYCdp7q10tsLXLhDeaMfMH-Qmmg1KQTMA0bho6G9lPtyVCPNo1HogvHnOUat3ks0H8oXq1ZT9gA9rtyL1SN0cDGWkMeUZRRjE_R6kisg-GqJTikFTys0nhnVshbB6LHDK-VUGRcSdOFWjpgl8qVsQ Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}] Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 5d3257db63ed4bf0861abc735c1e83ee Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '33feb928-6172-447e-90e8-14f32251ca9e'} Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:09.901818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. Jun 25 21:06:09.906593 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:09.907897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Returning 404 to user: Instance 33feb928-6172-447e-90e8-14f32251ca9e could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:09.913103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f38195f6-94cc-4dad-a10a-573385c43d12 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e" status: 404 len: 111 microversion: 2.1 time: 0.512230 Jun 25 21:06:09.914067 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1650/3610] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:09 2022] GET /compute/v2.1/servers/33feb928-6172-447e-90e8-14f32251ca9e => generated 111 bytes in 514 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:09.923910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5483d39-ca42-45e7-b21c-98bbde472adc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '.version_select at 0x7f98620c6040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:09.960177 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5483d39-ca42-45e7-b21c-98bbde472adc tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812992911" status: 202 len: 0 microversion: 2.1 time: 0.041181 Jun 25 21:06:09.961021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1961/3611] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:06:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812992911 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:06:10.329611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:10.330901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:10.344196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:10.345077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:10.346145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:10.346996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:10.765729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1334993915", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:10.886225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:10.886857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:10.887378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:10.887804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:10.888230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:10.904959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:10.905441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:10.906262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:10.906773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:10.935677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Getting quotas for project 7748ea0850294ce78a3f390458685b9b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:10.941958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Getting quotas for user ed80bbb76f8e4636a8ba37c23790b74f and project 7748ea0850294ce78a3f390458685b9b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:10.982013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:10.985820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:11.059091 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-930e3558-28cd-4f8e-b58d-ed35b1d3a14a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.494667 Jun 25 21:06:11.060039 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1962/3612] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 25 21:06:11.066705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:11.068140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:11.079611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:11.080331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:11.082320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:11.083040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:11.218040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:11.229346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-718a44c5-a757-4147-b478-4ea971726979 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1396 microversion: 2.1 time: 0.904203 Jun 25 21:06:11.230919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1651/3613] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:10 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1396 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:11.236279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:11.237214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:11.415162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:11.426597 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7c96ff6-2908-48a7-9dea-38c46f77d523 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.363054 Jun 25 21:06:11.427596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1963/3614] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:11 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:11.481351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-abe15c41-cabb-45c1-b0e2-baded646dba8 req-b09263d7-e0d5-4b66-935d-45f928532ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "tag": "3c10b649-a52b-4215-91c4-76eca8abefab"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:11.497935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-abe15c41-cabb-45c1-b0e2-baded646dba8 req-b09263d7-e0d5-4b66-935d-45f928532ad7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:11.502136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-abe15c41-cabb-45c1-b0e2-baded646dba8 req-b09263d7-e0d5-4b66-935d-45f928532ad7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:11.523117 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-abe15c41-cabb-45c1-b0e2-baded646dba8 req-b09263d7-e0d5-4b66-935d-45f928532ad7 service nova] Creating event network-changed:3c10b649-a52b-4215-91c4-76eca8abefab for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:11.534862 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-abe15c41-cabb-45c1-b0e2-baded646dba8 req-b09263d7-e0d5-4b66-935d-45f928532ad7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055674 Jun 25 21:06:11.535890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1964/3615] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:11.585261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:11.599181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:11.600801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:11.602960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9e58280-fc31-4af2-9fe2-1c6047ae1398 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1278 microversion: 2.54 time: 0.370659 Jun 25 21:06:11.612614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1652/3616] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:11 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1278 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:12.248035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:12.248728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:12.258485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:12.259009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:12.259888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:12.260359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:12.444817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:12.445436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:12.464798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:12.465665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:12.466620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:12.467213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.065258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.077968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.078459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7804dd53-a103-4b06-8d0a-57b92155b6b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.637798 Jun 25 21:06:13.079413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1653/3617] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:12 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:13.092785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:13.093406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:13.096838 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-daacd6fa-1f30-41d3-9cd8-27041f0a5cad tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1577 microversion: 2.1 time: 0.854412 Jun 25 21:06:13.106012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.106738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.109219 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1965/3618] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:12 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1577 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:13.120235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:13.120235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:13.121864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.122641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.125499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.125954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.126743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.127178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.179455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:13.271641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:13.384068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.384876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ea0e5df-85f5-4bfa-8ba7-7821eac201ee tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "DELETE /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 204 len: 0 microversion: 2.1 time: 0.274006 Jun 25 21:06:13.390731 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1966/3619] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:13 2022] DELETE /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:06:13.393754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.395269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.396450 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b9491aa-9ee6-446c-9e79-114a08c87406 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1336 microversion: 2.54 time: 0.316065 Jun 25 21:06:13.397862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:13.398689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:13.404144 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1654/3620] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:13 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1336 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:13.414271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:13.422853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:13.436382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.436761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.437549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.437989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.442794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.444668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.445548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.447431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.581852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32fd2a9a-b87e-462b-96ca-1f30840fc5f7 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.189082 Jun 25 21:06:13.583123 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1967/3621] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:06:13 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:13.598187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-12141267-2a67-4e80-8ace-43584751dac5 req-add3b0d0-3989-44a7-91d3-f64a9290cd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "tag": "5aeb855f-8363-46ff-a898-c5c768656d71"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:13.616731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-12141267-2a67-4e80-8ace-43584751dac5 req-add3b0d0-3989-44a7-91d3-f64a9290cd78 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:13.617178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-12141267-2a67-4e80-8ace-43584751dac5 req-add3b0d0-3989-44a7-91d3-f64a9290cd78 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:13.642514 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-12141267-2a67-4e80-8ace-43584751dac5 req-add3b0d0-3989-44a7-91d3-f64a9290cd78 service nova] Creating event network-changed:5aeb855f-8363-46ff-a898-c5c768656d71 for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:13.661032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-12141267-2a67-4e80-8ace-43584751dac5 req-add3b0d0-3989-44a7-91d3-f64a9290cd78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068737 Jun 25 21:06:13.662012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1968/3622] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:13.823454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:13.835367 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fe6789cc-89f0-447b-bd6d-2c152428655b tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1469 microversion: 2.1 time: 0.427170 Jun 25 21:06:13.836232 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1655/3623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:13 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:14.096227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:14.097075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:14.106784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.107187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:14.112693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.113445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:14.423137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:14.424581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:14.431606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.432304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:14.433432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.434115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:14.584502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:14.593584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:14.604176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84377b58-bb8a-4249-84b7-be3bd9b90950 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.512110 Jun 25 21:06:14.608061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1969/3624] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:14 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:14.614388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:14.617104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:14.619239 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6a82ea8-12aa-4e6f-ba50-b774de587465 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1336 microversion: 2.54 time: 0.200098 Jun 25 21:06:14.620500 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1656/3625] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:14 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1336 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:14.859189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:14.860446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:14.872320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.872979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:14.876229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:14.876890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.470461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:15.485446 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4c9e5f2-4630-4189-9d91-71d9c9f7bc2c tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 200 len: 1469 microversion: 2.1 time: 0.632742 Jun 25 21:06:15.487997 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1970/3626] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:14 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 1469 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:15.624894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:15.625632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:15.639439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:15.640264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:15.641170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.641636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.642588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.643202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.656557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.657558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.662353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.664036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.828147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:15.857304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:15.859471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:15.861138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b82deb9f-3de3-4b95-8c88-e8bdb925f367 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1357 microversion: 2.54 time: 0.226606 Jun 25 21:06:15.862274 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1971/3627] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:15 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:15.867946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:15.869376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:15.889870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.890574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:15.891417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:15.891861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.134421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:16.146739 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed901071-9a47-42db-b597-0e4eded654cb tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1577 microversion: 2.1 time: 0.282943 Jun 25 21:06:16.148253 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1972/3628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:15 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1577 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:16.153176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1e1f49cf-40b2-46d6-abdb-fa8b813ec2ec req-b144c8a8-8386-4388-a7e1-8ecf26502df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce", "tag": "ccec844b-2f94-4b02-9a20-be7e974fa196"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:16.171776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1e1f49cf-40b2-46d6-abdb-fa8b813ec2ec req-b144c8a8-8386-4388-a7e1-8ecf26502df6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.172364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1e1f49cf-40b2-46d6-abdb-fa8b813ec2ec req-b144c8a8-8386-4388-a7e1-8ecf26502df6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.185140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:16.185386 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1e1f49cf-40b2-46d6-abdb-fa8b813ec2ec req-b144c8a8-8386-4388-a7e1-8ecf26502df6 service nova] Creating event network-changed:ccec844b-2f94-4b02-9a20-be7e974fa196 for instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce on nch1-master-1 Jun 25 21:06:16.191510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1e1f49cf-40b2-46d6-abdb-fa8b813ec2ec req-b144c8a8-8386-4388-a7e1-8ecf26502df6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041413 Jun 25 21:06:16.193665 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44a9b439-8cc0-4039-846f-08feb8d8b2b8 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.572968 Jun 25 21:06:16.200005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1657/3629] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:15 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:16.210827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1973/3630] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:16.212822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5cfcf15b-9484-4694-bd25-2b99fd88e40a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Action: 'create', calling method: .version_select at 0x7f985c5625e0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-868556718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1wiCh8xxPF4itPPM53AFibmcGIjsIBZWVEQhARSB7FPdvdAPsCqJ6HuJuf9mWDCQvfxzxKSJ0FjB9K+C0eFb/3tqD9CSiWiCoe3eBi96B9mMn1ZxZFMwModPPb2Y5Xbw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:16.239903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5cfcf15b-9484-4694-bd25-2b99fd88e40a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Getting quotas for project 7748ea0850294ce78a3f390458685b9b. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:16.245816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5cfcf15b-9484-4694-bd25-2b99fd88e40a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Getting quotas for user ed80bbb76f8e4636a8ba37c23790b74f and project 7748ea0850294ce78a3f390458685b9b. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:16.309087 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5cfcf15b-9484-4694-bd25-2b99fd88e40a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.107599 Jun 25 21:06:16.310367 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1658/3631] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 21:06:16 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:06:16.322110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-868556718", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:16.324818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.342926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.343841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.344951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.345592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.473214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:16.473679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:16.474160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:16.474621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:16.475221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:16.505096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:16.506062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: def3f120-ac80-4b2f-8cad-7d7859fc5246] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.519116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.519720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.521698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.524008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.566205 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] HTTP exception thrown: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Request method failure captured: Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 HTTP/1.1 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eU8y6Lwo4JusrB7QlSgp5M8JZYCdp7q10tsLXLhDeaMfMH-Qmmg1KQTMA0bho6G9lPtyVCPNo1HogvHnOUat3ks0H8oXq1ZT9gA9rtyL1SN0cDGWkMeUZRRjE_R6kisg-GqJTikFTys0nhnVshbB6LHDK-VUGRcSdOFWjpgl8qVsQ Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}] Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 5d3257db63ed4bf0861abc735c1e83ee Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'def3f120-ac80-4b2f-8cad-7d7859fc5246'} Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:16.567839 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. Jun 25 21:06:16.572366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:16.579777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Returning 404 to user: Instance def3f120-ac80-4b2f-8cad-7d7859fc5246 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:16.580999 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f2d4749-b002-4a07-bd29-10b0fb1951b9 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246" status: 404 len: 111 microversion: 2.1 time: 0.081616 Jun 25 21:06:16.582652 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1659/3632] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:16 2022] GET /compute/v2.1/servers/def3f120-ac80-4b2f-8cad-7d7859fc5246 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:16.595282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.597391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:16.599596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:16.604543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.610115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.610566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.611354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.611783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.620722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.621373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.622337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.624593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.689336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7164cf86-e156-40f0-a21a-cceff9689a1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "POST /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837/action" status: 202 len: 1139 microversion: 2.54 time: 0.372163 Jun 25 21:06:16.694548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:16.695979 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1974/3633] 10.222.0.39 () {62 vars in 1319 bytes} [Sat Jun 25 21:06:16 2022] POST /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837/action => generated 1139 bytes in 380 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 25 21:06:16.708827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:16.709702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.738373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.741989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.743043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.743684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.862083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:16.878941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:16.881463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:16.882737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7578d917-095d-4add-aaf6-9b2bf0a33486 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.181063 Jun 25 21:06:16.883777 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1975/3634] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:16 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:16.949438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3bac367e-6c2b-4269-8b38-cd5f53f0017a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 204 len: 0 microversion: 2.1 time: 0.361675 Jun 25 21:06:16.952819 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1660/3635] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:16 2022] DELETE /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:06:16.965471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:16.966248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:16.979162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.981073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:16.981920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:16.982377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:17.165644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:17.185948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f03bb3c-a292-4db2-a472-4123fa987a89 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1469 microversion: 2.1 time: 0.224932 Jun 25 21:06:17.187910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1976/3636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:16 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:17.217627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:17.218806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:17.226585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:17.227070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:17.227851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:17.228511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:17.902130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:17.903035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:17.922411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:17.922849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:17.923828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:17.924272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:17.953361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:17.994430 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4461379b-37cf-492b-9bd4-1d26c1cc71d6 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.775279 Jun 25 21:06:18.002207 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1661/3637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:17 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:18.107109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:18.119495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:18.121977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:18.123286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-062ba004-4554-4f6c-a86a-bbef4334703c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.225230 Jun 25 21:06:18.124478 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1977/3638] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:17 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:18.206936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:18.207511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:18.217347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3b6d1339-d1fd-4634-a203-30988185ccca req-ce9a3744-c33f-4592-826f-a45a640ae176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def3f120-ac80-4b2f-8cad-7d7859fc5246", "name": "network-vif-deleted", "tag": "4e6556ec-82c5-4ce6-8c04-2b5bfade04b6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:18.226299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:18.227961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:18.229031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:18.232302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:18.234215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3b6d1339-d1fd-4634-a203-30988185ccca req-ce9a3744-c33f-4592-826f-a45a640ae176 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:18.234904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3b6d1339-d1fd-4634-a203-30988185ccca req-ce9a3744-c33f-4592-826f-a45a640ae176 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:18.252302 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3b6d1339-d1fd-4634-a203-30988185ccca req-ce9a3744-c33f-4592-826f-a45a640ae176 service nova] Creating event network-vif-deleted:4e6556ec-82c5-4ce6-8c04-2b5bfade04b6 for instance def3f120-ac80-4b2f-8cad-7d7859fc5246 on nch2-master-1 Jun 25 21:06:18.262134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3b6d1339-d1fd-4634-a203-30988185ccca req-ce9a3744-c33f-4592-826f-a45a640ae176 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051226 Jun 25 21:06:18.265288 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1978/3639] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:18.804555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:18.815760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-97b4e2cd-e106-4e49-8d8f-217700843096 tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1469 microversion: 2.1 time: 0.614680 Jun 25 21:06:18.817177 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1662/3640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:18 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1469 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:19.014404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:19.015385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:19.023245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.023919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:19.025046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.025658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:19.147091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:19.147998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:19.156952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.157503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:19.158556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.159243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:19.165542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:19.323411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:19.331675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2bfb56ba-44f3-4481-92aa-7e6dc5fe101b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.322421 Jun 25 21:06:19.332818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1979/3641] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:19 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:19.337606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:19.354516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:19.356368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:19.358482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6a307f0-63bf-45ab-bf23-732f3791eda2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.216904 Jun 25 21:06:19.359596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1663/3642] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:19 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:19.835348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:19.835991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:19.843194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.843658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:19.844472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:19.844913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.033776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d3257db63ed4bf0861abc735c1e83ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5e11266f1884df8b0f27ebc2f4133d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:20.043943 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7173f307-8c67-4f67-9897-cc81784104ed tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 200 len: 1469 microversion: 2.1 time: 0.214545 Jun 25 21:06:20.045047 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1980/3643] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:19 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:20.121747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-33c25268-559a-4805-bf3d-b1eb55bdd2e1 req-bf416f72-6525-43eb-8690-24f5c155c205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e03d38f8-6dce-4362-9511-c88250b1baaa", "name": "network-vif-deleted", "tag": "329afdc7-d57c-4256-ad84-0c6701ea7402"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:20.141133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-33c25268-559a-4805-bf3d-b1eb55bdd2e1 req-bf416f72-6525-43eb-8690-24f5c155c205 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:20.141612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-33c25268-559a-4805-bf3d-b1eb55bdd2e1 req-bf416f72-6525-43eb-8690-24f5c155c205 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.159812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-33c25268-559a-4805-bf3d-b1eb55bdd2e1 req-bf416f72-6525-43eb-8690-24f5c155c205 service nova] Creating event network-vif-deleted:329afdc7-d57c-4256-ad84-0c6701ea7402 for instance e03d38f8-6dce-4362-9511-c88250b1baaa on nch1-master-1 Jun 25 21:06:20.166107 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-33c25268-559a-4805-bf3d-b1eb55bdd2e1 req-bf416f72-6525-43eb-8690-24f5c155c205 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048124 Jun 25 21:06:20.167130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1664/3644] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:20.348485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:20.349312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:20.356954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:20.357413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.358209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:20.358659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.378957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:20.379877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:20.396379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:20.398912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.400659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:20.401399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:20.479940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:20.490454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:20.492754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:20.494185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17b9e9d6-c672-42e2-96bc-f0f0947f917a tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.120446 Jun 25 21:06:20.495056 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1665/3645] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:20 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:20.578257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1068784149", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "c568f9af-eb37-4843-aaa4-85eca05265d6"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:20.637745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] validate_networks() for [('c568f9af-eb37-4843-aaa4-85eca05265d6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:06:20.677512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:20.705999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b6a9431a-2ece-49ae-9d47-7431315b78a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.359396 Jun 25 21:06:20.719338 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1981/3646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:20 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:21.064687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:21.068222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] [instance: e03d38f8-6dce-4362-9511-c88250b1baaa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:21.072131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:21.084390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:21.099081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.099834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.100764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.101274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.120742 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] HTTP exception thrown: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Request method failure captured: Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa HTTP/1.1 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eU8y6Lwo4JusrB7QlSgp5M8JZYCdp7q10tsLXLhDeaMfMH-Qmmg1KQTMA0bho6G9lPtyVCPNo1HogvHnOUat3ks0H8oXq1ZT9gA9rtyL1SN0cDGWkMeUZRRjE_R6kisg-GqJTikFTys0nhnVshbB6LHDK-VUGRcSdOFWjpgl8qVsQ Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b5e11266f1884df8b0f27ebc2f4133d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b5e11266f1884df8b0f27ebc2f4133d8"}]}] Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b5e11266f1884df8b0f27ebc2f4133d8 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-MigrationsAdminTest-277741278 Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5d3257db63ed4bf0861abc735c1e83ee Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-MigrationsAdminTest-277741278-project Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e03d38f8-6dce-4362-9511-c88250b1baaa'} Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:21.122602 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:21.128601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] Returning 404 to user: Instance e03d38f8-6dce-4362-9511-c88250b1baaa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:21.129576 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b965510d-6533-41ec-adfe-f588aff4ab1a tempest-MigrationsAdminTest-277741278 tempest-MigrationsAdminTest-277741278-project] 10.222.0.39 "GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa" status: 404 len: 111 microversion: 2.1 time: 0.071087 Jun 25 21:06:21.130280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1982/3647] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:21 2022] GET /compute/v2.1/servers/e03d38f8-6dce-4362-9511-c88250b1baaa => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:06:21.326997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:21.327562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:21.328227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:21.328825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:21.329904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:21.351856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.353178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.354607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.355247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.379639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Getting quotas for project 646b2a5c42444e6891d6cc44e816c918. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:21.386792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Getting quotas for user fdc9d61eb01b444f9071248ecbd1bc43 and project 646b2a5c42444e6891d6cc44e816c918. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:21.404010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:21.406688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:21.484325 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-990b4d20-f9bb-4480-8982-167968720de5 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987940 Jun 25 21:06:21.485084 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1666/3648] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:06:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:06:21.496203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa139d95-900b-47cc-93f6-b25fc6323f64 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:21.497354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa139d95-900b-47cc-93f6-b25fc6323f64 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:21.513868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:21.514811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:21.548519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.564520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.569563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.575755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.629847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa139d95-900b-47cc-93f6-b25fc6323f64 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:21.635220 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa139d95-900b-47cc-93f6-b25fc6323f64 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1225 microversion: 2.1 time: 0.143902 Jun 25 21:06:21.648410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1983/3649] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:21 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:21.725379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:21.727266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:21.750079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.750757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.752924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:21.755839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:21.833518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:21.917723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:21.935031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:21.936940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:21.938625 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-76dffe74-4282-483f-8228-858e5bbfca5c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.429162 Jun 25 21:06:21.939857 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1667/3650] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:21 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:22.016944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:22.029932 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c524d271-0f76-4b0e-9ceb-51ff9d58e73b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.308716 Jun 25 21:06:22.045543 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1984/3651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:21 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:22.653131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:22.653758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:22.672777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:22.673278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:22.674105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:22.674714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:22.798691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:22.812228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-232c1b54-612f-4e5f-8398-f627290ce4e1 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1277 microversion: 2.1 time: 0.163499 Jun 25 21:06:22.813273 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1668/3652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:22 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:22.966333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:22.967628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:22.985646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:22.989337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:22.990467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:22.991089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:23.062181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:23.062883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:23.078430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:23.078882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:23.079668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:23.080101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:23.285777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:23.323829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:23.330090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:23.331361 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d404caf3-990b-4420-b6e0-86772be7855f tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.378196 Jun 25 21:06:23.337364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1985/3653] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:22 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:23.753824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:23.776021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85932d91-3447-4f5c-a0d5-fdfa5ea67b5f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.716516 Jun 25 21:06:23.784163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1669/3654] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:23 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:23.830574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:23.831529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:23.845630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:23.847211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:23.849498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:23.850413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:24.073472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:24.085545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34fe683e-ad3d-4929-8de0-dd858797ad2b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1283 microversion: 2.1 time: 0.257987 Jun 25 21:06:24.087886 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1986/3655] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:23 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:24.350959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:24.352757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:24.369074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:24.369579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:24.370588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:24.371028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:24.512753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:24.521511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:24.542110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:24.544128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cae0fad1-b302-4103-b7a3-87c290bfae9c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.197072 Jun 25 21:06:24.545723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1670/3656] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:24 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:24.803116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:24.803997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:24.817497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:24.818235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:24.819239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:24.819845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.103075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:25.103698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:25.118306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:25.118769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.119550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:25.125819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.204497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:25.214172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ae0fdd4-aa55-47d7-8e82-0575ebb0126c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.416248 Jun 25 21:06:25.222056 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1987/3657] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:24 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:25.568125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:25.568778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:25.579903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:25.591841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.592708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:25.593145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.750762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:25.764889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:25.768346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:25.773101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-804e0265-c2e1-4bfd-b717-60bc0c790d2b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.212907 Jun 25 21:06:25.773101 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1988/3658] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:25 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:25.827955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:25.836557 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4bdbfbba-2c6d-457b-a53f-ed02c2bc9f5b tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.737296 Jun 25 21:06:25.837116 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1671/3659] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:25 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:25.921419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-331c4d2f-4045-4876-9b12-067db137c6d0 req-ad3c6af8-2b5b-4335-981c-6f64f16eb56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39dafdd8-b069-4454-9669-1b9c5bb2e266", "tag": "2257c93e-9d8e-4066-89b8-702425cca780"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:25.935095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-331c4d2f-4045-4876-9b12-067db137c6d0 req-ad3c6af8-2b5b-4335-981c-6f64f16eb56e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:25.935299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-331c4d2f-4045-4876-9b12-067db137c6d0 req-ad3c6af8-2b5b-4335-981c-6f64f16eb56e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:25.987703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-331c4d2f-4045-4876-9b12-067db137c6d0 req-ad3c6af8-2b5b-4335-981c-6f64f16eb56e service nova] Creating event network-changed:2257c93e-9d8e-4066-89b8-702425cca780 for instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 on nch2-master-1 Jun 25 21:06:26.006928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-331c4d2f-4045-4876-9b12-067db137c6d0 req-ad3c6af8-2b5b-4335-981c-6f64f16eb56e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088590 Jun 25 21:06:26.007638 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1672/3660] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:26.009668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3134c255-c4f4-454e-b4db-26a4bb942b73 tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] Calling method '.version_select at 0x7f984fc63790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:26.010999 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:06:26.010999 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:06:26.026165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3134c255-c4f4-454e-b4db-26a4bb942b73 tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.250015 Jun 25 21:06:26.027088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1989/3661] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 21:06:25 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:26.038856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce56c562-168b-4935-9483-55dba289e26d tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] Action: 'update', calling method: .version_select at 0x7f984fd8e0d0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:26.041779 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:06:26.041779 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:06:26.100657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=5,nova_api:UPDATE=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:26.236082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:26.237864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:26.250402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.250855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.251686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.252126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.407511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce56c562-168b-4935-9483-55dba289e26d tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.373327 Jun 25 21:06:26.408692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1673/3662] 10.222.0.39 () {60 vars in 1205 bytes} [Sat Jun 25 21:06:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:26.420694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-780cd30d-f0e6-464e-88c9-88e1cbf80f9c tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] Calling method '.version_select at 0x7f984fe5ef70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:26.422617 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:06:26.422617 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:06:26.437160 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-780cd30d-f0e6-464e-88c9-88e1cbf80f9c tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.021559 Jun 25 21:06:26.437988 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1674/3663] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 21:06:26 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:26.449081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04b929bb-0fc2-412b-b3f1-e10f0165284d tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] Action: 'update', calling method: .version_select at 0x7f984fe26670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:26.525714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:26.539902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d701c007-df10-4453-97fa-d577d578c4cd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.310364 Jun 25 21:06:26.574793 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1990/3664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:26 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:26.597656 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04b929bb-0fc2-412b-b3f1-e10f0165284d tempest-QuotaClassesAdminTestJSON-1467102679 tempest-QuotaClassesAdminTestJSON-1467102679-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.152476 Jun 25 21:06:26.604294 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1675/3665] 10.222.0.39 () {60 vars in 1205 bytes} [Sat Jun 25 21:06:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:26.792560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:26.793835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:26.801480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.803352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.804340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.805677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.854540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:26.856217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:26.872371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.872982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.875094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:26.875767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:26.914589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:26.927384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:26.933032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:26.938083 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ef30a73-edb1-4e5c-b635-3412b8cc33c2 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.149958 Jun 25 21:06:26.940621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1991/3666] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:26 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:27.105768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:27.113675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e28e4c8-59fb-4194-a938-f12445190760 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.263874 Jun 25 21:06:27.114254 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1676/3667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:26 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:27.563306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:27.563942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:27.571196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:27.571657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:27.572460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:27.572948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:27.733240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:27.741571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b6ce184-8cce-4e7f-9fbb-a43051c85445 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.182116 Jun 25 21:06:27.742481 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1992/3668] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:27 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:27.965931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:27.967071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:27.975747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:27.976594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:27.978132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:27.978890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.081260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:28.097810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:28.101207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:28.102959 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a109c9af-54ce-4d95-a125-ee4d5c85580b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.141464 Jun 25 21:06:28.113934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1677/3669] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:27 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:28.130692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:28.131322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:28.137950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:28.138391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.139287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:28.139750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.286805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:28.298327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7787f804-bd01-4a7a-b1b6-022da5763d88 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.171627 Jun 25 21:06:28.299664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1993/3670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:28 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:28.754503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-904b3594-70b5-408c-88d4-69d33c6d0357 req-d198762a-c002-4d52-8ede-d4eb53993626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-plugged", "status": "completed", "tag": "3c10b649-a52b-4215-91c4-76eca8abefab"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:28.758062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:28.758693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:28.766280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-904b3594-70b5-408c-88d4-69d33c6d0357 req-d198762a-c002-4d52-8ede-d4eb53993626 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:28.766954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-904b3594-70b5-408c-88d4-69d33c6d0357 req-d198762a-c002-4d52-8ede-d4eb53993626 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.767125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:28.767676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.768884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:28.769803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:28.802191 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-904b3594-70b5-408c-88d4-69d33c6d0357 req-d198762a-c002-4d52-8ede-d4eb53993626 service nova] Creating event network-vif-plugged:3c10b649-a52b-4215-91c4-76eca8abefab for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:28.813863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-904b3594-70b5-408c-88d4-69d33c6d0357 req-d198762a-c002-4d52-8ede-d4eb53993626 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063340 Jun 25 21:06:28.817159 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1678/3671] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:29.003910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:29.015885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7fd087a8-9309-47b4-9ecd-87579a7ae82f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.260718 Jun 25 21:06:29.016532 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1994/3672] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:28 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:29.126189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:29.129653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:29.139471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:29.141060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:29.142159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:29.143160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:29.238943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:29.260230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:29.265958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:29.267289 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7bdc8f41-e7d3-47d1-89bc-7cd7dfc53658 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.148825 Jun 25 21:06:29.270751 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1679/3673] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:29 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:29.317542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:29.318251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:29.328667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:29.329126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:29.329907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:29.331695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:29.579711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:29.589842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cc1add57-9895-4260-87a8-4d88b924852e tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.276117 Jun 25 21:06:29.591770 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1995/3674] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:29 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:30.033031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.033848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:30.041155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.041746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.042591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.043096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.153725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a952d009-0b63-4dab-bfaf-fd4ca3c04842 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984ff255e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.204566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:30.212395 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63ffb334-5824-408e-bd87-47549d5c43ff tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.183253 Jun 25 21:06:30.220185 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1996/3675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:30.227320 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a952d009-0b63-4dab-bfaf-fd4ca3c04842 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6" status: 200 len: 371 microversion: 2.1 time: 0.221999 Jun 25 21:06:30.228009 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1680/3676] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6 => generated 371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:30.238143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Action: 'update', calling method: .version_select at 0x7f9861e9b820>, body: {"quota_set": {"ram": "5120"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:30.289082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.289697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:30.296069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.296555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.297302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.297735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.305873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.306328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.307145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.307606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.361027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4656824-ec21-442f-b2b3-bc0a50362dd1 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6" status: 200 len: 328 microversion: 2.1 time: 0.126401 Jun 25 21:06:30.366588 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1997/3677] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 21:06:30 2022] PUT /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6 => generated 328 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:30.367279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:30.371852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40481cb0-aacf-456e-ad2a-319b3084bd9f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.374719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:30.376328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:30.378068 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1196e3ab-bf22-4aee-9dba-83cdae4fff4d tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.092712 Jun 25 21:06:30.382586 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40481cb0-aacf-456e-ad2a-319b3084bd9f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6" status: 202 len: 0 microversion: 2.1 time: 0.014418 Jun 25 21:06:30.386262 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1998/3678] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:06:30 2022] DELETE /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6 => generated 0 bytes in 16 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:06:30.386385 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1681/3679] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:30.390883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84ff1bdb-28a7-44c0-9694-b281bc07f920 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984fcbfca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.454727 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84ff1bdb-28a7-44c0-9694-b281bc07f920 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6" status: 200 len: 371 microversion: 2.1 time: 0.067423 Jun 25 21:06:30.455429 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 1999/3680] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/os-quota-sets/2017fe70e1d549eeb093ed121c9b10e6 => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:30.574515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d79f8d3-193f-4203-a04b-8f2ffa41d771 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984fe26310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.610745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:30.611755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:30.622452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.623257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.625560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.626372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.779537 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d79f8d3-193f-4203-a04b-8f2ffa41d771 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031/defaults" status: 200 len: 371 microversion: 2.1 time: 0.208858 Jun 25 21:06:30.780508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1682/3681] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031/defaults => generated 371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:30.830589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:30.841907 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-300a59d3-1792-4fc8-bae1-c0442f77a057 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.237900 Jun 25 21:06:30.847060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-plugged", "status": "completed", "tag": "4a6b941d-41da-4d2b-b381-9230a9d24c9c"}, {"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-plugged", "status": "completed", "tag": "5aeb855f-8363-46ff-a898-c5c768656d71"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:30.851602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2000/3682] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:30 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:30.858027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:30.858476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:30.870959 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] Creating event network-vif-plugged:4a6b941d-41da-4d2b-b381-9230a9d24c9c for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:30.871490 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] Creating event network-vif-plugged:5aeb855f-8363-46ff-a898-c5c768656d71 for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:30.877332 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2dd27fcf-5a26-40fd-ade7-a3a9074216dc req-7c52942f-21ca-4425-93ae-3befd29844df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034397 Jun 25 21:06:30.878726 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1683/3683] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:31.028442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Action: 'update', calling method: .version_select at 0x7f9861e93f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:31.153067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.153684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.154454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.154961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.206081 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-151f4e57-e688-47c1-8015-fb107342db30 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd" status: 200 len: 328 microversion: 2.1 time: 0.182615 Jun 25 21:06:31.206726 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2001/3684] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 21:06:31 2022] PUT /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd => generated 328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:31.217890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984fe5e820>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:31.230536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:31.231162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:31.238492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.238944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.239727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.240158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.306669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.307418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.308368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.308851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.334272 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b6749b5-dd4f-4d1e-909e-140fe81f058a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd/detail" status: 200 len: 916 microversion: 2.1 time: 0.120872 Jun 25 21:06:31.335176 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1684/3685] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:06:31 2022] GET /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd/detail => generated 916 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:31.398856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:31.399608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:31.409571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.410162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.410782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.411219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.422068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:31.433983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb7422b1-93a5-42d9-a30d-ae30f40ab1a1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.207764 Jun 25 21:06:31.435358 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2002/3686] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:31 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:31.489661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:31.496433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Action: 'update', calling method: .version_select at 0x7f9861e93550>, body: {"quota_set": {"ram": "2048"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:31.499679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:31.501442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:31.502740 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-148b5428-99cd-4e93-800f-1e7681b31487 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.107956 Jun 25 21:06:31.503558 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1685/3687] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:31 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:31.562091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.562544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.563336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.563774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.597075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.597525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.598320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.598759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.618306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:31.654312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3eb89ddd-2360-4d8c-98ab-9448ba22ff2a tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd?user_id=b98461574ae04936aabbe9b384847465" status: 200 len: 328 microversion: 2.1 time: 0.161847 Jun 25 21:06:31.655061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2003/3688] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 21:06:31 2022] PUT /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd?user_id=b98461574ae04936aabbe9b384847465 => generated 328 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:31.665584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69f05829-f257-4cc8-b7de-955df5f3503f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984fd8e430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:31.742538 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69f05829-f257-4cc8-b7de-955df5f3503f tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd?user_id=b98461574ae04936aabbe9b384847465" status: 200 len: 370 microversion: 2.1 time: 0.080622 Jun 25 21:06:31.743239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1686/3689] 10.222.0.39 () {58 vars in 1322 bytes} [Sat Jun 25 21:06:31 2022] GET /compute/v2.1/os-quota-sets/bf9dcac865924a2085c4632e27921fbd?user_id=b98461574ae04936aabbe9b384847465 => generated 370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:31.858428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:31.859163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:31.865608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.866074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:31.866847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:31.867273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.017242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:32.026179 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-921542a2-6347-4f86-a2f6-48c547d2d10f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.171795 Jun 25 21:06:32.026968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2004/3690] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:31 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:32.109206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b33dfb8a-e2fc-45d0-9e80-2b35e4a4a9d8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Calling method '.version_select at 0x7f984fd9caf0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:32.286527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:UPDATE=21 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:32.292261 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b33dfb8a-e2fc-45d0-9e80-2b35e4a4a9d8 tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031/defaults" status: 200 len: 371 microversion: 2.1 time: 0.187317 Jun 25 21:06:32.292871 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1687/3691] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:06:32 2022] GET /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031/defaults => generated 371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:32.303485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Action: 'update', calling method: .version_select at 0x7f9861f35d30>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:32.371772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.372230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.373069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.373514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.454004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:32.455283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:32.463408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.464064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.465476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.466019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.601891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24772340-b7e3-4d2f-bd8a-bd35fabc042c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031" status: 200 len: 329 microversion: 2.1 time: 0.302140 Jun 25 21:06:32.602809 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2005/3692] 10.222.0.39 () {60 vars in 1262 bytes} [Sat Jun 25 21:06:32 2022] PUT /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031 => generated 329 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:32.613937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:32.614643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:32.622356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.623062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.624321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.624321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.640900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:32.653909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:32.663739 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7514266-35d4-4cfc-9cf0-52c6e96ab873 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1355 microversion: 2.1 time: 0.214591 Jun 25 21:06:32.664895 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1688/3693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:32 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1355 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:32.669680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Action: 'update', calling method: .version_select at 0x7f984fed5430>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:32.713815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:32.724907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:32.726841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:32.728537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54f60243-2859-4876-9111-ab7858094054 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.119622 Jun 25 21:06:32.730018 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2006/3694] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:32 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:32.769225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.769770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.770690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.771163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.897480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a725ac05-d042-4206-9700-2b05214b2b2f req-fcfe5085-11d9-4c03-b587-0e6b2bcd2020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39dafdd8-b069-4454-9669-1b9c5bb2e266", "name": "network-vif-plugged", "status": "completed", "tag": "2257c93e-9d8e-4066-89b8-702425cca780"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:32.907602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a725ac05-d042-4206-9700-2b05214b2b2f req-fcfe5085-11d9-4c03-b587-0e6b2bcd2020 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:32.908084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a725ac05-d042-4206-9700-2b05214b2b2f req-fcfe5085-11d9-4c03-b587-0e6b2bcd2020 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:32.922211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a725ac05-d042-4206-9700-2b05214b2b2f req-fcfe5085-11d9-4c03-b587-0e6b2bcd2020 service nova] Creating event network-vif-plugged:2257c93e-9d8e-4066-89b8-702425cca780 for instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 on nch2-master-1 Jun 25 21:06:32.928986 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a725ac05-d042-4206-9700-2b05214b2b2f req-fcfe5085-11d9-4c03-b587-0e6b2bcd2020 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034980 Jun 25 21:06:32.929932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2007/3695] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:33.045305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:33.046075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:33.054898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.055419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.056215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.056743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.122806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-690e0637-4bf8-4260-a86c-dd13f53e1f1c tempest-QuotasAdminTestJSON-122975825 tempest-QuotasAdminTestJSON-122975825-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031" status: 200 len: 329 microversion: 2.1 time: 0.456718 Jun 25 21:06:33.123423 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1689/3696] 10.222.0.39 () {60 vars in 1262 bytes} [Sat Jun 25 21:06:32 2022] PUT /compute/v2.1/os-quota-sets/681cedebb0ca40b1bf5214248e378031 => generated 329 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:33.316231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:33.328222 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-261ff574-1c71-4f00-b46a-f93710e6d698 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.287978 Jun 25 21:06:33.329251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2008/3697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:33 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:33.681727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:33.683141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:33.690974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.691498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.692568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.693082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.752830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:33.753808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:33.760933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.761601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.762570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:33.763153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:33.831898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:33.841859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:33.846550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:33.846550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e31a0411-012e-4eb5-a4da-d2f6df67cfb3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.096638 Jun 25 21:06:33.846550 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2009/3698] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:33 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:33.977626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:33.989808 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-af2fdfd4-6eab-4957-95ff-47182b6d37d9 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1806 microversion: 2.1 time: 0.311816 Jun 25 21:06:34.001575 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1690/3699] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:33 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1806 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:34.008213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:34.008810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:34.017649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.017941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.018872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.019345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.059439 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c063f4d3-35e2-4b41-91a4-d84ad31c8365 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6/ips" status: 200 len: 219 microversion: 2.1 time: 0.055196 Jun 25 21:06:34.067760 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2010/3700] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:06:34 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6/ips => generated 219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:34.073160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:34.073936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:34.081728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.082456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.083392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.083976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.104960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:34.118634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:34.279150 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-57bd3deb-d935-4d83-8055-5d6b519caca0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 204 len: 0 microversion: 2.1 time: 0.211045 Jun 25 21:06:34.280577 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1691/3701] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:34 2022] DELETE /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:06:34.288857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:34.289484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:34.303395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.305422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.306232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.306678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.349049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:34.350172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:34.365176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.368733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.369677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.370124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.615622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:34.625840 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db838a54-809e-4094-8d96-0f261bc49b60 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1812 microversion: 2.1 time: 0.340801 Jun 25 21:06:34.627418 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2011/3702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:34 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1812 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:34.663210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:34.705825 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-978d7849-9fdc-4755-abea-caf1bdbfd05f tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.362932 Jun 25 21:06:34.707060 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1692/3703] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:34 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:34.865224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:34.865910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:34.872768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.873222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:34.874202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:34.875040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:35.026093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:35.039893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:35.041476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:35.048705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-573fba94-0624-4be9-ba77-30110c4b78f9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.186966 Jun 25 21:06:35.049309 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2012/3704] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:34 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:35.644801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:35.645619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:35.653070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:35.653783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:35.654734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:35.655324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:35.723022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:35.724363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:35.746260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:35.746729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:35.747761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:35.748223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:35.893892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:35.907493 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12ce09d3-8295-4ef9-b725-d1e3277e37d7 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1812 microversion: 2.1 time: 0.265231 Jun 25 21:06:35.909007 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1693/3705] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:35 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1812 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:35.963716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:35.979249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7538587-5e68-46c3-a787-7d1f2a000e5d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1325 microversion: 2.1 time: 0.259857 Jun 25 21:06:35.980947 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2013/3706] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:35 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1325 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:36.078243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:36.081181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:36.090222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:36.091286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:36.092264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:36.092883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:36.202194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:36.213646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:36.216530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:36.217997 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d7f42c8-cbd2-4980-8348-5a92eb59dd2e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.154075 Jun 25 21:06:36.219236 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1694/3707] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:36 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:36.925934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:36.927332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:36.934942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:36.935525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:36.936625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:36.937184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:36.995671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:36.996302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.010286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.011324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.012650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.013542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.250851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:37.262458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-001efa9e-7af9-4a39-90f2-59f339da2401 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1522 microversion: 2.1 time: 0.270699 Jun 25 21:06:37.263560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1695/3708] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:36 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:37.269699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:37.271419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.280219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.281083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.281881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.282320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.380463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:37.394632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:37.396181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:37.397464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca73cfea-d6c7-4a83-b3c8-dfccea856f1c tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.132692 Jun 25 21:06:37.398033 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1696/3709] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:37 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:37.402948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:37.403686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.414867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.415593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.416494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.417838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.446659 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] HTTP exception thrown: Action 999 not found Jun 25 21:06:37.454930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Request method failure captured: Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266/os-instance-actions/999 HTTP/1.1 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3jMbno3JQsZBH527JLLswIN326Mu_TuhNVDVTsE9KqbOGrfq9Dkyfu5vAP30s_bPi-IoCLtaz7n2WqTuDPrkGifDnNmRCFLVA8vZbZQeRp1WK0Y9kd9XX_ZNp5CTjTydfdkWV_YyO2MJ6960MKA87ssJI-VgGcK4ojPIvK3UQ1c_xc Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}] Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: fdc9d61eb01b444f9071248ecbd1bc43 Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: exception: Action 999 not found Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '39dafdd8-b069-4454-9669-1b9c5bb2e266', 'id': '999'} Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jun 25 21:06:37.458899 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.463305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Returning 404 to user: Action 999 not found {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:37.463305 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eebe30d0-bab6-4e91-8fa0-ac5c357ac745 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.063707 Jun 25 21:06:37.465729 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1697/3710] 10.222.0.39 () {58 vars in 1307 bytes} [Sat Jun 25 21:06:37 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266/os-instance-actions/999 => generated 66 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:06:37.473794 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cb8e9f86-e600-45ba-ac3c-a4cd9b08fed3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1812 microversion: 2.1 time: 0.551800 Jun 25 21:06:37.474688 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2014/3711] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:36 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1812 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:37.488346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '.version_select at 0x7f984fc47700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:37.488955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 28b346c9-9f85-4c89-85fe-6b13e22beadc] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.496196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] HTTP exception thrown: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Request method failure captured: Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/28b346c9-9f85-4c89-85fe-6b13e22beadc/os-instance-actions HTTP/1.1 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3jMbno3JQsZBH527JLLswIN326Mu_TuhNVDVTsE9KqbOGrfq9Dkyfu5vAP30s_bPi-IoCLtaz7n2WqTuDPrkGifDnNmRCFLVA8vZbZQeRp1WK0Y9kd9XX_ZNp5CTjTydfdkWV_YyO2MJ6960MKA87ssJI-VgGcK4ojPIvK3UQ1c_xc Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}] Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: fdc9d61eb01b444f9071248ecbd1bc43 Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '28b346c9-9f85-4c89-85fe-6b13e22beadc'} Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:37.498331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Returning 404 to user: Instance 28b346c9-9f85-4c89-85fe-6b13e22beadc could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2906c390-0a2a-46f1-9c7a-83bb9d9424cd tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/28b346c9-9f85-4c89-85fe-6b13e22beadc/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024038 Jun 25 21:06:37.509390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2015/3712] 10.222.0.39 () {58 vars in 1295 bytes} [Sat Jun 25 21:06:37 2022] GET /compute/v2.1/servers/28b346c9-9f85-4c89-85fe-6b13e22beadc/os-instance-actions => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:37.512911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:37.513818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.528112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.529055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.529858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.530304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.584719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:37.665104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1255617592", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:37.742942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:06:37.787680 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-288b59f9-6c0e-4d48-acf0-35b610906027 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "DELETE /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 204 len: 0 microversion: 2.1 time: 0.280953 Jun 25 21:06:37.788490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2016/3713] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:37 2022] DELETE /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:06:37.795956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8139c0fc-ec50-470a-ae82-eec97365bee9 req-6db65c27-6002-442e-aefb-b552cbc6088a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-deleted", "tag": "4a6b941d-41da-4d2b-b381-9230a9d24c9c"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:37.807465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8139c0fc-ec50-470a-ae82-eec97365bee9 req-6db65c27-6002-442e-aefb-b552cbc6088a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.808370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8139c0fc-ec50-470a-ae82-eec97365bee9 req-6db65c27-6002-442e-aefb-b552cbc6088a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.822913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8139c0fc-ec50-470a-ae82-eec97365bee9 req-6db65c27-6002-442e-aefb-b552cbc6088a service nova] Creating event network-vif-deleted:4a6b941d-41da-4d2b-b381-9230a9d24c9c for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:37.829464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8139c0fc-ec50-470a-ae82-eec97365bee9 req-6db65c27-6002-442e-aefb-b552cbc6088a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038486 Jun 25 21:06:37.830212 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2017/3714] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:37.835426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:37.836116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:37.843323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.844209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.845755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:37.846205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:37.989443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:37.989990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:37.991095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:37.991578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:37.992556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:38.005916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=82,nova_cell0:UPDATE=7 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:38.008820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.009822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.010737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.011414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.034296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:38.038019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=14,nova_api:UPDATE=15 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:38.042114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for user ea5a50f6e8ea470894e19f8c1dec476f and project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:38.060403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:38.063555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:38.143863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:38.152821 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-81d31559-3556-447b-b75f-6b32955ce5de tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.679516 Jun 25 21:06:38.154982 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1698/3715] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:06:38.169593 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3547d206-79cd-4279-92b7-31e37df534ec tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1528 microversion: 2.1 time: 0.337909 Jun 25 21:06:38.170295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2018/3716] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:37 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1528 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:38.237498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-788348913", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:38.360783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:06:38.418095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:38.418956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:38.429277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.429788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.430704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.431142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.548907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:38.560161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:38.562178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:38.563794 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f7b1701c-6e38-49e0-a574-8c53ef8fac1e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.150453 Jun 25 21:06:38.565071 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2019/3717] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:38 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:38.581055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:38.581920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:38.589052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.589997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.590918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.591252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.797624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:38.798070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:38.798547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:38.798961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:38.799441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:38.836046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.836597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.837458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:38.837899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:38.881388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:38.896699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for user ea5a50f6e8ea470894e19f8c1dec476f and project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:38.923035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:38.925319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:38.959449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:38.971487 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-365823ae-2b76-4a16-8013-86387afb27ab tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1770 microversion: 2.1 time: 0.404780 Jun 25 21:06:38.972096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2020/3718] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:38 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1770 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:38.980852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7acb954-ddea-4244-ad5a-01eb93465ec7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748453 Jun 25 21:06:38.981905 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1699/3719] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:06:38.987016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-74cb16be-8c50-45fd-93a0-b217eed3b74c req-6683b85d-5af3-43e9-82d9-33f050a110e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-unplugged", "status": "completed", "tag": "5aeb855f-8363-46ff-a898-c5c768656d71"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:38.996189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d307efa-5baa-4f7e-b07e-3c5c38a28043 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:39.002653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d307efa-5baa-4f7e-b07e-3c5c38a28043 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:39.016715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-74cb16be-8c50-45fd-93a0-b217eed3b74c req-6683b85d-5af3-43e9-82d9-33f050a110e7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.018164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-74cb16be-8c50-45fd-93a0-b217eed3b74c req-6683b85d-5af3-43e9-82d9-33f050a110e7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.032601 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-74cb16be-8c50-45fd-93a0-b217eed3b74c req-6683b85d-5af3-43e9-82d9-33f050a110e7 service nova] Creating event network-vif-unplugged:5aeb855f-8363-46ff-a898-c5c768656d71 for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:39.045475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-74cb16be-8c50-45fd-93a0-b217eed3b74c req-6683b85d-5af3-43e9-82d9-33f050a110e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062097 Jun 25 21:06:39.047642 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1700/3720] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:39.095447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d307efa-5baa-4f7e-b07e-3c5c38a28043 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:39.103768 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d307efa-5baa-4f7e-b07e-3c5c38a28043 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1213 microversion: 2.1 time: 0.112573 Jun 25 21:06:39.119004 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2021/3721] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:38 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:39.189587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:39.190313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:39.198148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.198714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.199575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.200019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.582381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:39.582983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:39.592825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.593278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.594069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.594550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.755476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:39.768027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:39.769586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:39.770804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d442e05-b105-4820-b48f-c34e1f474fa7 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.192512 Jun 25 21:06:39.800825 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2022/3722] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:39 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:39.844777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:39.863892 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab423511-c567-4dcf-9052-8629afdbbfd6 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1528 microversion: 2.1 time: 0.676738 Jun 25 21:06:39.865255 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1701/3723] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:39 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1528 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:39.884491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-deleted", "tag": "3c10b649-a52b-4215-91c4-76eca8abefab"}, {"server_uuid": "6df1cfdb-ff38-4305-b99a-df57f73a24e6", "name": "network-vif-deleted", "tag": "5aeb855f-8363-46ff-a898-c5c768656d71"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:39.898112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:39.898785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:39.911389 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] Creating event network-vif-deleted:3c10b649-a52b-4215-91c4-76eca8abefab for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:39.911979 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] Creating event network-vif-deleted:5aeb855f-8363-46ff-a898-c5c768656d71 for instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 on nch2-master-1 Jun 25 21:06:39.918881 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-16f90557-0035-4067-a836-c735b07d8085 req-c371e015-8d4f-4efe-bc45-7d8edb55e452 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041598 Jun 25 21:06:39.919505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2023/3724] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:39.990404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:39.993351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:40.014265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.016556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.020014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.022064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.131274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.131988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.132630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lazy-loading 'fault' on Instance uuid 6df1cfdb-ff38-4305-b99a-df57f73a24e6 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:06:40.137378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:40.137378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:40.152915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.160651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.163107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.164237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.300844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:40.313761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa1f904e-ae77-49be-807e-23bf65497361 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1265 microversion: 2.1 time: 0.182932 Jun 25 21:06:40.314745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2024/3725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:40 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:40.624679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:40.636910 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7efe3d25-eca3-4e15-b11d-0f52964c4cc0 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 200 len: 1303 microversion: 2.1 time: 0.651139 Jun 25 21:06:40.637516 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1702/3726] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:39 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 1303 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:40.796287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:40.804390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:40.826362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.826822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.833861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.837548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.881618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:40.882248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:40.901513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.902501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.908517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:40.909981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:40.958546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:40.962329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:40.975228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:40.990856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:40.992391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5c8019f-2ec6-4ac4-a597-2abeaae91e3b tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.200407 Jun 25 21:06:40.993651 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2025/3727] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:40 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:41.342019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:41.346711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:41.353316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=15,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:41.392804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc9d61eb01b444f9071248ecbd1bc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646b2a5c42444e6891d6cc44e816c918', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:41.402309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:41.404495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55d9576d-fe98-4263-8c7a-67d44237e067 tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 200 len: 1528 microversion: 2.1 time: 0.526706 Jun 25 21:06:41.406690 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1703/3728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:40 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:41.407425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:41.408448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:41.426202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:41.457328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-046f3bc7-e039-40d0-8c67-e3108e3f3d1e req-f5a5f062-e6eb-4945-be77-f9390bfd90cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39dafdd8-b069-4454-9669-1b9c5bb2e266", "name": "network-vif-deleted", "tag": "2257c93e-9d8e-4066-89b8-702425cca780"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:41.484375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-046f3bc7-e039-40d0-8c67-e3108e3f3d1e req-f5a5f062-e6eb-4945-be77-f9390bfd90cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:41.486442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-046f3bc7-e039-40d0-8c67-e3108e3f3d1e req-f5a5f062-e6eb-4945-be77-f9390bfd90cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:41.524549 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-046f3bc7-e039-40d0-8c67-e3108e3f3d1e req-f5a5f062-e6eb-4945-be77-f9390bfd90cf service nova] Creating event network-vif-deleted:2257c93e-9d8e-4066-89b8-702425cca780 for instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 on nch2-master-1 Jun 25 21:06:41.538629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-046f3bc7-e039-40d0-8c67-e3108e3f3d1e req-f5a5f062-e6eb-4945-be77-f9390bfd90cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086829 Jun 25 21:06:41.540783 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1704/3729] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:41.659600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:41.660374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:41.673943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:41.674596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:41.675445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:41.675881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:41.709392 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 HTTP/1.1 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6df1cfdb-ff38-4305-b99a-df57f73a24e6'} Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:41.716358 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:06:41.723364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:41.725738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:41.727031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43d803d9-56a9-40ce-a907-b04f582e2a40 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 404 len: 111 microversion: 2.1 time: 0.076102 Jun 25 21:06:41.727703 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1705/3730] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:41 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:41.810157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:41.819366 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-396dd48c-8327-40ca-bb8c-d912772983e1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1271 microversion: 2.1 time: 0.492015 Jun 25 21:06:41.821014 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2026/3731] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:41 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1271 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:42.012345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:42.013017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:42.026354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.026828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:42.032921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.033667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:42.177887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:42.186731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:42.188258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:42.189486 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9336254-fc73-4ef5-83e3-7153f377a2da tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.181262 Jun 25 21:06:42.192613 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1706/3732] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:42 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:42.425304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:42.426244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] [instance: 39dafdd8-b069-4454-9669-1b9c5bb2e266] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:42.429467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=11 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:42.436953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.437683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:42.438745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.439400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:42.497409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] HTTP exception thrown: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Request method failure captured: Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 HTTP/1.1 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3jMbno3JQsZBH527JLLswIN326Mu_TuhNVDVTsE9KqbOGrfq9Dkyfu5vAP30s_bPi-IoCLtaz7n2WqTuDPrkGifDnNmRCFLVA8vZbZQeRp1WK0Y9kd9XX_ZNp5CTjTydfdkWV_YyO2MJ6960MKA87ssJI-VgGcK4ojPIvK3UQ1c_xc Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_646b2a5c42444e6891d6cc44e816c918"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/646b2a5c42444e6891d6cc44e816c918"}]}] Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 646b2a5c42444e6891d6cc44e816c918 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-18364223 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: fdc9d61eb01b444f9071248ecbd1bc43 Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-18364223-project Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '39dafdd8-b069-4454-9669-1b9c5bb2e266'} Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:42.512709 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] Returning 404 to user: Instance 39dafdd8-b069-4454-9669-1b9c5bb2e266 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c93a7d26-f15f-42a3-9928-2180273d480d tempest-InstanceActionsNegativeTestJSON-18364223 tempest-InstanceActionsNegativeTestJSON-18364223-project] 10.222.0.39 "GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266" status: 404 len: 111 microversion: 2.1 time: 0.095748 Jun 25 21:06:42.517411 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2027/3733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:42 2022] GET /compute/v2.1/servers/39dafdd8-b069-4454-9669-1b9c5bb2e266 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:06:42.845722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:42.848366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:42.856018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.857262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:42.858477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:42.859155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:43.027152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:43.069296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2932d290-81f0-4113-96e1-3696bc8003d0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1271 microversion: 2.1 time: 0.233934 Jun 25 21:06:43.075814 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1707/3734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:42 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1271 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:43.209715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:43.211612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:43.225616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:43.226547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:43.227575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:43.229640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:43.357884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:43.374730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:43.377835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:43.379816 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fb68e0f-af93-4dd9-91be-90e7e2419951 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.174263 Jun 25 21:06:43.380706 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2028/3735] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:43 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:44.092923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:44.093755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:44.120848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:44.124827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:44.126228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:44.126860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:44.398829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:44.400203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:44.407566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:44.408391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:44.409458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:44.410138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:44.546686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:44.562586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:44.565440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:44.566704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd3fe70e-af3a-400b-9577-2cf5d2bfe688 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1408 microversion: 2.54 time: 0.171834 Jun 25 21:06:44.567646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2029/3736] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:44 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:44.780052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:44.788414 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d586da2c-a2ee-419d-8c6c-799c0fb996a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.700839 Jun 25 21:06:44.789017 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1708/3737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:44 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:45.593427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:45.597395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:45.620636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:45.626852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:45.628883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:45.631746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:45.805223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:45.806031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:45.823659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:45.824970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:45.826023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:45.826697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:45.850753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:46.114876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:46.130562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:46.134123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:46.137814 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e88c11c1-df83-4b36-bb2c-7bc3101ef2dc tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1414 microversion: 2.54 time: 0.553707 Jun 25 21:06:46.138430 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2030/3738] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:45 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1414 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:46.151397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6c3f2636-e637-403f-a0a7-a60a35d180b1 req-74f1948c-a390-4ff0-8ae2-c31515d78b1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c915083-b7bd-47e7-8861-52f5e318b2b4", "tag": "3002f539-100d-48dc-a62d-0dab07c8a061"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:46.173740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c3f2636-e637-403f-a0a7-a60a35d180b1 req-74f1948c-a390-4ff0-8ae2-c31515d78b1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:46.174604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c3f2636-e637-403f-a0a7-a60a35d180b1 req-74f1948c-a390-4ff0-8ae2-c31515d78b1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:46.208296 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6c3f2636-e637-403f-a0a7-a60a35d180b1 req-74f1948c-a390-4ff0-8ae2-c31515d78b1b service nova] Creating event network-changed:3002f539-100d-48dc-a62d-0dab07c8a061 for instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 on nch1-master-1 Jun 25 21:06:46.228571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6c3f2636-e637-403f-a0a7-a60a35d180b1 req-74f1948c-a390-4ff0-8ae2-c31515d78b1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082782 Jun 25 21:06:46.229770 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2031/3739] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:46.429493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:46.445228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a19dcae-81cf-43c4-892f-10a493863052 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.640780 Jun 25 21:06:46.448265 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1709/3740] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:45 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:47.157806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:47.158503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:47.172659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.173556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.174584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.175304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.276064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.293192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.295732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.297932 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ca62248-75fa-401a-8f0e-bc034cbba926 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1399 microversion: 2.54 time: 0.143858 Jun 25 21:06:47.299446 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2032/3741] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:47 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1399 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:47.317134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47b2e46f-e4e4-4677-bad0-2ab338c75d36 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '.version_select at 0x7f984fce3940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:47.343467 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47b2e46f-e4e4-4677-bad0-2ab338c75d36 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-868556718" status: 204 len: 0 microversion: 2.54 time: 0.029921 Jun 25 21:06:47.348647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1710/3742] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:06:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-868556718 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:06:47.362198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:47.363492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:47.372141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.372726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.373870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.374531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.418178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:47.466296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:47.467391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:47.481900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.483594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.485953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.488409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.596196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36211adb-ab42-4132-95b2-befe3dd378e9 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "DELETE /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 204 len: 0 microversion: 2.54 time: 0.237925 Jun 25 21:06:47.597458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2033/3743] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:06:47 2022] DELETE /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:06:47.606772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:47.607904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:47.615014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.616152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.617292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:47.617982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:47.798339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.812265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.821689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:47.823027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-020eac27-9da4-4cf8-b099-9927d4d8dd68 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1405 microversion: 2.54 time: 0.220304 Jun 25 21:06:47.824044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2034/3744] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:47 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:48.089549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:48.101354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63eed673-3416-4c03-931d-05c0b4a3cc0e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.641849 Jun 25 21:06:48.102259 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1711/3745] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:47 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:48.255484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e74d254a-6dd4-4e82-a1a1-6b182c8656d1 req-0c2c49cb-40be-4fb5-bfb4-663976c1829b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bead1ab6-e8ae-4873-9eac-b5467789b47b", "tag": "58c6da54-7e63-4bee-84c7-4b09fc2ed426"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:48.271376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e74d254a-6dd4-4e82-a1a1-6b182c8656d1 req-0c2c49cb-40be-4fb5-bfb4-663976c1829b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:48.272573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e74d254a-6dd4-4e82-a1a1-6b182c8656d1 req-0c2c49cb-40be-4fb5-bfb4-663976c1829b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:48.285380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e74d254a-6dd4-4e82-a1a1-6b182c8656d1 req-0c2c49cb-40be-4fb5-bfb4-663976c1829b service nova] Creating event network-changed:58c6da54-7e63-4bee-84c7-4b09fc2ed426 for instance bead1ab6-e8ae-4873-9eac-b5467789b47b on nch1-master-1 Jun 25 21:06:48.298368 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e74d254a-6dd4-4e82-a1a1-6b182c8656d1 req-0c2c49cb-40be-4fb5-bfb4-663976c1829b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041307 Jun 25 21:06:48.299493 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2035/3746] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:48.546531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-56011173", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "04e901cc-7ab6-4339-af79-18ae63556a61"}, {"uuid": "10a4f905-0fa3-4aa7-9852-076d6673def6"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:48.603217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] validate_networks() for [('04e901cc-7ab6-4339-af79-18ae63556a61', None, None, None, None, None), ('10a4f905-0fa3-4aa7-9852-076d6673def6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:06:48.847369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:48.848444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:48.857111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:48.858375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:48.863340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:48.864036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:48.867103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:48.909810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=11 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:48.977477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.002202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.004173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.006339 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-33786571-39a9-46f2-a790-8b86a1e4287e tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1405 microversion: 2.54 time: 0.165438 Jun 25 21:06:49.007472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2036/3747] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:48 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:06:49.119062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:49.119912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:49.122499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=70 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:49.137923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.138545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:49.139649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.140371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:49.466477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.479734 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28579ea3-c4f0-48b3-9e68-c46daf8d4afb tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.365152 Jun 25 21:06:49.490618 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2037/3748] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:49 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:49.783732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:49.787930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.790661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Searching by: {'deleted': False, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:06:49.804411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.805465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:49.806834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.808036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:49.881956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:06:49.919028 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ff7d579-583e-48f5-885d-c5c2e20597af tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.140812 Jun 25 21:06:49.919915 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2038/3749] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:06:49 2022] GET /compute/v2.1/servers => generated 334 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:49.931673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:49.947971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:49.948885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Searching by: {'deleted': False, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:06:49.955943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.956398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:49.957221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:49.957654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.001288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:06:50.051152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:50.067000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:50.067454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.396148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-efdc1644-07ca-426a-8e05-734ce6734cec tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.468754 Jun 25 21:06:50.396993 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2039/3750] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:06:49 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:50.416784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:50.418075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:50.425282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:50.426079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.427806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:50.430397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.578498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:50.595275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:50.597522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:50.599015 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8e54aac-dfd4-4d62-916f-49d1001765ad tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1405 microversion: 2.54 time: 0.187377 Jun 25 21:06:50.599789 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2040/3751] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:50 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:50.617849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-618ab3f7-2c5d-4475-9e12-a0727d6ada9c tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:50.631264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-618ab3f7-2c5d-4475-9e12-a0727d6ada9c tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018564 Jun 25 21:06:50.632582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2041/3752] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:06:50 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:50.638367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:50.639782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:50.648815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:50.649610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.650771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:50.651435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:50.987711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:50.991061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:51.007005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4812709d-cfe8-4a62-8edb-04ebee0825df tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.372844 Jun 25 21:06:51.008573 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2042/3753] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:50 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:51.081409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:51.082169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:51.098605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.099036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.099818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.100251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.169715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:51.332735 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-55683d50-b34c-4574-9780-98ab49246371 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 204 len: 0 microversion: 2.1 time: 0.255199 Jun 25 21:06:51.333718 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2043/3754] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:51 2022] DELETE /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:06:51.347989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:51.348897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:51.358422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.358985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.360656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.361227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.370602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:51.371215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:51.371503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:51.371921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:51.372341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:51.395294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.395790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.396687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.397132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.421620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Getting quotas for project 1174772192cc45578b127d170fda4ebf. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:51.428692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Getting quotas for user 9c53269024eb4c238ec405606e36a049 and project 1174772192cc45578b127d170fda4ebf. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:51.442840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:51.450290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:51.528652 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8cb8ffb0-bdcb-488a-97ab-4c0dc48add8f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.985954 Jun 25 21:06:51.529791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1712/3755] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:06:51.542628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c29406e4-a615-4d68-8454-4555ca4abe9c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:51.543593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c29406e4-a615-4d68-8454-4555ca4abe9c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:51.591939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:51.601279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-713b2055-1c9e-4ea6-b576-6e03ec7bc857 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1701 microversion: 2.1 time: 0.261853 Jun 25 21:06:51.603061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2044/3756] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:51 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1701 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:51.619256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:51.624020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:51.631136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.631605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.632352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.632815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.677419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c29406e4-a615-4d68-8454-4555ca4abe9c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:51.693515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:51.695678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:51.696255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lazy-loading 'fault' on Instance uuid 12cffe08-1d66-4150-8f43-a110cd631837 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:06:51.701826 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c29406e4-a615-4d68-8454-4555ca4abe9c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1211 microversion: 2.1 time: 0.165261 Jun 25 21:06:51.711847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1713/3757] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:51 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:51.759740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:51.771656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:51.773548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:51.775568 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d0d683e-cdbc-46f0-82b3-ea6bd796c1c1 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1410 microversion: 2.54 time: 0.161432 Jun 25 21:06:51.776615 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2045/3758] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:51 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1410 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:52.029357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:52.030410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:52.045312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.045768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.052992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.053453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.471727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:52.479867 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07846483-5c6c-4e61-8288-96d064eb2a7f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.458251 Jun 25 21:06:52.480856 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1714/3759] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:52 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:52.621629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:52.622361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:52.630392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.631015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.632737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.633459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.722674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:52.723516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:52.750425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.750981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.752025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.753537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.852588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:52.864982 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3d213187-529d-42fd-a90b-58409fa5e30a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1263 microversion: 2.1 time: 0.149401 Jun 25 21:06:52.876288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1715/3760] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:52 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:52.883932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:52.884846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:52.895057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.895921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.897107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:52.897749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:52.946261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:52.957976 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2aa6e88f-6454-44de-bb42-8672ee795464 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1701 microversion: 2.1 time: 0.340279 Jun 25 21:06:52.980593 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2046/3761] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:52 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1701 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:53.037337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.038397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.039158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lazy-loading 'fault' on Instance uuid 12cffe08-1d66-4150-8f43-a110cd631837 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:06:53.208178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:53.228883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:53.231074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed80bbb76f8e4636a8ba37c23790b74f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7748ea0850294ce78a3f390458685b9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:53.243449 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02bb0a17-b208-47ce-afd0-0eff144eb2c3 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 200 len: 1410 microversion: 2.54 time: 0.364217 Jun 25 21:06:53.246387 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1716/3762] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:52 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 1410 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:06:53.497997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:53.498949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:53.509811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.510841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.517014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.519195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.870422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:53.882938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:53.884320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:53.896488 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b6cd9c7-9241-4fe3-802c-1185877ef809 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.402225 Jun 25 21:06:53.898228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.898924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.899855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.903425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.908655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2047/3763] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:53 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:53.975643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:53.976732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:53.991841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.993408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:53.995739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:53.998014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.315754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:54.325232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9742e3c5-2dd3-4440-aeae-a01b0d6a956f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1701 microversion: 2.1 time: 0.353870 Jun 25 21:06:54.326141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2048/3764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:53 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1701 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:54.341997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:54.344636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:54.349890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:54.359128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.359597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.360882 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a81ceea1-1a81-476c-8ccc-574e7cd73602 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1269 microversion: 2.1 time: 0.481369 Jun 25 21:06:54.363194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.363635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.373607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1717/3765] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:53 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1269 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:54.382646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:54.384047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] [instance: 12cffe08-1d66-4150-8f43-a110cd631837] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:54.398284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.402093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.403153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.403813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.421344 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] HTTP exception thrown: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Request method failure captured: Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 HTTP/1.1 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3jCMqeYuKNQb_seO2wXVYeoRhSr3wd-gzcHrc-sjoclpcr6EEN-EWH5ZfMYxieMX9C_HvObhZcPr8RRBB6VOL3RbFoGkWnW92VYxc3I-DSnN2eEUBAGZ7nUtr36tRQoJYvbioC0yRpwFtY_i9XBezsCnUOK_YPUoU2Qv78cFfYn1ys Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.54 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 7748ea0850294ce78a3f390458685b9b Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerShowV254Test-588386932 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7748ea0850294ce78a3f390458685b9b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7748ea0850294ce78a3f390458685b9b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7748ea0850294ce78a3f390458685b9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7748ea0850294ce78a3f390458685b9b"}]}] Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerShowV254Test-588386932 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 7748ea0850294ce78a3f390458685b9b Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerShowV254Test-588386932 Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerShowV254Test-588386932-project Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ed80bbb76f8e4636a8ba37c23790b74f Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerShowV254Test-588386932-project Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '12cffe08-1d66-4150-8f43-a110cd631837'} Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:54.424372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. Jun 25 21:06:54.428526 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:54.430781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] Returning 404 to user: Instance 12cffe08-1d66-4150-8f43-a110cd631837 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:54.432185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b8445e9-8cc8-4477-804c-90baff2e4166 tempest-ServerShowV254Test-588386932 tempest-ServerShowV254Test-588386932-project] 10.222.0.39 "GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837" status: 404 len: 111 microversion: 2.54 time: 0.057035 Jun 25 21:06:54.433561 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1718/3766] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:54 2022] GET /compute/v2.1/servers/12cffe08-1d66-4150-8f43-a110cd631837 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:06:54.550535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'services' on Instance uuid ded86d25-8dab-4fbf-a377-2d30b193dc59 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:06:54.700146 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b58064c7-11fc-4ade-a705-66ce4d554fcd tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments/070f896c-fc3e-40df-8fe0-538d88646485" status: 202 len: 0 microversion: 2.1 time: 0.372069 Jun 25 21:06:54.700977 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2049/3767] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:06:54 2022] DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments/070f896c-fc3e-40df-8fe0-538d88646485 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:06:54.709907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:54.710974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:54.720573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.721044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.721951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.723595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.869348 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17e05c24-3e7b-4235-a13c-f4538585b234 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160450 Jun 25 21:06:54.871454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1719/3768] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:06:54 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:06:54.915695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:54.917168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:54.925971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.926915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:54.929349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:54.930822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:55.348118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:55.348893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:55.366434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:55.367201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:55.368199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:55.368829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:55.549391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:55.562248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65de49b0-8239-41c9-a3c3-3c5fa7eee102 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.651030 Jun 25 21:06:55.562986 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2050/3769] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:54 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:55.577412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:55.578026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:55.598138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:55.598592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:55.603584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:55.604034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:55.983020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:55.993991 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3c65af6-4ed1-4c14-af21-94f0517aa86b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1311 microversion: 2.1 time: 0.429677 Jun 25 21:06:56.004096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2051/3770] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:55 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1311 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:56.015469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:56.016934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.063973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.064872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.066066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.066917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.126937 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b50302ce-6a10-4570-9d8a-0125d2c76d7a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121187 Jun 25 21:06:56.128470 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2052/3771] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:06:56 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:06:56.191834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-62f28963-1ea9-4cd3-8201-2315576e6232 req-ceec11d4-6664-4f66-819c-91998e4aa63c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c915083-b7bd-47e7-8861-52f5e318b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "3002f539-100d-48dc-a62d-0dab07c8a061"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:56.223674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-62f28963-1ea9-4cd3-8201-2315576e6232 req-ceec11d4-6664-4f66-819c-91998e4aa63c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.224133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-62f28963-1ea9-4cd3-8201-2315576e6232 req-ceec11d4-6664-4f66-819c-91998e4aa63c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.243928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-62f28963-1ea9-4cd3-8201-2315576e6232 req-ceec11d4-6664-4f66-819c-91998e4aa63c service nova] Creating event network-vif-plugged:3002f539-100d-48dc-a62d-0dab07c8a061 for instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 on nch1-master-1 Jun 25 21:06:56.292507 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-62f28963-1ea9-4cd3-8201-2315576e6232 req-ceec11d4-6664-4f66-819c-91998e4aa63c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114507 Jun 25 21:06:56.301667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:56.309856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2053/3772] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:56.313595 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3070c42b-41d7-4a10-8119-3160a9439095 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1701 microversion: 2.1 time: 0.974290 Jun 25 21:06:56.314197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1720/3773] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:55 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1701 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:56.330062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:56.331747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.340375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.341319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.343711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.344472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.387961 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Cannot 'reboot' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action HTTP/1.1 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 28 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: {"reboot": {"type": "HARD"}} Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'reboot' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '49fe50b3-4f75-49b0-af3d-53f105e5f46e', 'body': {'reboot': {'type': 'HARD'}}} Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:06:56.389762 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.395857 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.398017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 409 to user: Cannot 'reboot' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:56.398918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d652adcf-bc5e-4ce7-9e6b-79031d7d9a7e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action" status: 409 len: 145 microversion: 2.1 time: 0.077704 Jun 25 21:06:56.399816 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2054/3774] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:06:56 2022] POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action => generated 145 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:06:56.415168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:56.417692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.425375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.426520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.427109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.427909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.485190 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Cannot 'rebuild' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action HTTP/1.1 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 65 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'rebuild' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '49fe50b3-4f75-49b0-af3d-53f105e5f46e', 'body': {'rebuild': {'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795'}}} Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e in vm_state rescued. Cannot rebuild while the instance is in this state. Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:06:56.495581 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued Jun 25 21:06:56.500795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:06:56.504174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 409 to user: Cannot 'rebuild' instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e while it is in vm_state rescued {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:06:56.506545 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30020464-a8f9-4c13-862b-bdecd0dcf3d9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action" status: 409 len: 146 microversion: 2.1 time: 0.097812 Jun 25 21:06:56.529202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1721/3775] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:06:56 2022] POST /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e/action => generated 146 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:06:56.534905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:56.535423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.545920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.546382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.547164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.547600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.581103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:56.581935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.597988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.601947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.602957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.604118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.637732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:06:56.806788 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de93542b-6933-4ff3-8f9c-2a9c9aa1d8cc tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 204 len: 0 microversion: 2.1 time: 0.275243 Jun 25 21:06:56.809281 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2055/3776] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:06:56 2022] DELETE /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:06:56.819480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:56.820712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:56.836800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.837568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.845813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:56.846966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:56.850906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:57.132361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:57.142806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65451b37-c755-4d46-8a17-95eeb1e1822f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.567213 Jun 25 21:06:57.152759 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1722/3777] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:56 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:57.163600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:57.164226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:57.182292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:57.182765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:57.193571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:57.194025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:57.262353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:57.270994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67097cc7-e572-44b8-a484-39678869806d tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1690 microversion: 2.1 time: 0.457416 Jun 25 21:06:57.276817 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2056/3778] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:56 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1690 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:57.331128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:57.332132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:57.340194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:57.341169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:57.342177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:57.342766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:57.449563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:57.461942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-effc2d82-ba00-4b9d-9107-81698749fa11 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1633 microversion: 2.1 time: 0.134574 Jun 25 21:06:57.463386 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2057/3779] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:57 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1633 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:06:57.510756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:57.524673 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb3db7d1-7431-41dd-ab51-2323843b3371 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1311 microversion: 2.1 time: 0.370353 Jun 25 21:06:57.525563 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1723/3780] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:57 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:58.170614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:58.171266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:58.181993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.185011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.186036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.193810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.291952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:58.295809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:58.307823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.309350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.311085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.313232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.544219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:58.554020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e85aa31b-20b8-41d8-81d8-461455db8b5a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.388251 Jun 25 21:06:58.554336 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2058/3781] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:58 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:58.562203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:58.562858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:58.580498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.583100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.584279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.585151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.661511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.662226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.662879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lazy-loading 'fault' on Instance uuid 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:06:58.719799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b7cbda91af54f84a9432ddbf6abec2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '034b90cc1b144b43b2aec3feaeb65f74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:58.731921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f7a8575-2316-4ddc-827d-e38caa7fee09 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 200 len: 1360 microversion: 2.1 time: 0.176232 Jun 25 21:06:58.732850 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2059/3782] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:58 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 1360 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:58.738023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b86dccad-b93a-4ea8-81ca-663051fcf77f req-a888daa9-e954-45f6-943a-a1e069821006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce", "name": "network-vif-deleted", "tag": "ccec844b-2f94-4b02-9a20-be7e974fa196"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:58.753535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b86dccad-b93a-4ea8-81ca-663051fcf77f req-a888daa9-e954-45f6-943a-a1e069821006 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.756527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b86dccad-b93a-4ea8-81ca-663051fcf77f req-a888daa9-e954-45f6-943a-a1e069821006 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.781665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b86dccad-b93a-4ea8-81ca-663051fcf77f req-a888daa9-e954-45f6-943a-a1e069821006 service nova] Creating event network-vif-deleted:ccec844b-2f94-4b02-9a20-be7e974fa196 for instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce on nch1-master-1 Jun 25 21:06:58.790140 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b86dccad-b93a-4ea8-81ca-663051fcf77f req-a888daa9-e954-45f6-943a-a1e069821006 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054637 Jun 25 21:06:58.791074 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2060/3783] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:58.797017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:58.798085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:58.811875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.812721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:58.813774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:58.814435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.059797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:59.069933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9d593e0-4d6c-40ca-bb51-8c531dac909c tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1311 microversion: 2.1 time: 0.277188 Jun 25 21:06:59.071067 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2061/3784] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:58 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:59.085454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5a593995-f634-4321-8627-b0b61fdf408f req-202a22a3-011f-4919-8075-17af2374d021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bead1ab6-e8ae-4873-9eac-b5467789b47b", "name": "network-vif-plugged", "status": "completed", "tag": "58c6da54-7e63-4bee-84c7-4b09fc2ed426"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:59.097344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5a593995-f634-4321-8627-b0b61fdf408f req-202a22a3-011f-4919-8075-17af2374d021 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:59.098066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5a593995-f634-4321-8627-b0b61fdf408f req-202a22a3-011f-4919-8075-17af2374d021 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.115948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5a593995-f634-4321-8627-b0b61fdf408f req-202a22a3-011f-4919-8075-17af2374d021 service nova] Creating event network-vif-plugged:58c6da54-7e63-4bee-84c7-4b09fc2ed426 for instance bead1ab6-e8ae-4873-9eac-b5467789b47b on nch1-master-1 Jun 25 21:06:59.125122 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5a593995-f634-4321-8627-b0b61fdf408f req-202a22a3-011f-4919-8075-17af2374d021 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042735 Jun 25 21:06:59.126420 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2062/3785] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:06:59.325417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1351913103", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:06:59.417898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:06:59.418333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:06:59.418812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:06:59.419223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:06:59.419660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:06:59.423929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:59.449024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:59.449787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.451181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:59.452147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.476039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Getting quotas for project ca0bcba91f3a4e749c46c491d5270fe2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:06:59.482591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Getting quotas for user 69be43ab3b044443b83d47d98f57ab1b and project ca0bcba91f3a4e749c46c491d5270fe2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:06:59.497761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:06:59.505467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:06:59.584064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8c56ed17-2a4e-49d7-8f05-a962d06abfe5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.455633 Jun 25 21:06:59.585662 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2063/3786] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:06:59.592286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:59.593530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:59.602731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:59.603773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.605042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:06:59.605703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:06:59.812340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:59.838195 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03687fb4-f2f5-4734-80d7-f441af6afe27 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1690 microversion: 2.1 time: 1.550415 Jun 25 21:06:59.839522 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1724/3787] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:58 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1690 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:06:59.844640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:06:59.845535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:06:59.862801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:06:59.989385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:06:59.998467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3783ef62-cffe-4321-b7d9-12f9cafe25dc tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.411249 Jun 25 21:07:00.001076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2064/3788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:06:59 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:00.006906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:00.007660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] [instance: 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:00.015454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.016206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.016959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.017459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.036968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] HTTP exception thrown: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Request method failure captured: Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce HTTP/1.1 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ikpRn8neCcwGQA81dXD3-3DtZonIq5w9SNi3xMjSsPACdgP-rGhvGPr_HtEqC0PwReKNXmc3fz0VcRJPF5oU_PzlQ82xuopON-33alKf0dqwUUwYMAS9nVsfBJJp8CJuE5JxJz0OUCcnKI7kkqk3qA46DVdrpfQjuzeik72DD4e1c Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 034b90cc1b144b43b2aec3feaeb65f74 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-1495780294 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/034b90cc1b144b43b2aec3feaeb65f74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/034b90cc1b144b43b2aec3feaeb65f74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_034b90cc1b144b43b2aec3feaeb65f74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/034b90cc1b144b43b2aec3feaeb65f74"}]}] Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-1495780294 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 034b90cc1b144b43b2aec3feaeb65f74 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-1495780294 Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-1495780294-project Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6b7cbda91af54f84a9432ddbf6abec2a Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-1495780294-project Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce'} Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:00.038722 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Returning 404 to user: Instance 9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72ed0e16-e1fd-41af-adce-12ac6a1b9b2f tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce" status: 404 len: 111 microversion: 2.1 time: 0.038770 Jun 25 21:07:00.043508 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2065/3789] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:00 2022] GET /compute/v2.1/servers/9cfc8d96-b77e-4c3c-a5f4-72a0ebc7ddce => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:00.062775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-03455ae4-7228-451b-b8d4-5f2e3a15e719 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] Calling method '.version_select at 0x7f984ef1f700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:00.099843 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-03455ae4-7228-451b-b8d4-5f2e3a15e719 tempest-ServersTestJSON-1495780294 tempest-ServersTestJSON-1495780294-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680282942" status: 202 len: 0 microversion: 2.1 time: 0.052422 Jun 25 21:07:00.106300 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2066/3790] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:07:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680282942 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:00.111405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:00.112075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:00.129591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.130050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.131379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.132492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.176874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:00.189474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:00.192801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:00.194223 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b93cb9db-b2cc-4462-af7b-7f670529a14b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1278 microversion: 2.57 time: 0.353690 Jun 25 21:07:00.198805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1725/3791] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:06:59 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1278 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:00.470613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:00.492606 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc28cfb4-796f-4a6c-9847-b602b7418c6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1311 microversion: 2.1 time: 0.384826 Jun 25 21:07:00.494188 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2067/3792] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:00 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1311 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:00.757841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:00.758871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:00.774313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.774764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.775599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.776033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.856895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:00.858386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:00.871144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.874673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.875729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.876603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.929930 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16ec3824-93ca-4b68-aaa9-82509c95ce99 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.174875 Jun 25 21:07:00.933222 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1726/3793] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:00 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:00.947915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:00.950947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:00.966481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.966907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:00.968178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:00.968837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.372338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.387057 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94b59f71-924f-4d98-87a1-d5a3f000efee tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1690 microversion: 2.1 time: 0.535432 Jun 25 21:07:01.389340 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2068/3794] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:00 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1690 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:01.404791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:01.406859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:01.410659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:01.427794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.429996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.435158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.436090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.639259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.651428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5fa39086-e19d-4b47-a56c-d1f372bb65b3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.713008 Jun 25 21:07:01.652594 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1727/3795] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:00 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:01.666838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:01.667852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:01.686777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.688677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.690325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.697484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.826486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.836021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.838386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.840541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19495cfd-86c9-4cc2-8ae1-20646388f744 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1336 microversion: 2.57 time: 0.184556 Jun 25 21:07:01.841489 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1728/3796] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:01 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1336 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:01.847240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:01.847887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:01.858996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.860094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.861358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:01.861939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:01.862597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:01.871725 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9c7fb7b0-d382-412d-83ff-fbf30c052115 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1313 microversion: 2.1 time: 0.480065 Jun 25 21:07:01.872758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2069/3797] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:01 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1313 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:01.888386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:02.406406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:02.407033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:02.424645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.425223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:02.431051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.431580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:02.704412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:02.715212 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b657b644-df31-496e-8d0c-aca04515cfc9 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1690 microversion: 2.1 time: 0.314068 Jun 25 21:07:02.721263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2070/3798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:02 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1690 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:02.733662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:02.735046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:02.742898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.743850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:02.744911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.745529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:02.795534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:02.803511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b0627ed-9a96-47ff-b18c-9705da8f5836 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1311 microversion: 2.1 time: 0.960704 Jun 25 21:07:02.813886 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1729/3799] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:01 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1311 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:02.876885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:02.878594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:02.891207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.891992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:02.896296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:02.904857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.140496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.154445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.157577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.159072 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-76e08bac-dbf3-4f10-9d72-2341a606c37f tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1336 microversion: 2.57 time: 0.302056 Jun 25 21:07:03.159926 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1730/3800] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:02 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1336 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:03.167341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:03.168406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:03.188020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.188504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.189300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.189739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.346607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.357264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0add5cb9-18e5-4b05-b35c-2d7431edb71f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.633243 Jun 25 21:07:03.358207 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2071/3801] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:02 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:03.721506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.732007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9130d6ad-18fc-4d43-bd36-5e040699c04e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1463 microversion: 2.1 time: 0.570104 Jun 25 21:07:03.732637 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1731/3802] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:03 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1463 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:03.739052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:03.740088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:03.750325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:03.750945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:03.754557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.755206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.756658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.757196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.763355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.763769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.764600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.765041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.888650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:03.897971 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4032a04-e6f9-4659-a45e-b658d7bea549 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1623 microversion: 2.1 time: 0.167077 Jun 25 21:07:03.899157 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2072/3803] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:03 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1623 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:03.904156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:03.904980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:03.917276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.918001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:03.918956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:03.920993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.284854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:04.293339 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c09539e-144f-4b61-a8df-3862f885916c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1463 microversion: 2.1 time: 0.547026 Jun 25 21:07:04.296932 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1732/3804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:03 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1463 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:04.301862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:04.302470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:04.317089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:04.318953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.320181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:04.320181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.368746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:04.379789 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-10bc3dd9-aae0-4371-b6ea-5da7074684c3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.479367 Jun 25 21:07:04.382675 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2073/3805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:03 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:04.398219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e87379e0-9ec1-4d8d-b8df-f05521f20fee req-b7cb0b38-caf1-4765-8d65-76794b3b9ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ded86d25-8dab-4fbf-a377-2d30b193dc59", "name": "network-vif-deleted", "tag": "04edfb42-32e0-444f-bfdb-39a05f98786f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:04.415503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e87379e0-9ec1-4d8d-b8df-f05521f20fee req-b7cb0b38-caf1-4765-8d65-76794b3b9ca0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:04.416109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e87379e0-9ec1-4d8d-b8df-f05521f20fee req-b7cb0b38-caf1-4765-8d65-76794b3b9ca0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.461673 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e87379e0-9ec1-4d8d-b8df-f05521f20fee req-b7cb0b38-caf1-4765-8d65-76794b3b9ca0 service nova] Creating event network-vif-deleted:04edfb42-32e0-444f-bfdb-39a05f98786f for instance ded86d25-8dab-4fbf-a377-2d30b193dc59 on nch2-master-1 Jun 25 21:07:04.474953 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e87379e0-9ec1-4d8d-b8df-f05521f20fee req-b7cb0b38-caf1-4765-8d65-76794b3b9ca0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091487 Jun 25 21:07:04.497049 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2074/3806] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:04.509234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:04.514443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:04.526084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:04.528547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:04.529062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.532804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:04.533265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:04.545051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:04.548811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:04.553051 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e8c45a0-62b5-40f7-81e1-e60fc1d704fd tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1336 microversion: 2.57 time: 0.254294 Jun 25 21:07:04.554060 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1733/3807] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:04 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1336 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:04.567239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2001937908", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1c915083-b7bd-47e7-8861-52f5e318b2b4"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:04.673635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:07:04.987775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:05.012765 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a59538cd-8672-4315-b779-623503c9969e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.509207 Jun 25 21:07:05.014026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2075/3808] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:04 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:05.019714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:05.021270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:05.028594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.029320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.030301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.030899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.070086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.072355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.073349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'fault' on Instance uuid ded86d25-8dab-4fbf-a377-2d30b193dc59 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:07:05.077394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:05.215765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:05.232041 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99537221-92f0-402d-bac1-258b90bc7fcf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 200 len: 1336 microversion: 2.1 time: 0.216472 Jun 25 21:07:05.233418 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2076/3809] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:05 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 1336 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:05.398393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:05.400823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:05.417068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.418149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.419231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.419914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.796873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:07:05.797362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:07:05.797759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:07:05.798167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:07:05.798582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:07:05.829264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.829740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.830724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:05.831999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:05.897056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:07:05.913817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Getting quotas for user ea5a50f6e8ea470894e19f8c1dec476f and project ccdbe2fec6454cef988cb3ed5466c6fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:07:05.946038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:07:05.948923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:07:06.046661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ff833da-800d-45c8-9580-d136f69724ac tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.489607 Jun 25 21:07:06.049137 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1734/3810] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:07:06.056336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:06.065655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:06.078053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.087475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.088499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.089789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.236001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:06.250203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:06.251703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:06.252987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fdc46b0d-ed2d-434e-a537-a9e106ab44e5 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1357 microversion: 2.57 time: 0.202738 Jun 25 21:07:06.265239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1735/3811] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:06 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:06.275022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:06.275022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:06.289650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.290111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.291119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.291709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.645692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:06.656375 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27adfa9d-b774-4100-973d-a84b74f10d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.396259 Jun 25 21:07:06.660002 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1736/3812] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:06 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:06.674782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a05984d-9372-4ba8-a060-02370fc5b426 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:06.675724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a05984d-9372-4ba8-a060-02370fc5b426 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:06.800926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a05984d-9372-4ba8-a060-02370fc5b426 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:06.810464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a05984d-9372-4ba8-a060-02370fc5b426 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1214 microversion: 2.1 time: 0.148955 Jun 25 21:07:06.813747 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1737/3813] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:06 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:06.822529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:06.834750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: ded86d25-8dab-4fbf-a377-2d30b193dc59] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:06.850854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.852098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.853478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.856463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.897663 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 HTTP/1.1 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ded86d25-8dab-4fbf-a377-2d30b193dc59'} Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:06.900369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. Jun 25 21:07:06.906449 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:06.908567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 404 to user: Instance ded86d25-8dab-4fbf-a377-2d30b193dc59 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:06.909964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-439981d4-eba3-4970-920f-79a3bab4f327 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59" status: 404 len: 111 microversion: 2.1 time: 0.092088 Jun 25 21:07:06.910649 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1738/3814] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:06 2022] GET /compute/v2.1/servers/ded86d25-8dab-4fbf-a377-2d30b193dc59 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:06.916397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:06.918411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:06.925167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.925927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:06.927069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:06.927731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.115136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:07:07.115641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:07:07.116144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:07:07.116599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:07:07.117305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:07:07.231670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:07.244213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.245392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.246719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.247240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.310692 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b53a83e5-157a-40f4-8f69-08b030a33719 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "POST /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9/action" status: 202 len: 1138 microversion: 2.57 time: 0.398651 Jun 25 21:07:07.311514 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1739/3815] 10.222.0.39 () {62 vars in 1319 bytes} [Sat Jun 25 21:07:06 2022] POST /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9/action => generated 1138 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 25 21:07:07.322225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9a8c42bf-3022-45d2-89d7-3acba95ed2a6 req-451ccd6f-86a2-4f68-ad55-8576a23145ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "tag": "2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:07.331430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9a8c42bf-3022-45d2-89d7-3acba95ed2a6 req-451ccd6f-86a2-4f68-ad55-8576a23145ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.332063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9a8c42bf-3022-45d2-89d7-3acba95ed2a6 req-451ccd6f-86a2-4f68-ad55-8576a23145ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.345569 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9a8c42bf-3022-45d2-89d7-3acba95ed2a6 req-451ccd6f-86a2-4f68-ad55-8576a23145ac service nova] Creating event network-changed:2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:07.351647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9a8c42bf-3022-45d2-89d7-3acba95ed2a6 req-451ccd6f-86a2-4f68-ad55-8576a23145ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038296 Jun 25 21:07:07.353618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1740/3816] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:07.359351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c502ef5e-716f-47cf-b83a-908f192fdd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '.version_select at 0x7f9862012d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:07.397354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c502ef5e-716f-47cf-b83a-908f192fdd0e tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804782989" status: 202 len: 0 microversion: 2.1 time: 0.042382 Jun 25 21:07:07.398881 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1741/3817] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:07:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804782989 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:07.407417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:07.408665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:07.417369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.418297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.419431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.420108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.686095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:07.698452 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f70c1edd-f430-4b3e-b039-86dbe94c80ba tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 2.304065 Jun 25 21:07:07.702117 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2077/3818] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:05 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 2308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:07.715055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:07.715774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:07.716454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:07.731499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.732977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.735406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.736785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.748468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:07.756590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:07.758081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f83d337-ad68-4ebf-9358-b383febe0716 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.356591 Jun 25 21:07:07.758996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1742/3819] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:07 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:07.830530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:07.831282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:07.842827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.843475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:07.844656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:07.845372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:08.154400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:08.170349 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6fa8f115-01cb-4958-8901-9d2f033ba9a3 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1274 microversion: 2.1 time: 0.343416 Jun 25 21:07:08.181642 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1743/3820] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:07 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1274 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:08.498048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:08.515161 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe9ecb22-ed29-43a3-81b4-7f30b7b2470d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1671 microversion: 2.1 time: 0.802192 Jun 25 21:07:08.524745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2078/3821] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:07 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1671 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:08.721801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:08.722505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:08.729920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:08.730423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:08.731310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:08.736935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:08.780899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:08.781680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:08.795345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:08.802744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:08.803938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:08.805087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:08.975875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:08.992844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:08.995195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:08.996715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53f7280c-820c-46c6-8611-5e868044315a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.220742 Jun 25 21:07:08.999471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2079/3822] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:08 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:07:09.175667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:09.186243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2cd3928b-0f50-461c-99aa-1ab2adbe159b tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.474875 Jun 25 21:07:09.187541 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1744/3823] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:08 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:09.197260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:09.198273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:09.206171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:09.207015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:09.208004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:09.208846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:09.416981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1346e31b-8978-4b19-89dc-7e5eebe7e4d4 req-24016ba2-6d3a-4cfd-9ebc-1d7fd20633ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "tag": "df274974-bae3-40d3-a60f-81a687f67fc8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:09.426368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1346e31b-8978-4b19-89dc-7e5eebe7e4d4 req-24016ba2-6d3a-4cfd-9ebc-1d7fd20633ed service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:09.427006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1346e31b-8978-4b19-89dc-7e5eebe7e4d4 req-24016ba2-6d3a-4cfd-9ebc-1d7fd20633ed service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:09.466219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:09.483401 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1346e31b-8978-4b19-89dc-7e5eebe7e4d4 req-24016ba2-6d3a-4cfd-9ebc-1d7fd20633ed service nova] Creating event network-changed:df274974-bae3-40d3-a60f-81a687f67fc8 for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:09.490992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:09.493134 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1346e31b-8978-4b19-89dc-7e5eebe7e4d4 req-24016ba2-6d3a-4cfd-9ebc-1d7fd20633ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077759 Jun 25 21:07:09.494569 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1745/3824] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:09.538545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:09.539904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:09.547764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:09.548220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:09.552071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:09.552579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:09.641606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:09.651211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8192b8a6-a976-4670-b7a2-4fab7574a3d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1272 microversion: 2.1 time: 0.467355 Jun 25 21:07:09.665706 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2080/3825] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:09 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1272 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:10.020133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:10.022629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:10.037347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.038081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.039822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.042670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.160844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:10.171797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:10.174843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:10.180635 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea292263-5ef5-4da5-9ab5-c689e8bf0dda tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.166301 Jun 25 21:07:10.181708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2081/3826] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:10 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:10.223670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:10.224594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:10.232072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.232958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.233746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.234394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.299303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:10.313162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4c2ff969-04a4-4988-a902-3da6296bf28e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1676 microversion: 2.1 time: 0.783660 Jun 25 21:07:10.314837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1746/3827] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:09 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1676 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:10.670203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:10.670937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:10.698344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.698524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.705100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:10.705526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:10.799305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:10.812535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a41dfa9-f79a-4418-9cd7-9d43834f38a3 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.611633 Jun 25 21:07:10.813687 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2082/3828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:10 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:11.190909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:11.203032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:11.203669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:11.223300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2f0e67de-55bb-4bbb-b81a-dd712f6b0ce0 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.558014 Jun 25 21:07:11.223938 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1747/3829] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:10 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:11.226748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.227420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:11.229685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.230844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:11.331857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:11.332598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:11.353121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.353735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:11.354622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.355212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:11.489206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:11.510193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:11.522902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:11.528891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35beb875-cdd4-49aa-9fbb-31d55a22b014 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.330106 Jun 25 21:07:11.531220 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2083/3830] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:11 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:07:11.700486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:11.706022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:11.718456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-df0cb45f-4213-4f49-ba6b-d8dec606e1aa tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1676 microversion: 2.1 time: 0.391196 Jun 25 21:07:11.728999 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1748/3831] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:11 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1676 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:11.829950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:11.830572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:11.836956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.837498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:11.838293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:11.838740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.240862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:12.241485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:12.253720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.256232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.257087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.257528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.309658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:12.336104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e8f65a1-84e0-4bb4-9467-67444299cc93 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.508036 Jun 25 21:07:12.347003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2084/3832] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:11 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:12.375945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a7a9aabb-0530-45c1-9f85-8abfa4304fc6 req-26156ed0-0b83-4e7c-a032-77fa4f320d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ff613c0-98a5-464a-8697-541c8e7b0ca1", "tag": "1234b128-0c74-4a13-b6cb-6d935688afc3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:12.397720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a7a9aabb-0530-45c1-9f85-8abfa4304fc6 req-26156ed0-0b83-4e7c-a032-77fa4f320d16 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.410471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a7a9aabb-0530-45c1-9f85-8abfa4304fc6 req-26156ed0-0b83-4e7c-a032-77fa4f320d16 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.468337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a7a9aabb-0530-45c1-9f85-8abfa4304fc6 req-26156ed0-0b83-4e7c-a032-77fa4f320d16 service nova] Creating event network-changed:1234b128-0c74-4a13-b6cb-6d935688afc3 for instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 on nch1-master-1 Jun 25 21:07:12.488896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a7a9aabb-0530-45c1-9f85-8abfa4304fc6 req-26156ed0-0b83-4e7c-a032-77fa4f320d16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120209 Jun 25 21:07:12.498848 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2085/3833] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:07:12.552376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:12.553861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:12.581825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.582637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.583611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.585935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.738962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:12.749025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:12.751129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:12.753699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a236d64-1901-4e32-83fe-c7704df1b3e2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.206629 Jun 25 21:07:12.754963 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2086/3834] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:12 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:07:12.760952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:12.761985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:12.766639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:12.770636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.772071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.773347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:12.774389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:12.783027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ebe16f3-083b-4ba8-ad59-b43e22f2e795 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.544299 Jun 25 21:07:12.783682 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1749/3835] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:12 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:13.220597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:13.232344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d50ecbc-14c0-4018-a843-5f9d411994ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1676 microversion: 2.1 time: 0.474501 Jun 25 21:07:13.243447 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2087/3836] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:12 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1676 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:13.307759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:13.308273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:13.316244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.316821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.318108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.318994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.349021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:07:13.354949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:13.356222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:13.363126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.363786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.365128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.365720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.453898 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a46f39e5-29b3-4ecc-85ab-c66bcd90b5a8 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 204 len: 0 microversion: 2.1 time: 0.149758 Jun 25 21:07:13.454614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1750/3837] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:07:13 2022] DELETE /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:07:13.467626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:13.468881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:13.480182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.481234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.483441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.485025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.827192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:13.841607 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71df6df5-0bf4-49f4-8cd3-319637fceb85 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1507 microversion: 2.1 time: 0.382606 Jun 25 21:07:13.843210 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1751/3838] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:13 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:13.874781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:13.875436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:13.897564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.898552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:13.899388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:13.899930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:14.122591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:14.139332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:14.141159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:14.148009 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0795c29e-98d2-4a13-b835-87c1249aaed0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.286818 Jun 25 21:07:14.149749 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1752/3839] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:13 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:14.161054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:14.166094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:14.182129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:14.183567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:14.184536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:14.187284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:14.423663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:14.434901 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79d352b4-9f42-42c1-859f-06fde84aaff5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 1.082906 Jun 25 21:07:14.436342 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2088/3840] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:13 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:14.628525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:14.662257 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45ee2941-c9f4-4bec-a8b7-00d29f8259c8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.500810 Jun 25 21:07:14.677404 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1753/3841] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:14 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:14.686788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:14.687426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:14.697597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:14.698224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:14.699498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:14.699959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:14.871697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-474180655", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:14.966559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] validate_networks() for [('61944c58-a4a1-48da-a6e8-db76a24acb2c', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:07:15.156863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:15.166628 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-738e6c6d-faa3-48ad-8f2e-50904660a3df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.487882 Jun 25 21:07:15.167222 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1754/3842] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:14 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:15.173142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:15.179618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:15.199438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:15.199888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:15.200692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:15.201517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:15.864298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:15.990177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:16.002398 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ec2f183-2be1-4aea-bab9-4da6a45bc4a6 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1507 microversion: 2.1 time: 0.832810 Jun 25 21:07:16.003171 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1755/3843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:15 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1507 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:16.035010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:16.036865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:16.050267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:07:16.050875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:07:16.051418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:07:16.051930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:07:16.052620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:07:16.057030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.057878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.058828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.059441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.071267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.073772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.075753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.076952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.141206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Getting quotas for project 29c4645abed4410981601604f61a3d89. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:07:16.152384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Getting quotas for user 5b01ed1ecd8d4609a5a277f96e8a8445 and project 29c4645abed4410981601604f61a3d89. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:07:16.184585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:07:16.189294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:07:16.291585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb13942f-7ef4-4861-8742-c705caf75679 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.853706 Jun 25 21:07:16.292632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2089/3844] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:07:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:07:16.301914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:16.309484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:16.323121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.323878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.324929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.325592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.810812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=18 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:16.839806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:16.855244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:16.861797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:16.866958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9291243-051a-4093-959d-5a23ee2b168e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.858701 Jun 25 21:07:16.869543 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1756/3845] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:16 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:16.881267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:16.884739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:16.902471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.903067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:16.905748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:16.906315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.062052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:17.072036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aad50a90-230f-4f56-995b-93fcad12bb57 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.777823 Jun 25 21:07:17.072473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2090/3846] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:16 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:17.082393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:17.082393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:17.103775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.104514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.105466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.106139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.231520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:17.244530 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c988b8ee-99a6-4f32-b37a-b1b579c01684 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1226 microversion: 2.1 time: 0.170935 Jun 25 21:07:17.246447 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2091/3847] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:17 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1226 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:17.251160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:17.251768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:17.278101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.278891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.279704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.280333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.580240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:17.590439 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ff419b3-00ee-4527-80b5-c6cbd03bed24 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1507 microversion: 2.1 time: 0.342437 Jun 25 21:07:17.593944 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2092/3848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:17 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:17.623067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:17.635610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4fbfa5aa-b7d3-43aa-892b-06a130ca1b5f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.764162 Jun 25 21:07:17.646534 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1757/3849] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:16 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:17.889863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:17.890410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:17.901470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.901898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:17.902864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:17.903533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.035947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.058560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-edb5c8fc-c0f1-4f18-ad43-1dc5e59a84df req-2e4d69f4-c28c-471f-a819-fbb1f22aa577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49fe50b3-4f75-49b0-af3d-53f105e5f46e", "name": "network-vif-deleted", "tag": "73e60ca6-2575-4b82-a46d-2aab07dd0f70"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:18.061615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.071190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.072096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-edb5c8fc-c0f1-4f18-ad43-1dc5e59a84df req-2e4d69f4-c28c-471f-a819-fbb1f22aa577 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.075495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-694aecf0-6d4f-48b4-984b-792ee2c3986e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.191290 Jun 25 21:07:18.076613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-edb5c8fc-c0f1-4f18-ad43-1dc5e59a84df req-2e4d69f4-c28c-471f-a819-fbb1f22aa577 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.093760 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2093/3850] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:17 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:18.100605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:18.101728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:18.111596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.112325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.113318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.113916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.115885 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-edb5c8fc-c0f1-4f18-ad43-1dc5e59a84df req-2e4d69f4-c28c-471f-a819-fbb1f22aa577 service nova] Creating event network-vif-deleted:73e60ca6-2575-4b82-a46d-2aab07dd0f70 for instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e on nch1-master-1 Jun 25 21:07:18.130566 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-edb5c8fc-c0f1-4f18-ad43-1dc5e59a84df req-2e4d69f4-c28c-471f-a819-fbb1f22aa577 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076916 Jun 25 21:07:18.131789 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1758/3851] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:18.138957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:18.266480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:18.268058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:18.276279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.276805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.277883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.278538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.394491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.404329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce2c17d4-f8be-4394-8012-831800aa62c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.308990 Jun 25 21:07:18.405150 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2094/3852] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:18 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:18.497201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.509005 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-636ded88-1445-4b57-a803-b7ea224df94c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1280 microversion: 2.1 time: 0.248955 Jun 25 21:07:18.513790 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1759/3853] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:18 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:18.608955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:18.609566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:18.617252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.618161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.619325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.619966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.654517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:18.655395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:18.677204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.684822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.685962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.686419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.705690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:18.706493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:18.707224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lazy-loading 'fault' on Instance uuid 49fe50b3-4f75-49b0-af3d-53f105e5f46e {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:07:18.786980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:18.816343 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcbb4c91-d694-4590-865b-3d529153a9f7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 200 len: 1311 microversion: 2.1 time: 0.210704 Jun 25 21:07:18.826465 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2095/3854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:18 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 1311 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:19.103339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:19.105833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:19.128911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.161823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.162891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.163624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.164067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.169731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9395a519-0f14-4332-afea-246fc4140d2a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.520055 Jun 25 21:07:19.170919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1760/3855] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:18 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:19.183811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9d843a7a-1a2c-4bb3-9df5-bbfd8428a0c0 req-c9ddbc2a-89ae-4515-ae76-06dd02ea43e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff613c0-98a5-464a-8697-541c8e7b0ca1", "name": "network-vif-plugged", "status": "completed", "tag": "1234b128-0c74-4a13-b6cb-6d935688afc3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:19.192750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:19.195164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9d843a7a-1a2c-4bb3-9df5-bbfd8428a0c0 req-c9ddbc2a-89ae-4515-ae76-06dd02ea43e4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.196748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9d843a7a-1a2c-4bb3-9df5-bbfd8428a0c0 req-c9ddbc2a-89ae-4515-ae76-06dd02ea43e4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.220892 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9d843a7a-1a2c-4bb3-9df5-bbfd8428a0c0 req-c9ddbc2a-89ae-4515-ae76-06dd02ea43e4 service nova] Creating event network-vif-plugged:1234b128-0c74-4a13-b6cb-6d935688afc3 for instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 on nch1-master-1 Jun 25 21:07:19.229359 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9d843a7a-1a2c-4bb3-9df5-bbfd8428a0c0 req-c9ddbc2a-89ae-4515-ae76-06dd02ea43e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057256 Jun 25 21:07:19.231130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1761/3856] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:19.311072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.322437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.324622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.326042 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9cc3f47-b074-4eee-a033-e5ff6a1ac757 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.234242 Jun 25 21:07:19.339554 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2096/3857] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:19 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:19.425542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:19.426944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:19.439371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.440152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.442787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.443647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.531913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:19.536857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:19.539163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:19.550972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.551579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.552359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.552820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.651571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.676750 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-209496da-e0f6-4b2b-b33a-8593898f982f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1280 microversion: 2.1 time: 0.148790 Jun 25 21:07:19.686608 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2097/3858] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:19 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1280 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:19.833281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:19.833895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: 49fe50b3-4f75-49b0-af3d-53f105e5f46e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:19.847922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:19.850906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.851576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.852508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.853000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.862588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-10366b65-5127-4764-bbea-2a3feb241375 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.441006 Jun 25 21:07:19.873016 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1762/3859] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:19 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:19.884061 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e HTTP/1.1 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '49fe50b3-4f75-49b0-af3d-53f105e5f46e'} Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:19.885843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 404 to user: Instance 49fe50b3-4f75-49b0-af3d-53f105e5f46e could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-82297d9e-8acf-4c37-9d7c-6843251bbb57 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e" status: 404 len: 111 microversion: 2.1 time: 0.058056 Jun 25 21:07:19.893111 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2098/3860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:19 2022] GET /compute/v2.1/servers/49fe50b3-4f75-49b0-af3d-53f105e5f46e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:07:19.903405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:19.904019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:19.912320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.914173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.915226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:19.916175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:19.946424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:07:20.025002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:20.071093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20ae72dd-b80a-4fd1-9b7a-9e351385cedf tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 204 len: 0 microversion: 2.1 time: 0.173319 Jun 25 21:07:20.071887 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1763/3861] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:07:19 2022] DELETE /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:07:20.080447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:20.081299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:20.088620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.089700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.090812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.091444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.187794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:20.191188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:20.203207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.203998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.205598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.206205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.373420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:20.394682 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13077750-517c-4241-bc5f-5cd6fdfe6986 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.318676 Jun 25 21:07:20.395759 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2099/3862] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:20 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:20.408517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:20.409413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:20.416133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.416651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.417610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.418234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.540650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:20.541212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:20.550219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d2be0e4-1ed6-4ffb-a0b1-9ac1dd651da6 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.366743 Jun 25 21:07:20.552268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:20.554153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:20.555583 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78c135f5-1370-4b32-b0da-84c82b3e97c1 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.158778 Jun 25 21:07:20.567243 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1764/3863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:20 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:20.569039 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2100/3864] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:20 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:20.693777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:20.694775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:20.706106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.706898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.707927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.708758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.882337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:20.883304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:20.902179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.903263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:20.910599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:20.911346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.269437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.279651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bf04e53-46d0-4a4e-8623-a0b2cce42c24 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.401361 Jun 25 21:07:21.280940 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2101/3865] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:20 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:21.412720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:21.414003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:21.421458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.422335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.423282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.424055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.591080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.599129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d8de77d-e0b9-4f4b-938a-89eb0a68f8e7 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.909306 Jun 25 21:07:21.600372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1765/3866] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:20 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:21.605134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:21.605902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:21.612130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.612849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.613831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.614458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.621913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.630489 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b1159580-7ac8-4daf-b454-26133ffb2b1a tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.221654 Jun 25 21:07:21.642978 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2102/3867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:21 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:21.645404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:21.649040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:21.657697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.661214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.666987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:21.667518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:21.754335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.766626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.768332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:21.769811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-00b47440-7853-4ff6-80da-027fde83647e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.131494 Jun 25 21:07:21.770964 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2103/3868] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:21 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:22.044453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:22.066189 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6168255-f073-4996-b900-3bc8fb1d3238 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1314 microversion: 2.1 time: 0.464504 Jun 25 21:07:22.067691 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1766/3869] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:21 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:22.298489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:22.299690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:22.312486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.315084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.318068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.320544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.616100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:22.617447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:22.624472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.625222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.626194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.626789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.668293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:22.679890 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d255464-43d9-4a9e-bd7d-becb8102866e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.385413 Jun 25 21:07:22.691008 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2104/3870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:22 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:22.706387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:22.707345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:22.716520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.719174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.720209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.720669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.949407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:22.964497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a565b7e0-845c-4b5e-a2ee-93d7b0ec03a3 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.266717 Jun 25 21:07:22.968782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2105/3871] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:22 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:22.975572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:22.977500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:22.991777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.992699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:22.994114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:22.995265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.078969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.101487 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9342e3db-dd04-4e32-9ae8-07da94b43c76 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.488013 Jun 25 21:07:23.103888 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1767/3872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:22 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:23.113487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-320f8d6e-07e2-4b5f-9eba-083a02a25cfd req-208097ff-12d6-463e-98c4-5c80f4104b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:23.136605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-320f8d6e-07e2-4b5f-9eba-083a02a25cfd req-208097ff-12d6-463e-98c4-5c80f4104b39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.137411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-320f8d6e-07e2-4b5f-9eba-083a02a25cfd req-208097ff-12d6-463e-98c4-5c80f4104b39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.154469 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-320f8d6e-07e2-4b5f-9eba-083a02a25cfd req-208097ff-12d6-463e-98c4-5c80f4104b39 service nova] Creating event network-changed:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:07:23.164173 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-320f8d6e-07e2-4b5f-9eba-083a02a25cfd req-208097ff-12d6-463e-98c4-5c80f4104b39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058210 Jun 25 21:07:23.166090 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1768/3873] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:23.174354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:23.175427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:23.196153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.200512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.202043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.203118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.571297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.585887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.587953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.592101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8a4db51-14a5-4cbf-b7b7-e12da368596d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.622001 Jun 25 21:07:23.605602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2106/3874] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:22 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:23.699442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:23.700163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:23.709771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.710231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.711016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.712067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.776960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.787717 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31ab6891-30c2-49e0-b27f-b75c7d72e613 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1464 microversion: 2.1 time: 0.619948 Jun 25 21:07:23.802409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1769/3875] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:23 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1464 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:23.920871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:23.930084 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-225e4890-a7e2-47b5-8b62-f8b71dfb10ec tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.236502 Jun 25 21:07:23.941071 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2107/3876] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:23 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:23.984957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:23.985915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:23.992666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.993179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:23.993965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:23.994402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.082895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.087800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'deleted': False, 'project_id': 'b9e9c5ec661d4a0181faabeeb9e393f1'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:24.103697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.104892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.106022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.106699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.150879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dfd24f8a-5c2f-46ca-9bb1-8ec3a2b4d6ba tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.339435 Jun 25 21:07:24.152742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1770/3877] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:07:23 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:24.169634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.170534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:24.179140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.180462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.181556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.182387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.186951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:24.196431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-49c4c347-9c07-4825-91ed-d906fb77e0e7 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1523 microversion: 2.1 time: 0.215226 Jun 25 21:07:24.197575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2108/3878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:23 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:24.204470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.215340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'deleted': False} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:24.222333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.223009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.225537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.226208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.363997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Listed batch of 10 results from cell out of 1000 limit. Returned 10 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:07:24.463106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.463630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.695379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:24.708176 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c640d1ba-38ad-496f-8f19-d7effe7f5837 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.553895 Jun 25 21:07:24.709647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1771/3879] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:24 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:24.717483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.718494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:24.731243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.732314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.734175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.735799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.842770 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3331b262-a469-4a6e-a4fa-17b3f398ea06 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 15948 microversion: 2.1 time: 0.643804 Jun 25 21:07:24.843546 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2109/3880] 10.222.0.39 () {58 vars in 1170 bytes} [Sat Jun 25 21:07:24 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 15948 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:07:24.872908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.876712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'deleted': False, 'project_id': 'b9e9c5ec661d4a0181faabeeb9e393f1'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:24.882179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.882796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.883678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.884331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.912630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a09f4bf9-bd4d-4464-b58a-c9050cf26fdd tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?tenant_id=ccdbe2fec6454cef988cb3ed5466c6fe" status: 200 len: 15 microversion: 2.1 time: 0.043449 Jun 25 21:07:24.913399 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2110/3881] 10.222.0.39 () {58 vars in 1230 bytes} [Sat Jun 25 21:07:24 2022] GET /compute/v2.1/servers/detail?tenant_id=ccdbe2fec6454cef988cb3ed5466c6fe => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:24.929209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:24.934667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'tenant_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'deleted': False} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:24.947616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.948190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.949890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:24.950808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:24.979883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:24.988328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:07:25.017624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:25.038107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:25.041998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:25.044496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a1890aa-b092-4f3a-897d-ab9c3640c07d tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.332493 Jun 25 21:07:25.045436 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1772/3882] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:24 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:25.055935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:25.060743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:25.061428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.062088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.126898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.127608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.130912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.132696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.273298 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e283b1b2-de97-414f-b6b2-ce34a63a5e6a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ccdbe2fec6454cef988cb3ed5466c6fe" status: 200 len: 4826 microversion: 2.1 time: 0.347645 Jun 25 21:07:25.287862 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2111/3883] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:07:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ccdbe2fec6454cef988cb3ed5466c6fe => generated 4826 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:25.294293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:25.300207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:25.322859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.323436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.324915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.325652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.470633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a15dadfd0448fab9e84a89173ed7d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3349ed72f824bcb9d1ce52d238bc870', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:25.486780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-142f8fb8-4271-4e6f-bd2d-9f8417d6dc05 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 200 len: 1307 microversion: 2.1 time: 0.196193 Jun 25 21:07:25.488104 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2112/3884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:25.500685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:25.510001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'tenant_id': 'b9e9c5ec661d4a0181faabeeb9e393f1', 'deleted': False} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:25.516811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.517561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.518523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.519328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.551930 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4db7951-1a13-4512-94b9-5b457dc27cf1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b9e9c5ec661d4a0181faabeeb9e393f1" status: 200 len: 15 microversion: 2.1 time: 0.062227 Jun 25 21:07:25.574919 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2113/3885] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b9e9c5ec661d4a0181faabeeb9e393f1 => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:25.582043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b0e425a1-0105-4496-99dc-b9736fa16ab5 req-6d3b83f9-41a6-4fb0-b378-0893d543001a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a104cd86-0a2f-45ec-8047-c581153d539c", "name": "network-vif-deleted", "tag": "91391f5e-59e8-41e4-8093-05cdb502d33b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:25.611083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b0e425a1-0105-4496-99dc-b9736fa16ab5 req-6d3b83f9-41a6-4fb0-b378-0893d543001a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.628919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b0e425a1-0105-4496-99dc-b9736fa16ab5 req-6d3b83f9-41a6-4fb0-b378-0893d543001a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.645242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b0e425a1-0105-4496-99dc-b9736fa16ab5 req-6d3b83f9-41a6-4fb0-b378-0893d543001a service nova] Creating event network-vif-deleted:91391f5e-59e8-41e4-8093-05cdb502d33b for instance a104cd86-0a2f-45ec-8047-c581153d539c on nch1-master-1 Jun 25 21:07:25.651246 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b0e425a1-0105-4496-99dc-b9736fa16ab5 req-6d3b83f9-41a6-4fb0-b378-0893d543001a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074353 Jun 25 21:07:25.651898 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2114/3886] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:25.659299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c30404d5-3708-4879-a50c-0ea9de9d02b1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:25.666352 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c30404d5-3708-4879-a50c-0ea9de9d02b1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010438 Jun 25 21:07:25.668521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2115/3887] 10.222.0.39 () {58 vars in 1188 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:25.725384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:25.729167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:25.736719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:25.740111 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f1df3bbe-56c8-492f-be5c-23a5f61cf8d5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.693316 Jun 25 21:07:25.751288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1773/3888] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:25.761623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.762381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:25.763083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:25.765832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.768341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.769908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.770274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.771005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.771808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:25.772517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:25.985625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dd36cd3-75c1-46c8-9ed0-566da063a356 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.305787 Jun 25 21:07:25.987009 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2116/3889] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:25 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:26.005481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.012338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:26.013311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:26.019940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.020388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.021468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.022098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.051023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:07:26.082086 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f14d664-7cec-4bbb-857a-731a530588da tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.089595 Jun 25 21:07:26.082731 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2117/3890] 10.222.0.39 () {58 vars in 1149 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:26.091938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.092880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.099824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.100154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.100958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.101394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.126152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:26.137954 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9b411c6-c0e5-4a23-99e2-77c7f507dbf5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.393694 Jun 25 21:07:26.138577 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1774/3891] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:25 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:26.150757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:26.151888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.158739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.159473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.160461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.161071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.183823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:26.196028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:26.197270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:26.198409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30860e31-93ae-4010-8448-415bc4c544d0 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.114667 Jun 25 21:07:26.199079 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2118/3892] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:26.266118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc52041e-16e9-44c6-9ec3-429aa270b338 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.119224 Jun 25 21:07:26.266118 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1775/3893] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:26 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:26.269678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.270259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.276850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.277302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.278069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.278499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.436830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4d512d2b-06dc-4fa0-ac22-8ac6dfccb1cc tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1614 microversion: 2.1 time: 0.170914 Jun 25 21:07:26.452135 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2119/3894] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1614 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:26.460716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.461353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.468380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.468866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.469652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.470102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.507560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.508184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] [instance: a104cd86-0a2f-45ec-8047-c581153d539c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.519711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.520144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.521039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.521483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.558419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] HTTP exception thrown: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Request method failure captured: Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c HTTP/1.1 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3eYLa2wew4NjyOEt9VS3zWEQRwSBTRku7HQFEa4ilBaPcHcQsvynK2Wt-GGU1HmL4IEvh9M3MXUuFU9ny2H-wef85zTJjFTJ9OnpUJ71MisKHfVoS5jXqVbCQMEHnDg-kyWt_gPPCgScCj87NrbF8MX5gxklPjpoQOYcGzUsWQALIM Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b3349ed72f824bcb9d1ce52d238bc870"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b3349ed72f824bcb9d1ce52d238bc870"}]}] Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: b3349ed72f824bcb9d1ce52d238bc870 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-722435674 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a6a15dadfd0448fab9e84a89173ed7d1 Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerRescueNegativeTestJSON-722435674-project Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a104cd86-0a2f-45ec-8047-c581153d539c'} Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:26.559862 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] Returning 404 to user: Instance a104cd86-0a2f-45ec-8047-c581153d539c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:26.564650 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39c335f9-6d4d-4ac4-a2b6-12c379745e69 tempest-ServerRescueNegativeTestJSON-722435674 tempest-ServerRescueNegativeTestJSON-722435674-project] 10.222.0.39 "GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c" status: 404 len: 111 microversion: 2.1 time: 0.060783 Jun 25 21:07:26.574358 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2120/3895] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers/a104cd86-0a2f-45ec-8047-c581153d539c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:26.761209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.761863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:26.774344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.775299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.780870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.781503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.898993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aefe4c8b-85d3-4f00-bad8-450d92182449 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1614 microversion: 2.1 time: 0.445062 Jun 25 21:07:26.899649 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1776/3896] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1614 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:26.918825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:26.927571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:26.939564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.945789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:26.947335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:26.948062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.091641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:07:27.178606 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4959710e-2e0e-45cd-b7fc-58b64fe1a0f2 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 1317 microversion: 2.1 time: 0.264211 Jun 25 21:07:27.182160 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1777/3897] 10.222.0.39 () {58 vars in 1189 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:27.195287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:27.196268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:27.212574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.213022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.214417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.215035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.305414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:27.314510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eaa4b337-d529-4b68-b229-c21f4b0e1288 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.559149 Jun 25 21:07:27.325326 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2121/3898] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:26 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:27.330211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:27.337410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:07:27.358692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.360219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.361420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.362315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.513873 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8d21a82-3af9-49f4-9eb0-135310c4f1c7 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.187283 Jun 25 21:07:27.515159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2122/3899] 10.222.0.39 () {58 vars in 1195 bytes} [Sat Jun 25 21:07:27 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:27.520356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:27.521592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:27.529641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.530472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.531814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.532485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.598265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:27.606339 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5193371d-c8b1-42b0-ba4c-05d1dee67028 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.422834 Jun 25 21:07:27.606933 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1778/3900] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:27 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:27.843035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:27.866414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:27.872985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:27.878880 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-188569ef-a4e4-4fbe-8244-12bbb5308bd3 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.361168 Jun 25 21:07:27.882477 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2123/3901] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:27 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:27.898252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:27.900834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:27.928522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.932368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.936678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-49aa7bf1-eabd-4b76-9013-8d274418ae62 req-ff037c17-baa0-4b6d-abbc-107587463436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "name": "network-vif-plugged", "status": "completed", "tag": "df274974-bae3-40d3-a60f-81a687f67fc8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:27.937556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.938515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.974586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-49aa7bf1-eabd-4b76-9013-8d274418ae62 req-ff037c17-baa0-4b6d-abbc-107587463436 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:27.979919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-49aa7bf1-eabd-4b76-9013-8d274418ae62 req-ff037c17-baa0-4b6d-abbc-107587463436 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:27.995855 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-49aa7bf1-eabd-4b76-9013-8d274418ae62 req-ff037c17-baa0-4b6d-abbc-107587463436 service nova] Creating event network-vif-plugged:df274974-bae3-40d3-a60f-81a687f67fc8 for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:28.007984 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-49aa7bf1-eabd-4b76-9013-8d274418ae62 req-ff037c17-baa0-4b6d-abbc-107587463436 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399621 Jun 25 21:07:28.009413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1779/3902] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:28.167180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a8df6e01-0657-4196-9ef7-6bf895ca3b3a tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.282409 Jun 25 21:07:28.169902 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2124/3903] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:27 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:07:28.188342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:28.190824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:28.222341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.223901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.226518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.228922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.300671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:28.351531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:28.353558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:28.384058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.384530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.387407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.389795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:07:28.390406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.390697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:07:28.391702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:07:28.392364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:07:28.393027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:07:28.494888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:28.502104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.503669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.504905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.505578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.539901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc7a2df5-72b8-4e81-85d7-700f3a968106 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 1067 microversion: 2.1 time: 0.362445 Jun 25 21:07:28.549842 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1780/3904] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:28 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 1067 bytes in 375 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 25 21:07:28.556709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:28.557487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:28.565370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.566091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.567061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.567631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.814811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:28.836455 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2475f839-f2ff-40e4-bd30-b433c4aa250a tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.283633 Jun 25 21:07:28.846563 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1781/3905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:28 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:28.851655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:28.855406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:28.867304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.873904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.874902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:28.875453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:28.995701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:29.006764 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e713c07e-549d-4ef6-bb11-44a30e9005b1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.660757 Jun 25 21:07:29.010248 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2125/3906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:28 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:29.018794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:29.019647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:29.035245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:29.036357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:29.042308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:29.042964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:29.145345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:29.155373 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50ab7d97-6eb2-4a1b-af31-4a4a1523fc86 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.306782 Jun 25 21:07:29.156011 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1782/3907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:28 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:29.223465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:29.238227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:29.240492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:29.242807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8349a33-1ab6-4f69-95fd-56599de92b12 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.231328 Jun 25 21:07:29.257703 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2126/3908] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:29 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:29.862336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:29.863085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:29.881950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:29.882404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:29.891985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:29.901978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.030713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:30.031299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:30.058645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.065173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.066641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.067255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.616361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:30.626599 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1a586d0-47d1-41fb-ba1d-32d0edc5d080 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.768705 Jun 25 21:07:30.633757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1783/3909] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:29 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:30.641514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d2aad4bc-e771-460c-89d0-3900802e0297 req-a32edce2-d61d-469f-9942-cd0efaa92ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "name": "network-vif-plugged", "status": "completed", "tag": "2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:30.654967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d2aad4bc-e771-460c-89d0-3900802e0297 req-a32edce2-d61d-469f-9942-cd0efaa92ec4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.655913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d2aad4bc-e771-460c-89d0-3900802e0297 req-a32edce2-d61d-469f-9942-cd0efaa92ec4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.673462 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d2aad4bc-e771-460c-89d0-3900802e0297 req-a32edce2-d61d-469f-9942-cd0efaa92ec4 service nova] Creating event network-vif-plugged:2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:30.681987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d2aad4bc-e771-460c-89d0-3900802e0297 req-a32edce2-d61d-469f-9942-cd0efaa92ec4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043595 Jun 25 21:07:30.683329 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1784/3910] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:30.695459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:30.696568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:30.706374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.707173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.708162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.708811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.796484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:30.799692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:30.810931 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8fb1e6f2-0801-400a-b9bd-b680ba787749 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.784064 Jun 25 21:07:30.812525 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2127/3911] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:30 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:30.828445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:30.830620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:30.845411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.847684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:30.854500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:30.854982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:31.033800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:31.049007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ee74f90-ef7b-445d-bceb-f5a9a91a9eb5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.359453 Jun 25 21:07:31.049611 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1785/3912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:30 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:31.070377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:31.078762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:31.080265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:31.081481 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8c887ca-7948-4302-a9f1-19b555cabcbb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.267837 Jun 25 21:07:31.082048 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2128/3913] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:30 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:31.643617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:31.644780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:31.666656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:31.667409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:31.668363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:31.668979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:31.832391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:31.833248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:31.841573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:31.842467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:31.843429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:31.844069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.357964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:32.367064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96dccc51-26f8-4373-8f75-0c56cc1277bd tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1332 microversion: 2.1 time: 0.542001 Jun 25 21:07:32.372531 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2129/3914] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:31 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1332 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:32.379266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:32.379890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:32.394641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:32.395397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.396397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:32.397072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.665843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:32.683185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8e9f774-43c9-40a2-b439-b9d98c9c7886 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 1.042454 Jun 25 21:07:32.684139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1786/3915] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:31 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:32.708865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:32.713241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:32.719706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:32.734754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-acb0e7ed-acde-419a-81ed-ce222635f47f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.354299 Jun 25 21:07:32.736302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:32.737908 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2130/3916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:32 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:32.738674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.739706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:32.742411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.815160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8841b13f-80bc-41b1-8c39-17257bc6ded0 req-eda09396-5995-483d-beff-b00d8bd006ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "name": "network-vif-plugged", "status": "completed", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:32.827331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8841b13f-80bc-41b1-8c39-17257bc6ded0 req-eda09396-5995-483d-beff-b00d8bd006ef service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:32.827784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8841b13f-80bc-41b1-8c39-17257bc6ded0 req-eda09396-5995-483d-beff-b00d8bd006ef service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:32.863221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8841b13f-80bc-41b1-8c39-17257bc6ded0 req-eda09396-5995-483d-beff-b00d8bd006ef service nova] Creating event network-vif-plugged:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:07:32.875780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8841b13f-80bc-41b1-8c39-17257bc6ded0 req-eda09396-5995-483d-beff-b00d8bd006ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070627 Jun 25 21:07:32.879982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2131/3917] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:07:33.046167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:33.063088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:33.065191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:33.066961 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a5fc816-cf1a-4e54-9ca6-f04c207bb44b tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1366 microversion: 2.57 time: 0.379226 Jun 25 21:07:33.067848 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1787/3918] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:32 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:33.390475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:33.394044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:33.414743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.415756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.421520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.424239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.687073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:33.695409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80aca097-e54e-4c69-b909-983de3036e39 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1667 microversion: 2.1 time: 0.311090 Jun 25 21:07:33.706980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:33.706980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:33.708275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2132/3919] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:33 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1667 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:33.709815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.710277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.714434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:33.715192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:33.717615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.718084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.722423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.723141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.724094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.724746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.759581 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8b082f2-8068-4597-8193-7275cbd39417 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a/ips" status: 200 len: 179 microversion: 2.1 time: 0.049027 Jun 25 21:07:33.770058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2133/3920] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:07:33 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a/ips => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:33.777096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:33.777927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:33.785899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.786660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:33.787693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:33.788309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.605494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:34.618705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abe7a1fd-885d-472a-964c-b93369a0a1a3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.845650 Jun 25 21:07:34.619499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2134/3921] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:33 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:34.626226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:34.627244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:34.684021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.684516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.685262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.685692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.738108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:34.747013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:07:34.753953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-903ebfad-814c-463c-923b-0d3f6ef8d6a4 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 1.057498 Jun 25 21:07:34.758162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1788/3922] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:33 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:34.769191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:34.777008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:34.798056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.808173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.809263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.809818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.903719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5013776d-85ba-4005-99dc-2486831ce11a tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "DELETE /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 204 len: 0 microversion: 2.1 time: 0.282484 Jun 25 21:07:34.908815 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2135/3923] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:07:34 2022] DELETE /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:07:34.923595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:34.926968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:34.941762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.942846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:34.944778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:34.945763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:35.028346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:35.042600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:35.055585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:35.061611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:35.063051 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2afd851a-060a-4924-b7f3-b9ffaebce07a tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1372 microversion: 2.57 time: 0.303761 Jun 25 21:07:35.063835 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1789/3924] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:34 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:35.138345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:35.159532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96c64b45-12f2-40c8-8ecb-084a81a96b48 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1673 microversion: 2.1 time: 0.246660 Jun 25 21:07:35.160976 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2136/3925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:34 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:35.635850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:35.636495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:35.643671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:35.644468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:35.645428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:35.646032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:35.774530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:35.775707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:35.786927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:35.787848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:35.789904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:35.790571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:36.080065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.097828 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3eca6cbe-92f6-4d11-a2c5-d2a1e8685a64 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.321291 Jun 25 21:07:36.103562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2137/3926] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:35 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:36.117991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:36.118697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:36.134978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:36.135902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:36.137006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:36.137811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:36.284469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.296601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.298139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.299377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8075a247-d378-4626-a84c-5cd7ecf882eb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1372 microversion: 2.57 time: 0.194366 Jun 25 21:07:36.311258 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2138/3927] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:36 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:36.322369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:36.322715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:36.334962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:36.335655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:36.336847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:36.337456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:36.637372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.650584 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38eaf3e1-6f52-42d5-bfea-aebe686f0cbf tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 1.017213 Jun 25 21:07:36.652235 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1790/3928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:35 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:36.943039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:36.951749 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30ff0263-a964-474a-831b-c73d9d711296 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1673 microversion: 2.1 time: 0.643450 Jun 25 21:07:36.956277 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2139/3929] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:36 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1673 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:37.121571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:37.122534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:37.134347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:37.139431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.140102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.142268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.144205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.319705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:37.321089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:37.334224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.335504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.337530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.341364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.403443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=14 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:37.418832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:37.442163 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65f2d82b-055c-4e32-b02d-6e7b8e01b3ad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.321808 Jun 25 21:07:37.444396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1791/3930] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:37 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:37.534837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:37.546003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:37.549188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:37.558090 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fafdeecc-1eaa-4524-95df-bda3d737ad37 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1372 microversion: 2.57 time: 0.243385 Jun 25 21:07:37.563362 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2140/3931] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:37 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:07:37.667812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:37.669203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:37.682974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.683617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.684619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.685224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.974486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:37.975681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:37.979098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:37.992964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.994322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:37.995409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:37.996712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:38.226451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.238963 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14e04d87-1b9b-4d76-82e0-4b30143a6269 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1322 microversion: 2.1 time: 0.575434 Jun 25 21:07:38.239861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1792/3932] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:37 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1322 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:38.332639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.342397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9cbc2068-ec6a-4449-aa71-e87ab5e1907f tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1673 microversion: 2.1 time: 0.372316 Jun 25 21:07:38.344523 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2141/3933] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:37 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1673 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:38.462748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:38.463737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:38.474068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:38.474929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:38.476119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:38.477723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:38.581004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:38.582553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:38.598720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:38.599392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:38.600251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:38.600725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:38.733808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.749072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.750604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.751816 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8df7bfb-f9cd-4bb9-ad69-39ca98124c05 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1372 microversion: 2.57 time: 0.175209 Jun 25 21:07:38.752399 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2142/3934] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:38 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:07:38.786214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:38.798636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7118baeb-fd82-47ac-80e9-247c532fa79f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.343043 Jun 25 21:07:38.800898 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1793/3935] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:38 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:39.260124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:39.261318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:39.278596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.279046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.285130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.286008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.363304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:39.364018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:39.384401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.384890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.388500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.389891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.776066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:39.783486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:39.794364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a141271-d0c5-4777-b924-66c7e5505a2e tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1516 microversion: 2.1 time: 0.538609 Jun 25 21:07:39.804673 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2143/3936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:39 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1516 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:39.832820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:39.835362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:39.863352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.865016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.868465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.868917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.913916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:39.923751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65353ac2-26b5-458d-b739-2807b287176e tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1673 microversion: 2.1 time: 0.566013 Jun 25 21:07:39.927629 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1794/3937] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:39 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1673 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:39.941601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:39.942543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:39.949293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.949806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.950662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:39.951098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:39.974719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:39.984280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lazy-loading 'flavor' on Instance uuid 8d4c2c20-a731-4403-9614-b978a24ab357 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:07:40.027913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:40.046518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:40.048846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:40.050824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67beb812-5b18-4968-b853-02bfbf6d8df2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1372 microversion: 2.57 time: 0.252716 Jun 25 21:07:40.052529 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2144/3938] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:39 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1372 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:40.059914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:40.060923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:40.070676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.073518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:40.075046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.076720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:40.100691 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5b75359-d490-4be3-967f-0e69f2cec9c5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action" status: 200 len: 32 microversion: 2.1 time: 0.168942 Jun 25 21:07:40.102371 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1795/3939] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:39 2022] POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:07:40.117885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:40.119094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:40.130611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.131585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:40.132700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.133526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:40.514662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:40.537162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79982c41-c890-4e04-ba1f-0e91a3371e8f tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.419528 Jun 25 21:07:40.538478 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1796/3940] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:40 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:40.944999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:40.946529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:40.960110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.973851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:40.978257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:40.978896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.098578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:41.129805 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-31632295-18d9-45bd-82b1-bc78d65dbe12 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 1.075908 Jun 25 21:07:41.135100 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2145/3941] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:40 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:41.145233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:41.147784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:41.161726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.164102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.165554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.167807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.368767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:41.416258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:41.418834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:41.421330 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-725bccd2-9684-4141-8cb9-30fcd68a6cf2 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1357 microversion: 2.57 time: 0.282004 Jun 25 21:07:41.423321 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2146/3942] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:41 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:41.461078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:41.466241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:41.482453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.483499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.484645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.487194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.563920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:07:41.720755 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c154228-6548-408a-88ac-51a5432294ef tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 204 len: 0 microversion: 2.57 time: 0.280311 Jun 25 21:07:41.722552 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2147/3943] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:07:41 2022] DELETE /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 25 21:07:41.757961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:41.759777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:41.767924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.768943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.770610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.775438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.932775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:41.945508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-62e02908-ba41-477c-8335-8aef4a5c7d6d tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1673 microversion: 2.1 time: 1.004395 Jun 25 21:07:41.946671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1797/3944] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:40 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1673 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:41.962069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:41.963013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:41.971620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.977271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:41.978263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:41.978796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:42.115815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:42.132101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:42.133818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:42.135221 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d8d1825-0e2b-4dbc-85a1-f5d89f2e27b8 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1363 microversion: 2.57 time: 0.185667 Jun 25 21:07:42.139283 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1798/3945] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:41 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:42.362597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-55030604-caa9-4f71-94a6-3321025e9b58 req-a73a40d7-0c99-45b0-aa46-9ccfea6ad902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "name": "network-vif-deleted", "tag": "df274974-bae3-40d3-a60f-81a687f67fc8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:42.371621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-55030604-caa9-4f71-94a6-3321025e9b58 req-a73a40d7-0c99-45b0-aa46-9ccfea6ad902 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:42.372329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-55030604-caa9-4f71-94a6-3321025e9b58 req-a73a40d7-0c99-45b0-aa46-9ccfea6ad902 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:42.385030 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-55030604-caa9-4f71-94a6-3321025e9b58 req-a73a40d7-0c99-45b0-aa46-9ccfea6ad902 service nova] Creating event network-vif-deleted:df274974-bae3-40d3-a60f-81a687f67fc8 for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:42.390867 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-55030604-caa9-4f71-94a6-3321025e9b58 req-a73a40d7-0c99-45b0-aa46-9ccfea6ad902 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250226 Jun 25 21:07:42.392239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1799/3946] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:42.413170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:42.413975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:42.421021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:42.421336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:42.422112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:42.422547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:42.532663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:42.549975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83656ac9-f92c-48b5-9bbf-f3032ae675c1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.823969 Jun 25 21:07:42.564968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2148/3947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:41 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:42.965190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:42.966555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:42.977917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:42.978646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:42.979983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:42.981073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:43.087382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.097848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-249f3cf0-60be-4acb-8507-a3f08be648c5 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1296 microversion: 2.1 time: 0.138430 Jun 25 21:07:43.100122 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2149/3948] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:42 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1296 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:43.160745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:43.161386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:43.170431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:43.170889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:43.171686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:43.172176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:43.265004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.274967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.276884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.278266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-925a9591-8a83-4ba5-84ef-ac083c7a0f4e tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1363 microversion: 2.57 time: 0.123058 Jun 25 21:07:43.279380 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2150/3949] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:43 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1363 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:43.446267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.457604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4153ad85-d819-4783-a281-f74c2f4559d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 1.060837 Jun 25 21:07:43.468180 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1800/3950] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:42 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:43.585604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:43.587136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:43.596185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:43.598312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:43.600133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:43.601453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:43.803200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:43.816099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7e8d079-148f-4145-96d1-d74cd1cd8efa tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.235100 Jun 25 21:07:43.816749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2151/3951] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:43 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:44.116392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:44.116392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:44.123722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.124153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.124959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.125388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.176273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.177477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.178230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lazy-loading 'fault' on Instance uuid 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:07:44.254014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53269024eb4c238ec405606e36a049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1174772192cc45578b127d170fda4ebf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:44.268207 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b3ceb7c-0ba2-472b-8aea-5639653a0826 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 200 len: 1301 microversion: 2.1 time: 0.153602 Jun 25 21:07:44.271814 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1801/3952] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:44 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 1301 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:44.297952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:44.298849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:44.315230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.315731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.316834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.317507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.421783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9a50a81a-7e9b-48c5-bef4-0e559f1d11bf req-d05dee4a-605c-4d03-9a7f-fa8782973c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d17f7c-083d-4cd7-a43e-ad57a05c6a9a", "name": "network-vif-deleted", "tag": "2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:44.447175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9a50a81a-7e9b-48c5-bef4-0e559f1d11bf req-d05dee4a-605c-4d03-9a7f-fa8782973c3f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.447880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9a50a81a-7e9b-48c5-bef4-0e559f1d11bf req-d05dee4a-605c-4d03-9a7f-fa8782973c3f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.479606 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9a50a81a-7e9b-48c5-bef4-0e559f1d11bf req-d05dee4a-605c-4d03-9a7f-fa8782973c3f service nova] Creating event network-vif-deleted:2f7b0a62-3834-4e26-ac70-dbb97d8dd9bb for instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a on nch2-master-1 Jun 25 21:07:44.500938 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9a50a81a-7e9b-48c5-bef4-0e559f1d11bf req-d05dee4a-605c-4d03-9a7f-fa8782973c3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083174 Jun 25 21:07:44.506488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1802/3953] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:07:44.510667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:44.524677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:44.526317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '69be43ab3b044443b83d47d98f57ab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca0bcba91f3a4e749c46c491d5270fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:44.530337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1190555e-635c-46d0-aa98-2958dca0ecfb tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 200 len: 1363 microversion: 2.57 time: 0.233650 Jun 25 21:07:44.542064 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2152/3954] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:44 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:07:44.542196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:44.543351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:44.558963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.561100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.561888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.562322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.833392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:44.834627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:44.847085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.847540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.856899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:44.857607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:44.999574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:45.010726 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c2dfcb89-4486-4636-bea0-68527bb4b531 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1471 microversion: 2.1 time: 0.500326 Jun 25 21:07:45.012043 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1803/3955] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:44 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1471 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:45.288079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:45.288908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:45.301141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:45.302909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:45.305212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:45.307490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:45.309002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:45.310046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:45.315272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b93dcf7-e612-499d-8417-9282583e09f9 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.485644 Jun 25 21:07:45.327396 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2153/3956] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:44 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:45.354575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a HTTP/1.1 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '99d17f7c-083d-4cd7-a43e-ad57a05c6a9a'} Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:45.359058 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:45.363562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.368997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:45.371464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3115be1-6b4b-4165-9564-1b845fd993ae tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 404 len: 111 microversion: 2.1 time: 0.087629 Jun 25 21:07:45.372881 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1804/3957] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:45 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:45.550876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:45.551771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] [instance: a639ed09-e46d-4dac-80ab-54f4e6dc93b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:45.571083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:45.572244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:45.584147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:45.585037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:45.631532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] HTTP exception thrown: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Request method failure captured: Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 HTTP/1.1 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3jy7D1Gr2jfO-wsefgN9__eB4OR52gNyd7mybpkNP1Ik0nDZZBP_1WKtWpiWYS5D4qse1XNfVRYii89Yr81j7djwIQFIcS9E94i1GWJhFSoqlNiLLULHM2qUHVNOqaAaDYFY2rRpI873UsEg4wB6hQOBbQD1RjBTHRlkyUY3F98ysE Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.57 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ca0bcba91f3a4e749c46c491d5270fe2 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerShowV257Test-1481971681 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ca0bcba91f3a4e749c46c491d5270fe2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca0bcba91f3a4e749c46c491d5270fe2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ca0bcba91f3a4e749c46c491d5270fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ca0bcba91f3a4e749c46c491d5270fe2"}]}] Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerShowV257Test-1481971681 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ca0bcba91f3a4e749c46c491d5270fe2 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerShowV257Test-1481971681 Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerShowV257Test-1481971681-project Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 69be43ab3b044443b83d47d98f57ab1b Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerShowV257Test-1481971681-project Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a639ed09-e46d-4dac-80ab-54f4e6dc93b9'} Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:45.637334 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. Jun 25 21:07:45.644544 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:07:45.648585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] Returning 404 to user: Instance a639ed09-e46d-4dac-80ab-54f4e6dc93b9 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:45.651094 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2dc045e2-4851-4137-b908-6b3226cf5898 tempest-ServerShowV257Test-1481971681 tempest-ServerShowV257Test-1481971681-project] 10.222.0.39 "GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9" status: 404 len: 111 microversion: 2.57 time: 0.104830 Jun 25 21:07:45.657033 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2154/3958] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:07:45 2022] GET /compute/v2.1/servers/a639ed09-e46d-4dac-80ab-54f4e6dc93b9 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:07:46.028717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:46.030095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:46.045568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:46.054697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:46.058973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:46.059948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:46.335948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:46.336631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:46.352139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:46.362301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:46.363293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:46.363846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:46.846509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:46.856779 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c51fe8b-1579-4332-b5c9-a02457897e88 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.832152 Jun 25 21:07:46.857935 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1805/3959] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:46 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:46.870142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:46.878200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-303876ba-2e2b-4a19-a07d-a9e61dc9e4b8 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.548138 Jun 25 21:07:46.888272 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2155/3960] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:46 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:47.875695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:47.877130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:47.896249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:47.900023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:47.901722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:47.903497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:47.903980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:47.904922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:47.913953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:47.914764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:47.916141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:47.917308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:48.257409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:48.266626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b1d9209-97be-4fce-bf35-566756d16368 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.396086 Jun 25 21:07:48.269469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1806/3961] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:47 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:48.822457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:48.847852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-435bc5ab-39ef-49b7-bde3-a583c426c046 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.953828 Jun 25 21:07:48.850080 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2156/3962] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:47 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:49.285445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:49.286067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:49.312994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:49.313450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:49.314243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:49.314683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:49.766679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:49.776408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-27c12bb5-3d2d-421a-a809-bda662d1baad tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.494801 Jun 25 21:07:49.783929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1807/3963] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:49 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:49.869429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:49.870951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:49.890856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:49.893323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:49.894327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:49.895583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:50.183840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:50.197772 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d61ccd4-b872-4478-af43-5b670430ed9c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.334820 Jun 25 21:07:50.198676 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2157/3964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:49 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:50.800070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:50.800695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:50.813313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:50.818641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:50.819705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:50.822774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:51.215088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:51.215703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:51.236268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:51.236766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:51.237568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:51.237998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:51.277124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:51.294086 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48224d6b-7730-4d1a-86bb-975a85e62f90 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.495564 Jun 25 21:07:51.320654 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1808/3965] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:50 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:51.889710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:51.917449 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aabdf76a-2b90-4e23-a425-cc34b7606999 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.693249 Jun 25 21:07:51.918440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2158/3966] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:51 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:52.317289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:52.319213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:52.335311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.336919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.338016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.338646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.818004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-82770edf-7827-4c7f-b2ff-06cbbd2c4d2c req-5169922e-2f42-49d5-9387-bf4037772a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c915083-b7bd-47e7-8861-52f5e318b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "3002f539-100d-48dc-a62d-0dab07c8a061"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:52.829476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:52.840572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82770edf-7827-4c7f-b2ff-06cbbd2c4d2c req-5169922e-2f42-49d5-9387-bf4037772a04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.841210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82770edf-7827-4c7f-b2ff-06cbbd2c4d2c req-5169922e-2f42-49d5-9387-bf4037772a04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.843098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c02515af-54eb-46ba-ae46-965a4b2595f7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.534588 Jun 25 21:07:52.855456 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1809/3967] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:52 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:52.869883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-82770edf-7827-4c7f-b2ff-06cbbd2c4d2c req-5169922e-2f42-49d5-9387-bf4037772a04 service nova] Creating event network-vif-plugged:3002f539-100d-48dc-a62d-0dab07c8a061 for instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 on nch1-master-1 Jun 25 21:07:52.876242 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-82770edf-7827-4c7f-b2ff-06cbbd2c4d2c req-5169922e-2f42-49d5-9387-bf4037772a04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062357 Jun 25 21:07:52.877947 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2159/3968] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:07:52.926277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:52.927048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:52.943792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.945069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.945956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.946399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.948609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:52.949535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:52.966752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.967228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.968734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:52.970419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:52.986882 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a HTTP/1.1 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '99d17f7c-083d-4cd7-a43e-ad57a05c6a9a'} Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:52.989967 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:52.995297 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:52.998151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:52.999217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1e6f458-3a5d-478b-a29d-9fdaaf16f1d2 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "DELETE /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 404 len: 111 microversion: 2.1 time: 0.077983 Jun 25 21:07:53.003782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1810/3969] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:07:52 2022] DELETE /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:53.011780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:53.012859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:53.023716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.024538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.025561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.026226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.061508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:53.062683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a HTTP/1.1 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '99d17f7c-083d-4cd7-a43e-ad57a05c6a9a'} Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.063574 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. Jun 25 21:07:53.068938 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.070776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 99d17f7c-083d-4cd7-a43e-ad57a05c6a9a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:53.071862 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c668d0e-4b40-43cd-b529-0d6686585302 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a" status: 404 len: 111 microversion: 2.1 time: 0.064217 Jun 25 21:07:53.077131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1811/3970] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:53 2022] GET /compute/v2.1/servers/99d17f7c-083d-4cd7-a43e-ad57a05c6a9a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:53.083908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:53.084792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:53.093660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.094406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.095390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.096023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.114702 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 HTTP/1.1 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6df1cfdb-ff38-4305-b99a-df57f73a24e6'} Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:53.116632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.121842 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.123882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:53.125002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b7252b4-5da3-435e-834e-c48d551e8ec1 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 404 len: 111 microversion: 2.1 time: 0.046578 Jun 25 21:07:53.129322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1812/3971] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:07:53 2022] DELETE /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:53.135243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:53.136138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] [instance: 6df1cfdb-ff38-4305-b99a-df57f73a24e6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:53.143853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.145271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.146280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.146903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.162996 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] HTTP exception thrown: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Request method failure captured: Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 HTTP/1.1 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3in0EFa8zxhhIvgZlpp_ne0SmI-MK3DbLnm95jf_wac_VhPs8G6ovPRma40R914sBlzDPDSjROkF6LjQm7sF_kjR5m-wrB8IA2oZ6EbgIxDZbwkBXX2O_UnIuc2sS2wqDG6Yk7rEP8-mU0r2X5LZJt7NnOhtb7JtDIsTGLTC4grEHU Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1174772192cc45578b127d170fda4ebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1174772192cc45578b127d170fda4ebf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1174772192cc45578b127d170fda4ebf"}]}] Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1174772192cc45578b127d170fda4ebf Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestMultiNic-708811573 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9c53269024eb4c238ec405606e36a049 Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestMultiNic-708811573-project Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6df1cfdb-ff38-4305-b99a-df57f73a24e6'} Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:07:53.165395 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. Jun 25 21:07:53.170536 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:07:53.171940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] Returning 404 to user: Instance 6df1cfdb-ff38-4305-b99a-df57f73a24e6 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:07:53.173058 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d282ef79-e4d4-4d2c-800f-83ebfa37f803 tempest-ServersTestMultiNic-708811573 tempest-ServersTestMultiNic-708811573-project] 10.222.0.39 "GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6" status: 404 len: 111 microversion: 2.1 time: 0.042383 Jun 25 21:07:53.179539 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1813/3972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:53 2022] GET /compute/v2.1/servers/6df1cfdb-ff38-4305-b99a-df57f73a24e6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:07:53.833096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:53.850338 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d28b88d4-48e9-45f3-8768-a9a7d5db2165 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.917554 Jun 25 21:07:53.850958 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2160/3973] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:52 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:53.863378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:53.864766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:53.872964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.873679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.874780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:53.875369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:53.896359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:07:54.367531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:54.407592 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c324aebd-0d0b-4eed-8413-e884b4bce44d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1477 microversion: 2.1 time: 0.548280 Jun 25 21:07:54.424777 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1814/3974] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:53 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1477 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:54.872453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:54.874264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:54.884317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:54.885151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:54.886136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:54.886744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:55.425697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:55.427201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:55.447304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:55.450622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:55.452761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:55.454033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:55.612731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:55.621685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7395c25d-ba63-437b-9cab-55060700b857 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.756636 Jun 25 21:07:55.622861 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2161/3975] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:54 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:55.957604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:55.988371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77db216c-e604-4dc2-b084-6afbb1897cd7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1463 microversion: 2.1 time: 0.566611 Jun 25 21:07:55.996605 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1815/3976] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:55 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1463 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:07:56.017346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:56.018521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:56.039073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.039591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.040406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.040897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.640756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:56.642259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:56.657034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.660632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.663581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.683738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.730806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:56.740786 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2f00537-3789-445a-ad61-22144099168b tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1463 microversion: 2.1 time: 0.730860 Jun 25 21:07:56.741581 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2162/3977] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:56 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1463 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:56.759387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:56.760976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:56.768568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.769495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.770581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:56.771375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:56.918709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:07:56.919523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:07:56.922529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:07:56.923138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:07:56.923785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:07:57.022324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:57.037388 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-740ff6ba-c286-42a8-9e90-f5a3f57fdccc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.402055 Jun 25 21:07:57.047817 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1816/3978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:56 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:57.099737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:57.121836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:57.124519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:57.125614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:57.130155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:57.205289 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5f37f2a-9fda-4619-a640-54cb351762d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 1067 microversion: 2.1 time: 0.450762 Jun 25 21:07:57.208982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2163/3979] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:07:56 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 1067 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 25 21:07:57.221197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:57.221830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:57.228344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:57.228850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:57.229825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:57.230427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:57.477236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:57.484995 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a155bc7-d29f-4cf0-9ae8-20fae39e8568 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.267735 Jun 25 21:07:57.501256 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1817/3980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:57 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:58.055646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:58.056397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:58.067456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:58.068259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:58.069449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:58.069885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:58.504608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:58.505578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:58.527004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:58.527602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:58.528466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:58.528917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:58.619350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:07:58.635841 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fa15ebe-b7d5-41cd-bd0f-d51428044794 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.584156 Jun 25 21:07:58.636697 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2164/3981] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:58 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:07:59.308518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd4fe650-3b15-4a98-8477-1d81d95c02b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Action: 'create', calling method: .version_select at 0x7f984f59cee0>, body: {"keypair": {"name": "tempest-keypair-1133061501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFCiExcMIyk3S/Lo1Fpd9TGaStntehkYkGoSoiRRdLlaH/ndkySzvSi09VRJ7T56slpYZtOpfVpYH3jsoHmXE63jISdwI4MEgWD95Qm+/eY2hmgrbgmhQZCNYA6jHtp/A=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:07:59.343098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cd4fe650-3b15-4a98-8477-1d81d95c02b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Getting quotas for project 4e97b91d23b24e7aba5860e7d0bd062c. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:07:59.351050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cd4fe650-3b15-4a98-8477-1d81d95c02b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Getting quotas for user ec129d5641ef457c99014e8f95fcfb5d and project 4e97b91d23b24e7aba5860e7d0bd062c. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:07:59.395976 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd4fe650-3b15-4a98-8477-1d81d95c02b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.091295 Jun 25 21:07:59.423600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2165/3982] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 21:07:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:07:59.655180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:07:59.657330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:07:59.671664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:59.672967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:07:59.678343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:07:59.681348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:00.068524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:00.079636 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-337a357c-44a3-4cac-b950-9a2ec8e73d16 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.429832 Jun 25 21:08:00.081870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2166/3983] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:59 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:00.132771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:00.147964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31db900f-81b0-4698-b7c1-92efa984e597 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 1.646671 Jun 25 21:08:00.151533 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1818/3984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:07:58 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:01.099226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:01.100889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:01.110588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:01.111300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:01.112472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:01.113205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:01.169487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:01.170316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:01.184226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:01.184979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:01.186056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:01.186650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:01.558853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:01.603208 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b44c12e-0002-48e4-a6a2-71242212db0c tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.508200 Jun 25 21:08:01.604592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2167/3985] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:01 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:01.660329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:01.670119 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-071e4d96-56cd-4a60-9961-2738fb84ebee tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.506466 Jun 25 21:08:01.678448 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1819/3986] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:01 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:02.620407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:02.621135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:02.654202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:02.654202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:02.654202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:02.654202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:02.696373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:02.697031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:02.725842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:02.730272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:02.735195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:02.736264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:03.283791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:03.306249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa060720-432e-4a47-9776-652bb23c4a60 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.689851 Jun 25 21:08:03.315516 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2168/3987] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:02 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:03.317912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-965901475", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5d334512-ecd6-4ea3-bd47-6c182cf06cf7"}, {"port": "6737e460-a7ee-4d74-a098-b0137bae8d87", "tag": "port-1"}, {"port": "613f1347-eaa6-452c-91db-c7556e0d2b78", "tag": "port-2"}, {"uuid": "da4c0635-b6ab-4a05-9618-27be68a72b94", "tag": "net-1"}, {"uuid": "da4c0635-b6ab-4a05-9618-27be68a72b94"}, {"uuid": "27520d06-1c20-467b-82b2-639940b59d7a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "27520d06-1c20-467b-82b2-639940b59d7a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5ce7b5ae-636f-4c81-8e58-e20f8d77d741", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "c7e78dca-d01a-47b0-9d2e-8dfacce8d58b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "10e6b373-c491-4f43-9dc5-373fa07f9035", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1267650586"}], "key_name": "tempest-keypair-1133061501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:03.621968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] validate_networks() for [('5d334512-ecd6-4ea3-bd47-6c182cf06cf7', None, None, None, None, None), (None, None, '6737e460-a7ee-4d74-a098-b0137bae8d87', None, None, None), (None, None, '613f1347-eaa6-452c-91db-c7556e0d2b78', None, None, None), ('da4c0635-b6ab-4a05-9618-27be68a72b94', None, None, None, None, None), ('da4c0635-b6ab-4a05-9618-27be68a72b94', None, None, None, None, None), ('27520d06-1c20-467b-82b2-639940b59d7a', '10.2.2.100', None, None, None, None), ('27520d06-1c20-467b-82b2-639940b59d7a', '10.2.2.200', None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:04.010075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:04.022588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cf770a5-4ce6-4896-bf55-7e9a32882193 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 1.328076 Jun 25 21:08:04.039252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1820/3988] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:02 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:04.323911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:04.324946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:04.335948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:04.336999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:04.338456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:04.339584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:05.070636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:05.101751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-455c9157-564b-4933-a704-67885d1f40f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.781995 Jun 25 21:08:05.103003 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1821/3989] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:04 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:05.108196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:05.109100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:05.118458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:05.119180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:05.120191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:05.121018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:05.592699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:05.602669 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-675d539b-d8e3-4604-9752-a83bb68f874f tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.498324 Jun 25 21:08:05.614364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1822/3990] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:05 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:06.119387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:06.120217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:06.147382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:06.147847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:06.159690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:06.162057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:07.257909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:07.271329 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5d7d82f-dfde-4e5f-ae4d-2420b73ed3f0 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 1.155891 Jun 25 21:08:07.278948 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1823/3991] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:06 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:07.287084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:07.300802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:07.321570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:07.322343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:07.324641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:07.326267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:07.766472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:07.780458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-646bd260-c6cc-49ee-921a-87dc7d14c9f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.498001 Jun 25 21:08:07.781071 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1824/3992] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:07 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:08.420871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-864876958", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:08.512670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] validate_networks() for [('4afca77e-1bb7-4cef-b35e-661d5d7aabe7', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:08.849218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:08.851389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:08.852089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:08.853994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:08.855223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:08.862323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:08.876446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:08.877540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:08.878879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:08.879693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:08.907977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Getting quotas for project 4e97b91d23b24e7aba5860e7d0bd062c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:08.920888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Getting quotas for user ec129d5641ef457c99014e8f95fcfb5d and project 4e97b91d23b24e7aba5860e7d0bd062c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:09.258385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:09.267721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5ce7b5ae-636f-4c81-8e58-e20f8d77d741',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='c7e78dca-d01a-47b0-9d2e-8dfacce8d58b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='10e6b373-c491-4f43-9dc5-373fa07f9035',volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:09.602816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:09.603375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:09.608796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:09.609375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:09.609896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:09.631689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:09.636577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:09.637590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:09.639069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:09.689746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Getting quotas for project 8983a71e4a2142fc9fa3460969b2f425. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:09.703824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Getting quotas for user 10c0287a5f02499cb26cc144cd7588cf and project 8983a71e4a2142fc9fa3460969b2f425. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:09.731504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:09.736769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:09.854250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00053678-2ccb-409f-a51c-2595cc66a261 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.066636 Jun 25 21:08:09.855215 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1825/3993] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:08:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:08:09.860920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:09.861748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:09.880789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:09.881255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:09.882048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:09.882559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:10.080645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25e441e2-d9f8-4524-b1d0-561b5344b3e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.763955 Jun 25 21:08:10.084331 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2169/3994] 10.222.0.39 () {62 vars in 1188 bytes} [Sat Jun 25 21:08:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 6775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:08:10.104992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:10.107463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:10.128301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:10.128786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:10.129573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:10.139606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:10.708860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:10.725918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39fcf487-83be-401b-8dfe-99eb350f2f73 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.635383 Jun 25 21:08:10.738324 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2170/3995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:10 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:10.751923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:10.759937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:10.769924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:10.770653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:10.771665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:10.772358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:10.853741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:10.865805 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dbf59c62-db34-4681-8b93-a9a4074cb8fe tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 1.008950 Jun 25 21:08:10.886217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1826/3996] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:09 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:10.891557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c8959c6-7aec-4fd8-80a7-0d95051c7ea7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:10.892209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c8959c6-7aec-4fd8-80a7-0d95051c7ea7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:11.051771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2c8959c6-7aec-4fd8-80a7-0d95051c7ea7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.060304 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c8959c6-7aec-4fd8-80a7-0d95051c7ea7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1216 microversion: 2.1 time: 0.172918 Jun 25 21:08:11.065507 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1827/3997] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:10 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1216 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:11.078775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:11.079827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:11.252677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.263257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.266216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.269795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6faacad-d444-4d76-aa2e-83a7023d3fe1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1285 microversion: 2.32 time: 0.202522 Jun 25 21:08:11.277119 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1828/3998] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:11 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:11.612807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.642573 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e95bd16-8f6f-4c19-8218-35da85f45663 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.903977 Jun 25 21:08:11.648891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2171/3999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:10 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:11.664750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:11.665869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:11.677107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:11.679501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:11.680595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:11.683163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:11.746404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:11.747053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:11.766209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:11.767332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:11.768584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:11.769181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:11.923140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:11.930948 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-916e44e4-a28f-432c-9ba9-03d676989dde tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.270278 Jun 25 21:08:11.931586 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1829/4000] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:11 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:12.128442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-28310838", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "51fa8f4c-01cc-4d25-97c7-3eb82b6c73f9"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:12.216098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] validate_networks() for [('51fa8f4c-01cc-4d25-97c7-3eb82b6c73f9', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:12.607746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:12.619994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0a57bd0-b408-4b57-9f5e-7998a5b42820 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.877650 Jun 25 21:08:12.644159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2172/4001] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:11 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:12.651722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:12.655381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:12.669589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:12.670287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:12.671273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:12.671870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:12.932002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:12.932613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:12.933088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:12.933880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:12.934591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:12.951093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:12.951865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:12.954929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:12.958275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.007671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Getting quotas for project 26b2606c05e441e58e2bba46a8ee48e5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:13.020031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Getting quotas for user b6aaf0215c7d4342b75c8921f1ac54d3 and project 26b2606c05e441e58e2bba46a8ee48e5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:13.047102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:13.052195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:13.149658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c5953d3-6920-4cd6-9c52-06ee2b600228 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.216947 Jun 25 21:08:13.150340 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1830/4002] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:08:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:08:13.166980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:13.168181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:13.186429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.195609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.196768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.197362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.249729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:13.259503 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1b6c265-39b4-4f32-893e-db1baec13e02 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1522 microversion: 2.1 time: 0.613279 Jun 25 21:08:13.273874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2173/4003] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:12 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:13.282691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:13.284920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:13.293985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.294287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.306256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.307046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.523062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:13.537097 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3f8892b-09bc-4b77-bbd9-79aaeeab6e00 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1274 microversion: 2.1 time: 0.260286 Jun 25 21:08:13.539415 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2174/4004] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:13 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1274 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:13.584544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:13.588375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:13.603299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.603753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.604584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:13.605015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:13.747103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:13.767813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:13.777510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:13.780339 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42a8a854-5c6c-49c0-b834-34d53b354def tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1593 microversion: 2.32 time: 0.238448 Jun 25 21:08:13.786143 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2175/4005] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:13 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1593 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:13.802797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d824cf20-d244-4eff-adec-2fe5ed77feb7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:13.810520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d824cf20-d244-4eff-adec-2fe5ed77feb7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:14.212370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d824cf20-d244-4eff-adec-2fe5ed77feb7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:14.223340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d824cf20-d244-4eff-adec-2fe5ed77feb7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1226 microversion: 2.1 time: 0.435609 Jun 25 21:08:14.223945 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2176/4006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:13 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1226 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:14.230843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:14.249454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:14.267340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.267791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:14.276118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.276747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:14.322312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:14.649742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:14.661725 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3e0d3de-a3bb-48c1-9a4c-28db9a7f72df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 1.497912 Jun 25 21:08:14.665391 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1831/4007] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:13 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:14.677555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:14.681110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:14.692748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:14.708690 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93ef9c0b-ed30-4b58-a7cb-561ed2815208 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.481443 Jun 25 21:08:14.713005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.718948 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2177/4008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:14 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:14.722078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:14.723654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.726722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:14.736290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:14.739414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:14.769888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.775164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:14.776226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:14.779822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:15.441509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:15.456702 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f098e02-b810-42dc-b252-667016f148d5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.734990 Jun 25 21:08:15.460194 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2178/4009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:14 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:15.471683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:15.480666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:15.484110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:15.488928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ce85f4f-425d-45e7-bd31-e8a06a218be4 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1502 microversion: 2.1 time: 0.822176 Jun 25 21:08:15.505340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:15.510428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:15.511262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1832/4010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:14 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1502 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:15.514355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:15.514821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:15.517400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:15.518281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:15.523464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:15.546805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:15.548359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:15.552372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:15.554649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:16.142448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:16.159840 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41963c10-f852-4803-a2df-4b059252387c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.693079 Jun 25 21:08:16.160399 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2179/4011] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:15 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:16.173048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:16.173973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:16.200694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:16.202737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:16.204935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:16.205614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:16.375188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:16.385745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c071b6e2-12a7-46bf-85d4-d8b468e77d13 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1284 microversion: 2.1 time: 0.223792 Jun 25 21:08:16.386655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2180/4012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:16 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1284 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:16.403250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7e8681b-16d0-46c4-a050-b4d4ff39aa36 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'create', calling method: .version_select at 0x7f984ef1e820>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1765772495", "description": "tempest-description-1398068782"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:16.480626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:16.490377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:16.491911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:16.493121 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6cc3ec8c-9618-4e78-8bab-9d36c4aa369c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1593 microversion: 2.32 time: 0.980477 Jun 25 21:08:16.504607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1833/4013] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:15 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1593 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:16.521784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:16.522641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:16.530581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:16.531214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:16.532192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:16.532812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:16.571112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:17.220920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7e8681b-16d0-46c4-a050-b4d4ff39aa36 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.822670 Jun 25 21:08:17.224540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2181/4014] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:08:16 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:17.230591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-420491100", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:17.308951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:17.320502 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6fe19b65-bf4a-41b3-aa66-37ca9a6d3342 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.802972 Jun 25 21:08:17.321106 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1834/4015] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:16 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:17.331637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] validate_networks() for [('4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:17.346212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:17.349373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:17.392032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:17.393949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:17.395786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:17.396475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:18.382552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:18.417598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c6f64746-4c99-4fc9-a337-875ea9cefc76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 1.082920 Jun 25 21:08:18.423548 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1835/4016] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:18.429657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1765772495"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:18.441685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:18.466401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:18.467292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:18.468367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:18.473240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:18.882763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:18.883191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:18.883650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:18.884283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:18.884878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:18.895001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:18.908778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:18.913130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:18.914434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:18.915037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:18.936297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:18.950056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:18.982917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:18.985473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:19.044133 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e0d409d-9505-469f-b1c4-c0d56fc3da2e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.818248 Jun 25 21:08:19.046231 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2182/4017] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:08:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:08:19.051639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:19.052889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:19.060714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.061475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.062490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.063121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.227094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:19.237137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df3da802-4963-4954-8deb-11c470152716 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1284 microversion: 2.1 time: 0.189444 Jun 25 21:08:19.239812 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2183/4018] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:19 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:19.246443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:19.248387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:19.257440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.258125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.259335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.260623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.519904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:19.538204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:19.545273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:19.546949 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebdb5241-eae5-459f-8b9e-b63d00eb3ace tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1661 microversion: 2.32 time: 0.305875 Jun 25 21:08:19.552314 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2184/4019] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:19 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1661 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:19.563560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:19.565057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:19.581831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.582952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.585524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:19.586175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:19.749268 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.network.security_group_api [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Adding security group 8829ce82-80ac-439c-a309-023d30e24504 to port 3543ee3d-2e5b-45d3-b7c1-d1c78224e615 Jun 25 21:08:20.052080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:20.063549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75d7f571-9e81-4d45-967e-468edf788e70 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.508796 Jun 25 21:08:20.066997 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2185/4020] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:19 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:20.084147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:20.092546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:20.110709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.113094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:20.119703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.120438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:20.291828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:20.303862 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0bc67b9-592a-45d5-9668-23c42806728f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1210 microversion: 2.1 time: 0.235495 Jun 25 21:08:20.305070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2186/4021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:20 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1210 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:20.311891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:20.315782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:20.326851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.327313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:20.328102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.328577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:20.633108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:20.647302 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71a32db9-cbaf-4775-92e3-f6e42bacecc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.340885 Jun 25 21:08:20.653246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2187/4022] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:20 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:20.661119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:20.662041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:20.680463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.682459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:20.684957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:20.686646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:21.092475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:21.122337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-82d79d09-853e-402f-9e89-969d205d5589 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.467286 Jun 25 21:08:21.123473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2188/4023] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:20 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:21.130863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:21.132624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:21.140639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:21.141708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:21.143071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:21.146767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:21.562268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:21.574821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:21.578054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:21.586364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9d5a0d4-e54b-4fa7-9cd3-99d9c902ac79 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1649 microversion: 2.32 time: 0.457265 Jun 25 21:08:21.587341 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2189/4024] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:21 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1649 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:21.729431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a584c005-e169-4520-ae52-a3cc383790cf req-912e2c66-b68c-4daa-a400-70e844d48f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:21.739174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a584c005-e169-4520-ae52-a3cc383790cf req-912e2c66-b68c-4daa-a400-70e844d48f39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:21.739791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a584c005-e169-4520-ae52-a3cc383790cf req-912e2c66-b68c-4daa-a400-70e844d48f39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:21.760829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a584c005-e169-4520-ae52-a3cc383790cf req-912e2c66-b68c-4daa-a400-70e844d48f39 service nova] Creating event network-changed:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:08:21.773114 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a584c005-e169-4520-ae52-a3cc383790cf req-912e2c66-b68c-4daa-a400-70e844d48f39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183873 Jun 25 21:08:21.775259 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2190/4025] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:21.782338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:21.783114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:21.795517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:21.796274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:21.797309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:21.798093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.028086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:22.040641 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6d6869a-75d0-49d4-bedb-a7ab1499ef74 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.263491 Jun 25 21:08:22.041872 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2191/4026] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:21 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:22.047023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:22.049046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:22.057307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.058113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.059132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.059815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.148605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:22.161450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1237684a-36f9-4ca8-8408-6f8f3af86d5a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1272 microversion: 2.1 time: 0.118214 Jun 25 21:08:22.163782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2192/4027] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:22 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:22.176372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:22.177066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:22.189752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.190492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.198405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.198874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.502602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:22.513768 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6680a77f-7c64-4362-85c3-368a71f86baa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.348809 Jun 25 21:08:22.525017 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2193/4028] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:22 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:22.525017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:22.525017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:22.550669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.551034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.551813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.552275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.818897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec03a037-203b-4b9f-bbfe-6da36bbc4358 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action" status: 202 len: 0 microversion: 2.1 time: 4.393754 Jun 25 21:08:22.820033 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1836/4029] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:18 2022] POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action => generated 0 bytes in 4395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:22.825118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:22.825908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:22.834545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.835349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.839201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.840695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.900754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:22.922885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b928af00-d977-4fdf-a310-bc300d31e3ea tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.404787 Jun 25 21:08:22.929016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2194/4030] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:22 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:22.939572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1765772495"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:22.940366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:22.948266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.948769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.950279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:22.950898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:22.970883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:23.034289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=16 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:23.212767 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Removing security group 8829ce82-80ac-439c-a309-023d30e24504 from port 3543ee3d-2e5b-45d3-b7c1-d1c78224e615 Jun 25 21:08:23.630709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:23.665297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:23.672405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:23.674482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4056e9c6-3627-40d2-8328-e75f064c7370 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1649 microversion: 2.32 time: 0.853195 Jun 25 21:08:23.676307 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1837/4031] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:22 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1649 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:23.682395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:23.683663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:23.693243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:23.694244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:23.695609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:23.696369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.094918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d2eacbd7-fb9b-4ff5-9313-558d2d55cdfc tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action" status: 202 len: 0 microversion: 2.1 time: 1.160576 Jun 25 21:08:24.095555 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2195/4032] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:22 2022] POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action => generated 0 bytes in 1162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:24.105348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:24.105862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:24.141946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.142500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.143957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.144535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.221632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:24.252949 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3e637508-d593-46af-9b53-aa9709a7694c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1472 microversion: 2.1 time: 0.574579 Jun 25 21:08:24.257360 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1838/4033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:23 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1472 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:24.272983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:24.274873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:24.284606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.285402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.286659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.287336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.411502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:24.418633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:24.426632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5cab1c27-525d-41af-9ad7-f1c4e81856b9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1272 microversion: 2.1 time: 0.329809 Jun 25 21:08:24.437012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2196/4034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:24 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:24.442957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-23b1c6b1-27a2-4d7b-b775-96f3debe549e req-a33216f3-38bf-4a29-a0bb-d692dd2ff760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:24.454336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-23b1c6b1-27a2-4d7b-b775-96f3debe549e req-a33216f3-38bf-4a29-a0bb-d692dd2ff760 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.455014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-23b1c6b1-27a2-4d7b-b775-96f3debe549e req-a33216f3-38bf-4a29-a0bb-d692dd2ff760 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.468396 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-23b1c6b1-27a2-4d7b-b775-96f3debe549e req-a33216f3-38bf-4a29-a0bb-d692dd2ff760 service nova] Creating event network-changed:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:08:24.475962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-23b1c6b1-27a2-4d7b-b775-96f3debe549e req-a33216f3-38bf-4a29-a0bb-d692dd2ff760 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037265 Jun 25 21:08:24.477462 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2197/4035] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:24.483287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:24.484252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:24.495349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.496050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.497222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:24.498336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:24.821447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:24.840902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-761daf8b-4cd7-4cef-8f5f-c96e209a4eb1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.577695 Jun 25 21:08:24.842986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1839/4036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:24 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:24.857057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6f370d3-c603-4209-aee5-74cdd1b7e6a5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'create', calling method: .version_select at 0x7f984f4b2ee0>, body: {"pool": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:25.022622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:25.040165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a9bd105-0643-46c4-95a7-d2fe17e52793 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.560238 Jun 25 21:08:25.052502 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2198/4037] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:24 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:25.066145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-59c9bc21-7e9c-46fa-9c6e-097d524ac3da req-dcd7c1cc-9ca7-46e9-971f-ae8b037eae7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:25.085750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-59c9bc21-7e9c-46fa-9c6e-097d524ac3da req-dcd7c1cc-9ca7-46e9-971f-ae8b037eae7d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.086205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-59c9bc21-7e9c-46fa-9c6e-097d524ac3da req-dcd7c1cc-9ca7-46e9-971f-ae8b037eae7d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.115528 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-59c9bc21-7e9c-46fa-9c6e-097d524ac3da req-dcd7c1cc-9ca7-46e9-971f-ae8b037eae7d service nova] Creating event network-changed:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:08:25.133678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-59c9bc21-7e9c-46fa-9c6e-097d524ac3da req-dcd7c1cc-9ca7-46e9-971f-ae8b037eae7d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077651 Jun 25 21:08:25.134331 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2199/4038] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:25.139831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:25.140582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:25.152833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.153804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.155603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.156296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.464788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:25.478871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:25.483331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:25.484617 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7eb3d567-e5c9-4181-8be2-068747c768f2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1696 microversion: 2.32 time: 0.348942 Jun 25 21:08:25.485399 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2200/4039] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:25 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1696 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:25.490453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:25.491303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:25.498053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.498765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.499743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.500341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.871452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:25.903370 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-951dc710-74c9-4aa4-a330-efe6aa0d73d8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1478 microversion: 2.1 time: 0.415371 Jun 25 21:08:25.904968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2201/4040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:25 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1478 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:25.924083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:25.924677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:25.938784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.939645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:25.941252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:25.942328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:26.362343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:26.396111 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cdea3d22-323e-4a65-af9a-d70252c6e15a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.489714 Jun 25 21:08:26.396993 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2202/4041] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:25 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:26.407763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:26.408579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:26.418243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:26.419010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:26.420037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:26.420638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:26.904644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:26.945496 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c208e58e-a99f-478c-a91b-08c0b6db5dbe tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.546396 Jun 25 21:08:26.946120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2203/4042] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:26 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:26.960839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:26.962660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:26.981586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:26.982086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:26.983036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:26.983357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:27.833936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:27.846129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9619423-43cb-4fbc-b7dc-b5e268629ee9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.894155 Jun 25 21:08:27.849818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2204/4043] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:26 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:27.859368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:27.859636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:27.874589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:27.875105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:27.875929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:27.876368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.306166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:28.319960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:28.326814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:28.328205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0efca2cc-e60e-4251-974c-1873bc9fda25 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1743 microversion: 2.32 time: 0.477307 Jun 25 21:08:28.328950 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2205/4044] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:27 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1743 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:28.342612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ff32e4f7-caaf-4d04-bf5a-1597867c9cff req-d0cc6fc4-c859-4e93-bd0b-1299ea5418db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf084eab-d6ab-47e7-ba45-118d00b33e50", "tag": "1c9879d8-b265-42d8-ad63-0cf7ef31520d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:28.348749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:28.365871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff32e4f7-caaf-4d04-bf5a-1597867c9cff req-d0cc6fc4-c859-4e93-bd0b-1299ea5418db service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:28.366809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff32e4f7-caaf-4d04-bf5a-1597867c9cff req-d0cc6fc4-c859-4e93-bd0b-1299ea5418db service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.390398 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ff32e4f7-caaf-4d04-bf5a-1597867c9cff req-d0cc6fc4-c859-4e93-bd0b-1299ea5418db service nova] Creating event network-changed:1c9879d8-b265-42d8-ad63-0cf7ef31520d for instance cf084eab-d6ab-47e7-ba45-118d00b33e50 on nch2-master-1 Jun 25 21:08:28.397773 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ff32e4f7-caaf-4d04-bf5a-1597867c9cff req-d0cc6fc4-c859-4e93-bd0b-1299ea5418db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066799 Jun 25 21:08:28.399242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2206/4045] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:28.407642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:28.408748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:28.417676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:28.418474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.419456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:28.420083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.762805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:28.773577 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d54715c9-e248-48bf-a2a7-9f2b3055f0a7 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1478 microversion: 2.1 time: 0.371983 Jun 25 21:08:28.774499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2207/4046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:28 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1478 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:28.781671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:28.782537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:28.793217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:28.794450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.795489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:28.800749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:28.926709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:28.978754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=18 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:29.161886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:29.177789 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6a29a40-8d86-46c7-81b6-99663e56161f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.401944 Jun 25 21:08:29.181179 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2208/4047] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:28 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:29.194308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:29.194873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:29.219779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.221440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.222638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.223248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.457312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:29.466567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-faeb8be0-012f-4c7f-a197-50496f313c17 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.283876 Jun 25 21:08:29.470463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2209/4048] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:29 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:29.475530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:29.477265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:29.483939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.484389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.485351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.485972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.636734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:29.645361 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-97d6cf89-f81a-4582-abb3-1f8930dce97f tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.173618 Jun 25 21:08:29.646873 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2210/4049] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:29 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:29.652387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0e856299-2849-4105-b464-dd8112e59080 req-e8ad95c0-cbc4-4685-bb28-b69e6dfa058b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c915083-b7bd-47e7-8861-52f5e318b2b4", "name": "network-vif-plugged", "status": "completed", "tag": "3002f539-100d-48dc-a62d-0dab07c8a061"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:29.666347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0e856299-2849-4105-b464-dd8112e59080 req-e8ad95c0-cbc4-4685-bb28-b69e6dfa058b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.667091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0e856299-2849-4105-b464-dd8112e59080 req-e8ad95c0-cbc4-4685-bb28-b69e6dfa058b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.680447 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0e856299-2849-4105-b464-dd8112e59080 req-e8ad95c0-cbc4-4685-bb28-b69e6dfa058b service nova] Creating event network-vif-plugged:3002f539-100d-48dc-a62d-0dab07c8a061 for instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 on nch1-master-1 Jun 25 21:08:29.685352 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0e856299-2849-4105-b464-dd8112e59080 req-e8ad95c0-cbc4-4685-bb28-b69e6dfa058b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037083 Jun 25 21:08:29.686014 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2211/4050] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:29.691810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:29.692814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:29.699849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.700570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.702112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:29.703119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:29.990495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.004779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.006762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.008151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4297d391-055e-45a2-aa41-4f988278a007 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1743 microversion: 2.32 time: 0.320383 Jun 25 21:08:30.009686 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2212/4051] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:29 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1743 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:30.015986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:30.016762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:30.034431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.034896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.035693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.036140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.346205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.359213 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89d7b673-6d5e-4d59-9ec4-2b9d8528568c tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1478 microversion: 2.1 time: 0.346750 Jun 25 21:08:30.364280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2213/4052] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:30 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:30.373085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:30.374353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:30.387585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.388578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.389716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.393341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.662841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.671945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-95b5e8ec-cfb7-41b3-9035-cdea3591af28 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.305812 Jun 25 21:08:30.692416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2214/4053] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:30 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:30.698833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:30.699462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:30.706840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.707517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.708511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.709120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.867408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:30.875615 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff733505-4c27-4ef1-9c1a-5508234df752 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.181167 Jun 25 21:08:30.876030 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2215/4054] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:30 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:30.890452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:30.891076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:30.898952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.899302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.900202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:30.900760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:30.906779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:31.035315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.044942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41d3e7ec-3078-4522-af49-21668ca3b5a7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.158570 Jun 25 21:08:31.045699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2216/4055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:30 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:31.050700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-43393884-e1b3-4a84-a3b5-237f18d3be59 req-91b92799-0b78-4bbc-bc6d-0493793ef0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fcb7f6-3686-47fa-8c13-59f0390761a1", "tag": "acd10142-cd26-4efa-8292-86ac0213e07f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:31.058952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43393884-e1b3-4a84-a3b5-237f18d3be59 req-91b92799-0b78-4bbc-bc6d-0493793ef0ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.059520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43393884-e1b3-4a84-a3b5-237f18d3be59 req-91b92799-0b78-4bbc-bc6d-0493793ef0ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.071552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-43393884-e1b3-4a84-a3b5-237f18d3be59 req-91b92799-0b78-4bbc-bc6d-0493793ef0ac service nova] Creating event network-changed:acd10142-cd26-4efa-8292-86ac0213e07f for instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 on nch1-master-1 Jun 25 21:08:31.076414 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-43393884-e1b3-4a84-a3b5-237f18d3be59 req-91b92799-0b78-4bbc-bc6d-0493793ef0ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029408 Jun 25 21:08:31.077079 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2217/4056] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:31.082622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:31.083352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:31.095197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.095842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.097001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.097698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.320344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.335189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.339683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.339683 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67f51c32-f0e3-4f02-9059-5e49a375d34e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1743 microversion: 2.32 time: 0.259705 Jun 25 21:08:31.339683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2218/4057] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:31 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1743 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:31.382285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:31.382921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:31.391623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.392142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.392955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.393419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.603030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.612696 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5fede5ec-652b-4f59-98e0-57b4c744c95d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1478 microversion: 2.1 time: 0.234778 Jun 25 21:08:31.613283 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2219/4058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:31 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1478 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:31.696366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:31.697024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:31.705822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.706274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.707041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.707472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:31.932382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:31.944094 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-05c9576e-b64d-483c-b894-a374c505b03c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.254611 Jun 25 21:08:31.945005 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2220/4059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:31 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:31.949317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8f652da3-8826-48c9-8e39-c1def0f06268 req-2ff590a1-069e-448a-8d04-c1da667146c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "name": "network-vif-plugged", "status": "completed", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:31.966326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8f652da3-8826-48c9-8e39-c1def0f06268 req-2ff590a1-069e-448a-8d04-c1da667146c2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:31.974533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8f652da3-8826-48c9-8e39-c1def0f06268 req-2ff590a1-069e-448a-8d04-c1da667146c2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.004974 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8f652da3-8826-48c9-8e39-c1def0f06268 req-2ff590a1-069e-448a-8d04-c1da667146c2 service nova] Creating event network-vif-plugged:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:08:32.028845 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8f652da3-8826-48c9-8e39-c1def0f06268 req-2ff590a1-069e-448a-8d04-c1da667146c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082676 Jun 25 21:08:32.030061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2221/4060] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:32.035485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:32.036530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:32.060244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.061081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.062076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.063184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.186498 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6f370d3-c603-4209-aee5-74cdd1b7e6a5 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 7.339776 Jun 25 21:08:32.188213 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1840/4061] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 21:08:24 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 7344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:32.196392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:32.197533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:32.207190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.208146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.209740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.210464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.417158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:32.430843 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a0b7b17-b28a-4ceb-88ba-c201cd2e978d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1316 microversion: 2.1 time: 0.399253 Jun 25 21:08:32.431707 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2222/4062] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1316 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:32.457486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.66"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:32.458892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:32.466448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.467245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.468195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.468856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.496315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Acquired lock "refresh_cache-8d4c2c20-a731-4403-9614-b978a24ab357" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 21:08:32.704836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:32.712989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e2e3b04a-2fc4-42f0-b69d-610de89b7805 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.522865 Jun 25 21:08:32.715088 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1841/4063] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:32 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:32.720413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:32.721260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:32.729551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.730497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:32.731625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:32.732318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:33.212518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:33.223872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:33.225956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:33.227487 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aed128bd-87b9-445b-a7e8-e2503fd0238a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1790 microversion: 2.32 time: 0.511186 Jun 25 21:08:33.238883 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1842/4064] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:32 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1790 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:33.244128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:33.244837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:33.251333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:33.252016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:33.252870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:33.253480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:34.110812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:34.123429 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e68a1a42-b9b6-42a3-8095-d2f52748b6c2 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1463 microversion: 2.1 time: 0.882965 Jun 25 21:08:34.124442 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1843/4065] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:33 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1463 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:34.129391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:34.133751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:34.152527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:34.153941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:34.155293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:34.155905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:34.580530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 21:08:34.676571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:34.701561 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-866d46cb-f4a3-414d-aa58-29d496bef89d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.572146 Jun 25 21:08:34.703764 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1844/4066] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:34 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:34.724747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:34.726594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:34.757978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:34.758478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:34.761476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:34.762222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.233716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:35.245633 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-362d3a40-c3bb-4844-8c57-ad71652ade72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.540587 Jun 25 21:08:35.247519 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1845/4067] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:34 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:35.257897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:35.259161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:35.276616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.277560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.282477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.283176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.765028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:35.781695 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-335c108f-ca87-4f6f-9b14-1433a79ca47a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1326 microversion: 2.1 time: 0.532786 Jun 25 21:08:35.782411 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1846/4068] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:35 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1326 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:35.787842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:35.789019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:35.810256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.810907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.814364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.815917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.959665 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d9cabfae-e9b1-4426-ab58-71919b22eb3c tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.174947 Jun 25 21:08:35.961685 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1847/4069] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:35 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:35.970283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:35.971243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:35.982104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.983889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.986416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:35.987064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:35.996705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Updating instance_info_cache with network_info: [{"id": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615", "address": "fa:16:3e:61:89:f8", "network": {"id": "61944c58-a4a1-48da-a6e8-db76a24acb2c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-435590867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "29c4645abed4410981601604f61a3d89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3543ee3d-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:08:36.025015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Releasing lock "refresh_cache-8d4c2c20-a731-4403-9614-b978a24ab357" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 21:08:36.026096 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3f6e12a-a1e1-466a-a532-0fc227d60f68 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action" status: 202 len: 0 microversion: 2.1 time: 3.572466 Jun 25 21:08:36.030329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2223/4070] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:32 2022] POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action => generated 0 bytes in 3589 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 21:08:36.044620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1afd25f9-a984-4a87-8c63-21ed19652079 req-5ed50581-60c3-46b3-9c27-ee09793f6f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf084eab-d6ab-47e7-ba45-118d00b33e50", "name": "network-vif-plugged", "status": "completed", "tag": "1c9879d8-b265-42d8-ad63-0cf7ef31520d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:36.065203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1afd25f9-a984-4a87-8c63-21ed19652079 req-5ed50581-60c3-46b3-9c27-ee09793f6f4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:36.065645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1afd25f9-a984-4a87-8c63-21ed19652079 req-5ed50581-60c3-46b3-9c27-ee09793f6f4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:36.095312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1afd25f9-a984-4a87-8c63-21ed19652079 req-5ed50581-60c3-46b3-9c27-ee09793f6f4a service nova] Creating event network-vif-plugged:1c9879d8-b265-42d8-ad63-0cf7ef31520d for instance cf084eab-d6ab-47e7-ba45-118d00b33e50 on nch2-master-1 Jun 25 21:08:36.109654 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1afd25f9-a984-4a87-8c63-21ed19652079 req-5ed50581-60c3-46b3-9c27-ee09793f6f4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077571 Jun 25 21:08:36.113648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2224/4071] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:36.125520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c14ad94a-4eb4-40b7-b43b-4770b065ed52 req-c5e1a6b3-8e10-4f85-b86d-af4654ebeace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:36.146749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c14ad94a-4eb4-40b7-b43b-4770b065ed52 req-c5e1a6b3-8e10-4f85-b86d-af4654ebeace service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:36.152084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c14ad94a-4eb4-40b7-b43b-4770b065ed52 req-c5e1a6b3-8e10-4f85-b86d-af4654ebeace service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:36.183168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c14ad94a-4eb4-40b7-b43b-4770b065ed52 req-c5e1a6b3-8e10-4f85-b86d-af4654ebeace service nova] Creating event network-changed:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:08:36.200688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c14ad94a-4eb4-40b7-b43b-4770b065ed52 req-c5e1a6b3-8e10-4f85-b86d-af4654ebeace service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085146 Jun 25 21:08:36.202197 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2225/4072] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:36.207583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-878440913", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:36.299946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] validate_networks() for [('4afca77e-1bb7-4cef-b35e-661d5d7aabe7', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:36.990035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:37.010753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:37.013662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:37.018287 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87daea65-7b12-40be-bc17-2c5baf48ebcc tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1837 microversion: 2.32 time: 1.055138 Jun 25 21:08:37.020299 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1848/4073] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:35 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1837 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:37.031079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:37.033555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:37.050631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.054026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.058293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.059015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.450115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:37.461947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1152ccd-4c16-4c39-8974-4f12ac391287 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.439431 Jun 25 21:08:37.470458 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1849/4074] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:37 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:37.485498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:37.486340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:37.497956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.498351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.499161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.499673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.579526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.580014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.580538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lazy-loading 'fault' on Instance uuid 1c915083-b7bd-47e7-8861-52f5e318b2b4 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:08:37.702643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:37.703249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:37.703520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:37.704127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:37.704755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:37.722292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.730456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.731934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:37.732655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:37.780588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Getting quotas for project 8983a71e4a2142fc9fa3460969b2f425. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:37.794139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Getting quotas for user 10c0287a5f02499cb26cc144cd7588cf and project 8983a71e4a2142fc9fa3460969b2f425. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:37.834369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:37.848752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:37.956236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9a2fb13-f05a-4637-a5dd-2f171bd4d3ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.748679 Jun 25 21:08:37.957643 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2226/4075] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:08:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:08:37.977350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:37.991270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.66"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:37.997292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-33a43726-7170-4daa-9457-3ba55fefcc6d tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1597 microversion: 2.1 time: 0.525412 Jun 25 21:08:37.997918 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1850/4076] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:37 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1597 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:38.030965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:38.031777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:38.059196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.059791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.060693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.061113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.414131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:38.425424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.426674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.427983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.429490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.466118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:38.476889 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45ef0b9e-2629-4d19-b05d-03b5fcc4adb5 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1526 microversion: 2.1 time: 0.468829 Jun 25 21:08:38.484874 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1851/4077] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:37 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1526 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:38.499860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a5ed4fdd-282a-40b8-9aa0-3bb55cbfc503 req-e7e4446f-ea59-4de4-95df-42aae3db799d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "febbd08b-81b9-4e73-a726-475aaee4e08b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:38.521297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5ed4fdd-282a-40b8-9aa0-3bb55cbfc503 req-e7e4446f-ea59-4de4-95df-42aae3db799d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.523706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a5ed4fdd-282a-40b8-9aa0-3bb55cbfc503 req-e7e4446f-ea59-4de4-95df-42aae3db799d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.542675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a5ed4fdd-282a-40b8-9aa0-3bb55cbfc503 req-e7e4446f-ea59-4de4-95df-42aae3db799d service nova] Creating event network-changed:febbd08b-81b9-4e73-a726-475aaee4e08b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:38.558636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a5ed4fdd-282a-40b8-9aa0-3bb55cbfc503 req-e7e4446f-ea59-4de4-95df-42aae3db799d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065703 Jun 25 21:08:38.559617 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1852/4078] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:38.566989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd00b3e4-4087-424d-b414-2a452132419c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:38.568305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd00b3e4-4087-424d-b414-2a452132419c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:38.724031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bd00b3e4-4087-424d-b414-2a452132419c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:38.732257 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd00b3e4-4087-424d-b414-2a452132419c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1216 microversion: 2.1 time: 0.170848 Jun 25 21:08:38.742609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1853/4079] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:38 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:38.749398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:38.750714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:38.758840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.759685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.760712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.761314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.899772 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88502820-62c3-4948-94d7-37ffe3651828 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action" status: 202 len: 0 microversion: 2.1 time: 0.155483 Jun 25 21:08:38.904358 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1854/4080] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:38 2022] POST /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:38.910222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:38.911583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:38.920320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.921150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:38.922147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:38.922790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:39.383793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Acquired lock "refresh_cache-8d4c2c20-a731-4403-9614-b978a24ab357" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 21:08:39.866770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:39.878859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:39.881166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:39.882833 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c382eae-f729-40bf-9dbc-94a17dd4a4a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1858 microversion: 2.32 time: 0.977224 Jun 25 21:08:39.883664 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1855/4081] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:38 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1858 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:39.890910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-00f17a85-12db-430f-8955-1d0871868f89 req-96c11a3a-2d94-48eb-afd8-4cc4070b1c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fcb7f6-3686-47fa-8c13-59f0390761a1", "name": "network-vif-plugged", "status": "completed", "tag": "acd10142-cd26-4efa-8292-86ac0213e07f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:39.902222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-00f17a85-12db-430f-8955-1d0871868f89 req-96c11a3a-2d94-48eb-afd8-4cc4070b1c9e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:39.902791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-00f17a85-12db-430f-8955-1d0871868f89 req-96c11a3a-2d94-48eb-afd8-4cc4070b1c9e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:39.916705 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-00f17a85-12db-430f-8955-1d0871868f89 req-96c11a3a-2d94-48eb-afd8-4cc4070b1c9e service nova] Creating event network-vif-plugged:acd10142-cd26-4efa-8292-86ac0213e07f for instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 on nch1-master-1 Jun 25 21:08:39.922453 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-00f17a85-12db-430f-8955-1d0871868f89 req-96c11a3a-2d94-48eb-afd8-4cc4070b1c9e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037019 Jun 25 21:08:39.923773 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1856/4082] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:39.941465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:39.942563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:39.951365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:39.952384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:39.953477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:39.955395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:40.349789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:40.376610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66cc9cab-2b7b-4b8e-ba5d-3e1dee53b4f9 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1314 microversion: 2.1 time: 0.439572 Jun 25 21:08:40.378456 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1857/4083] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:39 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:40.413682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:40.415359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:40.443491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:40.444302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:40.445564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:40.446183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:40.877885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Building network info cache for instance {{(pid=137461) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jun 25 21:08:40.901388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:40.919299 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89e6fdb8-7cfe-4f9c-8505-bd72ffe62e33 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1526 microversion: 2.1 time: 0.537783 Jun 25 21:08:40.921971 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1858/4084] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:40 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1526 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:40.927302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:40.928251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:40.951327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:40.953007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:40.954601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:40.955652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.595039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Updating instance_info_cache with network_info: [{"id": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615", "address": "fa:16:3e:61:89:f8", "network": {"id": "61944c58-a4a1-48da-a6e8-db76a24acb2c", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-435590867-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "29c4645abed4410981601604f61a3d89", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3543ee3d-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:08:41.616040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Releasing lock "refresh_cache-8d4c2c20-a731-4403-9614-b978a24ab357" {{(pid=137461) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 21:08:41.618917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ebb2503-cf8e-477b-bd87-36506841a997 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action" status: 202 len: 0 microversion: 2.1 time: 3.658648 Jun 25 21:08:41.621875 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2227/4085] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:37 2022] POST /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357/action => generated 0 bytes in 3663 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jun 25 21:08:41.652335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:41.654761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:41.672915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:41.673832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.676270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:41.677086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.812801 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-04054a61-dddb-4769-a089-233b78b40ff1 tempest-ServersAdminTestJSON-1481589651 tempest-ServersAdminTestJSON-1481589651-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1614 microversion: 2.1 time: 0.889187 Jun 25 21:08:41.829941 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1859/4086] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:40 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1614 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:41.846028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d58a4e95-e835-4e12-8198-642a5347edcc req-0565032c-4417-427f-9c3c-5c4de37f106a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "6737e460-a7ee-4d74-a098-b0137bae8d87"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:41.868982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d58a4e95-e835-4e12-8198-642a5347edcc req-0565032c-4417-427f-9c3c-5c4de37f106a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:41.873638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d58a4e95-e835-4e12-8198-642a5347edcc req-0565032c-4417-427f-9c3c-5c4de37f106a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.915589 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d58a4e95-e835-4e12-8198-642a5347edcc req-0565032c-4417-427f-9c3c-5c4de37f106a service nova] Creating event network-changed:6737e460-a7ee-4d74-a098-b0137bae8d87 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:41.926444 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d58a4e95-e835-4e12-8198-642a5347edcc req-0565032c-4417-427f-9c3c-5c4de37f106a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094722 Jun 25 21:08:41.933356 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1860/4087] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:41.941485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:41.943602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:41.960963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:41.961433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.962256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:41.962676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:41.989172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:42.013512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b0f7f23-9637-4643-a75e-c3c2f8badfc4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1274 microversion: 2.1 time: 0.387154 Jun 25 21:08:42.015617 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2228/4088] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:41 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1274 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:42.034179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e8b376c9-039b-4c6b-bb04-86c5e7cd9dca req-4f901c12-2b15-4812-a17a-f59f06de7a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:42.077696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e8b376c9-039b-4c6b-bb04-86c5e7cd9dca req-4f901c12-2b15-4812-a17a-f59f06de7a62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:42.079095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e8b376c9-039b-4c6b-bb04-86c5e7cd9dca req-4f901c12-2b15-4812-a17a-f59f06de7a62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:42.121499 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e8b376c9-039b-4c6b-bb04-86c5e7cd9dca req-4f901c12-2b15-4812-a17a-f59f06de7a62 service nova] Creating event network-changed:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:08:42.129414 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e8b376c9-039b-4c6b-bb04-86c5e7cd9dca req-4f901c12-2b15-4812-a17a-f59f06de7a62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111819 Jun 25 21:08:42.131201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2229/4089] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:42.608843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:42.609454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:42.630122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:42.631408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:42.635889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:42.637852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:42.686149 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] HTTP exception thrown: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Request method failure captured: Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 HTTP/1.1 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k7eM0unovCfqtAF6FkwuT--UZxRgyW0A1LQ_zdrdpm_6kVJaoIz9yIkoIY3B8KC3qi-hZ7tcZw7B6NpvU5gl99_UzdMZInUNmNfleYq7quSWNO6hpvBB9qwL7RjwAocjm1wh7DnITx27BVgsOYukYYtp2Zi742QWsO1szOHw1z52Q Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7ab1810b8d3f4b779e76e0c393c1c519 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ab1810b8d3f4b779e76e0c393c1c519"}]}] Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7ab1810b8d3f4b779e76e0c393c1c519 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestMultiTenantJSON-609302876-project Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 91429b3bdbb147e6ab7d91ebbba73af4 Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876-project Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cf084eab-d6ab-47e7-ba45-118d00b33e50'} Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:42.688189 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:42.694792 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:42.699740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Returning 404 to user: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:42.705822 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85a72096-5034-4525-b845-0c445bc9abcc tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 404 len: 111 microversion: 2.1 time: 0.572326 Jun 25 21:08:42.720837 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2230/4090] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:42 2022] DELETE /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 111 bytes in 588 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:42.745407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:42.748751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:42.773830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:42.776361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:42.778582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:42.779876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:43.097394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:43.127623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:43.129561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:43.131164 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d85f42b7-a8c9-42bc-89c8-98bf52a4f16a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1858 microversion: 2.32 time: 1.195554 Jun 25 21:08:43.132345 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1861/4091] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:41 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1858 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:43.152904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e67dfab6-0bcc-4154-bb89-5a8d41b2473a tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '.version_select at 0x7f984f4439d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:43.287819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:43.302112 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8dc9b433-6061-40db-b038-9dbae2a27ff6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1501 microversion: 2.1 time: 0.578944 Jun 25 21:08:43.303158 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2231/4092] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:42 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1501 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:43.344719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:43.345616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:43.373535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:43.378528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:43.380160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:43.381572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:43.460662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:08:43.665667 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ed1cdf9-5e30-49d1-998f-b2e3e996be03 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 204 len: 0 microversion: 2.1 time: 0.345581 Jun 25 21:08:43.666889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2232/4093] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:43 2022] DELETE /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:08:43.679253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:43.680069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:43.687143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:43.688063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:43.704720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:43.705596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:44.041456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:44.049512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a140dddc-e84d-4d01-87ba-0e3ec80a277a tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1526 microversion: 2.1 time: 0.380981 Jun 25 21:08:44.052014 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2233/4094] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:43 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1526 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:44.069372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:44.070471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:44.078841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:44.093940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:44.097542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:44.099705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:44.114151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:44.466720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:44.478188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64c5aa06-75fa-4e7a-a260-b67634d5d061 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.415109 Jun 25 21:08:44.489848 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2234/4095] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:44 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:44.493724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:44.495010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:44.513076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:44.514426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:44.515316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:44.516997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:44.888119 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Removing security group 3da0a582-79c0-4da4-9c3a-2b6a0d3dab23 from port acd10142-cd26-4efa-8292-86ac0213e07f Jun 25 21:08:45.506467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cdb8e6f9-abd4-4a73-8caf-8300719721fc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1/action" status: 202 len: 0 microversion: 2.1 time: 1.023335 Jun 25 21:08:45.510510 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2235/4096] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:08:44 2022] POST /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1/action => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:45.518245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:45.518881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:45.551310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.551765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:45.553250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.554093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:45.805288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:45.818462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e087cdf-d02d-476e-ab63-623640e493f8 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1470 microversion: 2.1 time: 0.305007 Jun 25 21:08:45.819814 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2236/4097] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:45 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:45.832505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Action: 'update', calling method: >, body: {"server": {"name": "cf084eab-d6ab-47e7-ba45-118d00b33e50_new"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:45.839406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:45.848634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.849467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:45.850573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.851266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:45.884665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] HTTP exception thrown: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Request method failure captured: Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 HTTP/1.1 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 64 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k7eM0unovCfqtAF6FkwuT--UZxRgyW0A1LQ_zdrdpm_6kVJaoIz9yIkoIY3B8KC3qi-hZ7tcZw7B6NpvU5gl99_UzdMZInUNmNfleYq7quSWNO6hpvBB9qwL7RjwAocjm1wh7DnITx27BVgsOYukYYtp2Zi742QWsO1szOHw1z52Q Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7ab1810b8d3f4b779e76e0c393c1c519 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7ab1810b8d3f4b779e76e0c393c1c519"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7ab1810b8d3f4b779e76e0c393c1c519"}]}] Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7ab1810b8d3f4b779e76e0c393c1c519 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestMultiTenantJSON-609302876-project Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 91429b3bdbb147e6ab7d91ebbba73af4 Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-609302876-project Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "cf084eab-d6ab-47e7-ba45-118d00b33e50_new"}} Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cf084eab-d6ab-47e7-ba45-118d00b33e50', 'body': {'server': {'name': 'cf084eab-d6ab-47e7-ba45-118d00b33e50_new'}}} Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 21:08:45.887272 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:45.891791 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:45.896360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] Returning 404 to user: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:45.897699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf2a2eee-809b-4052-86e8-c7b20fb0d6ee tempest-ServersNegativeTestMultiTenantJSON-609302876 tempest-ServersNegativeTestMultiTenantJSON-609302876-project] 10.222.0.39 "PUT /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 404 len: 111 microversion: 2.1 time: 0.076615 Jun 25 21:08:45.898886 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2237/4098] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:08:45 2022] PUT /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:45.907961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:45.908864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:45.916691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.917386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:45.918257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:45.918791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:46.674013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:46.689717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:46.692134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:46.693837 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77c1aac1-1727-434c-81ce-415e45ff591a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.793736 Jun 25 21:08:46.695580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2238/4099] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:45 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:46.700735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c40958d2-ee50-488a-bee2-ac97fd691876 req-049b6e06-7d52-44c1-9b7c-a9a91574603a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "613f1347-eaa6-452c-91db-c7556e0d2b78"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:46.711549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c40958d2-ee50-488a-bee2-ac97fd691876 req-049b6e06-7d52-44c1-9b7c-a9a91574603a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:46.712250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c40958d2-ee50-488a-bee2-ac97fd691876 req-049b6e06-7d52-44c1-9b7c-a9a91574603a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:46.734062 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c40958d2-ee50-488a-bee2-ac97fd691876 req-049b6e06-7d52-44c1-9b7c-a9a91574603a service nova] Creating event network-changed:613f1347-eaa6-452c-91db-c7556e0d2b78 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:46.740616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c40958d2-ee50-488a-bee2-ac97fd691876 req-049b6e06-7d52-44c1-9b7c-a9a91574603a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043342 Jun 25 21:08:46.741323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2239/4100] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:46.748271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:46.751396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:46.759271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:46.759940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:46.760787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:46.761220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:46.926562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:46.934906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e2965f5-e5d2-4b7b-8e0d-f6d6895528f8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.191593 Jun 25 21:08:46.935945 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2240/4101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:46 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:46.941425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:46.942574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:46.949412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:46.950159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:46.951153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:46.951808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.055793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:47.067852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-367a1ab6-bc18-4811-815a-234dd24c891b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1459 microversion: 2.1 time: 0.130285 Jun 25 21:08:47.081867 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2241/4102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:46 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1459 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:47.090658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a21864be-c7e3-4c55-97d1-1d7179ec68c4 req-0c339c35-a4d6-4e36-8b91-0102070a4f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fcb7f6-3686-47fa-8c13-59f0390761a1", "tag": "acd10142-cd26-4efa-8292-86ac0213e07f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:47.103780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a21864be-c7e3-4c55-97d1-1d7179ec68c4 req-0c339c35-a4d6-4e36-8b91-0102070a4f0c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.104349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a21864be-c7e3-4c55-97d1-1d7179ec68c4 req-0c339c35-a4d6-4e36-8b91-0102070a4f0c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.129747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a21864be-c7e3-4c55-97d1-1d7179ec68c4 req-0c339c35-a4d6-4e36-8b91-0102070a4f0c service nova] Creating event network-changed:acd10142-cd26-4efa-8292-86ac0213e07f for instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 on nch1-master-1 Jun 25 21:08:47.135751 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a21864be-c7e3-4c55-97d1-1d7179ec68c4 req-0c339c35-a4d6-4e36-8b91-0102070a4f0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052189 Jun 25 21:08:47.140650 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2242/4103] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:47.152676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:47.154128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:47.163332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.163869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.164884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.165490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.198698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:08:47.354811 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e67dfab6-0bcc-4154-bb89-5a8d41b2473a tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/ccb5892b-20b6-4103-9212-7661a472594b" status: 202 len: 0 microversion: 2.1 time: 4.218963 Jun 25 21:08:47.358212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1862/4104] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:08:43 2022] DELETE /compute/v2.1/os-floating-ips/ccb5892b-20b6-4103-9212-7661a472594b => generated 0 bytes in 4225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:47.375977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:47.377793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:47.422544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=60 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:47.438496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.439695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.443463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.446441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.685065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:47.693655 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e755e937-6a87-4636-bf41-626642d166d5 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 200 len: 1428 microversion: 2.1 time: 0.331276 Jun 25 21:08:47.694326 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1863/4105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:47 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 1428 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:47.699028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:47.699693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:47.700580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:47.710429 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-927e90e8-8aa4-4d1b-97a8-224e69aec4bb tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 204 len: 0 microversion: 2.1 time: 0.567976 Jun 25 21:08:47.722530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.723088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2243/4106] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:47 2022] DELETE /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:08:47.725110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.737210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:47.737492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5da89f82-ba4d-4e3d-acfb-7b2a2e338879 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '.version_select at 0x7f984e873040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:47.738774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:47.751221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:47.815511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:48.262036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:48.291167 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0903762c-3842-4a48-9c29-1bb6df6dd527 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.595707 Jun 25 21:08:48.291858 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1864/4107] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:47 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:48.298822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:48.299733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:48.309217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.309942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:48.311454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.312261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:48.604947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5da89f82-ba4d-4e3d-acfb-7b2a2e338879 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/8829ce82-80ac-439c-a309-023d30e24504" status: 202 len: 0 microversion: 2.1 time: 0.880127 Jun 25 21:08:48.608749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2244/4108] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:08:47 2022] DELETE /compute/v2.1/os-security-groups/8829ce82-80ac-439c-a309-023d30e24504 => generated 0 bytes in 882 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:08:48.614021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:48.617948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:48.650613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.652686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:48.654208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.654912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:48.732303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:48.885098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:48.893803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1874a106-94ed-42bd-9a99-602639fb4af0 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1532 microversion: 2.1 time: 0.286468 Jun 25 21:08:48.904013 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2245/4109] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:48 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1532 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:48.909241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:48.910155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:48.920458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.920925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:48.921751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:48.922193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.154163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.167448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-286614f7-5d4e-4c6d-bab0-9dba189316a2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.261980 Jun 25 21:08:49.168943 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2246/4110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:48 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:49.174344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:49.175342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:49.183293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.184380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.185414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.186198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.280586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.291067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.301956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.303865 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da2b65bc-ec64-47ac-843b-dfe785763e94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 1.010829 Jun 25 21:08:49.305597 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1865/4111] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:48 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:49.317060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:49.318177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:49.329400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.330261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.333504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.334380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.379123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:08:49.552957 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4da83ea1-cf93-418e-8e73-e99c777ef225 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 204 len: 0 microversion: 2.1 time: 0.244783 Jun 25 21:08:49.554456 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1866/4112] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:49 2022] DELETE /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:08:49.562222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.572199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:49.574196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5a5675f3-dce7-4c67-b57a-f36586a8abc1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.404017 Jun 25 21:08:49.575382 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2247/4113] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:49 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:49.577044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 7ff613c0-98a5-464a-8697-541c8e7b0ca1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:49.581654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ff613c0-98a5-464a-8697-541c8e7b0ca1", "name": "network-vif-deleted", "tag": "1234b128-0c74-4a13-b6cb-6d935688afc3"}, {"name": "network-changed", "server_uuid": "1a9a653b-3c16-444c-be5d-92d54ae6cab7", "tag": "d756f698-3d43-4d7c-bd2b-fe5f3b3475ed"}, {"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "83606aab-a9e6-48e1-84e5-271f3f683537"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:49.591035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.598301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.599532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.600687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.604675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.605275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.626482 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Creating event network-vif-deleted:1234b128-0c74-4a13-b6cb-6d935688afc3 for instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 on nch1-master-1 Jun 25 21:08:49.627340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Creating event network-changed:d756f698-3d43-4d7c-bd2b-fe5f3b3475ed for instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 on nch2-master-1 Jun 25 21:08:49.628011 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] Creating event network-changed:83606aab-a9e6-48e1-84e5-271f3f683537 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:49.650264 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] HTTP exception thrown: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Request method failure captured: Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 HTTP/1.1 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3jcwU805Ejc8Y0JT_-NIlM14O5rqrcCKpHw7PcQwae6LfMk8CGMY9kEZQqpBVUwsvFd2AhgZZA13Xg1fBXU26mtvE3Un77tpgBuZGHoUiTYAsH01EJx_0nQtn98vtvbYFa1zECHU2cOw63f-vJbxWQ1XkkpCzmhN2r0KTqrHO_nQ4g Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}] Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ea5a50f6e8ea470894e19f8c1dec476f Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '7ff613c0-98a5-464a-8697-541c8e7b0ca1'} Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:49.653088 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. Jun 25 21:08:49.661559 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:49.664555 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4623f578-10a8-492a-81ae-0a25c5108dba req-67f198d5-ea68-4325-96e4-48e146a3b456 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.080662 Jun 25 21:08:49.664555 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2248/4114] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:49.677723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:49.678499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:49.680052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Returning 404 to user: Instance 7ff613c0-98a5-464a-8697-541c8e7b0ca1 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:49.682267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b81829d-99c5-4982-b4ab-2d19d7d5d1d1 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1" status: 404 len: 111 microversion: 2.1 time: 0.126398 Jun 25 21:08:49.683240 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1867/4115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:49 2022] GET /compute/v2.1/servers/7ff613c0-98a5-464a-8697-541c8e7b0ca1 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:49.692249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:49.692995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:49.700915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.701380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.701824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.702170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.702490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.702662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.703719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:49.704966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:49.981288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:49.988010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:49.999566 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da55e249-3496-4e75-aa54-91b177bca790 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.315196 Jun 25 21:08:50.002031 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1868/4116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:49 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:50.011043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.011998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.020983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.022026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.023083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.024180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.060586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:08:50.076295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:50.089615 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1941a04-f2a4-43b4-93c1-0e578e8323e3 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1508 microversion: 2.1 time: 0.423675 Jun 25 21:08:50.090331 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2249/4117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:49 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:50.101570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.102926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.118031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.118488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.119273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.119709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.287649 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2915451a-cd60-4582-9114-89a35ada5f7d tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 204 len: 0 microversion: 2.1 time: 0.283226 Jun 25 21:08:50.288476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1869/4118] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:50 2022] DELETE /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:08:50.297770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.298542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.309754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.310348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.311395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.311936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.621667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:50.628663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:50.632332 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab13e5c0-4ec0-4c16-8451-2a34d6b4a604 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.342675 Jun 25 21:08:50.637398 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1870/4119] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:50 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:50.642632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77cd48a6-ed96-4f0e-9a0d-eaf987c7a6e4 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1532 microversion: 2.1 time: 0.544339 Jun 25 21:08:50.643540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2250/4120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:50 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1532 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:50.646366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.647066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.653107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.660823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.663880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.664348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.665165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.665607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.670390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.671553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.675372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.676312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.928654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:50.939399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c302227-acad-4864-960a-a8d3a28ca2d4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.299961 Jun 25 21:08:50.940288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1871/4121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:50 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:50.948812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:50.952901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:50.966441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.967166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:50.968171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:50.968901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:51.001357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:51.012245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17c97ced-1f4f-4e4e-a7df-a6b47d747702 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1469 microversion: 2.1 time: 0.367324 Jun 25 21:08:51.014839 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2251/4122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:50 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1469 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:51.027972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1778903051", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:51.130731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] validate_networks() for [('4c15c322-db0c-43c6-be0b-e0a6ca9bf5ca', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:08:51.402623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:51.418934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:51.421026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:51.422900 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a518fc0-481f-4007-8b37-5c4e84167e5b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.480482 Jun 25 21:08:51.424042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1872/4123] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:50 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:51.441925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:51.443828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:51.474493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:51.475603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:51.476830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:51.488645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:51.908942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:51.918603 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d411ac1-a0a9-4c6d-aefc-3e1428f21b72 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1508 microversion: 2.1 time: 0.490015 Jun 25 21:08:51.929318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1873/4124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:51 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1508 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:51.929318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:51.929318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:51.951843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:51.952304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:51.953113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:51.953550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:52.608041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:52.623351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30a093b3-25c0-425e-b849-6af616b280d7 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1532 microversion: 2.1 time: 0.700909 Jun 25 21:08:52.624352 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1874/4125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:51 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1532 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:52.640058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3b9420c5-e713-4250-9506-f23f861c0e03 req-e8c900b1-2d05-4157-b7cb-e09ba249b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "7ea183c3-f749-4eb9-8da7-cf65b316e82d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:52.658680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3b9420c5-e713-4250-9506-f23f861c0e03 req-e8c900b1-2d05-4157-b7cb-e09ba249b9e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:52.665887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3b9420c5-e713-4250-9506-f23f861c0e03 req-e8c900b1-2d05-4157-b7cb-e09ba249b9e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:52.690952 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3b9420c5-e713-4250-9506-f23f861c0e03 req-e8c900b1-2d05-4157-b7cb-e09ba249b9e9 service nova] Creating event network-changed:7ea183c3-f749-4eb9-8da7-cf65b316e82d for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:52.715848 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3b9420c5-e713-4250-9506-f23f861c0e03 req-e8c900b1-2d05-4157-b7cb-e09ba249b9e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089689 Jun 25 21:08:52.716992 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1875/4126] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:52.725859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:52.735639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:52.765287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:52.767457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:52.769605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:52.770571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:53.150644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:08:53.151444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:08:53.152178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:08:53.153530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:08:53.154200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:08:53.166803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:53.167443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:53.168516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:53.169151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:53.197981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:53.207523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Getting quotas for user 69effad76345477987af68f55c90e2e1 and project e11392205e814f46be92aa13f9e7dcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:53.251389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:08:53.257782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:08:53.339459 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b505878-29e4-4315-b731-286e32c4fabb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.323154 Jun 25 21:08:53.340702 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2252/4127] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:08:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:08:53.348830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:53.350303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:53.376585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:53.377422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:53.378444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:53.379103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:53.969242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:53.978299 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8cc83613-9af7-480c-8e1e-cff8b34cbc41 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 1.259766 Jun 25 21:08:53.978884 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1876/4128] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:52 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:53.998015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:53.998631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:54.009774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.012665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.018817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.020015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.237246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:54.240564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:54.270685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1c7bae3-a9c5-499d-b0d8-30dd917d5341 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1469 microversion: 2.1 time: 0.923056 Jun 25 21:08:54.284178 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2253/4129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:53 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1469 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:54.302717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:54.305110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:54.325852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.327354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.331714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.333065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.695935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:54.710537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:54.715943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:54.720915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d0b0355-1b5c-43d4-bdaf-44cca19817a9 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.734566 Jun 25 21:08:54.724524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1877/4130] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:53 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:54.764404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ad35d289-729c-4fc0-87dc-6b8c54163e49 req-100b7c38-b109-4c95-acb7-e51ff697a7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf084eab-d6ab-47e7-ba45-118d00b33e50", "name": "network-vif-unplugged", "status": "completed", "tag": "1c9879d8-b265-42d8-ad63-0cf7ef31520d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:54.808278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ad35d289-729c-4fc0-87dc-6b8c54163e49 req-100b7c38-b109-4c95-acb7-e51ff697a7ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.809542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ad35d289-729c-4fc0-87dc-6b8c54163e49 req-100b7c38-b109-4c95-acb7-e51ff697a7ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.856259 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ad35d289-729c-4fc0-87dc-6b8c54163e49 req-100b7c38-b109-4c95-acb7-e51ff697a7ee service nova] Creating event network-vif-unplugged:1c9879d8-b265-42d8-ad63-0cf7ef31520d for instance cf084eab-d6ab-47e7-ba45-118d00b33e50 on nch2-master-1 Jun 25 21:08:54.874571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ad35d289-729c-4fc0-87dc-6b8c54163e49 req-100b7c38-b109-4c95-acb7-e51ff697a7ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131893 Jun 25 21:08:54.875220 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1878/4131] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:54.885899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:54.897309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:54.912606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.913064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:54.918544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:54.926922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.218464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:55.242912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-470fbf0d-37b4-4217-b926-6af3097192e7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1219 microversion: 2.1 time: 0.364316 Jun 25 21:08:55.245286 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1879/4132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:54 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1219 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:55.262749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:55.265258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:55.293880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.296269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.297311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.324087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.449055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.455785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.456648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lazy-loading 'fault' on Instance uuid cf084eab-d6ab-47e7-ba45-118d00b33e50 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:08:55.549166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6aaf0215c7d4342b75c8921f1ac54d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26b2606c05e441e58e2bba46a8ee48e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:55.568130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b112af2d-f99a-4116-859c-7a8a420901c9 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 200 len: 1316 microversion: 2.1 time: 0.319912 Jun 25 21:08:55.568839 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1880/4133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:55 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:55.586292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-90d49845-efaf-4497-9c7c-df52cdae8f04 req-7775dc8f-c811-45d2-bbc7-87c5d27dc577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf084eab-d6ab-47e7-ba45-118d00b33e50", "name": "network-vif-deleted", "tag": "1c9879d8-b265-42d8-ad63-0cf7ef31520d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:55.612119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-90d49845-efaf-4497-9c7c-df52cdae8f04 req-7775dc8f-c811-45d2-bbc7-87c5d27dc577 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.619447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-90d49845-efaf-4497-9c7c-df52cdae8f04 req-7775dc8f-c811-45d2-bbc7-87c5d27dc577 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.681037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-90d49845-efaf-4497-9c7c-df52cdae8f04 req-7775dc8f-c811-45d2-bbc7-87c5d27dc577 service nova] Creating event network-vif-deleted:1c9879d8-b265-42d8-ad63-0cf7ef31520d for instance cf084eab-d6ab-47e7-ba45-118d00b33e50 on nch2-master-1 Jun 25 21:08:55.694516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-90d49845-efaf-4497-9c7c-df52cdae8f04 req-7775dc8f-c811-45d2-bbc7-87c5d27dc577 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124390 Jun 25 21:08:55.696941 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1881/4134] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:55.704387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "b3347e88-190a-4637-80a6-61afca27cb1b"}, {"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "48c08606-e1db-4c6a-81c5-188382208a7b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:55.737950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.738350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.791886 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] Creating event network-changed:b3347e88-190a-4637-80a6-61afca27cb1b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:55.792387 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] Creating event network-changed:48c08606-e1db-4c6a-81c5-188382208a7b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:08:55.813540 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-73748caa-c889-4aeb-a3c8-c5203ac296fd req-51971bdf-b00f-4121-a62e-0a81505aec4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.113786 Jun 25 21:08:55.828668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1882/4135] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:55.833045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b01ed1ecd8d4609a5a277f96e8a8445', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29c4645abed4410981601604f61a3d89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:55.845380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:55.846317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:55.847004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01afa72f-d131-4dc7-a4e7-34b7165334ba tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 200 len: 1508 microversion: 2.1 time: 1.561128 Jun 25 21:08:55.848969 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2254/4136] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:54 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 1508 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:55.860376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.860891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.865698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.865896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:55.866154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.866368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:55.879045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.879822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:55.880856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:55.881572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:56.009915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:56.010400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:56.010870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lazy-loading 'fault' on Instance uuid bead1ab6-e8ae-4873-9eac-b5467789b47b {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:08:56.120232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:56.148535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a453c1cf-c92a-460a-a540-1d2705a38525 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 200 len: 1303 microversion: 2.1 time: 0.280065 Jun 25 21:08:56.149801 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2255/4137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:55 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 1303 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:56.164481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:56.165789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:56.183416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:56.184194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:56.185220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:56.188703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:56.369282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:56.384197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61fffeeb-3159-4244-8f9d-7d9c4c87d73d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.552972 Jun 25 21:08:56.388382 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1883/4138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:55 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:56.393527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:56.397560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:56.412100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:56.414344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:56.416897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:56.417560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.011731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:57.025596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:57.031729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:57.033850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc215fbe-8c0c-4f7c-ab58-ede1ee6187ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.882648 Jun 25 21:08:57.037362 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2256/4139] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:56 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:57.051825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.052496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] [instance: cf084eab-d6ab-47e7-ba45-118d00b33e50] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.075491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:57.076852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.077431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.078897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.079428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.086617 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7aff2ce5-fdfb-4cc0-a6ec-8a924b701a07 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1285 microversion: 2.1 time: 0.696618 Jun 25 21:08:57.091566 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1884/4140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:56 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1285 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:57.097204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.104543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] [instance: 8d4c2c20-a731-4403-9614-b978a24ab357] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.120050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.120533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.121330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.121772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.123107 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] HTTP exception thrown: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Request method failure captured: Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 HTTP/1.1 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3kqo8Of6_VZHrkKn8seiSHKya2VvzngdwxcUXOywKFClyGj_JglcxW9pZKqcR5hUp-HRdgrD3kRBUbnyzE1r20SxwO-jYORypSMzEwsuSaQYEsv_TgS01DK_X-xMK_1xqKotgrEaoCl17hrTBcglII-a65Jqydv5kA-f_Pa36x2dcw Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 26b2606c05e441e58e2bba46a8ee48e5 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-372992001 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/26b2606c05e441e58e2bba46a8ee48e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26b2606c05e441e58e2bba46a8ee48e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_26b2606c05e441e58e2bba46a8ee48e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/26b2606c05e441e58e2bba46a8ee48e5"}]}] Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-372992001 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 26b2606c05e441e58e2bba46a8ee48e5 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-372992001 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestMultiTenantJSON-372992001-project Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: b6aaf0215c7d4342b75c8921f1ac54d3 Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-372992001-project Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'cf084eab-d6ab-47e7-ba45-118d00b33e50'} Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.134000 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] Returning 404 to user: Instance cf084eab-d6ab-47e7-ba45-118d00b33e50 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:57.139686 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-858cbbb5-c454-4a3b-8046-d6d5f3c86cc8 tempest-ServersNegativeTestMultiTenantJSON-372992001 tempest-ServersNegativeTestMultiTenantJSON-372992001-project] 10.222.0.39 "GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50" status: 404 len: 111 microversion: 2.1 time: 0.095847 Jun 25 21:08:57.145315 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2257/4141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:57 2022] GET /compute/v2.1/servers/cf084eab-d6ab-47e7-ba45-118d00b33e50 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:57.151334 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] HTTP exception thrown: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Request method failure captured: Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 HTTP/1.1 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3kBCxWZZD9gE0LHUf7nrhNt4V0bQSA_eNtnS7fiT9JUHjLJlNDb3CaZN3YX4qrl4MSpLnoDmR4cji3FCQQlHFPEYm-T3kRm1mdczOR4sbGefvSDxItG1PBullVVlqQMVQIPmM9yRl3ZBJ92a4fOQ2uYQTynYKK-r4q_WU21b4hCQUQ Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 29c4645abed4410981601604f61a3d89 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-474559778 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/29c4645abed4410981601604f61a3d89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29c4645abed4410981601604f61a3d89"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_29c4645abed4410981601604f61a3d89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/29c4645abed4410981601604f61a3d89"}]}] Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-474559778 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 29c4645abed4410981601604f61a3d89 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-474559778 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueTestJSONUnderV235-474559778-project Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 5b01ed1ecd8d4609a5a277f96e8a8445 Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-474559778-project Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8d4c2c20-a731-4403-9614-b978a24ab357'} Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.153069 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.158733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] Returning 404 to user: Instance 8d4c2c20-a731-4403-9614-b978a24ab357 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:57.161856 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e7ee044-9026-44fa-beb8-ec2719a017e1 tempest-ServerRescueTestJSONUnderV235-474559778 tempest-ServerRescueTestJSONUnderV235-474559778-project] 10.222.0.39 "GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357" status: 404 len: 111 microversion: 2.1 time: 0.068720 Jun 25 21:08:57.162633 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1885/4142] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:57 2022] GET /compute/v2.1/servers/8d4c2c20-a731-4403-9614-b978a24ab357 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:57.166680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.167493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: bead1ab6-e8ae-4873-9eac-b5467789b47b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.175889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.180780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.182105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.184846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.210594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] HTTP exception thrown: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Request method failure captured: Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b HTTP/1.1 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3jcwU805Ejc8Y0JT_-NIlM14O5rqrcCKpHw7PcQwae6LfMk8CGMY9kEZQqpBVUwsvFd2AhgZZA13Xg1fBXU26mtvE3Un77tpgBuZGHoUiTYAsH01EJx_0nQtn98vtvbYFa1zECHU2cOw63f-vJbxWQ1XkkpCzmhN2r0KTqrHO_nQ4g Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}] Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ea5a50f6e8ea470894e19f8c1dec476f Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'bead1ab6-e8ae-4873-9eac-b5467789b47b'} Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:08:57.225799 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Returning 404 to user: Instance bead1ab6-e8ae-4873-9eac-b5467789b47b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:08:57.231661 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2c757e7-5b49-4449-9a0e-d8dc52a16383 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b" status: 404 len: 111 microversion: 2.1 time: 0.065360 Jun 25 21:08:57.236079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.236751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.244781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2258/4143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:57 2022] GET /compute/v2.1/servers/bead1ab6-e8ae-4873-9eac-b5467789b47b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:08:57.245923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.249076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.250409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.250990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.291484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:08:57.295685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:08:57.402144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.403181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.414135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.415398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.416933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.417643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.423581 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-434810bd-1e86-4dd3-95ff-da1c50a72e04 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 204 len: 0 microversion: 2.1 time: 0.191074 Jun 25 21:08:57.425924 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1886/4144] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:08:57 2022] DELETE /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:08:57.442393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:57.443772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:57.451004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.452241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.453828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.454737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.809168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:57.832888 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09575631-c742-4310-b28a-96addcd3321d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.434866 Jun 25 21:08:57.833638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2259/4145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:57 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:57.848831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-62d8c596-db61-4524-8f7c-83f822a5560c req-d54ae8b1-87fa-4873-aa0f-091beeddce04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bead1ab6-e8ae-4873-9eac-b5467789b47b", "name": "network-vif-deleted", "tag": "58c6da54-7e63-4bee-84c7-4b09fc2ed426"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:57.861977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-62d8c596-db61-4524-8f7c-83f822a5560c req-d54ae8b1-87fa-4873-aa0f-091beeddce04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.862483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-62d8c596-db61-4524-8f7c-83f822a5560c req-d54ae8b1-87fa-4873-aa0f-091beeddce04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:57.875985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-62d8c596-db61-4524-8f7c-83f822a5560c req-d54ae8b1-87fa-4873-aa0f-091beeddce04 service nova] Creating event network-vif-deleted:58c6da54-7e63-4bee-84c7-4b09fc2ed426 for instance bead1ab6-e8ae-4873-9eac-b5467789b47b on nch1-master-1 Jun 25 21:08:57.881375 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-62d8c596-db61-4524-8f7c-83f822a5560c req-d54ae8b1-87fa-4873-aa0f-091beeddce04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046100 Jun 25 21:08:57.882606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2260/4146] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:57.895709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f62bd8a-dce4-43e0-89da-e0bf53c8de3c tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Action: 'create', calling method: .version_select at 0x7f984e871940>, body: {"keypair": {"name": "tempest-keypair-170691039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCP79VOGRIWQ/IWaWoHbfAnPQ9XtbTxkd+x2vAir4PozwASzC422zEM1ElXiyBi8saN/Vw+CLUq7NWXiA+uZXIKe82065jiZWiWDbiLct+yctquFzNtA3Jrlew4VvdiSA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:57.913218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2f62bd8a-dce4-43e0-89da-e0bf53c8de3c tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Getting quotas for project 094538b7d28d413fbea48441d35cad09. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:08:57.920465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2f62bd8a-dce4-43e0-89da-e0bf53c8de3c tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Getting quotas for user 48103c7f170a4a97a3aa0402a52428c2 and project 094538b7d28d413fbea48441d35cad09. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:08:57.954204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f62bd8a-dce4-43e0-89da-e0bf53c8de3c tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.066946 Jun 25 21:08:57.956251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2261/4147] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 21:08:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:08:57.964364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ee9b470b-0b91-490d-9c9f-7108f4e076ad req-5fbc99c5-f217-4e8b-bd71-2e5a446fe185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4c2c20-a731-4403-9614-b978a24ab357", "name": "network-vif-deleted", "tag": "3543ee3d-2e5b-45d3-b7c1-d1c78224e615"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:57.977648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ee9b470b-0b91-490d-9c9f-7108f4e076ad req-5fbc99c5-f217-4e8b-bd71-2e5a446fe185 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:57.978120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ee9b470b-0b91-490d-9c9f-7108f4e076ad req-5fbc99c5-f217-4e8b-bd71-2e5a446fe185 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.002916 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ee9b470b-0b91-490d-9c9f-7108f4e076ad req-5fbc99c5-f217-4e8b-bd71-2e5a446fe185 service nova] Creating event network-vif-deleted:3543ee3d-2e5b-45d3-b7c1-d1c78224e615 for instance 8d4c2c20-a731-4403-9614-b978a24ab357 on nch2-master-1 Jun 25 21:08:58.010493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ee9b470b-0b91-490d-9c9f-7108f4e076ad req-5fbc99c5-f217-4e8b-bd71-2e5a446fe185 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051253 Jun 25 21:08:58.012164 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2262/4148] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:08:58.065204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:58.066209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:58.076628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.077420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.078405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.079880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.193912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:58.206357 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f3b96ff-9985-48c7-886c-c429d6ec5c7e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1469 microversion: 2.1 time: 0.772568 Jun 25 21:08:58.207469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1887/4149] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:57 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1469 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:08:58.212961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:58.214426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:58.221692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.222476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.223365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.223841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.345404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:58.355379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:58.357105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:58.358280 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c876bde-f84f-4a5c-9956-ebdb37b7f5e2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.305718 Jun 25 21:08:58.358891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2263/4150] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:58 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:08:58.398464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:58.407317 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-96633b51-d632-43ae-8ec7-bcbc724d8076 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1273 microversion: 2.1 time: 0.198547 Jun 25 21:08:58.408218 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1888/4151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:58 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:58.851023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:58.851818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:58.858747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.862378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.863525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.870604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.895829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-62f7e702-1765-4bc6-89c0-7896d7e4dd0e req-98c86b96-4d8b-4ac4-8fcc-2b1f98f198cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9a653b-3c16-444c-be5d-92d54ae6cab7", "name": "network-vif-plugged", "status": "completed", "tag": "d756f698-3d43-4d7c-bd2b-fe5f3b3475ed"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:08:58.905154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62f7e702-1765-4bc6-89c0-7896d7e4dd0e req-98c86b96-4d8b-4ac4-8fcc-2b1f98f198cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:58.909961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62f7e702-1765-4bc6-89c0-7896d7e4dd0e req-98c86b96-4d8b-4ac4-8fcc-2b1f98f198cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:58.930263 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-62f7e702-1765-4bc6-89c0-7896d7e4dd0e req-98c86b96-4d8b-4ac4-8fcc-2b1f98f198cf service nova] Creating event network-vif-plugged:d756f698-3d43-4d7c-bd2b-fe5f3b3475ed for instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 on nch2-master-1 Jun 25 21:08:58.944627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-62f7e702-1765-4bc6-89c0-7896d7e4dd0e req-98c86b96-4d8b-4ac4-8fcc-2b1f98f198cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052630 Jun 25 21:08:58.949212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1889/4152] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:08:59.226737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:59.227984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:59.243750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.247075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:59.248349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.255494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:59.272615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:59.281693 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e43706f-bc9b-4665-8ad2-1420ccc44fb0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.434795 Jun 25 21:08:59.285768 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2264/4153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:58 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:08:59.378253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:59.378926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:59.386058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.386911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:59.387935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.388656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:59.732864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:59.743354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:59.746233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:08:59.748286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13377f28-b2a2-4d7f-a3b3-812b9b872c6c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.374172 Jun 25 21:08:59.751043 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2265/4154] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:08:59 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:08:59.757015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:08:59.758997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:08:59.771388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.772138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:08:59.773017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:08:59.774980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.062030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:00.071506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be8da60d-7da2-4ba0-99de-8670108d0708 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.319050 Jun 25 21:09:00.072596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2266/4155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:59 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:00.077993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a8ab61ce-8551-4894-a6cc-18d3a8ce2e17 req-ce2cad6d-8a3a-4e5a-95b4-0de3d7ccc09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c915083-b7bd-47e7-8861-52f5e318b2b4", "name": "network-vif-deleted", "tag": "3002f539-100d-48dc-a62d-0dab07c8a061"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:00.094280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a8ab61ce-8551-4894-a6cc-18d3a8ce2e17 req-ce2cad6d-8a3a-4e5a-95b4-0de3d7ccc09f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:00.096613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a8ab61ce-8551-4894-a6cc-18d3a8ce2e17 req-ce2cad6d-8a3a-4e5a-95b4-0de3d7ccc09f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.118158 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a8ab61ce-8551-4894-a6cc-18d3a8ce2e17 req-ce2cad6d-8a3a-4e5a-95b4-0de3d7ccc09f service nova] Creating event network-vif-deleted:3002f539-100d-48dc-a62d-0dab07c8a061 for instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 on nch1-master-1 Jun 25 21:09:00.127689 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a8ab61ce-8551-4894-a6cc-18d3a8ce2e17 req-ce2cad6d-8a3a-4e5a-95b4-0de3d7ccc09f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053023 Jun 25 21:09:00.129593 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2267/4156] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:00.257191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea5a50f6e8ea470894e19f8c1dec476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccdbe2fec6454cef988cb3ed5466c6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:00.304313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:00.305447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:00.312766 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-589c8733-f6b3-4066-a513-f20fd806fd6e tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 200 len: 1469 microversion: 2.1 time: 1.092135 Jun 25 21:09:00.319701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1890/4157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:08:59 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 1469 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:00.328763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:00.328763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.328763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:00.328763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.770722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:00.772130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:00.781872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:00.782634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.784281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:00.784983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:00.929127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:00.942922 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f42a1926-58d7-4cf4-9bf5-37f8e704e07e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1316 microversion: 2.1 time: 0.644711 Jun 25 21:09:00.954832 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2268/4158] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:00 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1316 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:01.090236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:01.091003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:01.097761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.098598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:01.099531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.100146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:01.337163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:01.351842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3a5fd8a-14ca-4b41-8e24-91519651acb1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.266550 Jun 25 21:09:01.352469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2269/4159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:01 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:01.359196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:01.360009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] [instance: 1c915083-b7bd-47e7-8861-52f5e318b2b4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:01.384311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.384793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:01.385566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.385996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:01.410208 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] HTTP exception thrown: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Request method failure captured: Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 HTTP/1.1 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3jcwU805Ejc8Y0JT_-NIlM14O5rqrcCKpHw7PcQwae6LfMk8CGMY9kEZQqpBVUwsvFd2AhgZZA13Xg1fBXU26mtvE3Un77tpgBuZGHoUiTYAsH01EJx_0nQtn98vtvbYFa1zECHU2cOw63f-vJbxWQ1XkkpCzmhN2r0KTqrHO_nQ4g Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccdbe2fec6454cef988cb3ed5466c6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccdbe2fec6454cef988cb3ed5466c6fe"}]}] Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ccdbe2fec6454cef988cb3ed5466c6fe Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAdminTestJSON-1351054820 Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ea5a50f6e8ea470894e19f8c1dec476f Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAdminTestJSON-1351054820-project Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1c915083-b7bd-47e7-8861-52f5e318b2b4'} Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:01.411934 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] Returning 404 to user: Instance 1c915083-b7bd-47e7-8861-52f5e318b2b4 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a09be4bf-0981-46d6-8d98-6f61d77f3860 tempest-ServersAdminTestJSON-1351054820 tempest-ServersAdminTestJSON-1351054820-project] 10.222.0.39 "GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4" status: 404 len: 111 microversion: 2.1 time: 0.058092 Jun 25 21:09:01.418239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2270/4160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:01 2022] GET /compute/v2.1/servers/1c915083-b7bd-47e7-8861-52f5e318b2b4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:01.426634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:01.439962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:01.450559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:01.452113 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4baa2e31-72da-47a1-b3b3-f20d74354eb1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.686803 Jun 25 21:09:01.464810 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1891/4161] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:00 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:01.964862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:01.965491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:01.977559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.978357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:01.979333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:01.980300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.006908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-233551609", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "dddfbf0e-7f42-4820-8bab-3d36351d8dc5"}, {"port": "662e8a6c-11c8-477b-9a5c-2994b7f2ebd5", "tag": "port-1"}, {"port": "2df6d7a0-8189-45ee-a287-e11964e1391b", "tag": "port-2"}, {"uuid": "90ecf6f3-e394-4006-bac2-0755e5ea58d1", "tag": "net-1"}, {"uuid": "90ecf6f3-e394-4006-bac2-0755e5ea58d1"}, {"uuid": "50510792-42c5-4a10-9cf8-76186e3c9f40", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "50510792-42c5-4a10-9cf8-76186e3c9f40", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "77b4d6d2-e904-4959-879b-fbabba9a3139", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "fbbe220f-e91a-425b-81dd-bebb3a0f18fb", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--581950147"}], "key_name": "tempest-keypair-170691039", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:02.290081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:02.299452 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0131f938-b812-490d-8dc3-ca42a64d6bbb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1506 microversion: 2.1 time: 0.340235 Jun 25 21:09:02.300689 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2271/4162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:01 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:02.319280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:02.319884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:02.326990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.327540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.328905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.329525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.353302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] validate_networks() for [('dddfbf0e-7f42-4820-8bab-3d36351d8dc5', None, None, None, None, None), (None, None, '662e8a6c-11c8-477b-9a5c-2994b7f2ebd5', None, None, None), (None, None, '2df6d7a0-8189-45ee-a287-e11964e1391b', None, None, None), ('90ecf6f3-e394-4006-bac2-0755e5ea58d1', None, None, None, None, None), ('90ecf6f3-e394-4006-bac2-0755e5ea58d1', None, None, None, None, None), ('50510792-42c5-4a10-9cf8-76186e3c9f40', '10.2.2.100', None, None, None, None), ('50510792-42c5-4a10-9cf8-76186e3c9f40', '10.2.2.200', None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:09:02.358369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:09:02.473151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0f10280-7f51-4b49-9043-1a80a325667f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 204 len: 0 microversion: 2.1 time: 0.159243 Jun 25 21:09:02.473953 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2272/4163] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:09:02 2022] DELETE /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:09:02.483345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:02.484047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:02.490850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.491298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.492284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.492771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.509992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:02.693457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:02.702860 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2eae0ba-82d7-44cf-8f2c-d70d0a0f4b13 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.223555 Jun 25 21:09:02.703521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2273/4164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:02 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:02.718513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:02.719127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:02.725784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.726517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.727289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:02.727896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:02.974995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:02.995301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:02.999021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:03.000896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4de1982c-0144-4960-99af-bb1a8704d16f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.286300 Jun 25 21:09:03.001867 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2274/4165] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:02 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:03.009423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:03.010541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:03.030170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:03.030766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:03.031678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:03.032305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:03.179295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:03.324245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:03.333752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cefa2939-4de9-49ab-a15b-30d8ed88a889 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1512 microversion: 2.1 time: 0.330111 Jun 25 21:09:03.334557 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2275/4166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:03 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:03.514981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-bb82397a-c81d-444c-8b2e-5bdeb986e131 req-02b1a666-b044-4d8b-96c1-272bee291749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96e462d2-f761-41b7-8b26-00fdda3f5846", "tag": "813232fc-0a4b-46b8-8a25-fca191ce3ed1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:03.547657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bb82397a-c81d-444c-8b2e-5bdeb986e131 req-02b1a666-b044-4d8b-96c1-272bee291749 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:03.548484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bb82397a-c81d-444c-8b2e-5bdeb986e131 req-02b1a666-b044-4d8b-96c1-272bee291749 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:03.561627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-bb82397a-c81d-444c-8b2e-5bdeb986e131 req-02b1a666-b044-4d8b-96c1-272bee291749 service nova] Creating event network-changed:813232fc-0a4b-46b8-8a25-fca191ce3ed1 for instance 96e462d2-f761-41b7-8b26-00fdda3f5846 on nch2-master-1 Jun 25 21:09:03.567296 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-bb82397a-c81d-444c-8b2e-5bdeb986e131 req-02b1a666-b044-4d8b-96c1-272bee291749 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059883 Jun 25 21:09:03.568746 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2276/4167] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:03.730248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:03.731039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:03.758596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:03.758596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:03.758596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:03.759087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:04.042223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:04.054518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9267a3c-4eaf-4e15-9f83-baf3fdfe39e0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.337311 Jun 25 21:09:04.055244 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2277/4168] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:03 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:04.062157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:04.062881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:04.080140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:04.081858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:04.083799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:04.088777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:04.089239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:04.653932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:04.668378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:04.671507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:04.675260 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-014191f8-2c2e-4152-985a-621fdd5dc4ec tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.617618 Jun 25 21:09:04.678603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2278/4169] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:04 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:04.685160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:04.692726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:04.712352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:04.712738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:04.717364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:04.718012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:04.951424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:04.965173 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d10c033-8d05-48a5-80e7-b513a2c08804 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 200 len: 1512 microversion: 2.1 time: 0.284861 Jun 25 21:09:04.977600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2279/4170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:04 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:05.072280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:05.073115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:05.105017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:05.105689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:05.118128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:05.134938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:05.619955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:05.635909 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec387c02-2721-42d6-b89d-3413dacabc45 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.567263 Jun 25 21:09:05.639420 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2280/4171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:05 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:05.650793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-67ef54c1-e7d7-4eb9-ac60-6ebea31b2b9e req-85d10a27-df4f-459f-b388-bc98b8843a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a9a653b-3c16-444c-be5d-92d54ae6cab7", "name": "network-vif-deleted", "tag": "d756f698-3d43-4d7c-bd2b-fe5f3b3475ed"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:05.671707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-67ef54c1-e7d7-4eb9-ac60-6ebea31b2b9e req-85d10a27-df4f-459f-b388-bc98b8843a29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:05.675395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-67ef54c1-e7d7-4eb9-ac60-6ebea31b2b9e req-85d10a27-df4f-459f-b388-bc98b8843a29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:05.707386 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-67ef54c1-e7d7-4eb9-ac60-6ebea31b2b9e req-85d10a27-df4f-459f-b388-bc98b8843a29 service nova] Creating event network-vif-deleted:d756f698-3d43-4d7c-bd2b-fe5f3b3475ed for instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 on nch2-master-1 Jun 25 21:09:05.722714 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-67ef54c1-e7d7-4eb9-ac60-6ebea31b2b9e req-85d10a27-df4f-459f-b388-bc98b8843a29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080862 Jun 25 21:09:05.723653 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2281/4172] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:05.738218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:05.747261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:05.764635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:05.765458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:05.766900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:05.769495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.221524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:06.243189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:06.244758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:06.246324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a82e5c71-6b60-47a0-9a92-5bb4b7147db5 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.518060 Jun 25 21:09:06.247269 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2282/4173] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:05 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:06.259173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:06.260141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:06.291011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.291759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.297247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.298362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.334500 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 HTTP/1.1 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1a9a653b-3c16-444c-be5d-92d54ae6cab7'} Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:06.338052 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:09:06.347631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:06.351674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:06.353034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a9540c3-4769-4cc9-bef4-847d034d6fd3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 404 len: 111 microversion: 2.1 time: 0.104542 Jun 25 21:09:06.359208 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2283/4174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:06 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:06.366899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:06.367548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:06.376942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.377431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.379337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.379817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.689139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:06.697118 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18696fb8-c215-4384-a6ac-5c21a65c1b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.335464 Jun 25 21:09:06.704416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2284/4175] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:06 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:06.715996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:06.718589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:06.740461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.742907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:06.744095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:06.746724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.053488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:07.061715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-793bac9d-782d-43ef-b295-6e22a5682020 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.356126 Jun 25 21:09:07.062738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2285/4176] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:06 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:07.079857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65e707ab-bc26-4909-b0f4-9d1f54b3132e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65e707ab-bc26-4909-b0f4-9d1f54b3132e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 163 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": 12345, "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 12345 Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:07.086610 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65e707ab-bc26-4909-b0f4-9d1f54b3132e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:07.093057 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65e707ab-bc26-4909-b0f4-9d1f54b3132e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024180 Jun 25 21:09:07.095062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2286/4177] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:07 2022] POST /compute/v2.1/servers => generated 127 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:07.100059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:07.100799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:07.109042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.109885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.110864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.112352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.404072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:07.412625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa9716f1-a00d-4125-863b-bdaf330015cf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.317085 Jun 25 21:09:07.436904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2287/4178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:07 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:07.442632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:07.446467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:07.454639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.455340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.459451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.461164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.773149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:07.791904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:07.793451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:07.794654 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6aabf717-6cbd-48a4-9003-73c1a2a19f8b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.356087 Jun 25 21:09:07.795219 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2288/4179] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:07 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:07.800482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:07.801281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:07.818396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.820098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.825755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:07.826394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:07.931622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:08.143991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:08.152041 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c22089e-6fe9-471b-b96e-4f9a924da04e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.355439 Jun 25 21:09:08.155829 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2289/4180] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:07 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:08.161278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:08.162228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:08.168970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:08.170070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:08.171808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:08.171808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:08.517900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:08.543799 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abc5f169-02e8-4b10-99f4-b95f0306d7df tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.386523 Jun 25 21:09:08.550317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2290/4181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:08 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:08.814381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:08.815047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:08.864656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:08.864656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:08.864656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:08.864656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:09.388564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:09.400162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:09.402057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:09.404251 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02b988b2-9606-41b4-8adf-b6c394ca60bf tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.593731 Jun 25 21:09:09.416137 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2291/4182] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:08 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:09.572084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:09.572652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:09.592065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:09.593399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:09.600319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:09.603565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:10.357263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:10.375010 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-66da482e-ddf2-4891-8c7c-9231da4b6890 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.814968 Jun 25 21:09:10.376185 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2292/4183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:09 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:10.392089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dc61034-e1d5-45b1-a55c-8edf5c36f5db tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-281103797", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dfe1704f-f1a7-473a-9ef3-a3a678f32ff3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:10.559136 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1dc61034-e1d5-45b1-a55c-8edf5c36f5db tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dc61034-e1d5-45b1-a55c-8edf5c36f5db tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 357 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-281103797", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "dfe1704f-f1a7-473a-9ef3-a3a678f32ff3", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: exception: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-281103797', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'dfe1704f-f1a7-473a-9ef3-a3a678f32ff3'}], 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:10.570271 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:10.574474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1dc61034-e1d5-45b1-a55c-8edf5c36f5db tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Block Device dfe1704f-f1a7-473a-9ef3-a3a678f32ff3 is not bootable. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:10.575656 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1dc61034-e1d5-45b1-a55c-8edf5c36f5db tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.197021 Jun 25 21:09:10.576325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2293/4184] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:10.599852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:10.600513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:10.638316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:10.638812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:10.639625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:10.640060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:10.676673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.433161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:11.793594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:09:11.794316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:09:11.794997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:09:11.795609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:09:11.796562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:09:11.811708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:11.813749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:11.833588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:11.837230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:11.839115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:11.839655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:11.840129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:11.840293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89874d88-b46a-4c54-a3fb-7b1ed1f3e849 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 1.262244 Jun 25 21:09:11.843735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2294/4185] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:10 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:11.864349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:11.869183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:11.886109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Getting quotas for project 094538b7d28d413fbea48441d35cad09. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:09:11.893985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:11.896768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:11.899917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:11.902400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:11.906103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Getting quotas for user 48103c7f170a4a97a3aa0402a52428c2 and project 094538b7d28d413fbea48441d35cad09. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:09:12.239738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:09:12.243079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='77b4d6d2-e904-4959-879b-fbabba9a3139',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='fbbe220f-e91a-425b-81dd-bebb3a0f18fb',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3021df6d-a2e9-4c08-8bf1-d7b623d3d3cf',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:09:12.459137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:12.467108 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e5f5b6c-2fa1-49ba-8a26-8c56aa09db5c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.622091 Jun 25 21:09:12.473784 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2295/4186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:11 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:12.484502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:12.485361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:12.499218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:12.499747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:12.500673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:12.505037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:12.841107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:12.857063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-147f4952-66c9-47b1-ac7c-642ec45aea98 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.381918 Jun 25 21:09:12.857716 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2296/4187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:12 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:12.862272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:12.862883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:12.881779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:12.882240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:12.883025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:12.883470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:12.958298 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-845dea09-3fd6-4543-8b62-029a5160f41d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 10.956581 Jun 25 21:09:12.972849 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1892/4188] 10.222.0.39 () {62 vars in 1188 bytes} [Sat Jun 25 21:09:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 10972 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:09:12.981950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:12.982571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:13.026488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:13.027839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:13.032089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:13.034291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:13.602284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:13.613001 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b1175fd-7f1d-44b9-ad2c-263a57174595 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.754217 Jun 25 21:09:13.616343 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2297/4189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:12 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:13.621717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:13.622597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:13.822730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:13.834785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:13.837025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:13.839314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3139753e-fec2-4677-8358-204c0ee90956 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1284 microversion: 2.42 time: 0.220895 Jun 25 21:09:13.840911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2298/4190] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:13 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1284 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:13.849463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3d10bb46-eab5-4e6d-af21-e85d6024e8f8 req-1f2d7714-fd45-4780-815c-aced1608488d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e462d2-f761-41b7-8b26-00fdda3f5846", "name": "network-vif-plugged", "status": "completed", "tag": "813232fc-0a4b-46b8-8a25-fca191ce3ed1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:13.864665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3d10bb46-eab5-4e6d-af21-e85d6024e8f8 req-1f2d7714-fd45-4780-815c-aced1608488d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:13.865535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3d10bb46-eab5-4e6d-af21-e85d6024e8f8 req-1f2d7714-fd45-4780-815c-aced1608488d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:13.883898 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3d10bb46-eab5-4e6d-af21-e85d6024e8f8 req-1f2d7714-fd45-4780-815c-aced1608488d service nova] Creating event network-vif-plugged:813232fc-0a4b-46b8-8a25-fca191ce3ed1 for instance 96e462d2-f761-41b7-8b26-00fdda3f5846 on nch2-master-1 Jun 25 21:09:13.900655 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3d10bb46-eab5-4e6d-af21-e85d6024e8f8 req-1f2d7714-fd45-4780-815c-aced1608488d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057362 Jun 25 21:09:13.904351 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2299/4191] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:13.948604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:13.949531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:13.980178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:13.983773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:13.987700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:13.988411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:14.151102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:14.172251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:14.182250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:14.190685 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae9429f4-0002-4105-9231-620fb64d1115 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 1.212693 Jun 25 21:09:14.194685 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1893/4192] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:12 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:14.437586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:14.449819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90bf3f2a-84e2-4451-ad23-a5f55f68224e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.542213 Jun 25 21:09:14.450968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2300/4193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:13 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:14.858601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:14.859717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:14.886698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:15.214907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:15.216078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:15.228188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.228685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.229473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.229918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.350741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.360516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.362316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.363833 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3393aa57-71a9-40d9-b2be-e5f7089874f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1284 microversion: 2.42 time: 0.509380 Jun 25 21:09:15.365090 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1894/4194] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:14 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1284 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:15.371967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6382c1ba-1294-4fdf-a128-61effe75c1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-107144174", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5741eca-b932-4865-b29a-bd2a12a73795", "destination_type": "local"}, {"source_type": "volume", "uuid": "03b37d92-ce36-48dc-8227-a4cf921c9c6b", "destination_type": "invalid"}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6382c1ba-1294-4fdf-a128-61effe75c1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 494 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-107144174", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c5741eca-b932-4865-b29a-bd2a12a73795", "destination_type": "local"}, {"source_type": "volume", "uuid": "03b37d92-ce36-48dc-8227-a4cf921c9c6b", "destination_type": "invalid"}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-107144174', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '03b37d92-ce36-48dc-8227-a4cf921c9c6b', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'invalid' Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:15.375366 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jun 25 21:09:15.378577 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:15.380813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6382c1ba-1294-4fdf-a128-61effe75c1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:15.382418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6382c1ba-1294-4fdf-a128-61effe75c1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.015594 Jun 25 21:09:15.383175 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1895/4195] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:15 2022] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:15.393035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:15.393823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:15.407690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.417032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.418637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.419981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.871814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.873534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.889075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.894167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:15.895792 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92c1ce1d-6d56-4097-83d6-edef132eed53 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.687726 Jun 25 21:09:15.906415 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e4d7da52-4bc3-40e8-9a79-2acd3f3597b5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.518840 Jun 25 21:09:15.911173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2301/4196] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:15 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:09:15.914448 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1896/4197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:15 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:15.922152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:15.923068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:15.933057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:15.935703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:15.954023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.957211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.959266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.959726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.960040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.960542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:15.960973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:15.964658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:16.291058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:16.307210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd373884-22b7-48e4-81e3-aa896f9d736c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1315 microversion: 2.1 time: 0.393356 Jun 25 21:09:16.308000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2302/4198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:15 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:16.384149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:16.385104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:16.398033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:16.402389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:16.403347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:16.404239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:16.536061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:16.549461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:16.552357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:16.558554 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2607986f-5714-4545-8ae0-f53413d6364a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1582 microversion: 2.42 time: 0.177471 Jun 25 21:09:16.560722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2303/4199] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:16 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1582 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:16.813548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:16.847155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d4d737a-cb36-4c38-85df-8ea42ccd9b02 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.915343 Jun 25 21:09:16.848228 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1897/4200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:15 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:16.916801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:16.917473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:16.932480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:16.936161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:16.941377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:16.942400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.004894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c17a195-9df7-4a4a-b97e-efeb82c49f76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-256886793", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c17a195-9df7-4a4a-b97e-efeb82c49f76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 491 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-256886793", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-256886793', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jun 25 21:09:17.010492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c17a195-9df7-4a4a-b97e-efeb82c49f76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:17.013290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c17a195-9df7-4a4a-b97e-efeb82c49f76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011424 Jun 25 21:09:17.018939 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1898/4201] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:16 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:17.035369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:17.036018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:17.082775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.083352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.084137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.084629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.626712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:17.642089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:17.646876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:17.651462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c526bed-287d-4e42-8990-4ad7f18f2fa4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.739650 Jun 25 21:09:17.654904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2304/4202] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:16 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:17.668748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:17.670647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:17.689612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.690312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.691276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.693089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.835899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:17.845965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-383c1128-b0f3-4ca0-895c-a24d250ac13b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.825241 Jun 25 21:09:17.850916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1899/4203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:17.866541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:17.867165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:17.879824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.880292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:17.881377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:17.881973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.213882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:18.224830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:18.238492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:18.240588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63313199-0a16-4209-8b7f-aa3d1ad3f92f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1592 microversion: 2.42 time: 0.387632 Jun 25 21:09:18.241392 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1900/4204] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:17 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1592 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:18.246251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:18.246874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:18.259617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.260113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.265544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.265982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.616193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:18.635055 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b899e697-078f-4ea2-9792-8b10eb1826c4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1501 microversion: 2.1 time: 0.977649 Jun 25 21:09:18.635741 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2305/4205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:17 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1501 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:18.663450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:18.664061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:18.682769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.683310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.684145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.703668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.853470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:18.864210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-618e9ed8-5755-40fb-b0bb-665914ee3b3b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.621596 Jun 25 21:09:18.867541 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1901/4206] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:18 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:18.898754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:18.906859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:18.934576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.940478 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-66a16aad-ab87-4cd7-b47f-2f37ead184f2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846/action" status: 202 len: 0 microversion: 2.1 time: 0.291332 Jun 25 21:09:18.941306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.943363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:18.946931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:18.948549 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2306/4207] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:18 2022] POST /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:09:18.970601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:18.977337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:19.001500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:19.003269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:19.010634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:19.012305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:19.698175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:19.708705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d2f4cb80-965f-483d-a9a9-8fa1687430d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1506 microversion: 2.1 time: 0.755935 Jun 25 21:09:19.711057 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2307/4208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:18 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:19.725229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:19.726565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:19.735172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:19.737438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:19.739618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:19.740546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:19.953508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:19.971632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:19.974725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:19.977674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2af868b-dee2-49c8-8b5c-6473d78379be tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1592 microversion: 2.42 time: 0.264312 Jun 25 21:09:19.982698 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2308/4209] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:19 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1592 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:19.993843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52c8a9ae-0448-4415-981a-79b903bc265e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52c8a9ae-0448-4415-981a-79b903bc265e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 416 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:20.001210 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:09:20.003742 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:20.006050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52c8a9ae-0448-4415-981a-79b903bc265e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:20.009682 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52c8a9ae-0448-4415-981a-79b903bc265e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.025533 Jun 25 21:09:20.011414 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2309/4210] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:19 2022] POST /compute/v2.1/servers => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:20.020305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:20.021919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:20.030457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.031560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.032621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.033291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.053045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:20.066987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:20.075003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:20.082940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6df46528-d5bb-4f06-bfec-eff4bc0fe95a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 1.213829 Jun 25 21:09:20.083758 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1902/4211] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:18 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:20.567181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:20.577730 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9249099d-adcc-45d6-aace-a88489cbc1f0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.561938 Jun 25 21:09:20.582911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2310/4212] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:20 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:20.604527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:20.605284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:20.618818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.619625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.620689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.621336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.729325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:20.730528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:20.742378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.743981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.745327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:20.747615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:20.987972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:21.000885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-38426171-2161-4734-9210-8ba7b4469c50 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1486 microversion: 2.1 time: 0.276512 Jun 25 21:09:21.006166 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2311/4213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:20 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1486 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:21.025327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:21.026986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:21.036460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:21.037214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:21.045374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:21.046854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:21.083446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:21.854287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:21.868178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:21.889079 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6acb544-8650-4659-aa79-d8df19a5b9f2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.289066 Jun 25 21:09:21.889652 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1903/4214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:20 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:21.928543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:21.929336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:21.946939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:21.951485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:21.952127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:21.953233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:21.953864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:21.963675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:21.972873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:21.981640 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2e55c55-2912-48c6-9221-a716ca91a753 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1659 microversion: 2.42 time: 0.973579 Jun 25 21:09:21.987325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2312/4215] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:21 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1659 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:22.010985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:22.013401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:22.031195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:22.032741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:22.034678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:22.035345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:22.054203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lazy-loading 'flavor' on Instance uuid 96e462d2-f761-41b7-8b26-00fdda3f5846 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:09:22.749673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:22.769413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:22.773165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:22.778616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-661ec4e0-aa28-4e29-99a8-c521e728d06b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.789973 Jun 25 21:09:22.792810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2313/4216] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:21 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:22.806123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae0c733c-6e1c-47ed-8ff1-3858b97f701e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-865722872", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": -1, "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:22.845863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ae0c733c-6e1c-47ed-8ff1-3858b97f701e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Flavor -1 could not be found. Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae0c733c-6e1c-47ed-8ff1-3858b97f701e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 205 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-865722872", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": -1, "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor -1 could not be found. Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-865722872', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': -1, 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:22.857554 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae0c733c-6e1c-47ed-8ff1-3858b97f701e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae0c733c-6e1c-47ed-8ff1-3858b97f701e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.064019 Jun 25 21:09:22.864549 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2314/4217] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:22 2022] POST /compute/v2.1/servers => generated 73 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:22.870331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:22.870951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:22.903395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:22.905138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:22.910453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:22.911801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:22.956059 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6aea6e06-1045-4004-a77b-9b3f69126863 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846/action" status: 202 len: 0 microversion: 2.1 time: 1.062231 Jun 25 21:09:23.000883 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1904/4218] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:21 2022] POST /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846/action => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:09:23.040934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:23.043984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:23.054367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.055156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.056484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.057077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.234003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:23.246321 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8a32a948-c1b6-43e8-8a8d-dfa6e3551d76 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.380105 Jun 25 21:09:23.246916 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2315/4219] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:22 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:23.274270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:23.284349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:23.305727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.306439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.307477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.309068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.650997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:23.665948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:23.667717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:23.672868 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8acb3c23-01f0-41db-b6ea-ff80f31bfcb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1659 microversion: 2.42 time: 0.413836 Jun 25 21:09:23.673538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2316/4220] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:23 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1659 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:23.681091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:23.685302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:23.699125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.699921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.702181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:23.703888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:23.832930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:24.008207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.024317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfe15023-0354-41ee-a231-29cd64d1273d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.349415 Jun 25 21:09:24.025618 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2317/4221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:23 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:24.033061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:24.034507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:24.043976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.044697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.046534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.047865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.194015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.204185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a7d6f76-af21-466f-a92b-c1b4ec7230b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1492 microversion: 2.1 time: 1.200733 Jun 25 21:09:24.211661 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1905/4222] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:23 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1492 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:24.225425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fe7d842d-e7d5-46c6-8c94-83cb29ea6e56 req-e20a0e80-7c85-4693-8da4-d9a43a920bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "6737e460-a7ee-4d74-a098-b0137bae8d87"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:24.244949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fe7d842d-e7d5-46c6-8c94-83cb29ea6e56 req-e20a0e80-7c85-4693-8da4-d9a43a920bc8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.249114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fe7d842d-e7d5-46c6-8c94-83cb29ea6e56 req-e20a0e80-7c85-4693-8da4-d9a43a920bc8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.279252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fe7d842d-e7d5-46c6-8c94-83cb29ea6e56 req-e20a0e80-7c85-4693-8da4-d9a43a920bc8 service nova] Creating event network-vif-plugged:6737e460-a7ee-4d74-a098-b0137bae8d87 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:24.299899 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fe7d842d-e7d5-46c6-8c94-83cb29ea6e56 req-e20a0e80-7c85-4693-8da4-d9a43a920bc8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086576 Jun 25 21:09:24.304865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1906/4223] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:24.331167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6bc7d704-ab03-4834-a7ab-58ea3f1a8e08 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1802616347", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6bc7d704-ab03-4834-a7ab-58ea3f1a8e08 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 173 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1802616347", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1802616347', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi -1 Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:24.343887 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jun 25 21:09:24.347326 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:24.352671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6bc7d704-ab03-4834-a7ab-58ea3f1a8e08 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:24.355934 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6bc7d704-ab03-4834-a7ab-58ea3f1a8e08 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.049365 Jun 25 21:09:24.359642 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1907/4224] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:24 2022] POST /compute/v2.1/servers => generated 145 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:24.378245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:24.379786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:24.412146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.417788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.425500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.426093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.461425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.495670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.499856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.503454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c25a1ff-4d8c-46b0-9fac-7ab56659ba7c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.476365 Jun 25 21:09:24.506931 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2318/4225] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:24 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:24.694706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:24.695704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:24.710333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.711002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.713631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.714364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.958906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:24.967754 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d4f2d5d-ffdb-41af-94c3-b17d20a6da53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.599028 Jun 25 21:09:24.968359 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1908/4226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:24 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:24.986159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:24.986787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:24.994142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.994794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:24.996525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:24.997127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.310812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:25.326792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:25.328445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:25.336080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e287cc86-37bf-4090-bda5-6a5f1334eb94 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1647 microversion: 2.42 time: 0.647916 Jun 25 21:09:25.337125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2319/4227] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:24 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1647 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:09:25.352225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:25.352963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:25.360112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:25.377457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.377911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.378697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.379138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.382090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:25.391375 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d48e3f7-c9a2-4359-a84a-a33173c413bf tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.409977 Jun 25 21:09:25.397711 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1909/4228] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:24 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:25.525260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:25.525880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:25.537366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.548675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.549811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.550400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.815514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:25.837072 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d676942b-6510-4c6d-a262-91281a34ecb2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1513 microversion: 2.1 time: 0.497938 Jun 25 21:09:25.841462 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2320/4229] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:25 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:25.859877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6396b2e5-94cc-4ed1-a23c-487cb171e756 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730909986", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:25.878457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6396b2e5-94cc-4ed1-a23c-487cb171e756 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6396b2e5-94cc-4ed1-a23c-487cb171e756 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 215 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-730909986", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-730909986', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:25.882379 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jun 25 21:09:25.885443 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:25.889056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6396b2e5-94cc-4ed1-a23c-487cb171e756 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:25.893889 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6396b2e5-94cc-4ed1-a23c-487cb171e756 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.046750 Jun 25 21:09:25.894852 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2321/4230] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:25 2022] POST /compute/v2.1/servers => generated 123 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:25.903376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:25.906765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:25.938625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.939475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:25.947160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:25.948662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.173460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.187851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.189436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.190676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d40c365-3171-4f3b-ace6-865865877a94 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.669522 Jun 25 21:09:26.206690 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1910/4231] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:25 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:26.357897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:26.358586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:26.369968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.370666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.371500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.371949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.541936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.575654 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d92a25b-0caa-41ba-a1da-326c2a30c82b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.676066 Jun 25 21:09:26.588908 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2322/4232] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:25 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:26.626305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4ed889fd-05e9-4cf9-af0d-961473f75b38 req-1d11c3b4-6a0a-490d-884c-a32cfc923871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "febbd08b-81b9-4e73-a726-475aaee4e08b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:26.638505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4ed889fd-05e9-4cf9-af0d-961473f75b38 req-1d11c3b4-6a0a-490d-884c-a32cfc923871 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.641573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4ed889fd-05e9-4cf9-af0d-961473f75b38 req-1d11c3b4-6a0a-490d-884c-a32cfc923871 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.668761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4ed889fd-05e9-4cf9-af0d-961473f75b38 req-1d11c3b4-6a0a-490d-884c-a32cfc923871 service nova] Creating event network-vif-plugged:febbd08b-81b9-4e73-a726-475aaee4e08b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:26.680942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4ed889fd-05e9-4cf9-af0d-961473f75b38 req-1d11c3b4-6a0a-490d-884c-a32cfc923871 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059236 Jun 25 21:09:26.686088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2323/4233] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:09:26.693871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:26.702973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:26.712944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.713879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.715801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.717048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.864320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.872958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:26.881472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.887376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.889960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c1c7bb0-cba7-4ad0-9953-52f611137fff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1693 microversion: 2.42 time: 0.536206 Jun 25 21:09:26.896181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1911/4234] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:26 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1693 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:09:26.908992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:26.909822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:26.926514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.927253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.928233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:26.928864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:26.939043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:26.949871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf306958-c441-4b98-8afe-23c0c7d5e6ac tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.261451 Jun 25 21:09:26.950554 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2324/4235] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:26 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:27.209308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:27.211152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:27.235893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:27.238626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:27.240633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:27.241252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:27.689467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:27.702132 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53db1dbc-afb2-42d6-9b9f-44b0c3135361 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1513 microversion: 2.1 time: 0.800340 Jun 25 21:09:27.702777 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1912/4236] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:26 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1513 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:27.725150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-669462009", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-key-892770162", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:27.748844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:27.775545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:27.782773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:27.786949 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfc50d12-c53d-4188-97a8-6243b9d266af tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.581365 Jun 25 21:09:27.787652 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2325/4237] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:27 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:09:27.856559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] validate_networks() for [('4afca77e-1bb7-4cef-b35e-661d5d7aabe7', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:09:27.912293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:27.912792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:27.927095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:27.927960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:27.930444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:27.933734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:28.133246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:28.146112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:28.148389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:28.149911 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ba877b8-736c-4edd-8265-4a06654d5268 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1739 microversion: 2.42 time: 0.242984 Jun 25 21:09:28.162592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2326/4238] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:27 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:28.714586 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Invalid key_name provided. Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 245 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-669462009", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-key-892770162", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid key_name provided. Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-669462009', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'key_name': 'tempest-key-892770162', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-892770162 not found for user 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:28.719412 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jun 25 21:09:28.722712 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:28.724651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:28.724651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:28.725652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid key_name provided. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:28.729321 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bbf34f85-c74e-4127-ad55-12933925ad53 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.020801 Jun 25 21:09:28.730458 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1913/4239] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:27 2022] POST /compute/v2.1/servers => generated 70 bytes in 1022 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jun 25 21:09:28.740065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:28.741198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:28.741975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-653b3eb4-ad89-494f-b11d-f7f94413c96c req-a7ebab63-3dd3-42b7-808f-2e12f9991c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "7ea183c3-f749-4eb9-8da7-cf65b316e82d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:28.742252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:28.746575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:28.758083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-653b3eb4-ad89-494f-b11d-f7f94413c96c req-a7ebab63-3dd3-42b7-808f-2e12f9991c7a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:28.759282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-653b3eb4-ad89-494f-b11d-f7f94413c96c req-a7ebab63-3dd3-42b7-808f-2e12f9991c7a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:28.779727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-653b3eb4-ad89-494f-b11d-f7f94413c96c req-a7ebab63-3dd3-42b7-808f-2e12f9991c7a service nova] Creating event network-vif-plugged:7ea183c3-f749-4eb9-8da7-cf65b316e82d for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:28.788082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-653b3eb4-ad89-494f-b11d-f7f94413c96c req-a7ebab63-3dd3-42b7-808f-2e12f9991c7a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056145 Jun 25 21:09:28.789247 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1914/4240] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:28.797660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:28.798723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:28.805984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:28.807025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:28.808646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:28.809320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.045622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.058485 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01943397-515d-4bde-96a4-ce46454e949e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1513 microversion: 2.1 time: 0.341190 Jun 25 21:09:29.059632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2327/4241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:28 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:29.065616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:29.067712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:29.078619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.079442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.080562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.081413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.343242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.359350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3f35dbf-42d6-43ab-aa9e-b4286fb6f509 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.566542 Jun 25 21:09:29.361144 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1915/4242] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:28 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:29.369684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:29.377033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:29.396281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.397909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.400529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.402331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.462177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.482709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.487058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.488272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54aa4dff-aa13-44e1-8862-55f7ba22c521 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.427220 Jun 25 21:09:29.491744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2328/4243] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:29 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:29.503587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:29.506441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:29.532924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.533912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.534995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:29.535709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:29.938565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:29.953187 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b04a192f-8911-4c86-a05b-3b20f84f091d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.457904 Jun 25 21:09:29.954379 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2329/4244] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:29 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:30.077328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:30.078204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:30.099470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:30.116649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:30.121487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:30.123732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:30.125406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:30.522984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:30.538629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:30.547598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:30.556438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:30.557245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96660108-bdfd-4c91-a26e-e7f3d107aaca tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.483543 Jun 25 21:09:30.558452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2330/4245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:30 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:30.567991 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8553093-93e0-4872-bb0e-99e3f8de6b3a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1739 microversion: 2.42 time: 1.204410 Jun 25 21:09:30.569701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1916/4246] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:29 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1739 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:30.585775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:30.586734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:30.616054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:30.617411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:30.619031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:30.619470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:30.680440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980318505", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:31.143935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:31.147352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:31.167361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:31.171704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:31.176002 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cab11e50-6edc-47f7-a87e-159d628270b8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.602677 Jun 25 21:09:31.180948 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2331/4247] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:30 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:31.194077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "b3347e88-190a-4637-80a6-61afca27cb1b"}, {"server_uuid": "96e462d2-f761-41b7-8b26-00fdda3f5846", "name": "network-vif-plugged", "status": "completed", "tag": "813232fc-0a4b-46b8-8a25-fca191ce3ed1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:31.219965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.220885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.241756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] Creating event network-vif-plugged:b3347e88-190a-4637-80a6-61afca27cb1b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:31.242790 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] Creating event network-vif-plugged:813232fc-0a4b-46b8-8a25-fca191ce3ed1 for instance 96e462d2-f761-41b7-8b26-00fdda3f5846 on nch2-master-1 Jun 25 21:09:31.256825 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-52578fa9-3eb5-4e16-9777-78de25317ce5 req-9882898a-e1b1-4fef-a8e5-8e5eefa9badb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.074524 Jun 25 21:09:31.257795 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2332/4248] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:31.282639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.security_group_api [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Neutron security group does_not_exist not found {{(pid=137462) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jun 25 21:09:31.284234 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 258 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1980318505", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: exception: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1980318505', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jun 25 21:09:31.331661 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jun 25 21:09:31.336624 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:31.341903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:31.342958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4dfe3f18-1a39-4707-8766-e6ac3850a72f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.668451 Jun 25 21:09:31.354338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1917/4249] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:30 2022] POST /compute/v2.1/servers => generated 106 bytes in 678 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:09:31.354579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:31.355679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:31.371856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.377123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.379441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.381029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.576401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:31.577442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:31.605869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.606369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.607818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.608349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.742562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:31.756534 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4df97074-646c-4da1-9d91-eac34c285dc7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.407357 Jun 25 21:09:31.771594 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2333/4250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:31 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:31.791187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:31.792087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:31.818363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.818955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:31.820014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:31.822842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:32.204352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:32.219740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:32.224365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:32.229886 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e3688cb-3c51-4fc6-ae28-a44454c1a3f8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1785 microversion: 2.42 time: 0.456837 Jun 25 21:09:32.240864 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2334/4251] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:31 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1785 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:32.240864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:32.244705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:32.261109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:32.261568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:32.262372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:32.262789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:32.285445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:32.302960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e88cd264-7201-4ebd-a5be-cd452c1d9d5c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.729787 Jun 25 21:09:32.305318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1918/4252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:31 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:32.317652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:32.319427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:32.353751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:32.357229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:32.361858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:32.362386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:33.186436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:33.209242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:33.211717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:33.214496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3a3e05fd-8235-45af-a698-cd70238559c8 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.908000 Jun 25 21:09:33.225024 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1919/4253] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:32 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:34.018449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:34.029892 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7090e65-72d2-4030-88a7-48fa8b639461 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.797448 Jun 25 21:09:34.038487 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2335/4254] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:34.059636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8eca7791-101f-4d95-98f4-b41a87270c21 tempest-ExtensionsTest-194660060 tempest-ExtensionsTest-194660060-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:34.061496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8eca7791-101f-4d95-98f4-b41a87270c21 tempest-ExtensionsTest-194660060 tempest-ExtensionsTest-194660060-project] 10.222.0.39 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.835020 Jun 25 21:09:34.062226 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1920/4255] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 21:09:33 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:34.071990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:34.082636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:34.083750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:34.098372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:34.119579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:34.126618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:34.130192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:34.133715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:34.137085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:34.144606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:34.148269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:34.153746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:34.731667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:34.742801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:34.752783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:34.754572 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2247da46-454b-4478-8aef-d3c71eaf91ff tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1785 microversion: 2.42 time: 0.714746 Jun 25 21:09:34.763806 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2336/4256] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:34 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1785 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:34.780402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "48c08606-e1db-4c6a-81c5-188382208a7b"}, {"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "83606aab-a9e6-48e1-84e5-271f3f683537"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:34.818529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:34.819345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:34.865070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] Creating event network-vif-plugged:48c08606-e1db-4c6a-81c5-188382208a7b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:34.870379 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] Creating event network-vif-plugged:83606aab-a9e6-48e1-84e5-271f3f683537 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:34.881656 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-33d330f3-ba0d-4dab-9495-55cca8c95306 req-41c87ea0-d8f2-4b1e-8ead-b760ce61c7a0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114822 Jun 25 21:09:34.890499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2337/4257] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:34.896913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:34.907626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 36d017d3-98de-4352-8875-42ef642aa5ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:34.926413 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/36d017d3-98de-4352-8875-42ef642aa5ae HTTP/1.1 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '36d017d3-98de-4352-8875-42ef642aa5ae'} Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:34.933105 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. Jun 25 21:09:34.937308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:34.939095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 36d017d3-98de-4352-8875-42ef642aa5ae could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:34.942385 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64213dd7-9dbd-4a98-a571-b9fa6bb48b5f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/36d017d3-98de-4352-8875-42ef642aa5ae" status: 404 len: 111 microversion: 2.1 time: 0.050097 Jun 25 21:09:34.946756 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2338/4258] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:09:34 2022] DELETE /compute/v2.1/servers/36d017d3-98de-4352-8875-42ef642aa5ae => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:34.963924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e2bc518-8109-4161-a587-48c4b55752c4 tempest-ExtensionsTest-194660060 tempest-ExtensionsTest-194660060-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:34.968196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e2bc518-8109-4161-a587-48c4b55752c4 tempest-ExtensionsTest-194660060 tempest-ExtensionsTest-194660060-project] 10.222.0.39 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.019977 Jun 25 21:09:34.975397 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2339/4259] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:09:34 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:09:34.981038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:35.009993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:35.035839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.039632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:35.040756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.044329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:35.067614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:35.083354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d1dc3c4-f7d0-49e0-a5ed-a31b783521be tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 1.015124 Jun 25 21:09:35.090358 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1921/4260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:34 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:35.095549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:35.110513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:35.136812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.137529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:35.139617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.140770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:35.671997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:35.682336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:35.683758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:35.697214 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f90dc2d-997a-4660-97ef-506abdcbed34 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.717512 Jun 25 21:09:35.697857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2340/4261] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:34 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:35.779549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:35.780806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:35.819272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.819737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:35.829191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:35.829697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.134665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:36.143128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83d29fef-f387-4460-8d87-4fca0089d63a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.051407 Jun 25 21:09:36.147381 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1922/4262] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:35 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:36.155977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:36.158369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:36.174158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.174626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.175414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.175849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.547505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:36.567269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:36.573024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:36.576249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2340a5e9-dca9-4616-9f9a-9445e45d8fbd tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.799430 Jun 25 21:09:36.577395 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2341/4263] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:35 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:36.586068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:36.590764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:36.606276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.609807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.611489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.612491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.885594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:36.902372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ad4af74-93c1-4e63-b0fb-71c4b3f4e502 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.321009 Jun 25 21:09:36.905086 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2342/4264] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:36 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:36.913566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:36.914554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:36.936236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.937148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:36.938281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:36.939024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:37.081505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:37.091219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8dcf24ec-802a-4004-a0af-018f026b42ee tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.941688 Jun 25 21:09:37.097159 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1923/4265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:36 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:37.108645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:37.119689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Failed to fetch instance by id 9223372036854775808 {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:09:37.124688 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 9223372036854775808 could not be found. Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '9223372036854775808'} Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:37.127962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:37.131876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:37.131876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:37.131876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:37.131876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jun 25 21:09:37.131876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:37.136397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:37.137598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d4d24e2a-6df6-4a2c-a33f-51662d1f3f3f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.038613 Jun 25 21:09:37.142564 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1924/4266] 10.222.0.39 () {58 vars in 1187 bytes} [Sat Jun 25 21:09:37 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:09:37.156331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:37.164972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:37.174725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:37.175510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:37.176523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:37.177418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:37.353764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:37.375534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:37.378818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:37.380177 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bcea4071-8d45-4cc3-95eb-c39937278ecd tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.473562 Jun 25 21:09:37.383990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2343/4267] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:36 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:37.396739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9533799b-bd09-43f2-9676-4933714d23b1 req-eb7d9b9f-b311-40fb-b857-df2c2a4fefb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-plugged", "status": "completed", "tag": "613f1347-eaa6-452c-91db-c7556e0d2b78"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:37.411320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9533799b-bd09-43f2-9676-4933714d23b1 req-eb7d9b9f-b311-40fb-b857-df2c2a4fefb3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:37.412219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9533799b-bd09-43f2-9676-4933714d23b1 req-eb7d9b9f-b311-40fb-b857-df2c2a4fefb3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:37.435280 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9533799b-bd09-43f2-9676-4933714d23b1 req-eb7d9b9f-b311-40fb-b857-df2c2a4fefb3 service nova] Creating event network-vif-plugged:613f1347-eaa6-452c-91db-c7556e0d2b78 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:37.444053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9533799b-bd09-43f2-9676-4933714d23b1 req-eb7d9b9f-b311-40fb-b857-df2c2a4fefb3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055804 Jun 25 21:09:37.446422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2344/4268] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:37.598444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:37.599198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:37.614565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:37.615299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:37.618159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:37.625934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:38.005363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:38.017842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:38.020548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:38.023003 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ae0c71c-e066-4255-94c9-d6b8c4d1889d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.429461 Jun 25 21:09:38.024438 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2345/4269] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:37 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:38.113877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:38.114570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:38.124536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:38.124996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:38.125781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:38.126221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:38.527724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:38.537276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a88d3ca3-6105-408a-a16d-38116190e768 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.427992 Jun 25 21:09:38.546471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2346/4270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:38 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:38.575712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:38.585349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:38.607647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:38.608250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:38.608940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:38.609382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:38.997082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.014593 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b0756b0-0cc8-4788-8887-d61f46c809e4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.867628 Jun 25 21:09:39.020567 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1925/4271] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:37 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:39.037270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:39.041113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:39.061221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.061713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.066227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.066885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.201184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.214599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.216307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.217718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28b1884c-a4e2-43e8-8122-773b0b71605c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1879 microversion: 2.32 time: 0.667160 Jun 25 21:09:39.218800 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2347/4272] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:38 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1879 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:39.226382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:39.237571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:39.252244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.258416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.265671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.266341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.549898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.561813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.563720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.565595 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1d7a2e5b-eaec-4127-ac0f-3a1fabfde418 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.345457 Jun 25 21:09:39.566886 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2348/4273] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:39 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:39.571972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:39.572756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:39.580344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.580984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.582001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.582574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.874868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.883693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:39.888105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0950b55c-2ae5-4201-bce2-2b523d385e16 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.319666 Jun 25 21:09:39.888741 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2349/4274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:39 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:39.897324 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d236200-cfb0-4983-a7e9-61f779916f6f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.864542 Jun 25 21:09:39.900293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1926/4275] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:39 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:39.924962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:39.925461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Failed to fetch instance by id -1 {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:09:39.926069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance -1 could not be found. Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance -1 could not be found. Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '-1'} Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:39.927679 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance -1 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ffc7a182-5cb9-4d26-abe6-d8a6a7639426 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.012134 Jun 25 21:09:39.934186 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2350/4276] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:09:39 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:09:39.940996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:39.941617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:39.951356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.952052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:39.958397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:39.959948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:40.239079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:40.239880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:40.252823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:40.254010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:40.258714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:40.260529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.029683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.039480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.048582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.049928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21c1c70f-f147-42a6-a519-a01907b0932c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2831 microversion: 2.32 time: 0.816971 Jun 25 21:09:41.055090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2351/4277] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:40 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2831 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:41.067819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:41.073266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:41.087368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.088476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.090404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.092753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.313723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.327989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b85fdc2e-0656-41c6-92a6-fb150164bca8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.392406 Jun 25 21:09:41.331104 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1927/4278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:39 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:41.345910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:41.347021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:41.357504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.357982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.359815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.360385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.837765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.871744 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-086c5c42-5368-41a8-b173-00cdb56c475a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.528176 Jun 25 21:09:41.872406 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1928/4279] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:41 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:41.893043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:41.901939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:41.911451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.912369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.913587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:41.914742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:41.923653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.937449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.947674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:41.949311 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84d83d95-dfe6-4b3b-8491-48b960f03679 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.893185 Jun 25 21:09:41.950091 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2352/4280] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:41 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:41.991834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:41.994039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:42.025738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.026272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.033846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.035114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.076475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:42.260603 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-462e0146-b355-4597-b6d0-a371339c570a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.380931 Jun 25 21:09:42.262523 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1929/4281] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:09:41 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2/os-interface => generated 1830 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:42.294255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:42.305548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d64b5826-7315-4969-aece-9044f24aeb28 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.353670 Jun 25 21:09:42.306345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2353/4282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:41 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:42.324358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:42.324960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 182a6dde-d036-4424-bd46-fd043af748cd] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:42.337360 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/182a6dde-d036-4424-bd46-fd043af748cd/action HTTP/1.1 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 19 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: {"forceDelete": {}} Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '182a6dde-d036-4424-bd46-fd043af748cd', 'body': {'forceDelete': {}}} Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:42.349922 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 182a6dde-d036-4424-bd46-fd043af748cd could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:42.353898 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9dec3444-19b7-4308-ad84-75c742f9e77b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/182a6dde-d036-4424-bd46-fd043af748cd/action" status: 404 len: 111 microversion: 2.1 time: 0.033380 Jun 25 21:09:42.358075 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1930/4283] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:42 2022] POST /compute/v2.1/servers/182a6dde-d036-4424-bd46-fd043af748cd/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:42.362401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:42.363110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:42.372815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.378988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.380600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.381117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.708118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a13d081c-84c2-42fe-b80f-dbd0cc986d31 req-43a00fa4-0543-4454-b3f9-6877ca12966a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "ad635ecf-1213-4110-bff9-f73db63dd9ca"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:42.739324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a13d081c-84c2-42fe-b80f-dbd0cc986d31 req-43a00fa4-0543-4454-b3f9-6877ca12966a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.745732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a13d081c-84c2-42fe-b80f-dbd0cc986d31 req-43a00fa4-0543-4454-b3f9-6877ca12966a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.748695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:42.776349 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7a08232-bafc-4b5c-a6f3-fc6635119ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.418251 Jun 25 21:09:42.781861 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2354/4284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:42 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:42.795500 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a13d081c-84c2-42fe-b80f-dbd0cc986d31 req-43a00fa4-0543-4454-b3f9-6877ca12966a service nova] Creating event network-changed:ad635ecf-1213-4110-bff9-f73db63dd9ca for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:09:42.805241 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a13d081c-84c2-42fe-b80f-dbd0cc986d31 req-43a00fa4-0543-4454-b3f9-6877ca12966a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102664 Jun 25 21:09:42.813505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:42.814452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:42.824781 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1931/4285] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:42.830526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.831401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.833677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.835032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.891599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:42.892725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:42.910718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.911894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:42.913018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:42.915095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:43.403695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:43.425747 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b128bc7-5e19-4079-a2d3-1143f6837042 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.622701 Jun 25 21:09:43.437538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2355/4286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:42 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:43.443711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:43.449773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:43.461602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:43.462362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:43.464205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:43.464730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:43.765446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:43.788740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:43.791605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:43.794099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-839e33a7-132d-4e13-8b84-83d9bd2a192f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.358327 Jun 25 21:09:43.794894 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2356/4287] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:43 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:43.801659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:43.803328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 0e962e9c-f02e-4267-b652-b1c98a091833] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:43.812088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/0e962e9c-f02e-4267-b652-b1c98a091833/action HTTP/1.1 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 39 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: {"os-getConsoleOutput": {"length": 10}} Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '0e962e9c-f02e-4267-b652-b1c98a091833', 'body': {'os-getConsoleOutput': {'length': 10}}} Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:43.817606 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 0e962e9c-f02e-4267-b652-b1c98a091833 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:43.821367 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32c05957-d67b-4139-ba88-ed7cd6f198f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/0e962e9c-f02e-4267-b652-b1c98a091833/action" status: 404 len: 111 microversion: 2.1 time: 0.023199 Jun 25 21:09:43.823574 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2357/4288] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:43 2022] POST /compute/v2.1/servers/0e962e9c-f02e-4267-b652-b1c98a091833/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:43.829736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:43.830347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:43.839875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:43.840537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:43.841409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:43.841980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.028710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:44.038632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de8911d3-7015-4002-b3d8-2618d7e86aa4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.213614 Jun 25 21:09:44.039959 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2358/4289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:43 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:44.063049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:44.064208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:44.072224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.073118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.074220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.074872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.291498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:44.308244 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0d976ab-9f4f-4039-95c6-7f0acf9d86c4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.249655 Jun 25 21:09:44.308904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2359/4290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:44.327753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:44.328385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 08806a41-2a57-4189-9687-c62aa3dea5d4] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:44.334598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/08806a41-2a57-4189-9687-c62aa3dea5d4 HTTP/1.1 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '08806a41-2a57-4189-9687-c62aa3dea5d4'} Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:44.336121 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 08806a41-2a57-4189-9687-c62aa3dea5d4 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:44.340358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b1d4209-0a5f-4426-a378-d56c8a2c9ffa tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/08806a41-2a57-4189-9687-c62aa3dea5d4" status: 404 len: 111 microversion: 2.1 time: 0.013909 Jun 25 21:09:44.341772 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2360/4291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:44 2022] GET /compute/v2.1/servers/08806a41-2a57-4189-9687-c62aa3dea5d4 => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:44.346708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:44.347322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:44.362946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.363412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.365060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.365515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.567552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:44.579405 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c0d4ee1-e409-46cf-b34b-f5c70986efd9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.236437 Jun 25 21:09:44.580343 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2361/4292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:44.605085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:44.606203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:44.629818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.630443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.631356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:44.633363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:44.955920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:44.970261 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c602ea6-7b72-4abb-999c-12d992966b13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.376008 Jun 25 21:09:44.973490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2362/4293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:44.988777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:44.989580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:45.000939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:45.001503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:45.002601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:45.003624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:45.139456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:45.150424 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b497ad2-2229-4f0f-9720-982d03d3f8d1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 2.263443 Jun 25 21:09:45.151018 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1932/4294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:42 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:45.278953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef3db1b6-5852-455f-aaf1-1f952a66e001 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1922996300", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef3db1b6-5852-455f-aaf1-1f952a66e001 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 238 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1922996300", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1922996300', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:45.282731 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jun 25 21:09:45.286594 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:45.293314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef3db1b6-5852-455f-aaf1-1f952a66e001 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:45.294534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef3db1b6-5852-455f-aaf1-1f952a66e001 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021670 Jun 25 21:09:45.295617 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1933/4295] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:45.308542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:45.313469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:45.325200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=70 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:45.329351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:45.333261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:45.334317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:45.334937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:45.603005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:45.621635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:45.624816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:45.626359 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a555dd26-bb35-4078-b54b-5578e916b6ca tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1831 microversion: 2.42 time: 0.651554 Jun 25 21:09:45.627542 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2363/4296] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:44 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1831 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:45.935610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:45.969696 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd57d2b8-85d2-4596-a4e9-8cf44c6b8d4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.669839 Jun 25 21:09:45.971125 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1934/4297] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:45 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:45.989412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:45.989614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:46.001814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:46.002264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:46.003042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:46.003486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:46.167675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:46.168296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:46.193666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:46.197548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:46.202101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:46.210727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:46.431256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:46.442599 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07e2f643-6273-4d2b-91c8-eb9f9d5ba87f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.456426 Jun 25 21:09:46.444718 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2364/4298] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:45 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:47.011251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:47.027658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e76867c-bcc8-4ea1-9719-44e8b4985a4e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.861443 Jun 25 21:09:47.028668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1935/4299] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:46 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:47.041453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:47.042273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:47.058506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:47.059204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:47.061338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:47.063387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:47.076940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:47.188964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4580367d-d901-4f07-a325-9af1148a0e2e tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Action: 'create', calling method: .version_select at 0x7f984efa3f70>, body: {"keypair": {"name": "tempest-keypair-1127793342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPMZH4AIwv2o/Q6ji5oZg+rrfSJI50Sv88ICQ+CwISeeXEEIjAW19uSc1HZvBD5KwtmJU+DhpkU4UVWfFzbIqozsBH0tJd6Spapud1BTn+6YVgnaYokk5/KO8gfao2a3g=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:47.248064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4580367d-d901-4f07-a325-9af1148a0e2e tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:09:47.269229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-4580367d-d901-4f07-a325-9af1148a0e2e tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for user bee65f1c37764bdb9985b4e96a97ce9e and project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:09:47.361389 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4580367d-d901-4f07-a325-9af1148a0e2e tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.915149 Jun 25 21:09:47.362581 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2365/4300] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:09:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:47.377069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36ae5745-354a-4896-aca1-355977c6ad88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-399934448", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36ae5745-354a-4896-aca1-355977c6ad88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 234 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-399934448", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-399934448', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = func(instance) Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi 'notvalid' Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:47.410123 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jun 25 21:09:47.415907 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:09:47.425773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36ae5745-354a-4896-aca1-355977c6ad88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:47.430354 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36ae5745-354a-4896-aca1-355977c6ad88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.066531 Jun 25 21:09:47.436958 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2366/4301] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:47 2022] POST /compute/v2.1/servers => generated 133 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:09:47.448881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:47.449792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:47.459665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:47.460545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:47.461750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:47.463647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.025935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:48.058173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:48.067720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:48.070369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:48.072602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccb669fd-261c-45f8-9143-8d172aa3ab51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.628814 Jun 25 21:09:48.072739 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f1fa08be-dc8b-461d-b195-bbbfd6f5c527 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1852 microversion: 2.42 time: 1.041388 Jun 25 21:09:48.074003 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1936/4302] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:47 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1852 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:48.076235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2367/4303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:47 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:48.081434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:48.091013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:48.097417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-60fff15e-e7ec-4a7b-ade5-c7e8e5cf26fd req-4df5673b-c3bc-42b1-b928-43fdfb35a9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "662e8a6c-11c8-477b-9a5c-2994b7f2ebd5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:48.108135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-60fff15e-e7ec-4a7b-ade5-c7e8e5cf26fd req-4df5673b-c3bc-42b1-b928-43fdfb35a9d6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:48.108902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-60fff15e-e7ec-4a7b-ade5-c7e8e5cf26fd req-4df5673b-c3bc-42b1-b928-43fdfb35a9d6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.115168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:48.120159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.123249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:48.123883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.125123 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-60fff15e-e7ec-4a7b-ade5-c7e8e5cf26fd req-4df5673b-c3bc-42b1-b928-43fdfb35a9d6 service nova] Creating event network-changed:662e8a6c-11c8-477b-9a5c-2994b7f2ebd5 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:09:48.130813 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-60fff15e-e7ec-4a7b-ade5-c7e8e5cf26fd req-4df5673b-c3bc-42b1-b928-43fdfb35a9d6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055337 Jun 25 21:09:48.131744 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1937/4304] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:48.137423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:48.138991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:48.158639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:48.159359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.160295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:48.161200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:48.921612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:48.944135 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0762fa8a-c4e3-45dd-94ef-5434ad1b8e51 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.804321 Jun 25 21:09:48.948264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1938/4305] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:48 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:48.976019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:48.977290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: dcac04f1-8460-4bbc-8779-6a9903e1b473] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:49.015501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/dcac04f1-8460-4bbc-8779-6a9903e1b473/action HTTP/1.1 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 13 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: {"pause": {}} Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'dcac04f1-8460-4bbc-8779-6a9903e1b473', 'body': {'pause': {}}} Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:49.029361 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance dcac04f1-8460-4bbc-8779-6a9903e1b473 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:49.033261 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8535f1da-0cd4-446e-9049-3320a08ec45d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/dcac04f1-8460-4bbc-8779-6a9903e1b473/action" status: 404 len: 111 microversion: 2.1 time: 0.071058 Jun 25 21:09:49.038672 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1939/4306] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:48 2022] POST /compute/v2.1/servers/dcac04f1-8460-4bbc-8779-6a9903e1b473/action => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:09:49.057526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:49.067616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:49.082777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:49.084792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:49.089306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:49.091044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:49.482877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:49.523347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc0b6513-ba07-4253-bd38-5e382bc891cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 1.445682 Jun 25 21:09:49.529131 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2368/4307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:48 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:49.546928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:49.547821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:49.576636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:49.579734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:49.580851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:49.581563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:50.583231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:50.606840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2bae7531-9a53-467f-a1a0-18d2ea18ea60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.555815 Jun 25 21:09:50.624568 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1940/4308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:49 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:50.634378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:50.635032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:50.653230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:50.653969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:50.660791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:50.662021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:51.272831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:51.282574 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b84f7d7-6c97-429e-a0d9-4c54a4af7ffb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.656722 Jun 25 21:09:51.283187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1941/4309] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:50 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:51.322843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:51.323757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:51.347389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:51.348304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:51.351038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:51.353828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:51.690159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:51.772396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:51.779941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:51.803455 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e7e0c62-3f8c-4a30-9ef2-130f96cbc71a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 2.269617 Jun 25 21:09:51.806057 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2369/4310] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:49 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:51.822795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d20e696c-5215-4d6e-9f9c-b72bb2d31023 req-5c69dc48-20a8-4713-80f0-17a870a697b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "tag": "febbd08b-81b9-4e73-a726-475aaee4e08b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:51.850266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d20e696c-5215-4d6e-9f9c-b72bb2d31023 req-5c69dc48-20a8-4713-80f0-17a870a697b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:51.851044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d20e696c-5215-4d6e-9f9c-b72bb2d31023 req-5c69dc48-20a8-4713-80f0-17a870a697b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:51.872873 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d20e696c-5215-4d6e-9f9c-b72bb2d31023 req-5c69dc48-20a8-4713-80f0-17a870a697b5 service nova] Creating event network-changed:febbd08b-81b9-4e73-a726-475aaee4e08b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:09:51.884891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d20e696c-5215-4d6e-9f9c-b72bb2d31023 req-5c69dc48-20a8-4713-80f0-17a870a697b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074606 Jun 25 21:09:51.886043 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2370/4311] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:52.264252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:52.288702 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-062caddf-cfc8-4ed8-bcee-1592ffdf3b60 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.994177 Jun 25 21:09:52.314040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:52.315256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:52.322350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1942/4312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:51 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:52.369580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.373817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:52.374603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:52.375833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.376946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:52.377571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:52.439016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.451491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:52.455266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.459740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:52.650095 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23581f24-d0d6-4147-948f-a97907a2f500 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.324382 Jun 25 21:09:52.655272 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1943/4313] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:52 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:09:52.676988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:52.679959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:52.724572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.727361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:52.730283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:52.730740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:53.650366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:53.678745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ff34ece-8575-494b-9d94-44cf5a9a40ce tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 1.359091 Jun 25 21:09:53.682365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2371/4314] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:52 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:53.698053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:53.709766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:53.729039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:53.743029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:53.745897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:53.748013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:54.271891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:54.284917 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0fc696fa-a507-4604-90c9-612b7ac7241b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1510 microversion: 2.1 time: 1.624395 Jun 25 21:09:54.287025 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1944/4315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:52 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1510 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:54.303152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c51fba2c-f932-49f6-8b32-6e718c3c52de req-c30f1ce4-9969-461a-93e7-c536fd7382e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "2df6d7a0-8189-45ee-a287-e11964e1391b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:54.322955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c51fba2c-f932-49f6-8b32-6e718c3c52de req-c30f1ce4-9969-461a-93e7-c536fd7382e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:54.323787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c51fba2c-f932-49f6-8b32-6e718c3c52de req-c30f1ce4-9969-461a-93e7-c536fd7382e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:54.374309 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c51fba2c-f932-49f6-8b32-6e718c3c52de req-c30f1ce4-9969-461a-93e7-c536fd7382e6 service nova] Creating event network-changed:2df6d7a0-8189-45ee-a287-e11964e1391b for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:09:54.398064 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c51fba2c-f932-49f6-8b32-6e718c3c52de req-c30f1ce4-9969-461a-93e7-c536fd7382e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105284 Jun 25 21:09:54.402521 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1945/4316] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:54.699095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:54.699968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:54.730662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:54.731500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:54.733314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:54.737085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:54.841515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:54.852867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:54.858942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:54.872715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c5b0d4d6-847a-4e5d-8f11-0fa4acfcf6ed tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 1.170222 Jun 25 21:09:54.892000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2372/4317] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:53 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:55.305931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:55.307017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:55.318845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.324068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.327249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.329953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.402604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:55.411726 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e051dcb-8fbf-4ba1-a660-517c4877e4d2 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.718491 Jun 25 21:09:55.421472 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1946/4318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:54 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:55.732655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:55.741240 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d520589e-9400-4abd-9517-d26dd4aa19d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1490 microversion: 2.1 time: 0.440911 Jun 25 21:09:55.741783 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2373/4319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:55 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1490 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:09:55.764033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:55.764033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:55.771509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.785961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.788348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.795729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.887909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'pause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state paused Jun 25 21:09:55.900180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:55.900813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 13 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: {"pause": {}} Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'pause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state paused Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'pause': {}}} Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state paused. Cannot pause while the instance is in this state. Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state paused Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:09:55.900945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:09:55.905943 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:09:55.905943 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:09:55.905943 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:09:55.905943 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state paused Jun 25 21:09:55.905943 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:09:55.909372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'pause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state paused {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:09:55.911401 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bd3f658-332f-40a7-bd9c-512d5e7e8ea9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 143 microversion: 2.1 time: 0.156180 Jun 25 21:09:55.916281 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1947/4320] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:55 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 143 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:09:55.922606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.923081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.929763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.941304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:55.945546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:55.960251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.970138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.970609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:55.971407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:55.971849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.189997 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32d4de97-bc26-4107-9685-21bec8a44272 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.265386 Jun 25 21:09:56.194892 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1948/4321] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:09:55 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:09:56.217834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:56.222025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:56.244267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:56.245427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.247340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:56.249360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.666075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:56.669123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:56.678392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:56.679965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:56.688056 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-519fe574-d7d6-4645-b430-9bf522fd8797 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.789492 Jun 25 21:09:56.705612 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2374/4322] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:55 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:56.712083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:56.717542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:56.722464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:56.725472 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-24781720-ffaa-4fe4-92af-c5159ff45ac4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1497 microversion: 2.1 time: 0.523359 Jun 25 21:09:56.726400 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1949/4323] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:56 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1497 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:56.736390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:56.739391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-b37080c6-65cc-46e7-9f27-20c4cedfc069 req-39520b2a-3eca-4479-af17-a4cde8db1cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "54514947-c78f-4902-a825-cefd7ad64e30"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:56.740093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.741127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:56.741713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.755076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b37080c6-65cc-46e7-9f27-20c4cedfc069 req-39520b2a-3eca-4479-af17-a4cde8db1cdb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:56.755536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-b37080c6-65cc-46e7-9f27-20c4cedfc069 req-39520b2a-3eca-4479-af17-a4cde8db1cdb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:56.790432 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-b37080c6-65cc-46e7-9f27-20c4cedfc069 req-39520b2a-3eca-4479-af17-a4cde8db1cdb service nova] Creating event network-changed:54514947-c78f-4902-a825-cefd7ad64e30 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:09:56.804577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-b37080c6-65cc-46e7-9f27-20c4cedfc069 req-39520b2a-3eca-4479-af17-a4cde8db1cdb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075303 Jun 25 21:09:56.805686 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1950/4324] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:57.302197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:57.487923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-304672309", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "e0807ea8-6ee2-40b3-84d6-c56b282dcd8c"}], "security_groups": [{"name": "tempest-securitygroup--284017797"}], "key_name": "tempest-keypair-1127793342", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:57.826435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:57.838221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc3583e2-04aa-46d9-8607-f929bace6111 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 1.130848 Jun 25 21:09:57.842636 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2375/4325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:56 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:57.854001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:57.856350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:57.872685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:57.874039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:57.877109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:57.879086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:57.951024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] validate_networks() for [('e0807ea8-6ee2-40b3-84d6-c56b282dcd8c', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:09:58.858633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:58.901976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:58.908559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:58.912147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-806408a5-01c5-474b-979d-89a5a2a1e250 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 1.068077 Jun 25 21:09:58.916042 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2376/4326] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:09:57 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:09:58.938354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:58.939106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:58.952246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:58.953461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:58.954754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:58.955402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:59.281597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:59.298021 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17d8a1df-bff3-4e24-b962-70916c084579 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.377562 Jun 25 21:09:59.298934 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2377/4327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:58 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:59.308099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:59.310638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:59.316743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:09:59.326086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:59.326986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:59.328059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:59.328745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:59.749308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:09:59.767471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cfc11648-a4d9-498b-b298-b70f8cc9d94f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1508 microversion: 2.1 time: 0.458440 Jun 25 21:09:59.783016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2378/4328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:59 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1508 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:09:59.802363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-10091d09-2e4a-4435-8461-c7a2684af288 req-1ed21e1f-68d8-4dd6-9324-df3ed6ff68df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "15049829-d7b6-48d4-95ad-10d35343c6bc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:09:59.878585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-10091d09-2e4a-4435-8461-c7a2684af288 req-1ed21e1f-68d8-4dd6-9324-df3ed6ff68df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:59.879389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-10091d09-2e4a-4435-8461-c7a2684af288 req-1ed21e1f-68d8-4dd6-9324-df3ed6ff68df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:59.899359 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-10091d09-2e4a-4435-8461-c7a2684af288 req-1ed21e1f-68d8-4dd6-9324-df3ed6ff68df service nova] Creating event network-changed:15049829-d7b6-48d4-95ad-10d35343c6bc for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:09:59.908383 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-10091d09-2e4a-4435-8461-c7a2684af288 req-1ed21e1f-68d8-4dd6-9324-df3ed6ff68df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123962 Jun 25 21:09:59.949862 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2379/4329] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:09:59.962070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:09:59.963162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:09:59.980718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:59.985478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:09:59.986419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:09:59.988483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.593895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:10:00.595003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:10:00.595540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:10:00.596020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:10:00.596733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:10:00.636140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.654052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.676027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.678552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.748774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:10:00.760859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for user bee65f1c37764bdb9985b4e96a97ce9e and project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:10:00.782867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:10:00.787448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:10:00.817117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:00.836910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3d57485-6eb7-454f-9b43-dddfb85f6905 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.885064 Jun 25 21:10:00.848358 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2380/4330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:09:59 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:00.853519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:00.854349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:00.870831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.871290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.872080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.878674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.895463 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13667a97-ee43-43f0-8d6c-18720de44e4b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.408126 Jun 25 21:10:00.903359 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1951/4331] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:09:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 3422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:10:00.918470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:00.920996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:00.938330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.939438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:00.940852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:00.942462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:01.533423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:01.550207 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e41c43a-2db0-4e83-960e-d1b48dc62739 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1505 microversion: 2.1 time: 0.642318 Jun 25 21:10:01.551073 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1952/4332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:00 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1505 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:01.580141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:01.583550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:01.606624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:01.607291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:01.609446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:01.620104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:01.654471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action HTTP/1.1 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 28 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: {"reboot": {"type": "SOFT"}} Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1a9a653b-3c16-444c-be5d-92d54ae6cab7', 'body': {'reboot': {'type': 'SOFT'}}} Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:01.659496 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:01.665228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:01.666296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7645e65c-c7de-48a1-8fc1-c32d2808fc14 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action" status: 404 len: 111 microversion: 2.1 time: 0.112727 Jun 25 21:10:01.667706 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1953/4333] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:01 2022] POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:01.679502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b4923416-952d-4992-89df-7168276ec29c tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:01.680148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b4923416-952d-4992-89df-7168276ec29c tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:01.791664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b4923416-952d-4992-89df-7168276ec29c tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:01.808471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b4923416-952d-4992-89df-7168276ec29c tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1241 microversion: 2.1 time: 0.139078 Jun 25 21:10:01.809715 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1954/4334] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:01 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1241 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:01.820152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:01.822037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:01.832793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:01.833640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:01.834617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:01.835798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.186805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:02.204514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:02.208826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:02.213639 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-555a3260-22c7-4fe0-85d8-29e32d875e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 1.360873 Jun 25 21:10:02.214574 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2381/4335] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:00 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:02.228648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a847f6ae-248b-4f21-a77e-fe03c0fda918 req-bed20465-1e5a-4193-afae-8aba5beb3a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "13deb6b0-1f80-429a-ba4c-9fa21b1c1903"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:02.251269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a847f6ae-248b-4f21-a77e-fe03c0fda918 req-bed20465-1e5a-4193-afae-8aba5beb3a13 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:02.251820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a847f6ae-248b-4f21-a77e-fe03c0fda918 req-bed20465-1e5a-4193-afae-8aba5beb3a13 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.286327 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a847f6ae-248b-4f21-a77e-fe03c0fda918 req-bed20465-1e5a-4193-afae-8aba5beb3a13 service nova] Creating event network-changed:13deb6b0-1f80-429a-ba4c-9fa21b1c1903 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:02.293863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a847f6ae-248b-4f21-a77e-fe03c0fda918 req-bed20465-1e5a-4193-afae-8aba5beb3a13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077118 Jun 25 21:10:02.294496 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2382/4336] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:02.325249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:02.335474 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4bdf459d-6d20-492c-8249-23aaa78b9276 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.524480 Jun 25 21:10:02.340247 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1955/4337] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:01 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:02.359635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:02.360355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:02.369541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:02.369995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.370787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:02.371230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.571027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:02.571640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:02.590902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:02.599488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.609766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:02.611109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:02.649259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:03.012280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.024750 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f30c6e82-edb1-4cbe-8343-449909520651 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.669499 Jun 25 21:10:03.025316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2383/4338] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:02 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:03.032878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:03.041624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:03.075632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.076103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.077015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.077656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.219726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.231058 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e1c0818-cc75-429e-9b89-45403d2ce0aa tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1299 microversion: 2.1 time: 0.201925 Jun 25 21:10:03.233401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2384/4339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:03 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:03.242531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:03.249311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 680744b4-4b18-4fb7-9e49-871465c9c68c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:03.263689 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/680744b4-4b18-4fb7-9e49-871465c9c68c/action HTTP/1.1 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 28 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: {"reboot": {"type": "SOFT"}} Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '680744b4-4b18-4fb7-9e49-871465c9c68c', 'body': {'reboot': {'type': 'SOFT'}}} Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. Jun 25 21:10:03.268353 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. Jun 25 21:10:03.273083 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:03.275791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 680744b4-4b18-4fb7-9e49-871465c9c68c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:03.279920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-043318f8-4e5d-43f1-8211-b752d51379fd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/680744b4-4b18-4fb7-9e49-871465c9c68c/action" status: 404 len: 111 microversion: 2.1 time: 0.044369 Jun 25 21:10:03.280712 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2385/4340] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:03 2022] POST /compute/v2.1/servers/680744b4-4b18-4fb7-9e49-871465c9c68c/action => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:03.297111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:03.297987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:03.307051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.323868 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2957d20-5840-4a55-92f8-94d6b4f1f6dc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1505 microversion: 2.1 time: 0.758373 Jun 25 21:10:03.326639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1956/4341] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:02 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1505 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:03.330013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.330640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.332296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.332792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.345013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:03.348782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:03.366405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.367196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.368198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.369109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.811855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.840033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.846107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.847950 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-52721d62-fc95-49e1-a88c-cb1183ce23f0 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.561817 Jun 25 21:10:03.863735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2386/4342] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:03 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:03.883382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-148d2157-cc11-4e02-b1b6-d1856c9a0e3a req-932edf12-25dc-4091-b7c0-30e6811269e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e462d2-f761-41b7-8b26-00fdda3f5846", "name": "network-vif-unplugged", "status": "completed", "tag": "813232fc-0a4b-46b8-8a25-fca191ce3ed1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:03.895812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-148d2157-cc11-4e02-b1b6-d1856c9a0e3a req-932edf12-25dc-4091-b7c0-30e6811269e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.896900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-148d2157-cc11-4e02-b1b6-d1856c9a0e3a req-932edf12-25dc-4091-b7c0-30e6811269e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.905380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:03.910840 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-148d2157-cc11-4e02-b1b6-d1856c9a0e3a req-932edf12-25dc-4091-b7c0-30e6811269e2 service nova] Creating event network-vif-unplugged:813232fc-0a4b-46b8-8a25-fca191ce3ed1 for instance 96e462d2-f761-41b7-8b26-00fdda3f5846 on nch2-master-1 Jun 25 21:10:03.915925 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-efd712d7-2a14-4874-aa7f-c9ca4c104f13 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.587598 Jun 25 21:10:03.916540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1957/4343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:03 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:03.931049 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-148d2157-cc11-4e02-b1b6-d1856c9a0e3a req-932edf12-25dc-4091-b7c0-30e6811269e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064348 Jun 25 21:10:03.932332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2387/4344] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:03.938326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:03.939120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:03.947157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.947692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:03.949582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:03.950691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.277446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:04.286801 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf9fb652-48bc-4d0d-a285-31fa98454d5b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.352963 Jun 25 21:10:04.297596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2388/4345] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:03 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:04.306924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:04.307787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:04.315031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.315742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.318661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.321071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.484370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:04.499509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da76ab76-db98-400d-82e1-a9efb29e2b8a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1299 microversion: 2.1 time: 0.198531 Jun 25 21:10:04.500134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2389/4346] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:04 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1299 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:04.521275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:04.526516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:04.560019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.560813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.561786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.562396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.609820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action HTTP/1.1 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 65 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1a9a653b-3c16-444c-be5d-92d54ae6cab7', 'body': {'rebuild': {'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795'}}} Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 25 21:10:04.613201 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:10:04.617039 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:04.619819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:04.620948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb788f46-1969-4918-8ca0-1db22a8bec1c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action" status: 404 len: 111 microversion: 2.1 time: 0.113675 Jun 25 21:10:04.628304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac444a4f-1036-4b58-8cbf-9057845d33d1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: .version_select at 0x7f984f65a3a0>, body: {"keypair": {"name": "tempest-keypair-661154111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2LRGKnKAFuWV5tqgCzefcbrkSFQBKd97gQJ0SEtnRObJ6q2aW9UygMZVZXz0/2rz6JtWrKyyRPUQpqvvdpwG7XWDKRHkfOaFtJp2zPnbmyP8VXkri1uT9gfmSglMs+9A=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:04.633386 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2390/4347] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:04 2022] POST /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7/action => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:04.641581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cef79543-2430-45f1-a429-590b3f7311a2 req-df639191-c7a3-4a99-97ad-1569032639e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "3e15991d-09ea-4734-acf7-f1ade6cf8701"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:04.662659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ac444a4f-1036-4b58-8cbf-9057845d33d1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:10:04.664688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cef79543-2430-45f1-a429-590b3f7311a2 req-df639191-c7a3-4a99-97ad-1569032639e4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.667740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cef79543-2430-45f1-a429-590b3f7311a2 req-df639191-c7a3-4a99-97ad-1569032639e4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.679716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-ac444a4f-1036-4b58-8cbf-9057845d33d1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for user 6bcfb45bd9404205aefe7d1d2b33cd25 and project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:10:04.695344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cef79543-2430-45f1-a429-590b3f7311a2 req-df639191-c7a3-4a99-97ad-1569032639e4 service nova] Creating event network-changed:3e15991d-09ea-4734-acf7-f1ade6cf8701 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:04.703503 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cef79543-2430-45f1-a429-590b3f7311a2 req-df639191-c7a3-4a99-97ad-1569032639e4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065081 Jun 25 21:10:04.704653 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2391/4348] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:04.713767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:04.724796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:04.741939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.743982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.744966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.750011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.771144 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac444a4f-1036-4b58-8cbf-9057845d33d1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.853435 Jun 25 21:10:04.771816 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1958/4349] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:10:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:04.786575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:04.787259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:04.831476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.831977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:04.844330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:04.844852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.199365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:05.215469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18b54279-b910-4e34-a826-0617b4b0b42d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 200 len: 1448 microversion: 2.1 time: 0.508901 Jun 25 21:10:05.231928 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2392/4350] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:04 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 1448 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:05.243972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:05.245930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:05.264286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.265371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.267367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.276577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.615210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:05.632027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e68d32bc-75da-44dc-868f-3c3a8e1aea11 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.856463 Jun 25 21:10:05.632774 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1959/4351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:04 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:05.640778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:05.653718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:05.667882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.673290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.680213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.683308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.701912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:05.740084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:05.742217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:05.743802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af30127a-528d-456a-a362-5435edc2fb3b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.510380 Jun 25 21:10:05.753162 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2393/4352] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:05 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:05.781910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:05.782544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:05.808682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.810200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:05.811722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:05.813826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:06.223114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:06.235299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-377f5708-4a34-4f4f-83a8-13eccf60ff27 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 0.466255 Jun 25 21:10:06.236267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2394/4353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:05 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:06.255255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:06.256104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:06.273232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:06.276948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:06.278178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:06.279001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:06.909311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:06.919661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:06.924540 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80564212-7776-4923-8c9f-86792bd19a1a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.686376 Jun 25 21:10:06.930184 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2395/4354] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:06 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:06.957515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:06.958433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:06.969719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:06.970460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:06.971407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:06.972229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.030897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:07.047703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b05de548-92a5-41a7-a116-6ddac114b917 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 1.409988 Jun 25 21:10:07.049623 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1960/4355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:05 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:07.096764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:07.101024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 33793dbb-c355-4d8e-896a-2bde5ddc2475] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:07.111849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/33793dbb-c355-4d8e-896a-2bde5ddc2475/action HTTP/1.1 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 65 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '33793dbb-c355-4d8e-896a-2bde5ddc2475', 'body': {'rebuild': {'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795'}}} Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jun 25 21:10:07.114670 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. Jun 25 21:10:07.119562 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:07.131243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 33793dbb-c355-4d8e-896a-2bde5ddc2475 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:07.133892 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-06da1645-4c3b-4ed7-bc41-a618869811ee tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/33793dbb-c355-4d8e-896a-2bde5ddc2475/action" status: 404 len: 111 microversion: 2.1 time: 0.078462 Jun 25 21:10:07.134812 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1961/4356] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:07 2022] POST /compute/v2.1/servers/33793dbb-c355-4d8e-896a-2bde5ddc2475/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:07.150813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:07.154138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:07.172925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.173832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.175868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.177811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.620819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:07.636009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:07.641207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:07.645697 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-883d5e99-6566-42c2-ba89-4ea3191db49d tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.695011 Jun 25 21:10:07.647533 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2396/4357] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:06 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:07.668918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:07.670731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:07.678747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.679578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.680697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.681322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.700272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:07.721083 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4409d875-5612-43da-bc9c-ed0fd4754085 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.564059 Jun 25 21:10:07.721834 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1962/4358] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:07 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:07.742155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:07.743121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:07.761910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.763955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:07.767504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:07.768089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:08.175069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:08.194053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8c91a179-fc96-4bc0-a3d2-c15eebac7ffc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.545190 Jun 25 21:10:08.195119 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2397/4359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:07 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:08.609851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:08.610554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:08.627195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:08.631263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:08.634424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:08.634892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:08.842449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:08.863814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-441db1b1-a833-475d-93a7-5dc689b82ff9 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 1.139761 Jun 25 21:10:08.870068 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1963/4360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:07 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:08.885809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-461e6877-7a38-4848-82d9-12824a4d0d34 req-539bbd56-a565-4909-a561-32c32ad711be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f235586-ed12-4584-afe9-bc3aa733e6e9", "tag": "ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:08.912689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-461e6877-7a38-4848-82d9-12824a4d0d34 req-539bbd56-a565-4909-a561-32c32ad711be service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:08.915611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-461e6877-7a38-4848-82d9-12824a4d0d34 req-539bbd56-a565-4909-a561-32c32ad711be service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:08.938953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-461e6877-7a38-4848-82d9-12824a4d0d34 req-539bbd56-a565-4909-a561-32c32ad711be service nova] Creating event network-changed:ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad for instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 on nch1-master-1 Jun 25 21:10:08.952489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-461e6877-7a38-4848-82d9-12824a4d0d34 req-539bbd56-a565-4909-a561-32c32ad711be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080794 Jun 25 21:10:08.955662 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1964/4361] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:08.961926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:08.963005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:08.968260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:08.982912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df9ec2bf-665c-48c0-9e29-f2688b2d15f3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.786425 Jun 25 21:10:08.987041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2398/4362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:08 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:08.992064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:08.996869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:08.997338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:08.998119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:08.998563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:09.004511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:09.022293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:09.022863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:09.023887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:09.024412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:09.515550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:09.542230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:09.550558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:09.567459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:09.570085 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea4d556a-7362-40d2-9e4d-a655e4aa90b2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.581938 Jun 25 21:10:09.570576 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35547788-f98d-48ee-830a-ff9d4a81fb43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.613573 Jun 25 21:10:09.571545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1965/4363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:08 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:09.588904 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2399/4364] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:08 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:09.603156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:09.607214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:09.625238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:09.627173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:09.628063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:09.630871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:09.825975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1114300592", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "a87002b9-fcec-44a2-b6d1-93a9136b25de"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:09.869151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:09.883211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-763edd30-29e6-4a0a-b2c9-6f3baa594712 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.291202 Jun 25 21:10:09.885512 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2400/4365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:09 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:09.890984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:09.892079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 11bf729d-3e1a-4307-a9b2-cbee089a8133] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:09.901420 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/11bf729d-3e1a-4307-a9b2-cbee089a8133/action HTTP/1.1 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: {"restore": {}} Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '11bf729d-3e1a-4307-a9b2-cbee089a8133', 'body': {'restore': {}}} Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:09.903526 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 11bf729d-3e1a-4307-a9b2-cbee089a8133 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5db00c70-ea0e-4937-adbd-fbd4082a4350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/11bf729d-3e1a-4307-a9b2-cbee089a8133/action" status: 404 len: 111 microversion: 2.1 time: 0.018103 Jun 25 21:10:09.907115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2401/4366] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:09 2022] POST /compute/v2.1/servers/11bf729d-3e1a-4307-a9b2-cbee089a8133/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:09.911189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1489016502", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1eb20bd-61f4-4d72-bc42-77788c0f534a"}], "security_groups": [{"name": "tempest-securitygroup--2056492802"}], "key_name": "tempest-keypair-661154111", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:09.914010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] validate_networks() for [('a87002b9-fcec-44a2-b6d1-93a9136b25de', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:10:10.030921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] validate_networks() for [('d1eb20bd-61f4-4d72-bc42-77788c0f534a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:10:10.530401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:10:10.531886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:10:10.532454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:10:10.533695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:10:10.534467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:10:10.545382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.546799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.548261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.548827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.583233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:10:10.595335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for user 6bcfb45bd9404205aefe7d1d2b33cd25 and project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:10:10.621458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:10:10.625619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:10:10.695069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3fe42ee-2975-46e5-841d-f944fef95608 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.788019 Jun 25 21:10:10.696579 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2402/4367] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:10:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:10:10.703788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:10.705871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:10.710537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:10.724534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.725713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:10:10.726304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.726571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:10:10.727288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:10:10.728198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.728744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:10:10.729268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.729617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:10:10.753610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.754466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.755626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.756298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.791735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Getting quotas for project dc2d0a5c55aa4b37a53cb0fdf6c6ea45. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:10:10.798832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Getting quotas for user 3eb2928f8d734e61b71ae17ea712ac3d and project dc2d0a5c55aa4b37a53cb0fdf6c6ea45. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:10:10.804156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:10.820471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:10:10.824010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:10:10.895257 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1cc9b162-8db0-4396-9826-9d042c3b564d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.321955 Jun 25 21:10:10.896668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1966/4368] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:10:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:10:10.902708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3238fa3-4a65-4db7-bc31-012580379825 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:10.911062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3238fa3-4a65-4db7-bc31-012580379825 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:10.912450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3238fa3-4a65-4db7-bc31-012580379825 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:10.946344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3238fa3-4a65-4db7-bc31-012580379825 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Going to try to stop instance {{(pid=137462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:10:11.102903 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3238fa3-4a65-4db7-bc31-012580379825 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.204544 Jun 25 21:10:11.110111 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1967/4369] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:10 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:11.125420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:11.129599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:11.147954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.154443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.156863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.157430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.199851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:11.211861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f48fd7c-0939-46b7-89a7-111d88662f11 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 0.509806 Jun 25 21:10:11.224113 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2403/4370] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:10 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:11.237953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:11.238964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:11.249754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.250393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.253323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.253996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.669866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:11.684714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:11.689028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:11.691434 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fc461741-b51f-455f-aef9-ced1586e5880 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.465586 Jun 25 21:10:11.707500 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2404/4371] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:11 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:11.715996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:11.717956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:11.727977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.728738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.730335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.730978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.883658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:11.895856 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44924d5c-ab87-406a-8b1c-ca8858092de1 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1241 microversion: 2.1 time: 0.185704 Jun 25 21:10:11.909302 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2405/4372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:11 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:11.915564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:11.917115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:11.940397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.942274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:11.946012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:11.947787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.091072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:12.101201 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db972ff6-d006-47e4-b5d8-40ec98c73df1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1218 microversion: 2.1 time: 0.190280 Jun 25 21:10:12.101779 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2406/4373] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:11 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1218 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:12.118991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:12.121329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:12.122411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.132953 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1fce42ed-e52a-49ef-8029-81977198e346 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 1.021209 Jun 25 21:10:12.138379 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1968/4374] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:11 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:12.149031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.149998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.151154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.152383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.157009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:12.157951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.165983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.166697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.167677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.168328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.404281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:12.415232 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-faa0b950-4cb8-46bc-a2a1-38b32eaba217 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.306499 Jun 25 21:10:12.416596 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2407/4375] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:12 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:12.430809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:12.431579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.439816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.440531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.441519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.442134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.612293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:12.628767 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4b57601-6df6-4584-a155-26a5729ed470 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 0.210629 Jun 25 21:10:12.630003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2408/4376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:12 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:12.671458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:12.683755 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b82f80c-5a34-458c-91a1-7f33732c1045 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.532513 Jun 25 21:10:12.703319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1969/4377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:12 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:12.708982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:12.712305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.718924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:12.720085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.728762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.729889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.732325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.733682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.740940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.742564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.744088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.744808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.823602 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'restore' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: {"restore": {}} Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'restore' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'restore': {}}} Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state active. Cannot restore while the instance is in this state. Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:12.829464 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'restore' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:12.834108 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2cd1e06f-24ae-4b82-8fb1-938bb9436151 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 145 microversion: 2.1 time: 0.131435 Jun 25 21:10:12.841251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2409/4378] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:12 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 145 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:10:12.871580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:12.873501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:12.892760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.893536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:12.895422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:12.897848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.217912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.232742 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e05ef2a0-921e-45e0-8026-cc3b671b4df5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.389549 Jun 25 21:10:13.234653 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2410/4379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:12 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:13.262628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:13.264594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:13.279168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.281245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.282491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.283168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.408111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.427293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.432315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.434101 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-032353b3-b074-4f43-a9c0-c8997cb3c1d6 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.722041 Jun 25 21:10:13.435871 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1970/4380] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:12 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:13.464125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:13.466321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:13.480738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.481238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.482138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.482774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.640636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.656138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e01700e7-2998-4ed6-b42b-f557eb66881e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1272 microversion: 2.1 time: 0.218616 Jun 25 21:10:13.657286 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1971/4381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:13 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1272 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:13.668384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:13.671072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:13.694011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.694993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.696301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.697073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.846165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:13.858231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f335e0ef-d5d8-4c7b-b30c-f033a7e10d5f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1295 microversion: 2.1 time: 0.621629 Jun 25 21:10:13.860975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2411/4382] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:13 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1295 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:13.877946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:13.880935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:13.893393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.894496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:13.895560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:13.896155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.051338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.078731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aab96712-874d-49f4-96a1-109388aef6c5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.416247 Jun 25 21:10:14.080007 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1972/4383] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:13 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:14.093694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:14.095580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:14.113449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.113952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.115639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.117660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.117882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.132597 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-283f7d68-4c62-4c1c-9f7b-d8f46d7dd1f4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.269326 Jun 25 21:10:14.149605 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2412/4384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:13 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:14.158085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:14.158902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: c68a83bc-412f-42d9-a0f7-0b96780a21a6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:14.167709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/c68a83bc-412f-42d9-a0f7-0b96780a21a6/action HTTP/1.1 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 14 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: {"resume": {}} Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c68a83bc-412f-42d9-a0f7-0b96780a21a6', 'body': {'resume': {}}} Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:14.178579 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:14.182301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:14.182301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:14.182301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. Jun 25 21:10:14.182301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:14.184254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance c68a83bc-412f-42d9-a0f7-0b96780a21a6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:14.186093 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9fc506a-8712-4e1e-b57e-02494d204b5d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/c68a83bc-412f-42d9-a0f7-0b96780a21a6/action" status: 404 len: 111 microversion: 2.1 time: 0.035188 Jun 25 21:10:14.187871 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2413/4385] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:14 2022] POST /compute/v2.1/servers/c68a83bc-412f-42d9-a0f7-0b96780a21a6/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:14.202455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:14.205985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:14.223134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.226785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.227669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.228130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.412863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.449142 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ff57760-2362-4c94-8d6a-d1fee0d6867b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 0.360445 Jun 25 21:10:14.455151 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1973/4386] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:14 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:14.468642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a44fec13-2abb-4525-aa49-b738b7f4d14a req-b2978b0f-6312-428f-803b-f8af2d2b7395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f235586-ed12-4584-afe9-bc3aa733e6e9", "name": "network-vif-plugged", "status": "completed", "tag": "ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:14.484654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.485669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a44fec13-2abb-4525-aa49-b738b7f4d14a req-b2978b0f-6312-428f-803b-f8af2d2b7395 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.486595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a44fec13-2abb-4525-aa49-b738b7f4d14a req-b2978b0f-6312-428f-803b-f8af2d2b7395 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.506104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f07ea365-e406-480d-a2c0-da3a5270aa42 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.313658 Jun 25 21:10:14.508985 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2414/4387] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:14 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:14.515524 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a44fec13-2abb-4525-aa49-b738b7f4d14a req-b2978b0f-6312-428f-803b-f8af2d2b7395 service nova] Creating event network-vif-plugged:ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad for instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 on nch1-master-1 Jun 25 21:10:14.526299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:14.527232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:14.546151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.548956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.549857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.551266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.557715 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a44fec13-2abb-4525-aa49-b738b7f4d14a req-b2978b0f-6312-428f-803b-f8af2d2b7395 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065299 Jun 25 21:10:14.575109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1974/4388] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:14.613719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:14.615344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:14.619223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:14.634675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.641294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.643354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:14.643964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:14.970710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.983268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.985174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:14.986889 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ea3cd2c-fe08-4c59-a4d2-b104d60fbc99 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.475405 Jun 25 21:10:15.000232 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2415/4389] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:14 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:15.007029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:15.007890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.015279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.016100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.017115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.017699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.289653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:15.301008 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31ce0adc-d9d4-4d0d-a9f3-cf60a0fc76cd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.716344 Jun 25 21:10:15.302061 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1975/4390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:14 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:15.319005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:15.319900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.330924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.332206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.333966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.334797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.349667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:15.429566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:15.439324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d3c980b-98e1-40d6-acc5-0bd5984f502d tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.437373 Jun 25 21:10:15.450226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2416/4391] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:15 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:15.457903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:15.459046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.470209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.470995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.471995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.472656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.637153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:15.648372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39ca9d28-458c-406d-8bcf-ccae1587e2dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.333585 Jun 25 21:10:15.659413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1976/4392] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:15 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:15.665934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:15.667661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.675917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.676661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.677836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.678630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.714978 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'resume' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 14 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: {"resume": {}} Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'resume' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'resume': {}}} Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state active. Cannot resume while the instance is in this state. Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:15.717677 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:15.721610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:15.721610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:15.721610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:15.721610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:10:15.721610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:15.723538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'resume' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:15.724808 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdee6993-8f49-41b4-9b5d-07a7d6815b1d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 144 microversion: 2.1 time: 0.064154 Jun 25 21:10:15.726051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1977/4393] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:15 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 144 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:10:15.731672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:15.732360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.741599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.742338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.743386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:15.744156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.744867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.763746 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91b2b9db-ae5a-463c-a5e6-455d4ad71d25 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.311368 Jun 25 21:10:15.774096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2417/4394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:15 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:15.784529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:15.793518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:15.809429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.810247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:15.811245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:15.811885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.042879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.054820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3a27012-7915-47ea-97a6-5ebcfd71e81e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.285805 Jun 25 21:10:16.056018 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2418/4395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:15 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:16.062427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:16.063813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:16.075961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.077208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.078314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.079203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.205862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.221114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44ced862-00d2-46e0-be4c-9fc79c7e41b5 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1366 microversion: 2.1 time: 0.493733 Jun 25 21:10:16.230634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1978/4396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:15 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1366 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:16.237204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:16.239641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:16.250354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.251047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.252197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.252872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.585615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.598858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fca1e1de-4e49-4f69-9fad-01dbd4ea877b tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.366653 Jun 25 21:10:16.599898 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1979/4397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:16 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:16.608196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d3093c6b-21fd-4603-8fa6-4a1c1ef4bd74 req-9a79ed6a-8463-46fd-bdf8-0e659daaf22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26365fd2-d8a1-4c59-a24e-7ebc35313000", "tag": "2d258606-be3a-423d-9adf-aea92f13d512"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:16.644831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d3093c6b-21fd-4603-8fa6-4a1c1ef4bd74 req-9a79ed6a-8463-46fd-bdf8-0e659daaf22b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.645524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d3093c6b-21fd-4603-8fa6-4a1c1ef4bd74 req-9a79ed6a-8463-46fd-bdf8-0e659daaf22b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.668364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d3093c6b-21fd-4603-8fa6-4a1c1ef4bd74 req-9a79ed6a-8463-46fd-bdf8-0e659daaf22b service nova] Creating event network-changed:2d258606-be3a-423d-9adf-aea92f13d512 for instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 on nch1-master-1 Jun 25 21:10:16.675703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d3093c6b-21fd-4603-8fa6-4a1c1ef4bd74 req-9a79ed6a-8463-46fd-bdf8-0e659daaf22b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073984 Jun 25 21:10:16.676809 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1980/4398] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:16.685999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:16.686866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:16.694524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.695938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.697029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.698486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.725357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.738898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.740452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.743804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-376c77ed-0de7-4333-92b5-6e00347d2e98 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.686597 Jun 25 21:10:16.750113 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2419/4399] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:16 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:16.758579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-16eeeaa9-9ad0-4f2a-a7fe-1d63b4625d44 req-51fbe57e-b025-4124-bafd-7e9e13b99461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b26789-2359-4178-8de1-88f0006bac21", "tag": "3883bf85-377a-4b44-af9e-f1914ea539ed"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:16.766756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:16.784255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-16eeeaa9-9ad0-4f2a-a7fe-1d63b4625d44 req-51fbe57e-b025-4124-bafd-7e9e13b99461 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.784945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-16eeeaa9-9ad0-4f2a-a7fe-1d63b4625d44 req-51fbe57e-b025-4124-bafd-7e9e13b99461 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.797247 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-16eeeaa9-9ad0-4f2a-a7fe-1d63b4625d44 req-51fbe57e-b025-4124-bafd-7e9e13b99461 service nova] Creating event network-changed:3883bf85-377a-4b44-af9e-f1914ea539ed for instance c7b26789-2359-4178-8de1-88f0006bac21 on nch1-master-1 Jun 25 21:10:16.803282 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-16eeeaa9-9ad0-4f2a-a7fe-1d63b4625d44 req-51fbe57e-b025-4124-bafd-7e9e13b99461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051233 Jun 25 21:10:16.803890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2420/4400] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:16.814293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:16.815169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:16.823536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.824546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.825625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:16.826212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:16.984380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:16.998238 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5bea4988-84ae-4c0a-90fb-b6b64f6808ee tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.320066 Jun 25 21:10:17.009623 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1981/4401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:16 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.015924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ec3f4e1-0d63-4568-8546-c8636806a1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ec3f4e1-0d63-4568-8546-c8636806a1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 160 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "4afca77e-1bb7-4cef-b35e-661d5d7aabe7"}]}} Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'networks': [{'uuid': '4afca77e-1bb7-4cef-b35e-661d5d7aabe7'}]}}} Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '' Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:10:17.020372 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:10:17.026705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.029959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ec3f4e1-0d63-4568-8546-c8636806a1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:17.031639 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ec3f4e1-0d63-4568-8546-c8636806a1de tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.020535 Jun 25 21:10:17.032312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1982/4402] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:10:17 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:10:17.037756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.038549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.046693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.047142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.047912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.048836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.149259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:17.162348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7fdf1cd-7f1a-4cd7-8974-9a22f9fa6192 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.356910 Jun 25 21:10:17.163875 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2421/4403] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:16 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.169220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.170169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.178740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.179435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.180648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.181402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.415780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:17.427151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-60534696-ed21-4a4f-8ac1-8a5a35542c27 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.261647 Jun 25 21:10:17.429272 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2422/4404] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.438264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.439376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.453585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.454149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.455105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.455542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.596909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:17.605019 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64500b9d-e9de-4097-b751-6eda3420465f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.571455 Jun 25 21:10:17.605734 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1983/4405] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.610543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.611396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.620191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.620904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.621893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.622066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:17.622748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.631809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d2fc87c-37f4-43ce-acf8-41dde672f580 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1557 microversion: 2.1 time: 0.200812 Jun 25 21:10:17.632665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2423/4406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1557 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.649534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.650033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.656187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.656682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.657457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.657897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.745675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6759b789-71e6-4556-84b7-d2d088537792 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100670 Jun 25 21:10:17.746547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2424/4407] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:10:17.770586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.771477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.777837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.778474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.779676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.780249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.787804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:17.797433 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-748563a7-372e-438b-80fc-cec541f4b7ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.189249 Jun 25 21:10:17.798113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1984/4408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:17.830095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:17.830722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: b36b6f45-4844-4a65-84a4-309abe7c8b54] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.836676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/b36b6f45-4844-4a65-84a4-309abe7c8b54/action HTTP/1.1 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 14 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: {"shelve": {}} Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'b36b6f45-4844-4a65-84a4-309abe7c8b54', 'body': {'shelve': {}}} Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:17.846695 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance b36b6f45-4844-4a65-84a4-309abe7c8b54 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-06c00227-4444-43c8-b573-4405999d4123 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/b36b6f45-4844-4a65-84a4-309abe7c8b54/action" status: 404 len: 111 microversion: 2.1 time: 0.022365 Jun 25 21:10:17.850229 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1985/4409] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:17 2022] POST /compute/v2.1/servers/b36b6f45-4844-4a65-84a4-309abe7c8b54/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:17.859407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:17.859407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:17.865816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.866411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:17.867194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:17.867637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.022542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.033255 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f46f0bec-dc53-4ae5-9997-1d9919a10d8d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.179960 Jun 25 21:10:18.034350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1986/4410] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:18.041539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:18.042487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.051176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.052351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.053225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.053814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.123250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.135106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.137048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.138649 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ef9c1139-3aff-4d14-b07a-58378c5970c7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.372301 Jun 25 21:10:18.139932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2425/4411] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:17 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:10:18.145303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:18.147177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.156217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.158495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.160581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.160581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.251767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.269616 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86378c04-f2be-47ba-91c2-d169e3012402 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.233787 Jun 25 21:10:18.279889 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1987/4412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:18 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:18.286659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:18.287316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.294948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.295594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.296684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.297406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.438413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.456179 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-475dc1bd-5688-41b5-a060-e2d1f5e10ae0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.314666 Jun 25 21:10:18.457743 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2426/4413] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:18 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:18.461001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.469727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2164fe30-cf67-4b92-a441-3979c5ced9c8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.187781 Jun 25 21:10:18.470495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1988/4414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:18 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:18.476771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:18.477610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.484713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.485390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.486716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.487213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.510918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lazy-loading 'flavor' on Instance uuid 14e0eea3-98e0-455a-b989-d96aa9458741 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:10:18.626281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:18.627563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.637258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.638124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.639876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.640697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.798037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:18.814875 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca52309b-601f-4863-b1f8-df388ffb1dcc tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.195148 Jun 25 21:10:18.838187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1989/4415] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:18 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:18.850554 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ee817e7-9d2f-425d-81ea-09c2e64e6d94 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.377986 Jun 25 21:10:18.851214 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2427/4416] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:18 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:18.860924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:18.861732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:18.868062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.868575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:18.869343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:18.869787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.010015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:19.018515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0358e16-ff3d-40b1-9b6e-bfcede28405c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.161765 Jun 25 21:10:19.019405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1990/4417] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:18 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:19.165245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-bedc35ba-4f53-4a3a-9315-85806999c924 req-7ba1a2e1-879c-4ea3-9dfb-bc9cccc2f3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f235586-ed12-4584-afe9-bc3aa733e6e9", "tag": "ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:19.169619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:19.169619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:19.182615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bedc35ba-4f53-4a3a-9315-85806999c924 req-7ba1a2e1-879c-4ea3-9dfb-bc9cccc2f3b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.185424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.185890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.186982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bedc35ba-4f53-4a3a-9315-85806999c924 req-7ba1a2e1-879c-4ea3-9dfb-bc9cccc2f3b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.189143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.191114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.216195 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-bedc35ba-4f53-4a3a-9315-85806999c924 req-7ba1a2e1-879c-4ea3-9dfb-bc9cccc2f3b1 service nova] Creating event network-changed:ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad for instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 on nch1-master-1 Jun 25 21:10:19.230206 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-bedc35ba-4f53-4a3a-9315-85806999c924 req-7ba1a2e1-879c-4ea3-9dfb-bc9cccc2f3b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069084 Jun 25 21:10:19.234185 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1991/4418] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:19.294524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:19.295676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:19.311933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.314156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.315561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.317345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.733481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:19.744178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a97fc3b-b5bf-47ee-a6fb-90de906afdcb tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.459340 Jun 25 21:10:19.745067 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1992/4419] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:19 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:19.764054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:19.767798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:19.787619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.788397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:19.789398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:19.791670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.121827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.133401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.134630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.136037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bcc6f63f-f7fe-4895-82ef-a08435a68572 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.980550 Jun 25 21:10:20.136591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.148098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2428/4420] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:19 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:20.154941 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6cf314bc-67c0-474b-8418-7cbb31fb626e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.403352 Jun 25 21:10:20.155632 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1993/4421] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:19 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:20.165135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:20.165135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:20.167422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:20.171163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:20.180067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.185804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.187970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.189134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.208492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.209316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.210265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.211430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.559690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:20.597035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.613178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40f94701-e4f9-4f65-9d16-263a2fbd933a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1679 microversion: 2.1 time: 0.460341 Jun 25 21:10:20.614058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2429/4422] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:20 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1679 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:20.726264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.736731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d4728b3-5c86-4641-94c6-f7f52dfde3bc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.579966 Jun 25 21:10:20.737336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1994/4423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:20 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:20.763363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:20.764301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:20.773773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:20.776929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.778070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.779050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:20.780735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:20.960063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:20.969344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-96b2c5ed-92a2-45d7-bfad-1bb0e40d816e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.211594 Jun 25 21:10:20.969948 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2430/4424] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:20 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:21.155340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.157249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.159554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.160412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=18 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.169256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.170037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.171731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.173196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.174625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.176610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.197336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.199951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.201338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.201965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.233889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.426725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.442402 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d0a30e3-4319-4f73-a7ff-4933300aa61c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.272848 Jun 25 21:10:21.454043 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2431/4425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:21.463781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.475119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.477250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.479203 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c60923d-0acc-4565-84ac-4884b650cc42 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.328468 Jun 25 21:10:21.491602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1995/4426] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:21.632049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.632816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.639697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.640180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.640969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.641838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.754786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.755636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.765751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.766345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.767256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.767963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.785376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.790576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:21.795202 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fdfc2ce4-b2e7-4d16-81df-52b190886674 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1656 microversion: 2.1 time: 0.167861 Jun 25 21:10:21.814329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2432/4427] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1656 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:21.826771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e072851-4468-4f0a-b9ad-d08f188a7ec1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:21.833588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e072851-4468-4f0a-b9ad-d08f188a7ec1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.834485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e072851-4468-4f0a-b9ad-d08f188a7ec1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.859357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e072851-4468-4f0a-b9ad-d08f188a7ec1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Going to try to start instance {{(pid=137461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 21:10:21.913383 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e072851-4468-4f0a-b9ad-d08f188a7ec1 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.096948 Jun 25 21:10:21.914335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2433/4428] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:21 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:21.924459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.925945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.933386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.933571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:21.933965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.935095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.935502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.944716 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b3363d5-0b81-4936-abae-5afb3a37f232 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.193735 Jun 25 21:10:21.946545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1996/4429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:21.987524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:21.988226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:21.995964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.996952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:21.998243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:21.998742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.104764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.115079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d049202d-8f4f-4045-b96c-0d58988d9dd4 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1665 microversion: 2.1 time: 0.195401 Jun 25 21:10:22.116135 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2434/4430] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1665 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:22.268286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.280512 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb545c49-f684-4408-a48b-3a10ffe6f81e tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.297229 Jun 25 21:10:22.281363 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1997/4431] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:21 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:22.460900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:22.461527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:22.477312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.478874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.481405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.482031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.505406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:22.507636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:22.524805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.529403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.536597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.537704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.759744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.772293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76b76b00-ec52-43e1-8496-3866a2effaf5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.315826 Jun 25 21:10:22.781810 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2435/4432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:22 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:22.792158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ad2877e4-8af0-458b-bda0-828e23836017 req-b23ba7fe-896a-4ea8-94e6-70425612a61f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26365fd2-d8a1-4c59-a24e-7ebc35313000", "name": "network-vif-plugged", "status": "completed", "tag": "2d258606-be3a-423d-9adf-aea92f13d512"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:22.808812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ad2877e4-8af0-458b-bda0-828e23836017 req-b23ba7fe-896a-4ea8-94e6-70425612a61f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.810042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ad2877e4-8af0-458b-bda0-828e23836017 req-b23ba7fe-896a-4ea8-94e6-70425612a61f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.831411 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ad2877e4-8af0-458b-bda0-828e23836017 req-b23ba7fe-896a-4ea8-94e6-70425612a61f service nova] Creating event network-vif-plugged:2d258606-be3a-423d-9adf-aea92f13d512 for instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 on nch1-master-1 Jun 25 21:10:22.837218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ad2877e4-8af0-458b-bda0-828e23836017 req-b23ba7fe-896a-4ea8-94e6-70425612a61f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060670 Jun 25 21:10:22.838696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2436/4433] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:22.961761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.963826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:22.964669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:22.972193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.975554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.975554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:22.975554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:22.978868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.981638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:22.984470 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-107d1097-7199-4a1f-b73f-34b1a2ddc0d5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.488442 Jun 25 21:10:22.995184 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1998/4434] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:22 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:10:23.132231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:23.132901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:23.142837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.143765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.144841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.145839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.185251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:23.196003 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3dd2b96b-3be6-4c42-821d-7c9c157d5bb9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.237119 Jun 25 21:10:23.205503 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2437/4435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:22 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:23.296908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:23.297558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:23.305422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.305854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.307158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.307614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.364147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:23.385458 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f018bd76-cea1-44bf-9f7f-061219b96902 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1665 microversion: 2.1 time: 0.255984 Jun 25 21:10:23.388172 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 1999/4436] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:23 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1665 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:23.515865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:23.526938 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8fa19ba8-7fad-419a-9faa-77e3543587f7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.233990 Jun 25 21:10:23.533889 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2438/4437] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:23 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:23.790272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:23.791557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:23.807123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.807833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.809143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:23.809792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:23.978905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:23.987986 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e0b18bf-6b45-4d50-bd56-b8ae322c2c1f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1363 microversion: 2.1 time: 0.202415 Jun 25 21:10:23.989087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2000/4438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:23 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:24.003433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.004137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.010802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.011473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.012474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.016302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.213597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.214217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.221927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.222484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.223286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.223722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.262130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.272155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.274241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.275601 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34396670-c01c-484a-b3d6-999255fc305b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.276123 Jun 25 21:10:24.276771 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2439/4439] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:23 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:24.402738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.405267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.405895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.412500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.412650 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1bf3bd8-4941-4db9-9326-826e4fbcbfb7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.203715 Jun 25 21:10:24.412956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.413220 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2001/4440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:24.413732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.414169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.555641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.556730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.564664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.565299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.565458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.566272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.566869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.573715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24aa5b1d-9694-4b01-b75e-030d5b0b1726 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.172396 Jun 25 21:10:24.585323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2440/4441] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:24.593072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.593892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.601604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.602577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.603503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.604109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.756655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.763316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.769336 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fca7ec4e-ae7e-433e-ac14-053c9141792f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.217844 Jun 25 21:10:24.770339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2002/4442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:24.772532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb735456-88de-40c9-9d66-b15174eb008a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.183729 Jun 25 21:10:24.774546 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2441/4443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:24.793250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.793864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.800668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.801117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.801882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.802315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.857739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "ad635ecf-1213-4110-bff9-f73db63dd9ca"}, {"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "662e8a6c-11c8-477b-9a5c-2994b7f2ebd5"}, {"server_uuid": "c7b26789-2359-4178-8de1-88f0006bac21", "name": "network-vif-plugged", "status": "completed", "tag": "3883bf85-377a-4b44-af9e-f1914ea539ed"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:24.868223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.868582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.884768 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Creating event network-vif-plugged:ad635ecf-1213-4110-bff9-f73db63dd9ca for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:24.885290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Creating event network-vif-plugged:662e8a6c-11c8-477b-9a5c-2994b7f2ebd5 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:24.885798 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] Creating event network-vif-plugged:3883bf85-377a-4b44-af9e-f1914ea539ed for instance c7b26789-2359-4178-8de1-88f0006bac21 on nch1-master-1 Jun 25 21:10:24.898020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-dc77f4c2-ff57-4a15-929e-c53bc2a67e82 req-e63c87e5-2519-47a4-8302-83c895da40a2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044067 Jun 25 21:10:24.898713 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2442/4444] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:10:24.947907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:24.956819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b6373a32-51d8-4538-ba50-604c4d0cab8f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.167451 Jun 25 21:10:24.957457 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2003/4445] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:24.973922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:24.974626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:24.980900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.981351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:24.982107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:24.982546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.006011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.006999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.013692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.014455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.015343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.015996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.161916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.170235 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a04984d-034c-4ed7-9669-d6e6fa05966a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.200748 Jun 25 21:10:25.170986 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2443/4446] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:24 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:25.175849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.184668 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-534191dd-2096-49cd-bc8b-57c2715bf4bb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1548 microversion: 2.1 time: 0.182648 Jun 25 21:10:25.185265 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2004/4447] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:25.186907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.187529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.194350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.194807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.195636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.196165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.201502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.202052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.208269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.208769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.209553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.209997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.305562 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75a1824f-6f96-44f5-ae95-f62f66f4afb3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108134 Jun 25 21:10:25.306717 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2005/4448] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:25.317963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.319017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.335526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.336353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.337900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.338451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.368007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.382308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41e5f662-e306-4a16-8614-42210d91ce5d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.199100 Jun 25 21:10:25.396782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2444/4449] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:25.402705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:25.403514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.411428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.412266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.413297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.413940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.444229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lazy-loading 'flavor' on Instance uuid fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:10:25.544552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d101006c-c0ef-4acf-8b72-cf9eb12ffe61 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.145454 Jun 25 21:10:25.550300 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2445/4450] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:25 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:25.556991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.557955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.594422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.595237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.595913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.598058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.639822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:25.749037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.766339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.770709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.774501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f8942c3-b4a6-469c-9392-2bbe9f5b0e7a tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.465673 Jun 25 21:10:25.775248 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2006/4451] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:25.794764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.795603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.803737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.804613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.805781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.806378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.901562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:25.911168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba543d05-8126-41ef-9e77-91b5a2f7d683 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.359050 Jun 25 21:10:25.912211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2446/4452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:25.918932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:25.919767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:25.927703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.928233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:25.929114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:25.929868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:26.094759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:26.113065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6714d4d9-0b33-43a1-8de5-51ae1907f033 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1677 microversion: 2.1 time: 0.323074 Jun 25 21:10:26.113681 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2007/4453] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1677 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:26.199648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:26.209104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a2dc1d0-66bc-45a7-8244-33ce7971c6d1 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1314 microversion: 2.1 time: 0.295480 Jun 25 21:10:26.219635 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2447/4454] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:25 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:26.799561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:26.800556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:26.808623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:26.809119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:26.810668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:26.811190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:26.930943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:26.931489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:26.940113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:26.940608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:26.941513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:26.941959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.094187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.103948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54d8cb80-374b-476a-9891-b69c8f8c626f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.177378 Jun 25 21:10:27.104801 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2448/4455] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:26 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:27.131407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:27.132002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:27.139637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.140249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.141261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.141759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.297294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.309408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8fc40063-a180-4947-b1b7-442476aecae3 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1660 microversion: 2.1 time: 0.182094 Jun 25 21:10:27.310242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2449/4456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:27 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1660 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:27.337383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:27.338384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:27.348091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.348651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.349707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.350367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.535341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.546116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-128de654-25a3-4f22-a075-aef3034a83e7 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1498 microversion: 2.1 time: 0.234837 Jun 25 21:10:27.546870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2450/4457] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:27 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1498 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:27.547441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.554068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:27.554696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:27.559751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.561538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:27.563403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.564068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.564678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30d36d32-611e-42f6-9f76-8f9002893992 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.769397 Jun 25 21:10:27.564831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.572482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.584535 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2008/4458] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:26 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:27.601938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fc256a55-b769-43d0-83ae-98d385676418 req-da5c887d-daf0-4e74-a511-e117477a7bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26365fd2-d8a1-4c59-a24e-7ebc35313000", "tag": "2d258606-be3a-423d-9adf-aea92f13d512"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:27.637203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fc256a55-b769-43d0-83ae-98d385676418 req-da5c887d-daf0-4e74-a511-e117477a7bcf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.637697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fc256a55-b769-43d0-83ae-98d385676418 req-da5c887d-daf0-4e74-a511-e117477a7bcf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.669205 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fc256a55-b769-43d0-83ae-98d385676418 req-da5c887d-daf0-4e74-a511-e117477a7bcf service nova] Creating event network-changed:2d258606-be3a-423d-9adf-aea92f13d512 for instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 on nch1-master-1 Jun 25 21:10:27.685289 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fc256a55-b769-43d0-83ae-98d385676418 req-da5c887d-daf0-4e74-a511-e117477a7bcf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096324 Jun 25 21:10:27.689085 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2009/4459] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:27.766222 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-98540ca6-01d7-4f43-b01d-dba5f74a120b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.217871 Jun 25 21:10:27.767209 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2451/4460] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:27 2022] POST /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:27.779828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:27.780811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:27.794286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.795219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:27.797282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:27.799085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:28.129065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:28.129807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:28.150590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:28.152708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:28.153803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:28.154588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:28.260285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:28.286749 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75bbdb90-9d25-452e-8ebf-00eb1ce0209b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1666 microversion: 2.1 time: 0.512605 Jun 25 21:10:28.288091 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2010/4461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:27 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1666 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:28.585844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:28.586684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:28.598562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:28.599337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:28.600632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:28.601641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:28.742406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:28.751290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44ce2ea0-d5de-49a0-9777-2ec591db8c4c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.632211 Jun 25 21:10:28.765297 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2452/4462] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:28 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:29.140068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:29.156056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:29.156056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:29.156056 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f76995e6-4295-4785-853a-53b21cb7a479 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.574293 Jun 25 21:10:29.156056 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2011/4463] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:28 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:10:29.317719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:29.319402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:29.330565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:29.331402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:29.332657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:29.333111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:29.455020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-975c2614-257a-41d9-b2d3-c49298dd4310 req-4050a242-9427-43d0-9f12-eeb1a37cc853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "2df6d7a0-8189-45ee-a287-e11964e1391b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:29.470415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-975c2614-257a-41d9-b2d3-c49298dd4310 req-4050a242-9427-43d0-9f12-eeb1a37cc853 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:29.471770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-975c2614-257a-41d9-b2d3-c49298dd4310 req-4050a242-9427-43d0-9f12-eeb1a37cc853 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:29.517884 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-975c2614-257a-41d9-b2d3-c49298dd4310 req-4050a242-9427-43d0-9f12-eeb1a37cc853 service nova] Creating event network-vif-plugged:2df6d7a0-8189-45ee-a287-e11964e1391b for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:29.523880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-975c2614-257a-41d9-b2d3-c49298dd4310 req-4050a242-9427-43d0-9f12-eeb1a37cc853 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074756 Jun 25 21:10:29.527119 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2012/4464] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:29.718265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:29.730456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c91acfbd-9fe6-49cb-bbba-1bcfa0a3f306 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1666 microversion: 2.1 time: 0.427029 Jun 25 21:10:29.736877 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2453/4465] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:29 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1666 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:29.771698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:29.772441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:29.783830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:29.784341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:29.790990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:29.791715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.079900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:30.090962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64e80990-03ec-4ce0-b16f-73365654e157 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.324208 Jun 25 21:10:30.096390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2013/4466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:29 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:30.179907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:30.180888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:30.190072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.190980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.192275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.192958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.550950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:30.563052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:30.565152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:30.566382 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-217e124a-0c3a-4adb-ba6d-2a61a750e324 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.393686 Jun 25 21:10:30.572733 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2454/4467] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:30 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:30.677837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:30.679156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:30.687089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:30.692627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.693588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.695114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.695861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.749240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:30.750377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:30.751481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:30.753655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:30.764679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.765285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.766600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.767255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.875058 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7abc57f-9067-44f2-9b6e-df91a69350f6 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 204 len: 0 microversion: 2.1 time: 0.203368 Jun 25 21:10:30.877812 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2014/4468] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:30 2022] DELETE /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:30.888647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:30.889466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:30.896945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.897397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.898171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:30.898603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:30.980555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:30.991630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85df7433-6123-4fdb-8363-9f66db3535b8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.247047 Jun 25 21:10:30.992504 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2455/4469] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:30 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:31.021451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:31.022402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:31.029473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.030144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.031175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.032154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.065427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.078571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f14ce140-f0e2-40a8-9f88-2572b1f18b9f tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1504 microversion: 2.1 time: 0.195766 Jun 25 21:10:31.079161 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2015/4470] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:30 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:31.113279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:31.114882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:31.123786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.124556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.125413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.125849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.278797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.288628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5365cd01-003c-4438-9e49-ac4617000e9b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1669 microversion: 2.1 time: 0.273304 Jun 25 21:10:31.289566 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2456/4471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:31 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:31.305204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.315232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:31.316219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:31.323739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.325154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.326196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.327062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.327229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef726215-377e-4371-8ab3-db42a904d9ca tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1532 microversion: 2.1 time: 0.219594 Jun 25 21:10:31.341134 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2016/4472] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:31 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1532 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:31.359508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:31.368348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.compute.api [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Working on deleting snapshot 2c4c6b6f-5c38-4502-8b76-f16e64842f32 from shelved instance... Jun 25 21:10:31.544369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "13deb6b0-1f80-429a-ba4c-9fa21b1c1903"}, {"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "54514947-c78f-4902-a825-cefd7ad64e30"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:31.557330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.558274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.576718 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] Creating event network-vif-plugged:13deb6b0-1f80-429a-ba4c-9fa21b1c1903 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:31.577510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] Creating event network-vif-plugged:54514947-c78f-4902-a825-cefd7ad64e30 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:31.586207 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d096b1be-d29f-41fb-9a80-55e514f45bb2 req-815760ec-b5dc-4b52-9799-dc40f4d30e5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046051 Jun 25 21:10:31.587194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2017/4473] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:31.601893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:31.603044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:31.618934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.619828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.620925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:31.621601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:31.866303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.888993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.890556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:31.892765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92eeafb8-fa59-443b-b24b-b1e647a3a0f7 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.303211 Jun 25 21:10:31.893818 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2018/4474] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:31 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:32.099445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:32.100210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:32.108566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.109058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.109953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.110610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.159840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Doing local delete in cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) {{(pid=137461) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jun 25 21:10:32.163049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.164920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.165510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.compute.api [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jun 25 21:10:32.170174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] deallocate_for_instance() {{(pid=137461) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jun 25 21:10:32.297741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:32.306366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e72f722e-a352-4104-b0ba-d93382df5414 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1504 microversion: 2.1 time: 0.212408 Jun 25 21:10:32.307055 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2019/4475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:32 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:32.345546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:32.346167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:32.353143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.353598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.354635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.355220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.518387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:32.528506 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a278049-df0f-4af7-93fc-9a6b2d01f4e3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1532 microversion: 2.1 time: 0.186161 Jun 25 21:10:32.539218 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2020/4476] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1532 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:32.913053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:32.914568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:32.922976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.923787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:32.924899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:32.925346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.226101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:33.240371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:33.242552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:33.244897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2828c378-cbb9-41b1-bd4f-70f851576935 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.336214 Jun 25 21:10:33.245830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2021/4477] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:32 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:33.326929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:33.327940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:33.339576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:33.341495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.342903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:33.345359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.531035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Updating instance_info_cache with network_info: [] {{(pid=137461) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jun 25 21:10:33.577755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3eb2928f8d734e61b71ae17ea712ac3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2d0a5c55aa4b37a53cb0fdf6c6ea45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:33.593313 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1bcfb39d-6840-49a0-9e42-c07410e7dda3 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 200 len: 1462 microversion: 2.1 time: 0.273196 Jun 25 21:10:33.605094 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2022/4478] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:33 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 1462 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:33.612376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8412c3c4-ca0b-4c26-aa76-51335d0affcd req-57855f5d-bced-49ec-b314-884001a5bf78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96e462d2-f761-41b7-8b26-00fdda3f5846", "name": "network-vif-deleted", "tag": "813232fc-0a4b-46b8-8a25-fca191ce3ed1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:33.626905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8412c3c4-ca0b-4c26-aa76-51335d0affcd req-57855f5d-bced-49ec-b314-884001a5bf78 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:33.627633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8412c3c4-ca0b-4c26-aa76-51335d0affcd req-57855f5d-bced-49ec-b314-884001a5bf78 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.644625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_external_events [req-8412c3c4-ca0b-4c26-aa76-51335d0affcd req-57855f5d-bced-49ec-b314-884001a5bf78 service nova] Unable to find a host for instance 96e462d2-f761-41b7-8b26-00fdda3f5846. Dropping event network-vif-deleted {{(pid=137462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:10:33.646219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8412c3c4-ca0b-4c26-aa76-51335d0affcd req-57855f5d-bced-49ec-b314-884001a5bf78 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.038526 Jun 25 21:10:33.647397 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2023/4479] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:10:33.654650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:33.655393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:33.668622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:33.671190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.672624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:33.673300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:33.925854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:33.974151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:33.987286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7aaa7ff7-d662-4058-a7eb-f84cec3490bb tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1532 microversion: 2.1 time: 0.338570 Jun 25 21:10:33.990042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2024/4480] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:33 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1532 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:34.001933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-874dec69-d401-48e9-9c82-7c4746ff3498 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 204 len: 0 microversion: 2.1 time: 2.697438 Jun 25 21:10:34.002937 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2457/4481] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:31 2022] DELETE /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 0 bytes in 2699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:34.006726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "15049829-d7b6-48d4-95ad-10d35343c6bc"}, {"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-plugged", "status": "completed", "tag": "3e15991d-09ea-4734-acf7-f1ade6cf8701"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 96e462d2-f761-41b7-8b26-00fdda3f5846] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.024708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.027420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.028140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.041888 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 HTTP/1.1 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '96e462d2-f761-41b7-8b26-00fdda3f5846'} Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:34.044015 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.048535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 404 to user: Instance 96e462d2-f761-41b7-8b26-00fdda3f5846 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:34.050593 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2638cd83-de88-420a-a2d7-ab723bad87a0 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846" status: 404 len: 111 microversion: 2.1 time: 0.042976 Jun 25 21:10:34.054963 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2458/4482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:34 2022] GET /compute/v2.1/servers/96e462d2-f761-41b7-8b26-00fdda3f5846 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:34.061678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] Creating event network-vif-plugged:15049829-d7b6-48d4-95ad-10d35343c6bc for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:34.062221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:34.062971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:34.064214 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] Creating event network-vif-plugged:3e15991d-09ea-4734-acf7-f1ade6cf8701 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:34.073701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.074616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.076639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.077772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.107283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e31c75d3-67c2-4031-8516-124ec0b34a87 req-b7d40a5c-64e5-457d-b43a-5c60100372d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115659 Jun 25 21:10:34.109988 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2025/4483] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:34.142884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:34.283278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb522ff2-ee46-4387-9481-d05a4a85500d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 204 len: 0 microversion: 2.1 time: 0.226708 Jun 25 21:10:34.285529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:34.287725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:34.293204 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2459/4484] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:34 2022] DELETE /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:34.305476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:34.305476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:34.324165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.324552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.325457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.325777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.337048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.337968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.344079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.348313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.506180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:34.520902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76b33f10-a11f-4e32-83b1-908936908e83 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1465 microversion: 2.1 time: 0.221859 Jun 25 21:10:34.521861 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2460/4485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:34 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:34.591907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:34.602938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:34.604879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:34.606338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39a3bbf9-c730-4141-a53c-2c3d4117048e tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.339967 Jun 25 21:10:34.607181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2026/4486] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:34 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:10:34.614549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:34.616716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] [instance: c7b26789-2359-4178-8de1-88f0006bac21] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:34.625855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.626497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.627485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:34.628511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:34.647019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] HTTP exception thrown: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Request method failure captured: Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 HTTP/1.1 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrvGECPLAHQviTzxnic9edDnx3iTkz3LpoLi3CYAXc2ECx-GIQfVOMLaMPPuOX8kpkxLANFNklc5wIEbBLIgi-WfTXdeEMKuypqSVnt19iNTXfC7Fc_p_LUi83cD-DZWu-EwVPgQubTQ_MjaRRXL7LsvKYXqAsdz81Au6lJdchxPc Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: dc2d0a5c55aa4b37a53cb0fdf6c6ea45 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesActionsTest-770269746 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dc2d0a5c55aa4b37a53cb0fdf6c6ea45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc2d0a5c55aa4b37a53cb0fdf6c6ea45"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dc2d0a5c55aa4b37a53cb0fdf6c6ea45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dc2d0a5c55aa4b37a53cb0fdf6c6ea45"}]}] Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesActionsTest-770269746 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: dc2d0a5c55aa4b37a53cb0fdf6c6ea45 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesActionsTest-770269746 Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesActionsTest-770269746-project Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3eb2928f8d734e61b71ae17ea712ac3d Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesActionsTest-770269746-project Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c7b26789-2359-4178-8de1-88f0006bac21'} Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:34.649120 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] Returning 404 to user: Instance c7b26789-2359-4178-8de1-88f0006bac21 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bca491df-b216-4ae8-bf6e-a18b1b202c22 tempest-VolumesActionsTest-770269746 tempest-VolumesActionsTest-770269746-project] 10.222.0.39 "GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21" status: 404 len: 111 microversion: 2.1 time: 0.042043 Jun 25 21:10:34.654506 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2461/4487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:34 2022] GET /compute/v2.1/servers/c7b26789-2359-4178-8de1-88f0006bac21 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:10:35.005831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:35.006598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:35.019305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.022976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.025738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.026972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.213703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:35.228275 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8854440a-ffe0-4f19-90f4-efc349421edc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1532 microversion: 2.1 time: 0.226855 Jun 25 21:10:35.239319 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2027/4488] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:34 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1532 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:35.544934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:35.547919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:35.560359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.561445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.562566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.563205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.629586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:35.630721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:35.638641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.639364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.640736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.641378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.708283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:35.718606 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43a9b455-e6ca-449e-995d-28382292f244 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1465 microversion: 2.1 time: 0.182723 Jun 25 21:10:35.719191 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2462/4489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:35 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:35.730195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-71046056-e4eb-4d9f-b3b5-98afd70e972c req-9a6e1b4a-7f21-4e5f-8833-7d60a42af697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b26789-2359-4178-8de1-88f0006bac21", "name": "network-vif-deleted", "tag": "3883bf85-377a-4b44-af9e-f1914ea539ed"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:35.741723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:35.757050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-71046056-e4eb-4d9f-b3b5-98afd70e972c req-9a6e1b4a-7f21-4e5f-8833-7d60a42af697 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:35.757510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-71046056-e4eb-4d9f-b3b5-98afd70e972c req-9a6e1b4a-7f21-4e5f-8833-7d60a42af697 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:35.779320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-71046056-e4eb-4d9f-b3b5-98afd70e972c req-9a6e1b4a-7f21-4e5f-8833-7d60a42af697 service nova] Creating event network-vif-deleted:3883bf85-377a-4b44-af9e-f1914ea539ed for instance c7b26789-2359-4178-8de1-88f0006bac21 on nch1-master-1 Jun 25 21:10:35.812373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-71046056-e4eb-4d9f-b3b5-98afd70e972c req-9a6e1b4a-7f21-4e5f-8833-7d60a42af697 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071943 Jun 25 21:10:35.812373 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2463/4490] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:35.980757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:35.993349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:35.995201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:35.996611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8786531-a408-421b-8ec3-33d6e6550a15 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 1873 microversion: 2.42 time: 0.371646 Jun 25 21:10:35.997260 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2028/4491] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:35 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 1873 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:10:36.166243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0e7d4f6a-247a-461d-98a0-73af81e11b4d req-83129cf4-f48b-4b51-8a7b-4897dd0fa467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "name": "network-vif-plugged", "status": "completed", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:36.186011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0e7d4f6a-247a-461d-98a0-73af81e11b4d req-83129cf4-f48b-4b51-8a7b-4897dd0fa467 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:36.191808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0e7d4f6a-247a-461d-98a0-73af81e11b4d req-83129cf4-f48b-4b51-8a7b-4897dd0fa467 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:36.219866 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0e7d4f6a-247a-461d-98a0-73af81e11b4d req-83129cf4-f48b-4b51-8a7b-4897dd0fa467 service nova] Creating event network-vif-plugged:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:10:36.236551 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0e7d4f6a-247a-461d-98a0-73af81e11b4d req-83129cf4-f48b-4b51-8a7b-4897dd0fa467 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080262 Jun 25 21:10:36.237709 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2464/4492] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:36.247213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:36.247960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:36.261119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:36.262492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:36.264313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:36.265224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:36.556033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:36.565361 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bcd1b061-58d5-49bb-80fa-8f47aae96563 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1532 microversion: 2.1 time: 0.322751 Jun 25 21:10:36.569940 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2029/4493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:36 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1532 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:36.764403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:36.766062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:36.775515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:36.776521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:36.777676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:36.778343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:36.917282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:36.948589 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe595d94-c90b-4f69-ae13-a6168f3eb2cf tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 200 len: 1465 microversion: 2.1 time: 0.214989 Jun 25 21:10:36.949637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2465/4494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:36 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 1465 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:37.032057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:37.032899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:37.050458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.053358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.054659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.055539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.475626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:37.489547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:37.503110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:37.505685 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d6bbb15-30df-4e95-9443-7cbe93c42c69 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2832 microversion: 2.42 time: 0.492006 Jun 25 21:10:37.509286 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2030/4495] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:37 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2832 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:37.535117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:37.535662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:37.550515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.551017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.551811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.552247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.590063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:37.591358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:37.599428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.602578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.603583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:37.609807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:37.967533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:37.972484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:37.983370 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93bd80fa-8f9b-4319-8453-6e4b5fdeda74 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.396635 Jun 25 21:10:37.984302 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2031/4496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:37 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:38.011170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:38.012716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: e8fcb7f6-3686-47fa-8c13-59f0390761a1] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:38.040133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.040715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.041547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.041990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.091944 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 HTTP/1.1 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e8fcb7f6-3686-47fa-8c13-59f0390761a1'} Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:38.094705 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. Jun 25 21:10:38.099566 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:38.100079 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c88da56-7e96-48fb-8960-fedcbcd56cb8 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.570294 Jun 25 21:10:38.104377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 404 to user: Instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:38.106366 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2466/4497] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:10:37 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391/os-interface => generated 1832 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:38.107948 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b60ac31-8859-466b-8c6c-f78a2b17988e tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1" status: 404 len: 111 microversion: 2.1 time: 0.118081 Jun 25 21:10:38.111719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c01381aa-2001-40b2-af7d-3d4d0c20fa20 req-58d4e56f-7d82-42e2-aa8f-7650229ed2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fcb7f6-3686-47fa-8c13-59f0390761a1", "name": "network-vif-deleted", "tag": "acd10142-cd26-4efa-8292-86ac0213e07f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:38.114865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2032/4498] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:37 2022] GET /compute/v2.1/servers/e8fcb7f6-3686-47fa-8c13-59f0390761a1 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:38.128574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:38.129915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:38.137429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c01381aa-2001-40b2-af7d-3d4d0c20fa20 req-58d4e56f-7d82-42e2-aa8f-7650229ed2df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.140303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c01381aa-2001-40b2-af7d-3d4d0c20fa20 req-58d4e56f-7d82-42e2-aa8f-7650229ed2df service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.143665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.146352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.148017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.149730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.183534 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c01381aa-2001-40b2-af7d-3d4d0c20fa20 req-58d4e56f-7d82-42e2-aa8f-7650229ed2df service nova] Creating event network-vif-deleted:acd10142-cd26-4efa-8292-86ac0213e07f for instance e8fcb7f6-3686-47fa-8c13-59f0390761a1 on nch1-master-1 Jun 25 21:10:38.204924 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c01381aa-2001-40b2-af7d-3d4d0c20fa20 req-58d4e56f-7d82-42e2-aa8f-7650229ed2df service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096720 Jun 25 21:10:38.205556 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2467/4499] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:38.235362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:38.416632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b8cc678-38da-4547-9926-c898c9b6ef5b tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 204 len: 0 microversion: 2.1 time: 0.299998 Jun 25 21:10:38.417972 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2033/4500] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:38 2022] DELETE /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:38.435752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:38.435752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:38.443323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.443778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.444651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:38.445072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:38.747489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:38.761455 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc04e2c7-d776-4488-84ab-a042b762d097 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1506 microversion: 2.1 time: 0.338002 Jun 25 21:10:38.763632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2468/4501] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:38 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:39.006000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:39.007429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:39.016535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:39.017288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:39.018298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:39.018814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:39.782652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:39.783332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:39.800686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:39.801428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:39.802384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:39.802976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:40.037237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:40.048451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a5ae5f7-57c1-4b2b-98f5-33a1646c8fb6 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1506 microversion: 2.1 time: 0.269530 Jun 25 21:10:40.049313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2469/4502] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:39 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1506 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:40.345111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:40.359284 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d69ed3c2-b739-431c-93c8-620d5c95abf2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 1.358131 Jun 25 21:10:40.376560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2034/4503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:38 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:41.068094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:41.068750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:41.123518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:41.124458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:41.130849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-10a17111-c0cd-47d4-8951-ccf414577223 req-bf9833ae-5745-45b6-83e0-a2a141f7ca5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6755692c-81cd-4719-af0a-424a7ae0e2b9", "name": "network-vif-deleted", "tag": "afece301-cf9e-4ea4-9fd3-f2ce342f225f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:41.132275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:41.133113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:41.190953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-10a17111-c0cd-47d4-8951-ccf414577223 req-bf9833ae-5745-45b6-83e0-a2a141f7ca5e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:41.195200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-10a17111-c0cd-47d4-8951-ccf414577223 req-bf9833ae-5745-45b6-83e0-a2a141f7ca5e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:41.279488 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-10a17111-c0cd-47d4-8951-ccf414577223 req-bf9833ae-5745-45b6-83e0-a2a141f7ca5e service nova] Creating event network-vif-deleted:afece301-cf9e-4ea4-9fd3-f2ce342f225f for instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 on nch2-master-1 Jun 25 21:10:41.309154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-10a17111-c0cd-47d4-8951-ccf414577223 req-bf9833ae-5745-45b6-83e0-a2a141f7ca5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182494 Jun 25 21:10:41.310597 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2035/4504] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:41.326092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:41.341438 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a8c7478-394b-4fd6-8f7f-bad47382911f tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 200 len: 1464 microversion: 2.1 time: 0.279018 Jun 25 21:10:41.342960 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2470/4505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:41 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 1464 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:41.385672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:41.386402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:41.408929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:41.409556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:41.410407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:41.410848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:41.761300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:41.774571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c2207e29-6a50-4fa2-8c35-7d705379bc43 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.395015 Jun 25 21:10:41.776135 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2036/4506] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:41 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:42.369692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:42.369692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 6755692c-81cd-4719-af0a-424a7ae0e2b9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:42.379230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.379683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.380493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.380933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.405585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 HTTP/1.1 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6755692c-81cd-4719-af0a-424a7ae0e2b9'} Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:42.407283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 404 to user: Instance 6755692c-81cd-4719-af0a-424a7ae0e2b9 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd8a1324-d7d7-403d-ab8c-ad7578b8bb9d tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9" status: 404 len: 111 microversion: 2.1 time: 0.051770 Jun 25 21:10:42.410896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2471/4507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:42 2022] GET /compute/v2.1/servers/6755692c-81cd-4719-af0a-424a7ae0e2b9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:42.420114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:42.420728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:42.438934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.440279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.441443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.443223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.497473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:42.616369 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf379d80-9efc-4d5c-bb07-a0768cc5820c tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 204 len: 0 microversion: 2.1 time: 0.201450 Jun 25 21:10:42.617812 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2037/4508] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:42 2022] DELETE /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:42.626403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:42.627683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:42.650280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.650752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.651623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.652126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.796250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:42.797006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:42.816929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.817698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:42.818729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:42.819325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:43.263136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:43.333519 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bdb62f0e-ad52-41f2-a8d3-1a8b0c4d6274 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1495 microversion: 2.1 time: 0.709008 Jun 25 21:10:43.334866 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2472/4509] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:42 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1495 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:43.356643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:43.365074 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff742d4a-293b-4e67-a795-48fe3048a8c3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.573910 Jun 25 21:10:43.369449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6e624be6-db3b-43c9-b099-02192d5cec4e req-16910cd9-6275-4ed4-95b9-5e1ef5a2af81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "tag": "ad635ecf-1213-4110-bff9-f73db63dd9ca"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:43.379454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2038/4510] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:42 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:43.398265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6e624be6-db3b-43c9-b099-02192d5cec4e req-16910cd9-6275-4ed4-95b9-5e1ef5a2af81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:43.399760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6e624be6-db3b-43c9-b099-02192d5cec4e req-16910cd9-6275-4ed4-95b9-5e1ef5a2af81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:43.423919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6e624be6-db3b-43c9-b099-02192d5cec4e req-16910cd9-6275-4ed4-95b9-5e1ef5a2af81 service nova] Creating event network-changed:ad635ecf-1213-4110-bff9-f73db63dd9ca for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:10:43.435869 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6e624be6-db3b-43c9-b099-02192d5cec4e req-16910cd9-6275-4ed4-95b9-5e1ef5a2af81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099032 Jun 25 21:10:43.438398 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2473/4511] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:44.263586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-25790dae-35c2-4f5f-99c2-7201a0130d83 req-e2e00130-786b-440d-8668-d2cba378484b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11695f4e-7b8a-49a5-8a8d-91845bd2495d", "name": "network-vif-deleted", "tag": "56ed3ccf-28f5-45f5-a62e-f65c63bf03ab"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:44.283272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25790dae-35c2-4f5f-99c2-7201a0130d83 req-e2e00130-786b-440d-8668-d2cba378484b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:44.284301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-25790dae-35c2-4f5f-99c2-7201a0130d83 req-e2e00130-786b-440d-8668-d2cba378484b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:44.319006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-25790dae-35c2-4f5f-99c2-7201a0130d83 req-e2e00130-786b-440d-8668-d2cba378484b service nova] Creating event network-vif-deleted:56ed3ccf-28f5-45f5-a62e-f65c63bf03ab for instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d on nch1-master-1 Jun 25 21:10:44.326212 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-25790dae-35c2-4f5f-99c2-7201a0130d83 req-e2e00130-786b-440d-8668-d2cba378484b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067640 Jun 25 21:10:44.330609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2039/4512] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:10:44.357289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:44.358554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:44.397527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:44.399042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:44.419464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:44.427836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:44.435042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:44.435527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:44.436821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:44.443835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:44.445180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:44.449093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:44.648448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:44.661806 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40a8a985-0c96-4900-abe5-4bd2d2f6fceb tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 200 len: 1287 microversion: 2.1 time: 0.311633 Jun 25 21:10:44.662784 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2474/4513] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:44 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 1287 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:44.945937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:44.957516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68a28760-7c96-4a5f-9efd-85cef9cb9de3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.574133 Jun 25 21:10:44.968763 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2040/4514] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:45.683813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:45.685910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: 11695f4e-7b8a-49a5-8a8d-91845bd2495d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:45.700086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.700975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.701934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.702528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.724487 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d HTTP/1.1 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '11695f4e-7b8a-49a5-8a8d-91845bd2495d'} Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:45.726942 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 404 to user: Instance 11695f4e-7b8a-49a5-8a8d-91845bd2495d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:45.731398 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-626e2b2b-1457-4ab0-81ef-d4ff48a8e148 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d" status: 404 len: 111 microversion: 2.1 time: 0.052569 Jun 25 21:10:45.738751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:45.739287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:45.744536 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2475/4515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:45 2022] GET /compute/v2.1/servers/11695f4e-7b8a-49a5-8a8d-91845bd2495d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:45.755358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.756086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.757267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.758061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.797596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:10:45.919751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca8c8fbe-40ae-4522-be22-3e5b91ab11b5 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 204 len: 0 microversion: 2.1 time: 0.185434 Jun 25 21:10:45.920859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2041/4516] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:10:45 2022] DELETE /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:10:45.932226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:45.933769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:45.940672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.941403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.942440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.943083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.968701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:45.986750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:45.987940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:45.995682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.996349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:45.997376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:45.997963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:46.186013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:46.207083 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18fa68d0-4058-4c26-8616-0e74fd9aad22 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1675 microversion: 2.1 time: 0.281955 Jun 25 21:10:46.213227 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2476/4517] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:45 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:46.248720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:46.257352 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-65841994-1c07-4458-b781-7608dc6aa3df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.275511 Jun 25 21:10:46.258432 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2042/4518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:45 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:47.232136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:47.234082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:47.241056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:47.241969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:47.242907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:47.243520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:47.276804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:47.278113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:47.287015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:47.289808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:47.293538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:47.294162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:47.429018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:47.437844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29b229ab-1b12-4407-a53d-d7822aafebe7 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1675 microversion: 2.1 time: 0.211886 Jun 25 21:10:47.447958 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2477/4519] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:47 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:47.549091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:47.567456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb3356f7-836a-497a-8460-380b4dbbdc59 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.295843 Jun 25 21:10:47.568493 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2043/4520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:47 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:48.457349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:48.458848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:48.472202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:48.473136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:48.475774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:48.476374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:48.585414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:48.586049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:48.601108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:48.601821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:48.605888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:48.606521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:48.617213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:48.627363 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c21d5dab-19d5-4d94-804a-f5050993fbda tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1607 microversion: 2.1 time: 0.175513 Jun 25 21:10:48.640473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2478/4521] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:48 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1607 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:49.003413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:49.025344 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e6a1424-17e7-46d7-8a17-3d253e5a9ab5 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.443808 Jun 25 21:10:49.040072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2044/4522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:48 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:49.086164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-93704497-cd96-4675-bf10-e6859cdcba8a req-97018c8b-34b9-4ab4-b61e-3631c0cc5e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb", "name": "network-vif-deleted", "tag": "238884f5-462b-4239-9bb8-ef45c260d4d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:49.097516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-93704497-cd96-4675-bf10-e6859cdcba8a req-97018c8b-34b9-4ab4-b61e-3631c0cc5e6a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:49.098209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-93704497-cd96-4675-bf10-e6859cdcba8a req-97018c8b-34b9-4ab4-b61e-3631c0cc5e6a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:49.115342 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-93704497-cd96-4675-bf10-e6859cdcba8a req-97018c8b-34b9-4ab4-b61e-3631c0cc5e6a service nova] Creating event network-vif-deleted:238884f5-462b-4239-9bb8-ef45c260d4d3 for instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb on nch2-master-1 Jun 25 21:10:49.122357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-93704497-cd96-4675-bf10-e6859cdcba8a req-97018c8b-34b9-4ab4-b61e-3631c0cc5e6a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Jun 25 21:10:49.127201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2479/4523] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:49.646363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:49.647050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:49.667442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:49.667877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:49.668717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:49.669153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:49.758330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:49.807282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:49.809295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:49.810151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lazy-loading 'fault' on Instance uuid fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:10:49.989358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69effad76345477987af68f55c90e2e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11392205e814f46be92aa13f9e7dcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:50.002248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-11a23c06-639b-4c9b-a47d-d5e678795c4a tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 200 len: 1328 microversion: 2.1 time: 0.360525 Jun 25 21:10:50.011736 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2045/4524] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:49 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 1328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:50.059237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:50.060698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:50.128016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.130817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:50.131693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.132267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:50.417930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:50.428523 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dbdd299d-1a24-4023-8338-4cfc8cbee038 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.383955 Jun 25 21:10:50.440632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2480/4525] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:50 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:50.449197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:50.450370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:50.464703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.468695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:50.469849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.470637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:50.907934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:50.927268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:50.929480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:50.931304 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4806e3b1-70f2-488a-91e0-cc1422d6a077 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2950 microversion: 2.32 time: 0.488595 Jun 25 21:10:50.932551 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2046/4526] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:10:50 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2950 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:50.952130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:50.952993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:50.961299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.968398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:50.969650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:50.970302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:51.029549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:51.033092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] [instance: fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:51.046057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:51.046603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:51.051390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:51.051900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:51.111196 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] HTTP exception thrown: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Request method failure captured: Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb HTTP/1.1 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3dW0ld9sRZQLoegElV4T6Duia6cETM5tThMM8hWmAyIa5qJ0TtIFsC0GbZvNq1kKEjX5WiNUIjMMVp6_ESmYbC1neZzneGVERQT5EWBB4FXLgr2mOCz3qMO4wt8s2t8iNag7_NNYl4GlNdetaFU7Bz-jK9GcotB5aQJuGeHMQbPTns Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_e11392205e814f46be92aa13f9e7dcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/e11392205e814f46be92aa13f9e7dcfe"}]}] Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: e11392205e814f46be92aa13f9e7dcfe Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1582731628 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 69effad76345477987af68f55c90e2e1 Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1582731628-project Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb'} Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:51.114876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. Jun 25 21:10:51.119809 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:10:51.122313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Returning 404 to user: Instance fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:51.127084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f89bfc71-eba0-4c3e-8b3d-9e93847b9b97 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb" status: 404 len: 111 microversion: 2.1 time: 0.098712 Jun 25 21:10:51.127084 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2047/4527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:51 2022] GET /compute/v2.1/servers/fadaafe5-46aa-41f1-bfa7-8301a5b4b4cb => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:10:51.142571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cbafc66a-269a-46a9-8e8f-dc816bb011a8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] Calling method '.version_select at 0x7f985c85c430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:51.185696 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cbafc66a-269a-46a9-8e8f-dc816bb011a8 tempest-ServerActionsTestJSON-1582731628 tempest-ServerActionsTestJSON-1582731628-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884589205" status: 202 len: 0 microversion: 2.1 time: 0.054250 Jun 25 21:10:51.190471 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2048/4528] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:10:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884589205 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:10:51.281199 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7c5f2ed-d0bb-4315-9ac6-fe85d1cec520 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.333395 Jun 25 21:10:51.281933 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2481/4529] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:10:50 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2/os-interface => generated 1830 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:10:51.449605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:51.451079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:51.467954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:51.470087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:51.473703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:51.476705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:51.976840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:51.988063 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6f42ef8-5266-4b2d-84b8-a9af6c83567d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.544082 Jun 25 21:10:51.990318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2049/4530] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:51 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:53.008600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:53.009237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:53.023149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:53.023780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:53.024610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:53.029079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:53.390090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:53.413180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-551be6e2-059f-4342-ba48-35abb1c2bc19 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.409357 Jun 25 21:10:53.416969 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2482/4531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:53 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:54.439403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:54.442564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:54.461931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:10:54.499330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:54.505802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:54.513187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:54.515460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:54.792950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:54.806360 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e45021ff-3205-43a6-a5c6-6ff3d60365bd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1527 microversion: 2.1 time: 0.376575 Jun 25 21:10:54.807721 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2050/4532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:54 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1527 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:55.843473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:55.845021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:55.855698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:55.856380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:55.858996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:55.859454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:56.127849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:56.163144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72fe01ef-c0b2-4e7b-be36-0991709c15c7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1509 microversion: 2.1 time: 0.332869 Jun 25 21:10:56.173199 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2483/4533] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:55 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:57.147792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-bab8af1c-5fc8-45ee-87ac-f7a42315404c req-a98e451e-982b-408a-8fa1-ca667890efc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "name": "network-vif-unplugged", "status": "completed", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:57.167279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bab8af1c-5fc8-45ee-87ac-f7a42315404c req-a98e451e-982b-408a-8fa1-ca667890efc0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:57.172517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bab8af1c-5fc8-45ee-87ac-f7a42315404c req-a98e451e-982b-408a-8fa1-ca667890efc0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:57.182672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:57.183936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:57.199102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:57.199559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:57.207725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:57.208392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:57.221640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-bab8af1c-5fc8-45ee-87ac-f7a42315404c req-a98e451e-982b-408a-8fa1-ca667890efc0 service nova] Creating event network-vif-unplugged:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:10:57.237909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-bab8af1c-5fc8-45ee-87ac-f7a42315404c req-a98e451e-982b-408a-8fa1-ca667890efc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096062 Jun 25 21:10:57.239151 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2051/4534] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:57.513816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6879f6a0-af86-4af1-af9c-74cd6cfe0c38"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:57.515960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:57.534328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:57.534946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:57.536208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:57.538374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:57.565375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:57.583020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1bdd403-4af0-4a04-9685-bd87997694da tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1509 microversion: 2.1 time: 0.404024 Jun 25 21:10:57.584222 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2484/4535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:57 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:10:58.141730 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c64dd419-5848-431a-ab0c-c7a3bd723539 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "POST /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.628484 Jun 25 21:10:58.150568 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2052/4536] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:10:57 2022] POST /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:10:58.602818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:58.603556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:58.617076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:58.619126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:58.620139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:58.621102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:58.974157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:58.984128 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7375eda8-1aad-42de-8254-c052f1b66393 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1512 microversion: 2.1 time: 0.385692 Jun 25 21:10:58.986541 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2485/4537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:58 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:59.002732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:59.003448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:59.012120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.012852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.013858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.014576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.293310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:59.328541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59b746f7-0b28-44e8-b32e-29d00509729f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1452 microversion: 2.1 time: 0.312282 Jun 25 21:10:59.332575 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2053/4538] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:58 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1452 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:10:59.408521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:59.409546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:59.418242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.418920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.419910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.420672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.457157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lazy-loading 'flavor' on Instance uuid 14e0eea3-98e0-455a-b989-d96aa9458741 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:10:59.527886 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'shelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state shelved_offloaded Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 14 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: {"shelve": {}} Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'shelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state shelved_offloaded Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'shelve': {}}} Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jun 25 21:10:59.532119 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state shelved_offloaded Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state shelved_offloaded Jun 25 21:10:59.537081 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:10:59.541516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'shelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state shelved_offloaded {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:10:59.543444 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b12488f8-bd13-4392-bbd0-2cb7e2243c5a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 155 microversion: 2.1 time: 0.139896 Jun 25 21:10:59.544674 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2486/4539] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:59 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 155 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:10:59.555232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:10:59.556114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:59.573126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.577274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.580180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.582332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.760943 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-77078e80-a293-49d2-b8f8-d0c3bfe65a22 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.211680 Jun 25 21:10:59.765913 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2054/4540] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:10:59 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:10:59.775538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:10:59.776322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:10:59.786083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.786562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.787355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:10:59.787790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:10:59.991509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:10:59.999793 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8bb3c448-8c14-433c-91ed-4f91f6d90bc9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1460 microversion: 2.1 time: 0.229098 Jun 25 21:11:00.000371 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2487/4541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:10:59 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1460 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:01.017846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:01.018780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:01.039819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:01.042322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:01.043993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:01.044634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:01.287918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:01.298636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d96dcba3-667f-4112-8041-292bdc915fd1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1460 microversion: 2.1 time: 0.285037 Jun 25 21:11:01.300276 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2055/4542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:01 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1460 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:01.486688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1521370322", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:01.571004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:11:01.571560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:11:01.572304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:11:01.572730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:11:01.573217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:11:01.583101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:01.583631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:01.584532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:01.585020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:01.608555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Getting quotas for project ffb625e087fa4ad498ff0cd6d864116a. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:11:01.615306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Getting quotas for user 2d06d8ec975744088a0a9d20025491b8 and project ffb625e087fa4ad498ff0cd6d864116a. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:11:01.629063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:11:01.631563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:11:01.686127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-074e02a1-266f-4609-80b3-4a5abb722163 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.669122 Jun 25 21:11:01.687124 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2488/4543] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:11:01.698313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:01.698986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:01.781225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:01.795782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:01.802599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:01.806786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-819f4a86-0c2a-4cc7-971d-e70625e3508a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1281 microversion: 2.47 time: 0.113719 Jun 25 21:11:01.807338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2056/4544] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:01 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:02.024739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e6d99ddd-0fa8-4bef-a198-06721a44b3ce"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:02.026504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:02.044120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.044680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.045465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.046172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.181141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] HTTP exception thrown: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Request method failure captured: Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments/6879f6a0-af86-4af1-af9c-74cd6cfe0c38 HTTP/1.1 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 74 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3maeAu8I_12jQopFl6ZNKc2UyLmiR-p6RfDMnAuqd0NFEgIBTWziL2I2tz_3iR9StiTj5mzrLlGO1hWb6ujsVXhZCv4U0cHR1gzp76bhzA8a83xWvnN_VyHsKOAj_ibfVYvNvr6nPM1VOYI1_rzZYf8VHjuEX3MjG3t81sEp-vKQuA Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 932c8bf8a22a43cab5d091b6dfa13ba4 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/932c8bf8a22a43cab5d091b6dfa13ba4"}]}] Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 932c8bf8a22a43cab5d091b6dfa13ba4 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesAdminNegativeTest-681282819-project-admin Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6412ea72fc614168a6498d20e6a26f3c Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesAdminNegativeTest-681282819-project-admin Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: {"volumeAttachment": {"volumeId": "e6d99ddd-0fa8-4bef-a198-06721a44b3ce"}} Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: exception: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '8f235586-ed12-4584-afe9-bc3aa733e6e9', 'id': '6879f6a0-af86-4af1-af9c-74cd6cfe0c38', 'body': {'volumeAttachment': {'volumeId': 'e6d99ddd-0fa8-4bef-a198-06721a44b3ce'}}} Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. (HTTP 404) (Request-ID: req-9680f446-fa81-4b68-ae54-c9929bedb331) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:02.233080 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:02.237245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Returning 400 to user: Volume e6d99ddd-0fa8-4bef-a198-06721a44b3ce could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:02.242395 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a6db9384-50dd-440b-abf5-06722b02476a tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments/6879f6a0-af86-4af1-af9c-74cd6cfe0c38" status: 400 len: 107 microversion: 2.1 time: 0.508476 Jun 25 21:11:02.243734 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2489/4545] 10.222.0.39 () {60 vars in 1432 bytes} [Sat Jun 25 21:11:01 2022] PUT /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments/6879f6a0-af86-4af1-af9c-74cd6cfe0c38 => generated 107 bytes in 513 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:11:02.323943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:02.324977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:02.326333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:02.327906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:02.343644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.344103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.344932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.345376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.349018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.349473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.350256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.350787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.486368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lazy-loading 'services' on Instance uuid 8f235586-ed12-4584-afe9-bc3aa733e6e9 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:02.590074 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99dcbb88-4135-4019-bb78-ccf72e80559b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments/6879f6a0-af86-4af1-af9c-74cd6cfe0c38" status: 202 len: 0 microversion: 2.1 time: 0.272401 Jun 25 21:11:02.591714 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2490/4546] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:11:02 2022] DELETE /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments/6879f6a0-af86-4af1-af9c-74cd6cfe0c38 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:02.615428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:02.621577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:02.641376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.642807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.645464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.647565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.654382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:02.663543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-904dabe9-0cf5-4feb-8c50-f590bd013f15 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.350144 Jun 25 21:11:02.664520 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2057/4547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:02 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:02.698071 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bae342ce-4bc3-4bab-a860-da1f302783a7 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095650 Jun 25 21:11:02.700476 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2491/4548] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:11:02 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:02.826057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:02.826679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:02.833534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.833993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.834773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:02.835395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:02.959146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:02.969371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:02.971563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:02.972992 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9520c622-850f-4dd9-b06b-b9afa2c76ee1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1333 microversion: 2.47 time: 0.151074 Jun 25 21:11:02.984571 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2058/4549] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:02 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1333 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:03.684078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:03.685567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:03.695043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:03.695807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:03.697105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:03.697718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:03.713769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:03.715170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:03.748010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:03.751937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:03.753038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:03.753512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:03.807042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8942ac2f-614e-40cc-8f98-ef5c4aadaef8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.098938 Jun 25 21:11:03.813069 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2059/4550] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:11:03 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:11:03.996516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:03.997555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:04.015421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.017140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.021733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.024045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.106205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:04.138097 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd68f6be-05a2-4b99-a73f-d1c5e8150b88 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.459476 Jun 25 21:11:04.155576 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2492/4551] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:03 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:04.180361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:04.192232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:04.193898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:04.194484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1377388118", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "e0807ea8-6ee2-40b3-84d6-c56b282dcd8c"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:04.195118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53466b36-9ec0-4991-aa1b-15396da8997a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1339 microversion: 2.47 time: 0.206624 Jun 25 21:11:04.197037 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2060/4552] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:03 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1339 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:11:04.204481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:04.205563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:04.215912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.217100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.218487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.219386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.279438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb61e630-bf59-4394-aa2a-0d2810793f6f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/ips" status: 200 len: 145 microversion: 2.1 time: 0.079596 Jun 25 21:11:04.280041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2061/4553] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:11:04 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/ips => generated 145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:04.300792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] validate_networks() for [('e0807ea8-6ee2-40b3-84d6-c56b282dcd8c', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:11:04.756001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:11:04.756636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:11:04.757047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:11:04.757467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:11:04.757992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:11:04.767491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.768812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.769886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:04.770325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:04.790929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:11:04.796944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Getting quotas for user bee65f1c37764bdb9985b4e96a97ce9e and project 7cc291ebc8c64e32a229e9a993f517a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:11:04.823458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:11:04.828957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:11:04.884963 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aaec856d-6eb5-4557-b31f-dc645fad227d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727396 Jun 25 21:11:04.888101 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2493/4554] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:11:04.896637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5856f7ed-09bf-4705-b265-707cd00f1bf3 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:04.897373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5856f7ed-09bf-4705-b265-707cd00f1bf3 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:04.970089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5856f7ed-09bf-4705-b265-707cd00f1bf3 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:04.978630 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5856f7ed-09bf-4705-b265-707cd00f1bf3 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1218 microversion: 2.1 time: 0.086067 Jun 25 21:11:04.979454 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2062/4555] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:04 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:05.165784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:05.166582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:05.177796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:05.178540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:05.179697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:05.181459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:05.215436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:05.216331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:05.226546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:05.227228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:05.228015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:05.228489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:05.318140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:05.328416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:05.331154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:05.332359 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2b6e7b2-4e58-4c4c-a58d-9dd3184157f8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1339 microversion: 2.47 time: 0.121822 Jun 25 21:11:05.332986 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2063/4556] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:05 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:05.398370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:05.406870 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f9ae524-24bb-4da0-9c81-f2afdd653665 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.247429 Jun 25 21:11:05.407564 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2494/4557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:05 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:05.998658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:05.999808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:06.012577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.013984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.015954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.017021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.044658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:06.113328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:06.124249 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7d71c2c-e73c-4237-9a0a-a11d38a4cf57 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1278 microversion: 2.1 time: 0.131755 Jun 25 21:11:06.125118 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2064/4558] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:05 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:06.353959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:06.355698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:06.359550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:06.372736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.376811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.378639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.381613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.389947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:06.429589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:06.430133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:06.444547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.445902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.447562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.449535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.592831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:06.606208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:06.616130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:06.626039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0cfe8833-0825-4ac9-801b-262aaa0b9025 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1339 microversion: 2.47 time: 0.276938 Jun 25 21:11:06.644890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2495/4559] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:06 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:06.875419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:06.895618 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ae3c315-f29d-47ef-90cd-a503f4b0d961 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.468559 Jun 25 21:11:06.896828 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2065/4560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:06 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:06.951602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3c85d3e-4e4f-43ae-8178-accc09ce263b"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:06.953206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:06.965828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.969147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:06.970286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:06.972983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.148120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:07.149426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:07.165099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.165555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.166343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.168534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.300566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:07.314307 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-248687af-80d1-41b6-b369-8dec02df81f8 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1276 microversion: 2.1 time: 0.174523 Jun 25 21:11:07.315101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2066/4561] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:07 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:07.514492 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04909523-6bcf-4cb5-9058-dae81f25dd9f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.570458 Jun 25 21:11:07.515289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2496/4562] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:11:06 2022] POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:07.653754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:07.654679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:07.675674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.681544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.681544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.681544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.922516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:07.923590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:07.949778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.950764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:07.954388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:07.955166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:08.805196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:08.831184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc997c12-d750-432e-a2d0-4ea432ce2c86 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.916692 Jun 25 21:11:08.843081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2497/4563] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:07 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:08.856215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:08.861865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:08.881345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:08.892977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:08.895271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:08.896938 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ead819b6-d2ca-4731-929b-02fe374a00fd tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1339 microversion: 2.47 time: 1.247766 Jun 25 21:11:08.898038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2067/4564] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:07 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1339 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:08.900796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:08.901258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:08.902056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:08.902495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:09.860109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:09.861215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:09.889256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:09.890696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:09.891764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:09.892574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:10.211595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:10.220698 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b50a01c-31df-4aec-b0a6-32b26fc51965 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.365219 Jun 25 21:11:10.227165 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2068/4565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:09 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:10.245011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:10.248007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:10.263645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:10.264113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:10.264966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:10.271030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:10.379508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:10.393229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:10.397216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:10.399155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30d93ccf-3eb3-42ff-ae56-7b287e6b44f3 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1360 microversion: 2.47 time: 0.170654 Jun 25 21:11:10.400249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2069/4566] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:10 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1360 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:10.428611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1377886274"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:10.430249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:10.440728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:10.441185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:10.442104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:10.442590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:10.525556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:10.567355 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e72ff5da-7925-4d8f-8dd0-6856ee7c6273 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 1.719172 Jun 25 21:11:10.573006 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2498/4567] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:08 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:10.884272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fa0839be-6e19-459f-ad19-d7eadb69bfb0 req-d3da9a70-e18e-4013-b92b-e020f4b4b198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59bcc670-e8ed-4208-8982-d9cb2288c90d", "tag": "8ef238d8-e025-4d27-b4e3-4de6d7346db1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:10.951919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa0839be-6e19-459f-ad19-d7eadb69bfb0 req-d3da9a70-e18e-4013-b92b-e020f4b4b198 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:10.955638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa0839be-6e19-459f-ad19-d7eadb69bfb0 req-d3da9a70-e18e-4013-b92b-e020f4b4b198 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.030733 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fa0839be-6e19-459f-ad19-d7eadb69bfb0 req-d3da9a70-e18e-4013-b92b-e020f4b4b198 service nova] Creating event network-changed:8ef238d8-e025-4d27-b4e3-4de6d7346db1 for instance 59bcc670-e8ed-4208-8982-d9cb2288c90d on nch1-master-1 Jun 25 21:11:11.047575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fa0839be-6e19-459f-ad19-d7eadb69bfb0 req-d3da9a70-e18e-4013-b92b-e020f4b4b198 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169174 Jun 25 21:11:11.050285 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2499/4568] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:11.191032 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d87a552-8fcb-4fae-af95-01409f8fc8a8 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "POST /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9/action" status: 202 len: 52 microversion: 2.47 time: 0.767265 Jun 25 21:11:11.191747 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2070/4569] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:11:10 2022] POST /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9/action => generated 52 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:11:11.203659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:11.207847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:11.222626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.223449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.225564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.227892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.242899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:11.243872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:11.261874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.267395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.272123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.273227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.319145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:11:11.659344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-063b66ac-9d20-49cb-b91e-e187f850aea0 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 204 len: 0 microversion: 2.47 time: 0.459809 Jun 25 21:11:11.660416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2500/4570] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:11:11 2022] DELETE /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:11:11.679610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:11.680868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:11.707107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.708652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.721663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:11.725253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:11.984014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:12.002227 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-afeacb94-011b-48c7-9146-cf8d4232bf93 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.764127 Jun 25 21:11:12.013355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2071/4571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:11 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:12.026588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:12.027655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:12.042689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:12.049568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:12.053361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:12.054233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:12.286151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:12.299473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:12.301789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:12.303491 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1b7f3ce-6843-4c2c-8028-d14791cdf7da tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1366 microversion: 2.47 time: 0.289175 Jun 25 21:11:12.305557 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2072/4572] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:12 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:12.314584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:12.329293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f7c15d3-06ab-4685-bc6e-39f8c1fa64ce tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 0.667311 Jun 25 21:11:12.330892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2501/4573] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:11 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:12.811093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d2cdf902-7d44-4532-b958-7907b08b2a6a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:12.822140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2cdf902-7d44-4532-b958-7907b08b2a6a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:12.822634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2cdf902-7d44-4532-b958-7907b08b2a6a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:12.853249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d2cdf902-7d44-4532-b958-7907b08b2a6a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Going to try to stop instance {{(pid=137462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:11:12.913749 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d2cdf902-7d44-4532-b958-7907b08b2a6a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action" status: 202 len: 0 microversion: 2.1 time: 0.108501 Jun 25 21:11:12.915077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2073/4574] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:12 2022] POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:12.923429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:12.924899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:12.934106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:12.935215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:12.936352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:12.937215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.032127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:13.033217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:13.058628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.059656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.061106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.061846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.341330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.373432 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9710edec-2eb7-48e8-b9c8-8985938b1b59 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.453686 Jun 25 21:11:13.374367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2502/4575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:12 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:13.399932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:13.400710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:13.425906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.426384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.429198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.429713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.574353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.592492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.594154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.595899 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d1fc4ba-d6d1-45b3-89b3-e4b134a5acb6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1366 microversion: 2.47 time: 0.219576 Jun 25 21:11:13.597041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2503/4576] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:13 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:13.606573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:13.607605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:13.621378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.628364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.630145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.634240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:13.634741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:13.635653 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-576d8972-d32c-48cc-b69e-f541c2b87df0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.609329 Jun 25 21:11:13.636274 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2074/4577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:13 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:13.927487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:13.938147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78ead713-b9eb-49e3-a6cf-beb2b49c9773 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 0.339780 Jun 25 21:11:13.938746 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2504/4578] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:13 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:14.392606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:14.393217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:14.401557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.402074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.402906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.403354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.583704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:14.596069 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-205ac4c3-f79a-4acf-896e-cd5d8280f057 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.206937 Jun 25 21:11:14.601836 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2075/4579] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:14 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:14.617028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:14.617921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:14.625840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.626471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.627431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.627863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.654678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:14.655203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:14.684717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.685456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.686578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.687138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.746689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:14.777311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:14.792604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:14.799402 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa4d4ac0-7202-48b2-9433-a773a29b18d1 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1366 microversion: 2.47 time: 0.186231 Jun 25 21:11:14.801874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2505/4580] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:14 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:14.959999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:14.961453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:14.978486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:14.980034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:14.983446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:14.994146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:14.994768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:14.999576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:15.006106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:15.013031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:15.025886 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-180a25eb-6d46-48c8-9860-302ed869fcc3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.376129 Jun 25 21:11:15.027356 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2076/4581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:14 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:15.457482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:15.487806 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ac64f9a3-4c57-4e19-a6f7-e4ac432e70db tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 0.535893 Jun 25 21:11:15.488448 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2506/4582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:14 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:15.622382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:15.624351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:15.636780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:15.637526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:15.638758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:15.639561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:15.822156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:15.823062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:15.836250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:15.840925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:15.842469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:15.843332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:15.971352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:15.985601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:15.997460 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e3bd54f-fa6f-44be-88e4-6f6f573d567b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.379953 Jun 25 21:11:15.999908 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2077/4583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:15 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:16.003417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:16.005712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:16.007788 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9364f458-f1e2-4335-8970-c84471578581 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1366 microversion: 2.47 time: 0.191985 Jun 25 21:11:16.009263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2507/4584] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:15 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:16.049067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:16.054352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:16.066437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:16.070596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:16.072641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:16.075921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:16.110469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:16.280619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:16.291435 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ea37648b-3bc7-4341-8232-3e2a9179400f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.249132 Jun 25 21:11:16.292442 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2078/4585] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:16 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:16.507151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:16.508398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:16.524225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:16.525322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:16.529943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:16.530628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:16.868243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:16.883183 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d02092b-088a-44bc-be76-2cc1b9766da4 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 0.380515 Jun 25 21:11:16.884090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2508/4586] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:16 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:17.021085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:17.029909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:17.031244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:17.033891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:17.057612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.065489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.069425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.073899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.075978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.091209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.109647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.110840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.215572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:17.387833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:17.405068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:17.410353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:17.414778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b1f57c4-48a9-4e60-86b6-c0bec212368a tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1366 microversion: 2.47 time: 0.389419 Jun 25 21:11:17.427640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2509/4587] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:17 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1366 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:11:17.440506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7b301145-7359-45fa-b72c-3f1d6f3d4c53 req-0f3b635f-0b05-4bc9-a9c0-b6af30f325e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bcc670-e8ed-4208-8982-d9cb2288c90d", "name": "network-vif-plugged", "status": "completed", "tag": "8ef238d8-e025-4d27-b4e3-4de6d7346db1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:17.470630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7b301145-7359-45fa-b72c-3f1d6f3d4c53 req-0f3b635f-0b05-4bc9-a9c0-b6af30f325e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.472335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7b301145-7359-45fa-b72c-3f1d6f3d4c53 req-0f3b635f-0b05-4bc9-a9c0-b6af30f325e2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.502687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7b301145-7359-45fa-b72c-3f1d6f3d4c53 req-0f3b635f-0b05-4bc9-a9c0-b6af30f325e2 service nova] Creating event network-vif-plugged:8ef238d8-e025-4d27-b4e3-4de6d7346db1 for instance 59bcc670-e8ed-4208-8982-d9cb2288c90d on nch1-master-1 Jun 25 21:11:17.512801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:17.520133 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7b301145-7359-45fa-b72c-3f1d6f3d4c53 req-0f3b635f-0b05-4bc9-a9c0-b6af30f325e2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086858 Jun 25 21:11:17.521735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2510/4588] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:17.547204 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19c6e324-fbc0-463a-ad96-8a3ea951437f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.532545 Jun 25 21:11:17.551509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:17.552385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:17.554668 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2079/4589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:17 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:17.566506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.569950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.570774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.571214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.878004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:17.888496 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-59c87e6b-dae7-4f00-ae2b-6bc73365e61e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.365187 Jun 25 21:11:17.889317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2511/4590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:17 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:17.905173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:17.906197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:17.914129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.914902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:17.915874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:17.916536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.082942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:18.094246 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fde59076-c613-4b6b-b203-f77c0b6d3c3f tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1318 microversion: 2.1 time: 0.192883 Jun 25 21:11:18.094863 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2080/4591] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:17 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:18.437953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:18.439192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:18.446644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.447154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.450995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.451711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.503723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.504644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.505232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lazy-loading 'fault' on Instance uuid ab4b68c7-70d7-47de-a292-695526e115c9 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:18.552922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:18.563527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:18.565519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:18.566692 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e347b42e-f53b-49a3-94c1-f6c614da89e6 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1371 microversion: 2.47 time: 0.133664 Jun 25 21:11:18.568191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:18.569191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:18.578044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2512/4592] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:18 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:18.579025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.579610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.580644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.581361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.726909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:18.736303 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce23f9a5-6904-4112-ae64-6a08b0249c0b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.174354 Jun 25 21:11:18.737093 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2081/4593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:18 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:18.906190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:18.907216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:18.914965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.915515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:18.916316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:18.916779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.067371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.077222 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2e15c40-c689-40a0-9889-0b94c545aee4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.175044 Jun 25 21:11:19.077831 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2513/4594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:18 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:19.112097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:19.113546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:19.121491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.122207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.122996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.123476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.272877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.281516 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e7908e34-b6f1-403d-883a-4f1372768917 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1508 microversion: 2.1 time: 0.173910 Jun 25 21:11:19.282107 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2082/4595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:19 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:19.584988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:19.585602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:19.593993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.594659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.595685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.596274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.631437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.631877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.632538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lazy-loading 'fault' on Instance uuid ab4b68c7-70d7-47de-a292-695526e115c9 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:19.674273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.683647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.685325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.686783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3c4a696-bd1e-4106-a42e-546632e6f8ac tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1371 microversion: 2.47 time: 0.105773 Jun 25 21:11:19.698497 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2514/4596] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:19 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:19.754368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:19.755131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:19.761607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.762372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.763138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:19.763603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:19.920530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:19.929053 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f6c5c5b-9f3c-41c0-b044-7cf3d7128d2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.178713 Jun 25 21:11:19.940538 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2083/4597] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:19 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:20.095740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:20.096348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:20.103027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.103479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.104234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.104686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.264266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:20.274013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37da5fb6-6519-4102-bad4-2256ea909d99 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.182721 Jun 25 21:11:20.274732 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2515/4598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:20 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:20.706944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:20.707561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:20.716636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.717128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.718199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.718730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.740569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "36e34598-7571-43c8-8858-a1dec36e12c4"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:20.742315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:20.749023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.749705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.750644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.751305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.757774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.758667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.759292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lazy-loading 'fault' on Instance uuid ab4b68c7-70d7-47de-a292-695526e115c9 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:20.822869 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] HTTP exception thrown: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Request method failure captured: Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d/os-volume_attachments/c8b5f7bd-db60-4c33-a438-b95ef4a78136 HTTP/1.1 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 74 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3maeAu8I_12jQopFl6ZNKc2UyLmiR-p6RfDMnAuqd0NFEgIBTWziL2I2tz_3iR9StiTj5mzrLlGO1hWb6ujsVXhZCv4U0cHR1gzp76bhzA8a83xWvnN_VyHsKOAj_ibfVYvNvr6nPM1VOYI1_rzZYf8VHjuEX3MjG3t81sEp-vKQuA Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 932c8bf8a22a43cab5d091b6dfa13ba4 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_932c8bf8a22a43cab5d091b6dfa13ba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/932c8bf8a22a43cab5d091b6dfa13ba4"}]}] Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 932c8bf8a22a43cab5d091b6dfa13ba4 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-681282819 Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesAdminNegativeTest-681282819-project-admin Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6412ea72fc614168a6498d20e6a26f3c Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesAdminNegativeTest-681282819-project-admin Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: {"volumeAttachment": {"volumeId": "36e34598-7571-43c8-8858-a1dec36e12c4"}} Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: exception: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '59bcc670-e8ed-4208-8982-d9cb2288c90d', 'id': 'c8b5f7bd-db60-4c33-a438-b95ef4a78136', 'body': {'volumeAttachment': {'volumeId': '36e34598-7571-43c8-8858-a1dec36e12c4'}}} Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. (HTTP 404) (Request-ID: req-3cf7bb70-d29c-4344-9fd0-b3dedca60578) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:20.825403 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] Returning 404 to user: Volume c8b5f7bd-db60-4c33-a438-b95ef4a78136 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bdf5ccc-29cb-42a3-a995-6088bbc1c387 tempest-VolumesAdminNegativeTest-681282819 tempest-VolumesAdminNegativeTest-681282819-project-admin] 10.222.0.39 "PUT /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d/os-volume_attachments/c8b5f7bd-db60-4c33-a438-b95ef4a78136" status: 404 len: 109 microversion: 2.1 time: 0.090375 Jun 25 21:11:20.829708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2516/4599] 10.222.0.39 () {60 vars in 1432 bytes} [Sat Jun 25 21:11:20 2022] PUT /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d/os-volume_attachments/c8b5f7bd-db60-4c33-a438-b95ef4a78136 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:20.843853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:20.855215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:20.857388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d06d8ec975744088a0a9d20025491b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffb625e087fa4ad498ff0cd6d864116a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:20.860979 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85384ec1-c646-4e40-a1cc-ff40693f3c96 tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 200 len: 1371 microversion: 2.47 time: 0.157107 Jun 25 21:11:20.862129 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2084/4600] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:20 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:20.947067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:20.947766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:20.954192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.954766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:20.955801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:20.956452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:21.124678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:21.135452 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19fa987e-aa43-4261-b086-d6d1a6da8a39 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.192276 Jun 25 21:11:21.136761 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2517/4601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:20 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:21.292409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:21.293037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:21.300944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:21.301603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:21.302558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:21.303173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:21.489083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:21.503148 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d89f443-a965-49b5-b9a2-4b13958f7a4a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.214245 Jun 25 21:11:21.504380 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2085/4602] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:21 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:21.879870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:21.881411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] [instance: ab4b68c7-70d7-47de-a292-695526e115c9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:21.889889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:21.890481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:21.891355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:21.892195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:21.909259 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] HTTP exception thrown: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Request method failure captured: Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 HTTP/1.1 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3nkmJvTYfYBRPT6KOTzzm3Et3PRX14JPwOG8IG20E9srZHIxtuLEWPh6txGzjkZEu39SOixlXsVoSV6OPKdO7IBzthU3w9urfqMVxFaqBxkyIhmJ2I6Hbyo1XfuGmecDu3TBtZoAmfnc_XtavBJZmMUa8KrMGXSyXuwUSnp4xcGfWY Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.47 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ffb625e087fa4ad498ff0cd6d864116a Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAaction247Test-2019557715 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ffb625e087fa4ad498ff0cd6d864116a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffb625e087fa4ad498ff0cd6d864116a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ffb625e087fa4ad498ff0cd6d864116a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ffb625e087fa4ad498ff0cd6d864116a"}]}] Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAaction247Test-2019557715 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ffb625e087fa4ad498ff0cd6d864116a Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAaction247Test-2019557715 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAaction247Test-2019557715-project Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 2d06d8ec975744088a0a9d20025491b8 Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAaction247Test-2019557715-project Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ab4b68c7-70d7-47de-a292-695526e115c9'} Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:21.911705 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] Returning 404 to user: Instance ab4b68c7-70d7-47de-a292-695526e115c9 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13cd019e-abe9-4e17-bda9-08fa240dee6f tempest-ServersAaction247Test-2019557715 tempest-ServersAaction247Test-2019557715-project] 10.222.0.39 "GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9" status: 404 len: 111 microversion: 2.47 time: 0.038008 Jun 25 21:11:21.915812 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2518/4603] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:21 2022] GET /compute/v2.1/servers/ab4b68c7-70d7-47de-a292-695526e115c9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:11:22.011296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:22.013039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:22.023532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.024127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.025666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.026292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.058184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:11:22.154820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:22.156991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:22.166726 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be4ed547-6ee3-49bb-9221-072b2b9f5b71 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "DELETE /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 204 len: 0 microversion: 2.1 time: 0.160980 Jun 25 21:11:22.167569 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2086/4604] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:11:22 2022] DELETE /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:11:22.170072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.170791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.171826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.172526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.182676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:22.183399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:22.189934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.190392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.191720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.191720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.363840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:22.364927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:22.376875 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3a5f3d9e-b306-4f4e-aef5-0f303bd3e49a tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1514 microversion: 2.1 time: 0.203725 Jun 25 21:11:22.377299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ffc7a7da-0b14-41d7-9872-c41762d9a932 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.226404 Jun 25 21:11:22.386748 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2519/4605] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:22 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:22.387476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2087/4606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:22 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:22.521750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:22.522525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:22.529284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.529834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.530558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:22.531047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:22.683459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:22.694603 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4dc380e-250b-4142-bec0-e181c46b2f2f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.177306 Jun 25 21:11:22.695353 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2520/4607] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:22 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:23.396665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:23.397782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:23.398228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:23.398335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:23.411687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.413360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.413636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.414151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.414647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.415185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.415781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.416308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.627720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:23.636346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aa3aa273-c432-4b1f-9b70-9db7b22ba611 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1514 microversion: 2.1 time: 0.244185 Jun 25 21:11:23.645976 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2088/4608] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:23 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:23.730978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:23.739558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-201e9a5d-2b9d-4a54-98e8-3b2fa4e3bfe9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.347697 Jun 25 21:11:23.748563 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2521/4609] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:23 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:23.748563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:23.748563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:23.753283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.753811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.754664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:23.755164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:23.816204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b0bebf5-db53-486a-b39c-0a185c671aea tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Action: 'create', calling method: .version_select at 0x7f985c85cf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-979935565"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:23.984818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:24.001527 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8a94b30-0355-461f-b8d1-d62b4a6b065d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.259355 Jun 25 21:11:24.002138 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2522/4610] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:23 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:24.186752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-74313dad-ee54-4719-8470-76c8b76e3d12 req-6ebc8b36-2568-466f-9673-556ddedac1b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59bcc670-e8ed-4208-8982-d9cb2288c90d", "name": "network-vif-deleted", "tag": "8ef238d8-e025-4d27-b4e3-4de6d7346db1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:24.206828 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b0bebf5-db53-486a-b39c-0a185c671aea tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.538087 Jun 25 21:11:24.208205 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2089/4611] 10.222.0.39 () {60 vars in 1154 bytes} [Sat Jun 25 21:11:23 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 540 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 25 21:11:24.220589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c85c5faa-2b83-408b-b873-32df3eab880b tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f985c087430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:24.221055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-74313dad-ee54-4719-8470-76c8b76e3d12 req-6ebc8b36-2568-466f-9673-556ddedac1b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.221542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-74313dad-ee54-4719-8470-76c8b76e3d12 req-6ebc8b36-2568-466f-9673-556ddedac1b3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.247116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-74313dad-ee54-4719-8470-76c8b76e3d12 req-6ebc8b36-2568-466f-9673-556ddedac1b3 service nova] Creating event network-vif-deleted:8ef238d8-e025-4d27-b4e3-4de6d7346db1 for instance 59bcc670-e8ed-4208-8982-d9cb2288c90d on nch1-master-1 Jun 25 21:11:24.257891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-74313dad-ee54-4719-8470-76c8b76e3d12 req-6ebc8b36-2568-466f-9673-556ddedac1b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075423 Jun 25 21:11:24.259037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2523/4612] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:24.361399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c85c5faa-2b83-408b-b873-32df3eab880b tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 200 len: 337 microversion: 2.1 time: 0.145071 Jun 25 21:11:24.362618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2090/4613] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:24 2022] GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 337 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:24.654975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:24.655774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:24.667507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.669249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.671418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.671939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.717149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.717692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.718785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lazy-loading 'fault' on Instance uuid 59bcc670-e8ed-4208-8982-d9cb2288c90d {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:24.766184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:24.769100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:24.775083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:24.781277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.782081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.784599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:24.785616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:24.803086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:24.820268 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-85a38e18-341d-44e4-a6dd-ef7255149e09 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 200 len: 1308 microversion: 2.1 time: 0.170411 Jun 25 21:11:24.832244 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2524/4614] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:24 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:24.990068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:24.999115 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc911d06-5407-4d36-8339-6de0ba51631e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.245600 Jun 25 21:11:24.999790 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2091/4615] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:24 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:25.019498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.020225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:25.027090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:25.027547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:25.028322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:25.028787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:25.181532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:25.189810 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb576410-eded-48b3-b3d8-90ec0a3ab125 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.174312 Jun 25 21:11:25.190405 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2525/4616] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:25.374468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1e61fee-27df-48a8-8d73-55fe6bce1e90 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984fe59a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.424332 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1e61fee-27df-48a8-8d73-55fe6bce1e90 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 200 len: 338 microversion: 2.1 time: 0.054328 Jun 25 21:11:25.425088 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2092/4617] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 338 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:25.436733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d19cd23f-1454-4c02-b99c-f04838439272 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Action: 'create', calling method: .version_select at 0x7f984fd19790>, body: {"snapshot": {"volume_id": "610e16aa-feec-4f36-8277-ba9db76db73a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1545027934"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:25.635557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d19cd23f-1454-4c02-b99c-f04838439272 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.202584 Jun 25 21:11:25.636323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2526/4618] 10.222.0.39 () {60 vars in 1161 bytes} [Sat Jun 25 21:11:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:25.647437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d5679e7-d3bf-4aa5-9397-1b709df6f268 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f985cac6ee0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.718607 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d5679e7-d3bf-4aa5-9397-1b709df6f268 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 200 len: 287 microversion: 2.1 time: 0.075284 Jun 25 21:11:25.719320 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2093/4619] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:25.733933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-faef4b14-e9dd-4ec9-9587-c4fb43b3ade3 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984ebeb160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.785380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-faef4b14-e9dd-4ec9-9587-c4fb43b3ade3 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.058870 Jun 25 21:11:25.785982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2527/4620] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:25.797477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-274b4659-1e94-4f2e-a720-c5a70a91918e tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f985c087670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.840822 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-274b4659-1e94-4f2e-a720-c5a70a91918e tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 200 len: 287 microversion: 2.1 time: 0.048223 Jun 25 21:11:25.841456 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2094/4621] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:25.844733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:25.844733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 59bcc670-e8ed-4208-8982-d9cb2288c90d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:25.850792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:25.851251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:25.852285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:25.852755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:25.869260 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] HTTP exception thrown: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Request method failure captured: Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d HTTP/1.1 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mAKiib0aIM8kyOkyr6S4tT1A_RCStr-4TKC4_zUJvncMmUzmeBVHTCGXafAJZ4INpve0JfK_Z1lbk1hGrvrWBdHL4LKC8g1ucqmEHN9_fL9v5vpyVrqDtKE0HxTxbVp9FwlYj4ejU0BiHkNMoANaDekbNo0gYgNBG7c2iKxwW5Suo Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7cc291ebc8c64e32a229e9a993f517a9 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cc291ebc8c64e32a229e9a993f517a9"}]}] Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7cc291ebc8c64e32a229e9a993f517a9 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesAdminNegativeTest-200725683-project Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: bee65f1c37764bdb9985b4e96a97ce9e Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesAdminNegativeTest-200725683-project Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '59bcc670-e8ed-4208-8982-d9cb2288c90d'} Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:25.870999 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Returning 404 to user: Instance 59bcc670-e8ed-4208-8982-d9cb2288c90d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:25.875594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4997281-d813-40ff-bae4-1b8081bc29f6 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d" status: 404 len: 111 microversion: 2.1 time: 0.036502 Jun 25 21:11:25.877891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2528/4622] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:25 2022] GET /compute/v2.1/servers/59bcc670-e8ed-4208-8982-d9cb2288c90d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:11:26.018828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:26.019485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:26.026719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:26.027195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:26.028004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:26.028826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:26.195990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:26.205256 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5e98a00-147e-42cf-a381-dcb8f44bb5ff tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.190711 Jun 25 21:11:26.209030 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2095/4623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:26 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:26.210836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:26.211465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:26.218542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:26.219077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:26.219972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:26.220924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:26.385006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:26.393573 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02488028-cc8e-4680-b9bd-1ad92223f597 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.188195 Jun 25 21:11:26.394310 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2529/4624] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:26 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:26.853259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64786ba0-3192-4cb0-8949-c52cbb8bc60b tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f985ccc35e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:26.900849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64786ba0-3192-4cb0-8949-c52cbb8bc60b tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 200 len: 288 microversion: 2.1 time: 0.050544 Jun 25 21:11:26.901524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2096/4625] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:11:26 2022] GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 288 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:26.924719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5631dd46-15ec-400e-bfe8-127b61999f75 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984ebeb8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.012752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5631dd46-15ec-400e-bfe8-127b61999f75 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 202 len: 0 microversion: 2.1 time: 0.092332 Jun 25 21:11:27.013433 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2530/4626] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:11:26 2022] DELETE /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:27.022991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d192ff69-c664-4ba5-86c4-6ef9c331507e tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f9861f0c4c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.060634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.061174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:27.076861 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d192ff69-c664-4ba5-86c4-6ef9c331507e tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 200 len: 287 microversion: 2.1 time: 0.058047 Jun 25 21:11:27.077459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2097/4627] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:11:27 2022] GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:27.077606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.077932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.079073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.079777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.083450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:27.115799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:11:27.215840 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14119e3d-558e-4dfe-aae4-d6ab3858e30b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 204 len: 0 microversion: 2.1 time: 0.163436 Jun 25 21:11:27.216765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2531/4628] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:11:27 2022] DELETE /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:11:27.226338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.227057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.227418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:27.227866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:27.234136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.234807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.235919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.236513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.238643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.239698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.240603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.241201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.395405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:27.405458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-521ae784-b554-4ddd-ad70-b558e659e62b tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1682 microversion: 2.1 time: 0.183641 Jun 25 21:11:27.406220 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2532/4629] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:27 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:27.411687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5494cbe3-f21c-400c-94b3-a89bbcae673c req-43a0b595-c4e6-4ac5-ad3b-c9a1f5321a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "name": "network-vif-plugged", "status": "completed", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:27.418364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:27.421145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5494cbe3-f21c-400c-94b3-a89bbcae673c req-43a0b595-c4e6-4ac5-ad3b-c9a1f5321a1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.421661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5494cbe3-f21c-400c-94b3-a89bbcae673c req-43a0b595-c4e6-4ac5-ad3b-c9a1f5321a1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.427484 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfd62321-76ef-416f-b97d-ad2066589e14 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.206153 Jun 25 21:11:27.428637 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2098/4630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:27 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:27.433972 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5494cbe3-f21c-400c-94b3-a89bbcae673c req-43a0b595-c4e6-4ac5-ad3b-c9a1f5321a1b service nova] Creating event network-vif-plugged:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:11:27.436434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:27.437219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:27.439803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5494cbe3-f21c-400c-94b3-a89bbcae673c req-43a0b595-c4e6-4ac5-ad3b-c9a1f5321a1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032254 Jun 25 21:11:27.440518 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2533/4631] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:27.443812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.444263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.445083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:27.445515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:27.635014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:27.648015 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-11061fba-f250-453a-92a5-3577b65c5b45 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.218077 Jun 25 21:11:27.649139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2099/4632] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:27 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:28.091614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9fdba9-7756-4676-9fd6-2a65f00c58d4 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984f738820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.122920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4a9fdba9-7756-4676-9fd6-2a65f00c58d4 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] HTTP exception thrown: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9fdba9-7756-4676-9fd6-2a65f00c58d4 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Request method failure captured: Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 HTTP/1.1 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3n7gpSxVy08bLRpDbvixC0zXQPzM2lzdRR0Eij-hF3Bk2MlA784SzOVmdYNZNjX28Ha7a6d6e_KkCwLoQi4G6ttvxVO-vvOckPgAFBu5yBAlDkIkCL1ONFjGXqqNSq3hjbH_tQ29RFW_ihT1A7ctC4Fbp18-eO5ZiX8NZ-mgwHPLEo Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}] Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a045ffc3ca714026846fa943dc735596 Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: exception: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3ed1a4de-c8ef-4621-aeb2-6556a78f2882'} Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. (HTTP 404) (Request-ID: req-e1d3a5fa-8723-4e4a-ad8a-ba03aaaebe11) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:28.132398 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. Jun 25 21:11:28.136622 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:28.141110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a9fdba9-7756-4676-9fd6-2a65f00c58d4 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Returning 404 to user: Snapshot 3ed1a4de-c8ef-4621-aeb2-6556a78f2882 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:28.142267 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a9fdba9-7756-4676-9fd6-2a65f00c58d4 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882" status: 404 len: 111 microversion: 2.1 time: 0.056896 Jun 25 21:11:28.142894 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2534/4633] 10.222.0.39 () {58 vars in 1250 bytes} [Sat Jun 25 21:11:28 2022] GET /compute/v2.1/os-snapshots/3ed1a4de-c8ef-4621-aeb2-6556a78f2882 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:11:28.152203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-949e4a05-17cc-42de-a332-e1afc1d63907 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f9861ec33a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.232798 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-949e4a05-17cc-42de-a332-e1afc1d63907 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 202 len: 0 microversion: 2.1 time: 0.084515 Jun 25 21:11:28.233372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2100/4634] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:11:28 2022] DELETE /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:28.243560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c911b809-b3af-4ca6-8ec2-5480b39329ac tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984eb10670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.300837 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c911b809-b3af-4ca6-8ec2-5480b39329ac tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 200 len: 337 microversion: 2.1 time: 0.061905 Jun 25 21:11:28.301637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2535/4635] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:28 2022] GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 337 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:28.423221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.424355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:28.432706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.433458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.434258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.434805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.441059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:28.447911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.449022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:28.458066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.458927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.460011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.460830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.647951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:28.666418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7dfb999c-7860-4178-b1a4-061f2f88da13 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1682 microversion: 2.1 time: 0.247368 Jun 25 21:11:28.667445 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2101/4636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:28 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1682 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:28.675306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:28.676136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:28.686138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.686881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.687750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:28.689377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:28.716466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:28.745198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07a23975-5fc9-4cda-b23e-db9d5411e4cc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1723 microversion: 2.1 time: 0.300272 Jun 25 21:11:28.755505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2536/4637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:28 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:28.910165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:28.919513 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c181fec6-ee4b-4c73-a2af-b080f54e0d77 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.249562 Jun 25 21:11:28.921238 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2102/4638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:28 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:29.317474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61297529-dc2f-4cde-8d74-2af33094fa97 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984ebeb940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.381544 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-61297529-dc2f-4cde-8d74-2af33094fa97 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] HTTP exception thrown: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61297529-dc2f-4cde-8d74-2af33094fa97 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Request method failure captured: Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a HTTP/1.1 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3n7gpSxVy08bLRpDbvixC0zXQPzM2lzdRR0Eij-hF3Bk2MlA784SzOVmdYNZNjX28Ha7a6d6e_KkCwLoQi4G6ttvxVO-vvOckPgAFBu5yBAlDkIkCL1ONFjGXqqNSq3hjbH_tQ29RFW_ihT1A7ctC4Fbp18-eO5ZiX8NZ-mgwHPLEo Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}] Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a045ffc3ca714026846fa943dc735596 Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: exception: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '610e16aa-feec-4f36-8277-ba9db76db73a'} Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. (HTTP 404) (Request-ID: req-6f1bf113-8a79-4c5c-86df-9c19985110b2) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:29.387218 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.392913 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.399221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61297529-dc2f-4cde-8d74-2af33094fa97 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Returning 404 to user: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:29.399777 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-61297529-dc2f-4cde-8d74-2af33094fa97 tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 404 len: 109 microversion: 2.1 time: 0.088190 Jun 25 21:11:29.400387 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2537/4639] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:29 2022] GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:29.411593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d20ab243-a097-458b-9ea2-e7454fa3d75c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f9861f24ca0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.449550 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d20ab243-a097-458b-9ea2-e7454fa3d75c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] HTTP exception thrown: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d20ab243-a097-458b-9ea2-e7454fa3d75c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Request method failure captured: Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a HTTP/1.1 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3n7gpSxVy08bLRpDbvixC0zXQPzM2lzdRR0Eij-hF3Bk2MlA784SzOVmdYNZNjX28Ha7a6d6e_KkCwLoQi4G6ttvxVO-vvOckPgAFBu5yBAlDkIkCL1ONFjGXqqNSq3hjbH_tQ29RFW_ihT1A7ctC4Fbp18-eO5ZiX8NZ-mgwHPLEo Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}] Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: a045ffc3ca714026846fa943dc735596 Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: exception: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '610e16aa-feec-4f36-8277-ba9db76db73a'} Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. (HTTP 404) (Request-ID: req-7479252d-b0fc-4833-8cc5-b7115fef7695) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:29.454301 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d20ab243-a097-458b-9ea2-e7454fa3d75c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Returning 404 to user: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d20ab243-a097-458b-9ea2-e7454fa3d75c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 404 len: 109 microversion: 2.1 time: 0.050836 Jun 25 21:11:29.459155 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2103/4640] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:11:29 2022] DELETE /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:29.481583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea4e7b1b-78e7-4e91-ac52-7f46a8040c4c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Calling method '.version_select at 0x7f984fe3f790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.529146 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ea4e7b1b-78e7-4e91-ac52-7f46a8040c4c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] HTTP exception thrown: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea4e7b1b-78e7-4e91-ac52-7f46a8040c4c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Request method failure captured: Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a HTTP/1.1 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3n7gpSxVy08bLRpDbvixC0zXQPzM2lzdRR0Eij-hF3Bk2MlA784SzOVmdYNZNjX28Ha7a6d6e_KkCwLoQi4G6ttvxVO-vvOckPgAFBu5yBAlDkIkCL1ONFjGXqqNSq3hjbH_tQ29RFW_ihT1A7ctC4Fbp18-eO5ZiX8NZ-mgwHPLEo Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ba3c632ea72243429aedaf10e5af8ec2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ba3c632ea72243429aedaf10e5af8ec2"}]}] Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ba3c632ea72243429aedaf10e5af8ec2 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1030822409 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: a045ffc3ca714026846fa943dc735596 Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1030822409-project Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: exception: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '610e16aa-feec-4f36-8277-ba9db76db73a'} Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. (HTTP 404) (Request-ID: req-a75c9230-199a-47e4-b517-7fdb3d1a9764) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:29.533658 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. Jun 25 21:11:29.539504 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:29.546421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea4e7b1b-78e7-4e91-ac52-7f46a8040c4c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] Returning 404 to user: Volume 610e16aa-feec-4f36-8277-ba9db76db73a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:29.547435 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea4e7b1b-78e7-4e91-ac52-7f46a8040c4c tempest-VolumesSnapshotsTestJSON-1030822409 tempest-VolumesSnapshotsTestJSON-1030822409-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a" status: 404 len: 109 microversion: 2.1 time: 0.084486 Jun 25 21:11:29.550585 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2538/4641] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:29 2022] GET /compute/v2.1/os-volumes/610e16aa-feec-4f36-8277-ba9db76db73a => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:29.693095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.695270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:29.705302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.705776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:29.706734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.707394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:29.763607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.766879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:29.790383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.791843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:29.796004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.796930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:29.798973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee65f1c37764bdb9985b4e96a97ce9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc291ebc8c64e32a229e9a993f517a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:29.807946 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ebb8342-87c1-420e-ac0e-56106659489d tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 200 len: 1615 microversion: 2.1 time: 0.128114 Jun 25 21:11:29.808919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2104/4642] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:29 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 1615 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:29.946597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:29.947450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:29.958240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.958927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:29.959967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:29.960852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.292727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:30.316629 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7148f99e-65f9-4665-a2a7-94fd5a2b56eb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1700 microversion: 2.1 time: 0.557431 Jun 25 21:11:30.325177 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2539/4643] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:29 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1700 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:30.325177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2110ad9e-5d41-4fdd-af5d-a061191a0a48 req-dd5368ca-2d96-4141-ab15-a4830fde7bc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f235586-ed12-4584-afe9-bc3aa733e6e9", "name": "network-vif-deleted", "tag": "ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:30.339456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2110ad9e-5d41-4fdd-af5d-a061191a0a48 req-dd5368ca-2d96-4141-ab15-a4830fde7bc2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.339903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2110ad9e-5d41-4fdd-af5d-a061191a0a48 req-dd5368ca-2d96-4141-ab15-a4830fde7bc2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.362821 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2110ad9e-5d41-4fdd-af5d-a061191a0a48 req-dd5368ca-2d96-4141-ab15-a4830fde7bc2 service nova] Creating event network-vif-deleted:ec1ea66f-dafb-4c3c-bde3-19ee32aee2ad for instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 on nch1-master-1 Jun 25 21:11:30.383336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2110ad9e-5d41-4fdd-af5d-a061191a0a48 req-dd5368ca-2d96-4141-ab15-a4830fde7bc2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060698 Jun 25 21:11:30.384963 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2540/4644] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:30.408769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb6c0ae3-0707-4af1-8782-01215b5adbdd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:30.417586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb6c0ae3-0707-4af1-8782-01215b5adbdd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.418279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb6c0ae3-0707-4af1-8782-01215b5adbdd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.419961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:30.440077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dab8bdcc-f49a-4e68-b23a-e4896f776e72 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1518 microversion: 2.1 time: 0.499754 Jun 25 21:11:30.440776 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2105/4645] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:29 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1518 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:30.460872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb6c0ae3-0707-4af1-8782-01215b5adbdd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Going to try to start instance {{(pid=137461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 21:11:30.523251 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb6c0ae3-0707-4af1-8782-01215b5adbdd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action" status: 202 len: 0 microversion: 2.1 time: 0.133305 Jun 25 21:11:30.523956 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2541/4646] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:30 2022] POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:30.534015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:30.534984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:30.542767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.543697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.544903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.546100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.810536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:30.833111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:30.834194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] [instance: 8f235586-ed12-4584-afe9-bc3aa733e6e9] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:30.845455 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b809946-4b88-40bf-ad31-abdf66a3f1b8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1709 microversion: 2.1 time: 0.316123 Jun 25 21:11:30.846142 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2106/4647] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:30 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1709 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:30.851157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.851972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.853578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:30.854325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:30.874701 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] HTTP exception thrown: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Request method failure captured: Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 HTTP/1.1 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mAKiib0aIM8kyOkyr6S4tT1A_RCStr-4TKC4_zUJvncMmUzmeBVHTCGXafAJZ4INpve0JfK_Z1lbk1hGrvrWBdHL4LKC8g1ucqmEHN9_fL9v5vpyVrqDtKE0HxTxbVp9FwlYj4ejU0BiHkNMoANaDekbNo0gYgNBG7c2iKxwW5Suo Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7cc291ebc8c64e32a229e9a993f517a9 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7cc291ebc8c64e32a229e9a993f517a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7cc291ebc8c64e32a229e9a993f517a9"}]}] Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7cc291ebc8c64e32a229e9a993f517a9 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-200725683 Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesAdminNegativeTest-200725683-project Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: bee65f1c37764bdb9985b4e96a97ce9e Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesAdminNegativeTest-200725683-project Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8f235586-ed12-4584-afe9-bc3aa733e6e9'} Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:30.877027 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:30.882446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Returning 404 to user: Instance 8f235586-ed12-4584-afe9-bc3aa733e6e9 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:30.883704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-565fcd7b-6a06-494e-abb3-d49d63c85fbd tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9" status: 404 len: 111 microversion: 2.1 time: 0.056356 Jun 25 21:11:30.884578 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2542/4648] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:30 2022] GET /compute/v2.1/servers/8f235586-ed12-4584-afe9-bc3aa733e6e9 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:30.894722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0196e734-0dd8-4c98-ab61-b6a49fb5c512 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] Calling method '.version_select at 0x7f9861fd43a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:30.917969 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0196e734-0dd8-4c98-ab61-b6a49fb5c512 tempest-VolumesAdminNegativeTest-200725683 tempest-VolumesAdminNegativeTest-200725683-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127793342" status: 202 len: 0 microversion: 2.1 time: 0.027618 Jun 25 21:11:30.919468 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2107/4649] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1127793342 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:31.459966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:31.460787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:31.468087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:31.485581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.487707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:31.491302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.492397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:31.864544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:31.872603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:31.889469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:31.889740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.891268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:31.893184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.894579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:31.913599 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e223dacd-9c24-429f-b11e-67c718fc29af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.459603 Jun 25 21:11:31.927164 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2543/4650] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:31 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:31.944708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:31.947435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:31.956652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.957330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:31.958841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:31.959426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.169672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:32.180655 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6cc3bad8-97a9-46fe-b3b1-6c68f235e3c9 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.251775 Jun 25 21:11:32.181870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2544/4651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:31 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:32.198150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:32.208488 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b81348d-68d4-4867-bb36-e67160c6248d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1709 microversion: 2.1 time: 0.348665 Jun 25 21:11:32.212466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:32.220859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2108/4652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:31 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1709 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:32.220959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:32.224038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.225123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.230504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.232000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.440053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:32.450874 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e2f340d-a6cd-4531-9cd9-bdef812dfe3e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.243676 Jun 25 21:11:32.452129 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2545/4653] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:32.472960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-abc5dc34-8862-4413-9cfd-20f3d3b086ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:32.512021 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-abc5dc34-8862-4413-9cfd-20f3d3b086ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-abc5dc34-8862-4413-9cfd-20f3d3b086ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/a8cf5d46-a757-4527-823c-56a8c922063b/action HTTP/1.1 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 15 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: {"os-stop": {}} Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a8cf5d46-a757-4527-823c-56a8c922063b', 'body': {'os-stop': {}}} Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:32.523419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. Jun 25 21:11:32.528270 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.530622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-abc5dc34-8862-4413-9cfd-20f3d3b086ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance a8cf5d46-a757-4527-823c-56a8c922063b has no mapping to a cell. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:32.531929 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-abc5dc34-8862-4413-9cfd-20f3d3b086ed tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/a8cf5d46-a757-4527-823c-56a8c922063b/action" status: 404 len: 117 microversion: 2.1 time: 0.064541 Jun 25 21:11:32.549426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:32.554816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:32.563249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2109/4654] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:32 2022] POST /compute/v2.1/servers/a8cf5d46-a757-4527-823c-56a8c922063b/action => generated 117 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:32.581946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.585175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.588177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.593878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.840909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:32.850703 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec0bf71e-80e8-4a60-a50f-7bcc7039f8b0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.312168 Jun 25 21:11:32.851571 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2546/4655] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:32.871820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:32.872785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:32.880500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.881001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.881853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:32.882357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:32.894809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8465629-00f7-42c3-92ec-68ddb9260dfd tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Action: 'create', calling method: .version_select at 0x7f984f675790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1278051884", "metadata": {"Type": "work"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8465629-00f7-42c3-92ec-68ddb9260dfd tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 122 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1278051884", "metadata": {"Type": "work"}}} Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1278051884', 'metadata': {'Type': 'work'}}}} Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '#$%' Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:11:32.900097 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8465629-00f7-42c3-92ec-68ddb9260dfd tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8465629-00f7-42c3-92ec-68ddb9260dfd tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.300002 Jun 25 21:11:32.904364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2110/4656] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:11:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:11:32.913940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b44ca885-7dbd-465c-84e3-80346f4c0170 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Action: 'create', calling method: .version_select at 0x7f9861f0f160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-759347641", "metadata": {"Type": "work"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b44ca885-7dbd-465c-84e3-80346f4c0170 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 119 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-759347641", "metadata": {"Type": "work"}}} Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-759347641', 'metadata': {'Type': 'work'}}}} Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '0' Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:11:32.918226 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.926961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b44ca885-7dbd-465c-84e3-80346f4c0170 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:32.941024 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b44ca885-7dbd-465c-84e3-80346f4c0170 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013905 Jun 25 21:11:32.943607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2111/4657] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:11:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:11:32.958728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90c5c76e-cb6e-4833-8bf8-176bf4847991 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Action: 'create', calling method: .version_select at 0x7f984f700550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1782777794", "metadata": {"Type": "work"}}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90c5c76e-cb6e-4833-8bf8-176bf4847991 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 119 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1782777794", "metadata": {"Type": "work"}}} Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1782777794', 'metadata': {'Type': 'work'}}}} Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '' Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:11:32.962975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90c5c76e-cb6e-4833-8bf8-176bf4847991 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90c5c76e-cb6e-4833-8bf8-176bf4847991 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013890 Jun 25 21:11:32.969002 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2112/4658] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:11:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:11:32.982504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc6e5312-47be-44a2-b938-aea61b706ef3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Calling method '.version_select at 0x7f9861f0f160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.023443 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-dc6e5312-47be-44a2-b938-aea61b706ef3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] HTTP exception thrown: Volume tempest-invalid-2076393581 could not be found. Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc6e5312-47be-44a2-b938-aea61b706ef3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2076393581 HTTP/1.1 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: exception: Volume tempest-invalid-2076393581 could not be found. Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'tempest-invalid-2076393581'} Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2076393581 could not be found. (HTTP 404) (Request-ID: req-77408445-bc76-44c8-ab42-9956c03916b0) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.028662 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2076393581 could not be found. Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2076393581 could not be found. Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2076393581 could not be found. Jun 25 21:11:33.034503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.043205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc6e5312-47be-44a2-b938-aea61b706ef3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 404 to user: Volume tempest-invalid-2076393581 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:33.044328 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc6e5312-47be-44a2-b938-aea61b706ef3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2076393581" status: 404 len: 99 microversion: 2.1 time: 0.067219 Jun 25 21:11:33.045496 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2113/4659] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:11:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2076393581 => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:11:33.057803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a73b37da-6dfc-449e-8871-9e1b9206ef51 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005466 Jun 25 21:11:33.058767 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2114/4660] 10.222.0.39 () {58 vars in 1139 bytes} [Sat Jun 25 21:11:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 21:11:33.069502 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ac83e76-c439-4c68-9d29-e70dc6a5a19e tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005240 Jun 25 21:11:33.070583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2115/4661] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:11:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 21:11:33.082886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a71029c3-2e29-433b-b837-87f00a3664f3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Calling method '.version_select at 0x7f984f675790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.119886 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a71029c3-2e29-433b-b837-87f00a3664f3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] HTTP exception thrown: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a71029c3-2e29-433b-b837-87f00a3664f3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-volumes/59fd5b2f-3ef8-4140-a903-10a310c3f4d9 HTTP/1.1 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: exception: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '59fd5b2f-3ef8-4140-a903-10a310c3f4d9'} Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. (HTTP 404) (Request-ID: req-6cd09755-e447-45f8-9bdf-6ea70bd1a599) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:33.122546 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a71029c3-2e29-433b-b837-87f00a3664f3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 404 to user: Volume 59fd5b2f-3ef8-4140-a903-10a310c3f4d9 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a71029c3-2e29-433b-b837-87f00a3664f3 tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/59fd5b2f-3ef8-4140-a903-10a310c3f4d9" status: 404 len: 109 microversion: 2.1 time: 0.047542 Jun 25 21:11:33.129860 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2116/4662] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:11:33 2022] DELETE /compute/v2.1/os-volumes/59fd5b2f-3ef8-4140-a903-10a310c3f4d9 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:11:33.139880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:33.140298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-411a3a2f-1fd8-49ad-89e7-3e01bec81bda tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Calling method '.version_select at 0x7f984f675ca0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.147035 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11030423-2482-4b7d-a1cd-767ca80f858c tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.280464 Jun 25 21:11:33.148487 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2547/4663] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:32 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:33.173163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:33.173759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 071e086b-be33-4ee7-9dc2-21d85ce5108b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:33.180803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. Jun 25 21:11:33.182062 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-411a3a2f-1fd8-49ad-89e7-3e01bec81bda tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] HTTP exception thrown: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/071e086b-be33-4ee7-9dc2-21d85ce5108b/action HTTP/1.1 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: {"suspend": {}} Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '071e086b-be33-4ee7-9dc2-21d85ce5108b', 'body': {'suspend': {}}} Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.183170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.190359 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:33.190359 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:33.190359 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. Jun 25 21:11:33.190359 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.190359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 071e086b-be33-4ee7-9dc2-21d85ce5108b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-411a3a2f-1fd8-49ad-89e7-3e01bec81bda tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Request method failure captured: Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/os-volumes/1b91439e-4a60-4c42-8d6b-37cdaa08d654 HTTP/1.1 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oEs0TaV7JU9yp5IAGCyGEsKTZKn9oWW65I6D1gBQ9ZInSHG6gs2ltnrQATkr4OoBHLrkzBLLV70CDxsN0Z4IoLi6RJBCGyTlKkFZQvKLfSOpZc3dlMavPowJHNqDZ8iiNp47gRppMinT_smUt4RVxMVDnZREQp-TVn1Q5XnVSwk9A Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_3ffa25d25ce240dea2a04a03beed71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/3ffa25d25ce240dea2a04a03beed71a8"}]}] Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 3ffa25d25ce240dea2a04a03beed71a8 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-51008190 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 781dbfd151054dd5ba3bd91cff9e1642 Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-51008190-project Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: exception: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1b91439e-4a60-4c42-8d6b-37cdaa08d654'} Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. (HTTP 404) (Request-ID: req-92714643-b5bf-4f0c-a9db-7ae493658e76) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:11:33.190666 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-411a3a2f-1fd8-49ad-89e7-3e01bec81bda tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] Returning 404 to user: Volume 1b91439e-4a60-4c42-8d6b-37cdaa08d654 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-411a3a2f-1fd8-49ad-89e7-3e01bec81bda tempest-VolumesNegativeTest-51008190 tempest-VolumesNegativeTest-51008190-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/1b91439e-4a60-4c42-8d6b-37cdaa08d654" status: 404 len: 109 microversion: 2.1 time: 0.055180 Jun 25 21:11:33.195488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2117/4664] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:11:33 2022] GET /compute/v2.1/os-volumes/1b91439e-4a60-4c42-8d6b-37cdaa08d654 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:11:33.200990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19c04366-ada4-4d67-80f5-b0dc1637cbb3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/071e086b-be33-4ee7-9dc2-21d85ce5108b/action" status: 404 len: 111 microversion: 2.1 time: 0.022433 Jun 25 21:11:33.200990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2548/4665] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:33 2022] POST /compute/v2.1/servers/071e086b-be33-4ee7-9dc2-21d85ce5108b/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:33.212838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.213732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:33.223598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.224061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.225667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.226581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.238790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.239902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:33.254420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.255581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.257767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.258836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.471026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:33.481191 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a7b894a-d489-4639-8ff5-8c83b8ed6ca9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1713 microversion: 2.1 time: 0.252025 Jun 25 21:11:33.481879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2549/4666] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:33 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1713 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:33.527362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:33.540014 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c13cc1ae-7f5b-460c-801b-6f9112bf9299 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.335969 Jun 25 21:11:33.540677 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2118/4667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:33 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:33.560925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:33.561619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:33.570740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.571293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.572166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.572745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.810020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:33.821100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f080f57-5e56-44e7-abe6-c33af8dae090 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.265909 Jun 25 21:11:33.824767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2550/4668] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:33 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:33.848742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:33.849922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:33.858190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.859038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.860212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:33.860957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:33.898387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lazy-loading 'flavor' on Instance uuid 14e0eea3-98e0-455a-b989-d96aa9458741 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:34.028081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22fc3873-0862-4582-982b-11654ee488af tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.182979 Jun 25 21:11:34.028922 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2119/4669] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:33 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:11:34.038035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:34.039048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:34.048769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:34.049639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:34.051004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:34.052978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:34.226686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:34.238126 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8dc80df-feb4-4f14-8116-252e960942ff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1513 microversion: 2.1 time: 0.204103 Jun 25 21:11:34.239015 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2551/4670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:34 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1513 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:35.258556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:35.259357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:35.276733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.277534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.278338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.278776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.595476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:35.610116 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ef2159e-5901-404e-ab99-86d27ea0d2e0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1496 microversion: 2.1 time: 0.356863 Jun 25 21:11:35.620740 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2120/4671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:35 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1496 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:35.630250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:35.631013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:35.645927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.646381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.651441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.652498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.662670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:35.707802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lazy-loading 'flavor' on Instance uuid 14e0eea3-98e0-455a-b989-d96aa9458741 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:11:35.744156 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'suspend' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state suspended Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: {"suspend": {}} Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: exception: Cannot 'suspend' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state suspended Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'suspend': {}}} Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state suspended. Cannot suspend while the instance is in this state. Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jun 25 21:11:35.747959 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state suspended Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state suspended Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'suspend' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state suspended {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b41c9fb5-8cc9-456b-9f66-220fb98b4dff tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 148 microversion: 2.1 time: 0.124492 Jun 25 21:11:35.753236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2552/4672] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:35 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 148 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:11:35.760358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:35.760954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:35.777419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.778880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.780665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.781309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.916315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f03a672-79ad-4a3f-96cc-5bd951a377c1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 202 len: 0 microversion: 2.1 time: 0.158697 Jun 25 21:11:35.924271 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2121/4673] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:35 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:11:35.934229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:35.934969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:35.959998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.961033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:35.964312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:35.965485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:36.891113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:36.904374 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e070a43a-7daa-4e3a-b7f5-4ab71a99d023 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1502 microversion: 2.1 time: 0.972651 Jun 25 21:11:36.906182 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2553/4674] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:35 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1502 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:37.931638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:37.933640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:37.942891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:37.943929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:37.944981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:37.945763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:38.568544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:38.579590 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18408ef7-d716-4dc0-981f-b040b3249c98 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1502 microversion: 2.1 time: 0.656395 Jun 25 21:11:38.582097 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2122/4675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:37 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1502 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:39.600035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:39.601134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:39.616667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:39.617544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:39.619943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:39.620689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:40.076563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:40.088737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e097eed8-475d-4c59-93ba-94e519446f0a tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.493210 Jun 25 21:11:40.102975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2554/4676] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:39 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:40.112100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:40.112768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:40.119767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:40.124850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:40.125774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:40.126257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:40.542458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:40.559526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fcae995c-dc41-49f9-afec-22e97840d5df tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.451942 Jun 25 21:11:40.565751 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2123/4677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:40 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:40.577656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:40.577820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 5a880d67-9b49-4f51-be43-8a7061fcd6fa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:40.595196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/5a880d67-9b49-4f51-be43-8a7061fcd6fa/action HTTP/1.1 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 15 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: {"unpause": {}} Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5a880d67-9b49-4f51-be43-8a7061fcd6fa', 'body': {'unpause': {}}} Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:40.597165 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 5a880d67-9b49-4f51-be43-8a7061fcd6fa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f67625e0-67db-4f3c-8ded-4799998abfad tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/5a880d67-9b49-4f51-be43-8a7061fcd6fa/action" status: 404 len: 111 microversion: 2.1 time: 0.025511 Jun 25 21:11:40.609451 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2555/4678] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:40 2022] POST /compute/v2.1/servers/5a880d67-9b49-4f51-be43-8a7061fcd6fa/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:40.610786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:40.611411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:40.621808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:40.622271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:40.623058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:40.623500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:41.359032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:41.377961 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6cf63418-0dbc-4b8f-8d30-e03ea5fb0ab8 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.766741 Jun 25 21:11:41.380749 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2124/4679] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:40 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:41.402027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:41.402687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:41.435419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:41.436866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:41.440357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:41.446141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:41.991523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:42.006076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fd04309-28e9-4b09-8e4a-852e42a26bb2 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.606737 Jun 25 21:11:42.007097 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2556/4680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:41 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:42.030600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:42.031912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:42.062014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.067110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.069026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.070353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.169806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'unpause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 15 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: {"unpause": {}} Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'unpause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'unpause': {}}} Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state active. Cannot unpause while the instance is in this state. Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:42.176369 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'unpause' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:42.181803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd20a4d8-2953-48ce-aedc-16e80f21c540 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 145 microversion: 2.1 time: 0.155627 Jun 25 21:11:42.184660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2125/4681] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:42 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 145 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:11:42.187474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:42.188107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:42.203241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.203880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.206398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.206398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.494190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:42.504170 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bcf060f4-3c2e-4104-9911-008cc26d93d7 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.320821 Jun 25 21:11:42.508357 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2557/4682] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:42 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:42.526780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:42.527446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:42.543429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.543940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.544840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:42.547180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:42.572942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:43.126958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:43.143596 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be3d12e9-fa60-40d3-8a9f-b13d3831330e tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.616165 Jun 25 21:11:43.143596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2126/4683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:42 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:43.158685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:43.161839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14427fea-c36a-483a-87ca-2a32337c3150] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:43.168599 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/14427fea-c36a-483a-87ca-2a32337c3150/action HTTP/1.1 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 18 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: {"unshelve": null} Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14427fea-c36a-483a-87ca-2a32337c3150', 'body': {'unshelve': None}} Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:43.170473 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. Jun 25 21:11:43.175159 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:43.177370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 14427fea-c36a-483a-87ca-2a32337c3150 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:43.178490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-137f9471-90d4-4069-8ac7-1a6194390ddc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14427fea-c36a-483a-87ca-2a32337c3150/action" status: 404 len: 111 microversion: 2.1 time: 0.024410 Jun 25 21:11:43.189355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:43.190248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:43.195702 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2558/4684] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:43 2022] POST /compute/v2.1/servers/14427fea-c36a-483a-87ca-2a32337c3150/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:43.198226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:43.199294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:43.200587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:43.201266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:43.734972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:43.747738 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d22fb38-4da7-4160-a2c7-56243f9a7e12 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.563503 Jun 25 21:11:43.751367 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2127/4685] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:43 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:43.776453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:43.777761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:43.808060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:43.808953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:43.810760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:43.812584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.295143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:44.304719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb25a803-791c-4e91-9a6c-d5f2cd22b4ba tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.534526 Jun 25 21:11:44.305455 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2559/4686] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:43 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:44.323685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:44.324998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:44.341466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.344258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.345704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.346297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.391076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Cannot 'unshelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action HTTP/1.1 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 18 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: {"unshelve": null} Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: exception: Cannot 'unshelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'unshelve': None}} Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 in vm_state active. Cannot unshelve while the instance is in this state. Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 21:11:44.393081 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active Jun 25 21:11:44.396884 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:44.398732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 409 to user: Cannot 'unshelve' instance 14e0eea3-98e0-455a-b989-d96aa9458741 while it is in vm_state active {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:44.400891 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb697cc2-7468-4e8b-aa4b-f5948c8ac13f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action" status: 409 len: 146 microversion: 2.1 time: 0.082710 Jun 25 21:11:44.402987 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2128/4687] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:11:44 2022] POST /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741/action => generated 146 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 25 21:11:44.417304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:44.422778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:44.434031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.434720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.435603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.436260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.694954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:44.705193 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dfc0516c-4ddb-47d0-91ea-85456ce8adcd tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.295913 Jun 25 21:11:44.706678 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2560/4688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:44.727442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:44.730134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:44.743713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.745296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:44.746381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:44.747100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:45.238621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:45.253613 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a53c344-44f6-4ce0-9d93-d6caacdf38f3 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.532751 Jun 25 21:11:45.254840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2129/4689] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:44 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:45.275937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1977864388_updated"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:45.277374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:45.287803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/servers/70c5bc5d-6799-47e6-9ddc-f196fd28fdeb HTTP/1.1 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 81 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1977864388_updated"}} Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '70c5bc5d-6799-47e6-9ddc-f196fd28fdeb', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1977864388_updated'}}} Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jun 25 21:11:45.290412 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 70c5bc5d-6799-47e6-9ddc-f196fd28fdeb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b5605f7-d28e-4d5f-bbaf-5c05b335f50d tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "PUT /compute/v2.1/servers/70c5bc5d-6799-47e6-9ddc-f196fd28fdeb" status: 404 len: 111 microversion: 2.1 time: 0.022264 Jun 25 21:11:45.297467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2561/4690] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:11:45 2022] PUT /compute/v2.1/servers/70c5bc5d-6799-47e6-9ddc-f196fd28fdeb => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:45.306532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:45.307158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:45.329137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:45.334863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:45.335849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:45.336309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:45.796754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:45.818263 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85122e42-c3ee-4de1-965e-8df834e060f4 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.517909 Jun 25 21:11:45.819428 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2130/4691] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:45 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:45.842197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:45.843948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:45.867628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:45.868173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:45.871200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:45.871755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.128970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:46.140127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-781fa531-6463-4f41-89a8-ca9816e88fbc tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.304001 Jun 25 21:11:46.141158 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2562/4692] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:45 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:46.157695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1b37e0d-976a-44ef-93f3-497640d19072 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1b37e0d-976a-44ef-93f3-497640d19072 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: request: PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 HTTP/1.1 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 280 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.161450 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jun 25 21:11:46.165340 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.168173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1b37e0d-976a-44ef-93f3-497640d19072 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:46.170242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f1b37e0d-976a-44ef-93f3-497640d19072 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 400 len: 619 microversion: 2.1 time: 0.016927 Jun 25 21:11:46.170919 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2131/4693] 10.222.0.39 () {60 vars in 1256 bytes} [Sat Jun 25 21:11:46 2022] PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 619 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:11:46.180399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:46.181768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:46.190784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.191765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.193004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.193454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.377263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:46.398341 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e84ae3c-efad-4d14-b515-f4f535dad8e6 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.221162 Jun 25 21:11:46.411681 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2563/4694] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:46 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:46.421517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:46.422971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:46.437372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.438198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.439133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.439582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.898964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:46.918878 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ddde874-2d50-4552-9c82-1d814f7eb322 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.504519 Jun 25 21:11:46.921096 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2132/4695] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:46 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:46.942416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e984bbf0-a890-4854-94e0-aeaac460f549 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e984bbf0-a890-4854-94e0-aeaac460f549 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 HTTP/1.1 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 24 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": ""}} Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741', 'body': {'server': {'name': ''}}} Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi On instance['server']: Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi '' Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:11:46.949284 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e984bbf0-a890-4854-94e0-aeaac460f549 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e984bbf0-a890-4854-94e0-aeaac460f549 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 400 len: 108 microversion: 2.1 time: 0.008393 Jun 25 21:11:46.958211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2564/4696] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:11:46 2022] PUT /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:11:46.960744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:46.960744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:46.970963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.971371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:46.972151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:46.972619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:47.279266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:47.296816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d26ef6ce-3c05-464a-9407-500d1dd72d96 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1505 microversion: 2.1 time: 0.341165 Jun 25 21:11:47.310984 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2133/4697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:46 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:49.819742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:49.820268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:49.839274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.839910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.841183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.842000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.865881 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 HTTP/1.1 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1a9a653b-3c16-444c-be5d-92d54ae6cab7'} Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:49.869581 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.873948 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.876778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:49.878443 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc8c56ec-7103-4b04-ab04-7a71160b2350 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 404 len: 111 microversion: 2.1 time: 0.072823 Jun 25 21:11:49.879131 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2565/4698] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:11:49 2022] DELETE /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:49.890105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:49.891381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 1a9a653b-3c16-444c-be5d-92d54ae6cab7] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:49.901637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.902233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.903108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.904627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.923734 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 HTTP/1.1 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1a9a653b-3c16-444c-be5d-92d54ae6cab7'} Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:49.925810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. Jun 25 21:11:49.929669 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:11:49.930676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 1a9a653b-3c16-444c-be5d-92d54ae6cab7 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:49.931399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8a16f76-4f38-42d2-8608-97084fce9f4f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7" status: 404 len: 111 microversion: 2.1 time: 0.047185 Jun 25 21:11:49.932049 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2134/4699] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:49 2022] GET /compute/v2.1/servers/1a9a653b-3c16-444c-be5d-92d54ae6cab7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:49.941716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:49.942078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:49.951130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.951744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.952889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:49.953340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:49.991794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:11:50.095311 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d53e01bf-da8b-46a9-82df-0267cbd3cb1f tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 204 len: 0 microversion: 2.1 time: 0.157636 Jun 25 21:11:50.096616 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2566/4700] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:11:49 2022] DELETE /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:11:50.107243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:50.108410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:50.115848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:50.116404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:50.117399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:50.118015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:50.871578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:50.880925 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ca56445-bd0b-4d9a-ab71-b760feb41000 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 0.779314 Jun 25 21:11:50.883052 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2135/4701] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:50 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:11:51.899842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:51.900629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:51.916367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:51.916864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:51.917657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:51.918098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:53.723078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10c0287a5f02499cb26cc144cd7588cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8983a71e4a2142fc9fa3460969b2f425', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:53.742117 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a83a6e68-1a0c-4ac9-921b-67090a986dc1 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 200 len: 1511 microversion: 2.1 time: 1.839499 Jun 25 21:11:53.744972 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2567/4702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:51 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 1511 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:11:53.930759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ec42f092-0cf5-4cfe-89ca-85a81c0b6ddb req-b10e1353-bb40-41e5-aa57-4c59fddaa77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e0eea3-98e0-455a-b989-d96aa9458741", "name": "network-vif-deleted", "tag": "20e467d5-cf48-4e9b-a158-588147245877"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:11:54.016332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ec42f092-0cf5-4cfe-89ca-85a81c0b6ddb req-b10e1353-bb40-41e5-aa57-4c59fddaa77c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:54.017269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ec42f092-0cf5-4cfe-89ca-85a81c0b6ddb req-b10e1353-bb40-41e5-aa57-4c59fddaa77c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:54.051675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ec42f092-0cf5-4cfe-89ca-85a81c0b6ddb req-b10e1353-bb40-41e5-aa57-4c59fddaa77c service nova] Creating event network-vif-deleted:20e467d5-cf48-4e9b-a158-588147245877 for instance 14e0eea3-98e0-455a-b989-d96aa9458741 on nch2-master-1 Jun 25 21:11:54.077459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ec42f092-0cf5-4cfe-89ca-85a81c0b6ddb req-b10e1353-bb40-41e5-aa57-4c59fddaa77c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152482 Jun 25 21:11:54.079019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2136/4703] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:11:54.761050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:54.761663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] [instance: 14e0eea3-98e0-455a-b989-d96aa9458741] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:54.789663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:54.790196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:54.791303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:54.791504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:54.883392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] HTTP exception thrown: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Request method failure captured: Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 HTTP/1.1 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3k2ay5VEYP983EQ3Qwrd5IAQpO-Kueur0_K9_XhVK2hsfBorIkwzY1VFGgEBHFRuIDLm4CL3VrZc7o018ly46N4Bc9BQGBGugMMO8c_i6BCbUdu4uRC4bhF2b8rt5GCyfVILB3_EETV63D6EVAxFQRNJTCRInHCu6A8wwRaa_ZHssI Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_8983a71e4a2142fc9fa3460969b2f425"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/8983a71e4a2142fc9fa3460969b2f425"}]}] Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 8983a71e4a2142fc9fa3460969b2f425 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2131798312 Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 10c0287a5f02499cb26cc144cd7588cf Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-2131798312-project Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '14e0eea3-98e0-455a-b989-d96aa9458741'} Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:11:54.896994 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] Returning 404 to user: Instance 14e0eea3-98e0-455a-b989-d96aa9458741 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:11:54.902879 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f111316f-7005-4ba3-a6a4-5227ae93faa0 tempest-ServersNegativeTestJSON-2131798312 tempest-ServersNegativeTestJSON-2131798312-project] 10.222.0.39 "GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741" status: 404 len: 111 microversion: 2.1 time: 0.141838 Jun 25 21:11:54.908926 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2568/4704] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:11:54 2022] GET /compute/v2.1/servers/14e0eea3-98e0-455a-b989-d96aa9458741 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:11:57.476188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:57.477659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:57.499316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:11:57.502300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:57.505024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:57.509331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:57.512501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:58.056729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:58.076957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:58.078652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:11:58.079923 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83ca2e1a-eda9-4556-a305-980258f2739b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2951 microversion: 2.42 time: 0.615725 Jun 25 21:11:58.089882 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2137/4705] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:11:57 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2951 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:11:58.101771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:11:58.103016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:11:58.113504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:58.114703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:58.116504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:11:58.117820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:11:58.652064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e1faad0-f66d-441c-a3a4-968fc6b0e85f tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.554904 Jun 25 21:11:58.653024 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2569/4706] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:11:58 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391/os-interface => generated 1832 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:12:02.317150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85ef0617-0292-4cbd-904b-7442d38e70e0 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-66929361", "availability_zone": "foo_zone"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:02.319901 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:02.319901 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:02.320927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.aggregate [None req-85ef0617-0292-4cbd-904b-7442d38e70e0 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Generated uuid 9df61c3d-3ed5-4ab4-b5ca-2da57e0bd86e for aggregate {{(pid=137462) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jun 25 21:12:02.385154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85ef0617-0292-4cbd-904b-7442d38e70e0 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates" status: 200 len: 207 microversion: 2.1 time: 0.386282 Jun 25 21:12:02.386722 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2138/4707] 10.222.0.39 () {60 vars in 1163 bytes} [Sat Jun 25 21:12:01 2022] POST /compute/v2.1/os-aggregates => generated 207 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:02.403180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-408629f8-5784-402c-b4db-b18182861648 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:02.405395 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:02.405395 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:12:02.408936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:02.452938 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-408629f8-5784-402c-b4db-b18182861648 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 317 microversion: 2.1 time: 0.056900 Jun 25 21:12:02.454307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2570/4708] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 21:12:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 317 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:02.465516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:02.467837 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:02.467837 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:02.470380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:02.471116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:02.473775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:02.474547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:02.508984 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6911db7-fa6a-45e0-a9b5-13aec0025808 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046985 Jun 25 21:12:02.511235 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2139/4709] 10.222.0.39 () {58 vars in 1175 bytes} [Sat Jun 25 21:12:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:02.523334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c4966b5-eb05-453d-8e0b-2eecb5190b24 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:02.524677 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:02.524677 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:12:02.536293 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c4966b5-eb05-453d-8e0b-2eecb5190b24 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates" status: 200 len: 296 microversion: 2.1 time: 0.018505 Jun 25 21:12:02.537350 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2571/4710] 10.222.0.39 () {58 vars in 1142 bytes} [Sat Jun 25 21:12:02 2022] GET /compute/v2.1/os-aggregates => generated 296 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:02.548879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c7d51a0-f41b-4a11-b423-64c4b3c9ae33 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:02.550594 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:02.550594 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:02.568709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c7d51a0-f41b-4a11-b423-64c4b3c9ae33 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:02.569195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c7d51a0-f41b-4a11-b423-64c4b3c9ae33 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:03.221798 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c7d51a0-f41b-4a11-b423-64c4b3c9ae33 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 308 microversion: 2.1 time: 0.677002 Jun 25 21:12:03.227813 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2140/4711] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 21:12:02 2022] POST /compute/v2.1/os-aggregates/19/action => generated 308 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:03.233354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01fc1f68-172c-4d87-b143-d82092d1e16e tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:03.234185 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:03.234185 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:12:03.251210 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01fc1f68-172c-4d87-b143-d82092d1e16e tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 308 microversion: 2.1 time: 0.021755 Jun 25 21:12:03.251914 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2572/4712] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:12:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 308 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:03.275262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4eca89e5-04d9-4b28-b7ab-6acdcc8bb053 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-188677444", "availability_zone": "foo_zone"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:03.530909 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:03.530909 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:03.615614 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4eca89e5-04d9-4b28-b7ab-6acdcc8bb053 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.352493 Jun 25 21:12:03.616639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2141/4713] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 21:12:03 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:03.630217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0184d896-ad65-4b84-9829-c610df0927c7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:03.630217 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:03.630217 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:12:03.707167 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0184d896-ad65-4b84-9829-c610df0927c7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.083783 Jun 25 21:12:03.716855 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2573/4714] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 21:12:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:03.723773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2a6a25f-aecc-4339-848e-da52e0398941 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:03.724714 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:03.724714 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:03.751434 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2a6a25f-aecc-4339-848e-da52e0398941 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.033175 Jun 25 21:12:03.754735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2142/4715] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:12:03 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:03.765207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e922644-dcc7-421c-853e-32ce1d2decf7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:03.766496 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:03.766496 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:12:03.788680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e922644-dcc7-421c-853e-32ce1d2decf7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:03.789196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e922644-dcc7-421c-853e-32ce1d2decf7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:04.597288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e922644-dcc7-421c-853e-32ce1d2decf7 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.835655 Jun 25 21:12:04.598769 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2574/4716] 10.222.0.39 () {60 vars in 1193 bytes} [Sat Jun 25 21:12:03 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:04.626032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5bd5dd66-4a96-4a71-97c8-5d187f973491 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:04.628126 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:04.628126 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:04.730883 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5bd5dd66-4a96-4a71-97c8-5d187f973491 tempest-TestAggregatesBasicOps-31951491 tempest-TestAggregatesBasicOps-31951491-project-admin] 10.222.0.39 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.124340 Jun 25 21:12:04.732054 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2143/4717] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 21:12:04 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jun 25 21:12:05.528690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:05.529068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:05.545013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:05.545556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:05.546370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:05.554873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:05.812959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lazy-loading 'services' on Instance uuid 26365fd2-d8a1-4c59-a24e-7ebc35313000 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:12:06.034027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-345199f8-7ea8-4b98-9164-5b1ebd981f40 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments/d3c85d3e-4e4f-43ae-8178-accc09ce263b" status: 202 len: 0 microversion: 2.1 time: 0.509838 Jun 25 21:12:06.037180 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2144/4718] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:12:05 2022] DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments/d3c85d3e-4e4f-43ae-8178-accc09ce263b => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:06.137976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4bc3ecc0-ae5b-4c16-a4e4-594184630184 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Calling method '.version_select at 0x7f984eb104c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:06.279942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4bc3ecc0-ae5b-4c16-a4e4-594184630184 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] 10.222.0.39 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 1.024329 Jun 25 21:12:06.280905 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2575/4719] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:12:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:12:06.295176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8a72d1c-9b09-4613-ac45-94fc82c3dcc4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Action: 'create', calling method: .version_select at 0x7f98620241f0>, body: {"pool": "non_exist_pool"} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:06.405799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-b8a72d1c-9b09-4613-ac45-94fc82c3dcc4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] HTTP exception thrown: Floating IP pool not found. Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8a72d1c-9b09-4613-ac45-94fc82c3dcc4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Request method failure captured: Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 26 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3olunOYhiXSN1DjbRG_g4jE-yd79WcylfGQy20TPN0l1aNw_LfpqDBKbspK17tM5b7N7VroNTJaGe-7_Q1Ls5q2MbLOMDPc124Um4rYx6_vqYXQfMmakFCbVb66w2s0XMqyh5iaYgiGG3DPEKIha87JMzm5K5dDD_YOVhijRyy4pyw Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: c32fe49f7bcc41e3977a7773bef15000 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c32fe49f7bcc41e3977a7773bef15000"}]}] Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: c32fe49f7bcc41e3977a7773bef15000 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-FloatingIPsNegativeTestJSON-689272093-project Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: cfb795b2d1394fa7bf02c107989731e7 Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-689272093-project Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: {"pool": "non_exist_pool"} Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: method: Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: exception: Floating IP pool not found. Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'body': {'pool': 'non_exist_pool'}} Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:12:06.415527 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:12:06.421684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jun 25 21:12:06.421684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.421684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8a72d1c-9b09-4613-ac45-94fc82c3dcc4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Returning 404 to user: Floating IP pool not found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:12:06.421684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8a72d1c-9b09-4613-ac45-94fc82c3dcc4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] 10.222.0.39 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.128140 Jun 25 21:12:06.423170 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2145/4720] 10.222.0.39 () {60 vars in 1169 bytes} [Sat Jun 25 21:12:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:12:06.429324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Calling method '.version_select at 0x7f984ebba8b0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:06.593059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP a6b90792-c80f-4d1b-b4c5-43beede76683 could not be found", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:12:06.593829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] HTTP exception thrown: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Request method failure captured: Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-floating-ips/a6b90792-c80f-4d1b-b4c5-43beede76683 HTTP/1.1 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3olunOYhiXSN1DjbRG_g4jE-yd79WcylfGQy20TPN0l1aNw_LfpqDBKbspK17tM5b7N7VroNTJaGe-7_Q1Ls5q2MbLOMDPc124Um4rYx6_vqYXQfMmakFCbVb66w2s0XMqyh5iaYgiGG3DPEKIha87JMzm5K5dDD_YOVhijRyy4pyw Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: c32fe49f7bcc41e3977a7773bef15000 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_c32fe49f7bcc41e3977a7773bef15000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/c32fe49f7bcc41e3977a7773bef15000"}]}] Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: c32fe49f7bcc41e3977a7773bef15000 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-689272093 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-FloatingIPsNegativeTestJSON-689272093-project Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: cfb795b2d1394fa7bf02c107989731e7 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-689272093-project Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: exception: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a6b90792-c80f-4d1b-b4c5-43beede76683'} Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP a6b90792-c80f-4d1b-b4c5-43beede76683 could not be found Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f570d652-e465-4220-9765-e0f573fa6d38'] Jun 25 21:12:06.596324 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683. Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683 Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683 Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] Returning 404 to user: Floating IP not found for ID a6b90792-c80f-4d1b-b4c5-43beede76683 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-121c3d04-dade-40e2-bcf7-629953b9c7b4 tempest-FloatingIPsNegativeTestJSON-689272093 tempest-FloatingIPsNegativeTestJSON-689272093-project] 10.222.0.39 "DELETE /compute/v2.1/os-floating-ips/a6b90792-c80f-4d1b-b4c5-43beede76683" status: 404 len: 111 microversion: 2.1 time: 0.173837 Jun 25 21:12:06.600076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2576/4721] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:12:06 2022] DELETE /compute/v2.1/os-floating-ips/a6b90792-c80f-4d1b-b4c5-43beede76683 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:12:07.410446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7d03931-76f4-480d-9d01-a77763949ed4 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:07.423897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d03931-76f4-480d-9d01-a77763949ed4 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:07.430909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d03931-76f4-480d-9d01-a77763949ed4 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:07.514432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7d03931-76f4-480d-9d01-a77763949ed4 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Going to try to stop instance {{(pid=137462) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:12:07.640172 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7d03931-76f4-480d-9d01-a77763949ed4 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action" status: 202 len: 0 microversion: 2.1 time: 0.234478 Jun 25 21:12:07.642755 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2146/4722] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:12:07 2022] POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:07.650615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:07.651994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:07.677044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:07.678047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:07.679540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:07.685881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:07.713419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:08.363681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:08.383939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c923974-33fc-4f41-a7e1-98c1f384d8bc tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.738275 Jun 25 21:12:08.385645 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2577/4723] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:07 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:09.405368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:09.407502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:09.426522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:09.428943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:09.431749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:09.433063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:09.859677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:09.878482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f734fa8a-8873-4ec0-b13d-39410b5878b6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.476291 Jun 25 21:12:09.880826 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2147/4724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:09 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:10.899306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:10.901348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:10.928652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:10.929468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:10.933982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:10.935831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:11.434364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:11.449688 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a449b15c-e20f-48ae-9758-60f81b950971 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.554596 Jun 25 21:12:11.453559 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2578/4725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:10 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:12.476530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:12.478293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:12.494044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:12.506060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:12.506905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:12.508212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:12.508892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:12.530898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-33e356a2-9df3-4c57-a829-6bb6d4a7481c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: .version_select at 0x7f984f7784c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-801685190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmjV6G4Q3I+T1zSvz1WKn8pHOp/M/5EeXvf1sROUsmKAlhfanROvTxOkRpHJiFiuSOCmKc1Rxfh7psRMH06xM5G1ruBFDZeYVnM0liWMwwRXG/hPZaZREd7HTjirKbf7w=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:12.601079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-33e356a2-9df3-4c57-a829-6bb6d4a7481c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:12:12.628139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-33e356a2-9df3-4c57-a829-6bb6d4a7481c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:12:12.726600 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-33e356a2-9df3-4c57-a829-6bb6d4a7481c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.839719 Jun 25 21:12:12.727276 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2148/4726] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:12:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:13.228196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:13.237151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18cd0e8d-1726-41e9-9dfd-e5da3c68a6ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.771828 Jun 25 21:12:13.237756 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2579/4727] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:12 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:14.256670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:14.258065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:14.284695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:14.285418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:14.288463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:14.290414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:14.359764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:14.639734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:14.656102 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d79020d-5fbc-49c9-ac32-f61c25f1c27e tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.401805 Jun 25 21:12:14.657352 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2149/4728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:14 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:15.678665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:15.682226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:15.716757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:15.717756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:15.719411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:15.719922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:15.998771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:16.012512 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-379f2c7a-d069-4df0-8e4c-594f6b2ebf49 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.343121 Jun 25 21:12:16.013171 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2580/4729] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:15 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:17.035043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:17.039770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:17.063498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:17.066310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:17.067380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:17.070166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:17.520410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:17.536047 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5521dddf-0bdb-49dd-91c6-629eb1efea2a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1677 microversion: 2.1 time: 0.509444 Jun 25 21:12:17.541178 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2150/4730] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:17 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1677 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:18.556252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:18.557559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:18.567886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:18.572366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:18.573687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:18.574328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:18.987456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:18.997045 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b66a23f-4023-46ab-a40b-6d7d9b712796 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1654 microversion: 2.1 time: 0.445637 Jun 25 21:12:18.998912 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2581/4731] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:18 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1654 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:19.016584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-130ac523-996f-42e9-9183-1556dd824090 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:19.028141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-130ac523-996f-42e9-9183-1556dd824090 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:19.029663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-130ac523-996f-42e9-9183-1556dd824090 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:19.082244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-130ac523-996f-42e9-9183-1556dd824090 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Going to try to start instance {{(pid=137462) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 21:12:19.162803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-130ac523-996f-42e9-9183-1556dd824090 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action" status: 202 len: 0 microversion: 2.1 time: 0.150062 Jun 25 21:12:19.163982 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2151/4732] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:12:19 2022] POST /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:19.173873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:19.174592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:19.187762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:19.188554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:19.189552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:19.190061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:19.465302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:19.477228 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f05acf6f-e1a5-4bea-a8da-2c19c03fe4e8 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1663 microversion: 2.1 time: 0.307613 Jun 25 21:12:19.487803 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2582/4733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:19 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1663 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:20.161551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Calling method '.version_select at 0x7f984f7781f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:20.186130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:20.186601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:20.187524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:20.192010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:20.248250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b61325e-2c15-46c7-818d-9f74661486fc tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] 10.222.0.39 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.846009 Jun 25 21:12:20.249786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2152/4734] 10.222.0.39 () {58 vars in 1121 bytes} [Sat Jun 25 21:12:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:20.340387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-790073117", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:20.432936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:12:20.504666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:20.505344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:20.525454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:20.526159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:20.527218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:20.527659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:20.919287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Getting quotas for project 2afdedec58384749bdf082455e2cc2b9. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:12:20.933430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Getting quotas for user 8478d4ac9a9045e8b82fd5f47feb1602 and project 2afdedec58384749bdf082455e2cc2b9. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:12:20.947785 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Request method failure captured: Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers HTTP/1.1 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 1751 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3oznwvsk-d_GU1QW2nzOX0BGfM19SWTlnfQA2D9OKrmBSElxALWgViom4fqYAOPMCLnyNf7BqfKKIkADzH3DpuWwdLmdn2Cye-ojRnMwWDd9VrXhH-SqGUaDpV6WUHbzzSxiJAKu30Py0GeE5J89SCIJMWJ5f8vSGb0KpoiKVD7_pQ Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2afdedec58384749bdf082455e2cc2b9 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450196058 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2afdedec58384749bdf082455e2cc2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2afdedec58384749bdf082455e2cc2b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2afdedec58384749bdf082455e2cc2b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2afdedec58384749bdf082455e2cc2b9"}]}] Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1450196058 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2afdedec58384749bdf082455e2cc2b9 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450196058 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8478d4ac9a9045e8b82fd5f47feb1602 Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-790073117", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:12:20.950069 ncdv-master-1 devstack@n-api.service[137461]: exception: Maximum number of metadata items exceeds 128 Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-790073117', 'imageRef': 'c5741eca-b932-4865-b29a-bd2a12a73795', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._create_instance( Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:12:20.952269 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jun 25 21:12:20.955102 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:20.957903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:12:20.959116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dd7b47ea-2749-4939-ac19-c8518f0ad847 tempest-AbsoluteLimitsNegativeTestJSON-1450196058 tempest-AbsoluteLimitsNegativeTestJSON-1450196058-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.624386 Jun 25 21:12:20.960290 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2583/4735] 10.222.0.39 () {60 vars in 1147 bytes} [Sat Jun 25 21:12:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 626 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:12:21.594165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:21.664394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a4c7c22-d831-4400-8a73-bd3cbc7de7b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1663 microversion: 2.1 time: 1.163934 Jun 25 21:12:21.665038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2153/4736] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:20 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1663 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:22.687724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:22.689071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:22.696902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:22.697649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:22.701207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:22.701898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:23.712659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:23.732815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4875df8c-8db9-4e66-bf81-8f617d8f9838 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1667 microversion: 2.1 time: 1.050318 Jun 25 21:12:23.734098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2584/4737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:22 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1667 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:25.987588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1760799778", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "04d94b64-bb75-450f-bfbe-9d7103ba162a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-801685190", "security_groups": [{"name": "tempest-secgroup-smoke-1531596992"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:26.275901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] validate_networks() for [('04d94b64-bb75-450f-bfbe-9d7103ba162a', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:12:27.147244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:12:27.147842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:12:27.148179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:12:27.148664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:12:27.149267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:12:27.166011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:27.166657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:27.167475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:27.167925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:27.213001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:12:27.219264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:12:27.250698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:12:27.253480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:12:27.330280 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-feefe39d-63b9-4bb9-90f4-c447fd027c56 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.343726 Jun 25 21:12:27.332556 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2154/4738] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:12:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:12:27.343585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa33e73e-89fa-48da-a933-0ec78a17271a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:27.345857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa33e73e-89fa-48da-a933-0ec78a17271a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:27.575748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa33e73e-89fa-48da-a933-0ec78a17271a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:27.584616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa33e73e-89fa-48da-a933-0ec78a17271a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1266 microversion: 2.1 time: 0.246281 Jun 25 21:12:27.589592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2585/4739] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:27 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:28.609712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:28.610381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:28.654125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:28.655921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:28.656390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:28.657223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:28.657694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:28.887493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:28.909387 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c91d91b1-6e0a-4ffa-bb43-e767f33ec5cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1270 microversion: 2.1 time: 0.306448 Jun 25 21:12:28.912908 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2155/4740] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:28 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:29.935898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:29.937719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:29.950522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:29.951402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:29.952966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:29.953601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:30.159721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:30.175403 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8cc3a833-0b17-443a-b744-b89fdc7add30 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1324 microversion: 2.1 time: 0.250083 Jun 25 21:12:30.178823 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2586/4741] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:29 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:31.195605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:31.196230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:31.208588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:31.213079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:31.219671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:31.222978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:31.394956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:31.414433 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aeb415fb-d45d-402f-9924-ac79d67d746f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1324 microversion: 2.1 time: 0.222310 Jun 25 21:12:31.428565 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2156/4742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:31 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:32.437949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:32.439794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:32.465051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:32.465521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:32.466319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:32.466761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:34.239772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:34.252155 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f45be5d2-0efc-41df-9957-54772f82a315 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 1.824167 Jun 25 21:12:34.254316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2587/4743] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:32 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:35.270302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:35.271052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:35.274053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:35.298675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:35.299801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:35.302377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:35.305632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:35.649614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83788481-9541-4019-9301-e5f50158badb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f985cbf9dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-782596451", "description": "tempest-description-83876589"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:35.673569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:35.683880 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d04443c8-2552-4357-9cba-704ceaf4dcac tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.417887 Jun 25 21:12:35.685505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2588/4744] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:35 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:36.324472 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83788481-9541-4019-9301-e5f50158badb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.078121 Jun 25 21:12:36.328582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2157/4745] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:35 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:36.340006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca3b2dbf-1588-4aed-8e41-d046f2eec1f4 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984edc5790>, body: {"security_group_rule": {"parent_group_id": "5fbdb3e8-0d14-472d-8a14-ae8fd4597c37", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:36.485532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-88e7e534-066a-43ec-a00e-ce8d91cd1890 req-65d164ca-1651-450b-9fda-ca2a117b9b13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:36.511945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-88e7e534-066a-43ec-a00e-ce8d91cd1890 req-65d164ca-1651-450b-9fda-ca2a117b9b13 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:36.512798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-88e7e534-066a-43ec-a00e-ce8d91cd1890 req-65d164ca-1651-450b-9fda-ca2a117b9b13 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:36.539186 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-88e7e534-066a-43ec-a00e-ce8d91cd1890 req-65d164ca-1651-450b-9fda-ca2a117b9b13 service nova] Creating event network-changed:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch2-master-1 Jun 25 21:12:36.549000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-88e7e534-066a-43ec-a00e-ce8d91cd1890 req-65d164ca-1651-450b-9fda-ca2a117b9b13 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067377 Jun 25 21:12:36.552604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2158/4746] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:36.708142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:36.709090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:36.731385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:36.732326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:36.737912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:36.739214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:37.009012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca3b2dbf-1588-4aed-8e41-d046f2eec1f4 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.676323 Jun 25 21:12:37.011161 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2589/4747] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:37.029483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a584731c-aa26-4731-95e3-fe273e68bfd6 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f56d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-757091883", "description": "tempest-description-70124039"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:37.197713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:37.238894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:37.356132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:37.365379 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a35557d0-02ee-476e-ad1c-40656a44f3f9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.665045 Jun 25 21:12:37.377735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2159/4748] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:36 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:37.545657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a584731c-aa26-4731-95e3-fe273e68bfd6 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.526492 Jun 25 21:12:37.547679 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2590/4749] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:37 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:37.559543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1e33d13-bd1b-4452-bccb-325350316e2a tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f985c34bf70>, body: {"security_group_rule": {"parent_group_id": "6173a575-258f-4c98-8417-2f54d95a78df", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:38.380169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:38.388401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:38.389051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:38.410618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:38.414268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:38.415417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:38.416997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:38.433326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=60 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:38.782617 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1e33d13-bd1b-4452-bccb-325350316e2a tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.228756 Jun 25 21:12:38.783861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2160/4750] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:37 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:38.797079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b186995-d8a0-4841-a4ae-efceec39265d tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f64b160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1644815150", "description": "tempest-description-457083396"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:39.180999 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b186995-d8a0-4841-a4ae-efceec39265d tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.388973 Jun 25 21:12:39.186641 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2161/4751] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:38 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:39.196217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-898a4850-2b70-47ef-a09d-c5381703b689 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f64bca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-584433748", "description": "tempest-description-960920752"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:39.477145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:39.500109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c5ac61e8-0bc7-4f4f-bc70-51782e13c14c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 1.120475 Jun 25 21:12:39.519525 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2591/4752] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:38 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:12:39.638697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-898a4850-2b70-47ef-a09d-c5381703b689 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.445533 Jun 25 21:12:39.640558 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2162/4753] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:39 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:39.654527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8ca38bc-7d34-4a9e-9ae5-41b5a488f0ee tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f59c0d0>, body: {"security_group_rule": {"parent_group_id": "0f13bd99-bdeb-4a01-bc1b-12b8597cc8c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "78f10cdf-c112-40ef-ace0-e8aac17e216f"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:40.247427 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8ca38bc-7d34-4a9e-9ae5-41b5a488f0ee tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.600377 Jun 25 21:12:40.248044 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2592/4754] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:39 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:40.264764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d40e7203-a74b-45d2-9ccb-9785e1bffc5a tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f714280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-835319419", "description": "tempest-description-1471322399"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:40.525528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:40.526242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:40.547158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:40.548326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:40.550356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:40.553182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:40.869785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:40.881494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e64a00c2-98ac-4890-b931-4c5360b655b3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.359842 Jun 25 21:12:40.882294 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2593/4755] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:40 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:12:40.943727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d40e7203-a74b-45d2-9ccb-9785e1bffc5a tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.685010 Jun 25 21:12:40.944349 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2163/4756] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:40 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:40.960696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3dd1c493-bb26-4d30-88ac-e57bca423293 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f56dee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1690009448", "description": "tempest-description-1695142295"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:41.361548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3dd1c493-bb26-4d30-88ac-e57bca423293 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.408592 Jun 25 21:12:41.363473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2594/4757] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:40 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:41.375963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18e26dea-3c81-42f6-9ae7-4557a55aa7b3 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984f6965e0>, body: {"security_group_rule": {"parent_group_id": "1b3e4921-a7f6-4ce6-91b8-8abea9d0baff", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "45638d2a-4fc1-426f-9848-a97fc6eb671e"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:41.901549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:41.902903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:41.917244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:41.918588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:41.919644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:41.922942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:41.945079 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18e26dea-3c81-42f6-9ae7-4557a55aa7b3 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.574725 Jun 25 21:12:41.946091 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2164/4758] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:41 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:41.960174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7461b150-41aa-4155-abdf-20647870eb70 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f696dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:42.307391 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7461b150-41aa-4155-abdf-20647870eb70 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/45638d2a-4fc1-426f-9848-a97fc6eb671e" status: 202 len: 0 microversion: 2.1 time: 0.354305 Jun 25 21:12:42.308540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2165/4759] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:41 2022] DELETE /compute/v2.1/os-security-groups/45638d2a-4fc1-426f-9848-a97fc6eb671e => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:12:42.318330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-287ceda9-653e-4bce-ac55-d56448c328f2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f675160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:42.408767 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-287ceda9-653e-4bce-ac55-d56448c328f2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/1b3e4921-a7f6-4ce6-91b8-8abea9d0baff" status: 200 len: 247 microversion: 2.1 time: 0.095620 Jun 25 21:12:42.410666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2166/4760] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:12:42 2022] GET /compute/v2.1/os-security-groups/1b3e4921-a7f6-4ce6-91b8-8abea9d0baff => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:42.425424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:42.426757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e0259a0-b7c0-482d-8036-15bd5929aedb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f985c0e09d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-99711571", "description": "tempest-description-723117681"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:42.436372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5633cd3-0967-4ad6-85df-43360e0934b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.541259 Jun 25 21:12:42.442253 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2595/4761] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:41 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:12:42.841435 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e0259a0-b7c0-482d-8036-15bd5929aedb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.423989 Jun 25 21:12:42.842201 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2167/4762] 10.222.0.39 () {60 vars in 1179 bytes} [Sat Jun 25 21:12:42 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:42.856008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c0bd993-a598-4361-ae8c-3fc33fe66d30 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984fc9ec10>, body: {"security_group_rule": {"parent_group_id": "16b2a297-e7a7-4bba-aef7-e37ebe44753a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:43.459345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:43.460629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:43.486740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:43.486740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:43.486740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:43.486740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:43.646805 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c0bd993-a598-4361-ae8c-3fc33fe66d30 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.795315 Jun 25 21:12:43.647527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2596/4763] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:42 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:43.660983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28d88c9d-cf98-4152-8459-86d531d27397 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Action: 'create', calling method: .version_select at 0x7f984ebba160>, body: {"security_group_rule": {"parent_group_id": "16b2a297-e7a7-4bba-aef7-e37ebe44753a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:43.810882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:43.828769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b78027c4-1561-495a-b38c-e52035f128c8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.374380 Jun 25 21:12:43.833005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2168/4764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:43 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:44.812124 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28d88c9d-cf98-4152-8459-86d531d27397 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.154946 Jun 25 21:12:44.812124 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2597/4765] 10.222.0.39 () {60 vars in 1194 bytes} [Sat Jun 25 21:12:43 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:44.834240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14650cc9-6fc4-4ef3-b125-ac3487f1d2e2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f98620241f0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:44.853319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:44.854080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:44.864474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:44.865379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:44.866672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:44.867337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:44.953865 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14650cc9-6fc4-4ef3-b125-ac3487f1d2e2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/16b2a297-e7a7-4bba-aef7-e37ebe44753a" status: 200 len: 662 microversion: 2.1 time: 0.126589 Jun 25 21:12:44.955146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2169/4766] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:12:44 2022] GET /compute/v2.1/os-security-groups/16b2a297-e7a7-4bba-aef7-e37ebe44753a => generated 662 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:44.971583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1953289e-b8eb-40db-aa8e-c215c7cb519b tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f6964c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:45.174727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:45.185291 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1953289e-b8eb-40db-aa8e-c215c7cb519b tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-group-rules/4ab4b49a-966a-4ccb-9557-66a25d12a351" status: 202 len: 0 microversion: 2.1 time: 0.222319 Jun 25 21:12:45.186224 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2170/4767] 10.222.0.39 () {58 vars in 1286 bytes} [Sat Jun 25 21:12:44 2022] DELETE /compute/v2.1/os-security-group-rules/4ab4b49a-966a-4ccb-9557-66a25d12a351 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:12:45.201978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3206646-e740-4a5d-a46f-e914c3a46617 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f64b310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:45.213611 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8408bbf3-5b4c-4152-9323-a047a141afa0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.368265 Jun 25 21:12:45.218987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2598/4768] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:44 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:45.509847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3206646-e740-4a5d-a46f-e914c3a46617 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/16b2a297-e7a7-4bba-aef7-e37ebe44753a" status: 202 len: 0 microversion: 2.1 time: 0.318362 Jun 25 21:12:45.511095 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2171/4769] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:45 2022] DELETE /compute/v2.1/os-security-groups/16b2a297-e7a7-4bba-aef7-e37ebe44753a => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:12:45.527280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984eb60b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:45.602711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:12:45.603575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Neutron security group 45638d2a-4fc1-426f-9848-a97fc6eb671e not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:12:45.604392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] HTTP exception thrown: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.604392 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Request method failure captured: Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/45638d2a-4fc1-426f-9848-a97fc6eb671e HTTP/1.1 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pDUUTZKEMLFWaKQ_vQTz0ihNO-aevNHikKfWzBtLLGRLmXOhl9VC5k3Ip59wupMuTYYU5m5pcNwr0Cv7OGeyZvEGiLS6ZM3RVl-9IXXOdv41CAtKBXlBEQmUjnvfnx2Oc6Dw_v8fGANSlTN0hvqqQs12mbozERE-TG0oaFZS_6bBA Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 78bbd68e6c6e4a9ca1a5e5a4c872eb5d Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-694950975 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/78bbd68e6c6e4a9ca1a5e5a4c872eb5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78bbd68e6c6e4a9ca1a5e5a4c872eb5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_78bbd68e6c6e4a9ca1a5e5a4c872eb5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/78bbd68e6c6e4a9ca1a5e5a4c872eb5d"}]}] Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupRulesTestJSON-694950975 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 78bbd68e6c6e4a9ca1a5e5a4c872eb5d Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-694950975 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupRulesTestJSON-694950975-project Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: bd74e4b366624b72844b2d19f8b8bc35 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupRulesTestJSON-694950975-project Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '45638d2a-4fc1-426f-9848-a97fc6eb671e'} Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:12:45.606879 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] Jun 25 21:12:45.611586 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:12:45.616099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Returning 404 to user: Security group 45638d2a-4fc1-426f-9848-a97fc6eb671e does not exist Jun 25 21:12:45.616099 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-d0d9d4f5-2096-4afe-98aa-06ee5b864785'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:12:45.617690 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f845a6c-8369-4632-b968-c351c19d05dc tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/45638d2a-4fc1-426f-9848-a97fc6eb671e" status: 404 len: 194 microversion: 2.1 time: 0.101851 Jun 25 21:12:45.618989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2599/4770] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:45 2022] DELETE /compute/v2.1/os-security-groups/45638d2a-4fc1-426f-9848-a97fc6eb671e => generated 194 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:12:45.627878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8e9cf8c-e0de-4b7d-ac37-c03981c5bec6 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f985c0668b0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:46.235320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:46.237402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:46.252709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:46.255423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:46.256376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:46.257947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:46.666362 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8e9cf8c-e0de-4b7d-ac37-c03981c5bec6 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/1b3e4921-a7f6-4ce6-91b8-8abea9d0baff" status: 202 len: 0 microversion: 2.1 time: 1.043010 Jun 25 21:12:46.671846 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2172/4771] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:45 2022] DELETE /compute/v2.1/os-security-groups/1b3e4921-a7f6-4ce6-91b8-8abea9d0baff => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:46.834467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:46.843350 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1fb6d55-a678-46cb-aeed-393f78e0f16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.612641 Jun 25 21:12:46.850927 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2600/4772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:46 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:12:46.856339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfbc92fa-d199-4b66-9d0d-2010b6a91c62 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f59cca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:47.014973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1d09ec46-43c9-4017-b766-3a01c0e8c9a1 req-22dd7689-9076-48fb-bc58-cb8992f70b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "name": "network-vif-plugged", "status": "completed", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:47.048162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1d09ec46-43c9-4017-b766-3a01c0e8c9a1 req-22dd7689-9076-48fb-bc58-cb8992f70b77 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:47.053403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1d09ec46-43c9-4017-b766-3a01c0e8c9a1 req-22dd7689-9076-48fb-bc58-cb8992f70b77 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:47.067208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:47.130065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1d09ec46-43c9-4017-b766-3a01c0e8c9a1 req-22dd7689-9076-48fb-bc58-cb8992f70b77 service nova] Creating event network-vif-plugged:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch2-master-1 Jun 25 21:12:47.160796 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1d09ec46-43c9-4017-b766-3a01c0e8c9a1 req-22dd7689-9076-48fb-bc58-cb8992f70b77 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.478081 Jun 25 21:12:47.163588 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2173/4773] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:12:47.416994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfbc92fa-d199-4b66-9d0d-2010b6a91c62 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/78f10cdf-c112-40ef-ace0-e8aac17e216f" status: 202 len: 0 microversion: 2.1 time: 0.564458 Jun 25 21:12:47.418283 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2601/4774] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:46 2022] DELETE /compute/v2.1/os-security-groups/78f10cdf-c112-40ef-ace0-e8aac17e216f => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:47.428211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90095798-3ec5-4b05-b498-9d6af25975e2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f64b430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:47.869118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:47.870403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:47.884370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:47.884881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:47.885680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:47.886127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:48.265882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:48.276110 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d23c104e-5730-4ed2-b678-42af1704189e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.412959 Jun 25 21:12:48.277490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2602/4775] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:47 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:12:48.788359 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90095798-3ec5-4b05-b498-9d6af25975e2 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/0f13bd99-bdeb-4a01-bc1b-12b8597cc8c0" status: 202 len: 0 microversion: 2.1 time: 1.365902 Jun 25 21:12:48.790701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2174/4776] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:47 2022] DELETE /compute/v2.1/os-security-groups/0f13bd99-bdeb-4a01-bc1b-12b8597cc8c0 => generated 0 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:48.799602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3a3b7b2-4c5e-4d5c-80bb-b959b730cd01 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984eb60b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:49.307455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:49.310651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:49.328973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:49.329468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:49.331877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:49.332568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:49.361386 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3a3b7b2-4c5e-4d5c-80bb-b959b730cd01 tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6173a575-258f-4c98-8417-2f54d95a78df" status: 202 len: 0 microversion: 2.1 time: 0.565879 Jun 25 21:12:49.362324 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2603/4777] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:48 2022] DELETE /compute/v2.1/os-security-groups/6173a575-258f-4c98-8417-2f54d95a78df => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:49.376363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-851a8716-ca2e-4386-b158-6a18324595bb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] Calling method '.version_select at 0x7f984f56d310>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:49.876023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:49.895554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-923eb87c-a6ee-430a-8f96-121a1b737321 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1392 microversion: 2.1 time: 0.606450 Jun 25 21:12:49.898923 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2175/4778] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:49 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1392 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:49.910734 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-851a8716-ca2e-4386-b158-6a18324595bb tempest-SecurityGroupRulesTestJSON-694950975 tempest-SecurityGroupRulesTestJSON-694950975-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/5fbdb3e8-0d14-472d-8a14-ae8fd4597c37" status: 202 len: 0 microversion: 2.1 time: 0.541308 Jun 25 21:12:49.911348 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2604/4779] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:12:49 2022] DELETE /compute/v2.1/os-security-groups/5fbdb3e8-0d14-472d-8a14-ae8fd4597c37 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:12:50.926028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:50.929293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:50.948220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:50.952864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:50.957557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:50.960104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:51.451565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:51.466674 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75dfbd05-e0a6-4e4e-84b6-32ccac934630 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1564 microversion: 2.1 time: 0.552675 Jun 25 21:12:51.469213 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2176/4780] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:50 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1564 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:51.485077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:51.485702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:51.493855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:51.494285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:51.495061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:51.495504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:52.006413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:52.025850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16459273-43f5-4ccf-b717-1142a83b0ac3 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1564 microversion: 2.1 time: 0.544497 Jun 25 21:12:52.047549 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2605/4781] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:51 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1564 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:52.118853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:52.120240 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:12:52.120240 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:12:52.121911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:52.122609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:52.123668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:52.124292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:52.166511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5fe8f87e-a751-4552-a11f-e665c307b5e3 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.216638 Jun 25 21:12:52.167245 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2177/4782] 10.222.0.39 () {58 vars in 1184 bytes} [Sat Jun 25 21:12:51 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:52.510446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-472251977", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "2dfc3781-c596-4666-9e65-f053a8b13578"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:52.619492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] validate_networks() for [('2dfc3781-c596-4666-9e65-f053a8b13578', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:12:53.359252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:12:53.359781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:12:53.360366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:12:53.360909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:12:53.362582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:12:53.391788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:53.392984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:53.394058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:53.395188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:53.453544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Getting quotas for project 113e8385615d430ca60af9afcc5a3e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:12:53.467771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Getting quotas for user 6e277a300e4e4947b2e08d668daa9ed3 and project 113e8385615d430ca60af9afcc5a3e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:12:53.504470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:12:53.507076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:12:53.591745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d7ad7060-4902-4a81-806c-d0e11f6bc7fe tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082522 Jun 25 21:12:53.596767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2606/4783] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:12:53.604101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7aa5ce89-7b60-4f35-ae63-9ff956a68fd1 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:53.604962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7aa5ce89-7b60-4f35-ae63-9ff956a68fd1 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:53.838081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7aa5ce89-7b60-4f35-ae63-9ff956a68fd1 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1328 microversion: 2.1 time: 0.237626 Jun 25 21:12:53.838700 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2178/4784] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:53 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1328 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:54.861158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:54.861960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:54.880130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:54.890845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:54.891895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:54.892501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:55.253302 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-747fc356-1c61-419e-8331-29c0a142df46 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1337 microversion: 2.1 time: 0.400945 Jun 25 21:12:55.261160 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2607/4785] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:54 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1337 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:55.845731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:55.849684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:55.875673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:55.876780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:55.879484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:55.882068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:55.992023 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4f9b3c7-d36a-4834-97df-a20f20e57e4a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152847 Jun 25 21:12:55.993044 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2179/4786] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:12:55 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000/os-volume_attachments => generated 25 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:12:56.118450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:56.119043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:56.127272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.142059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.142997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.143446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.231669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:12:56.274251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:56.274995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:56.285785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.286251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.287046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.291511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.361373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d754512-2532-4477-8b94-d168ef2b720c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 204 len: 0 microversion: 2.1 time: 0.246397 Jun 25 21:12:56.362562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2608/4787] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:12:56 2022] DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:12:56.372598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:56.375694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:56.397599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.399978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.401089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:56.402422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:56.532412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a654c9c7-7bc3-4913-a620-7fc088c0f242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1421 microversion: 2.1 time: 0.262317 Jun 25 21:12:56.536285 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2180/4788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:56 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1421 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:56.832650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:56.846638 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c42bddb-aa49-4b0e-9512-17c95159ed51 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1673 microversion: 2.1 time: 0.476887 Jun 25 21:12:56.847393 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2609/4789] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:56 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1673 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:57.384237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:57.385060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:57.405605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.408275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.416260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7637c98e-23ff-41ae-bc20-11df69d17015 req-ca136328-1412-4b01-98c1-5e1ef7d0026a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:12:57.427090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.429808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.446560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7637c98e-23ff-41ae-bc20-11df69d17015 req-ca136328-1412-4b01-98c1-5e1ef7d0026a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.451201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7637c98e-23ff-41ae-bc20-11df69d17015 req-ca136328-1412-4b01-98c1-5e1ef7d0026a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.503066 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7637c98e-23ff-41ae-bc20-11df69d17015 req-ca136328-1412-4b01-98c1-5e1ef7d0026a service nova] Creating event network-changed:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch2-master-1 Jun 25 21:12:57.526006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7637c98e-23ff-41ae-bc20-11df69d17015 req-ca136328-1412-4b01-98c1-5e1ef7d0026a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113771 Jun 25 21:12:57.526665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2610/4790] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:12:57.566849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:57.567642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:57.603768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.606266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.607117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.607606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.921957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:57.931060 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-df46f98b-e0fb-42d6-8b3c-3e00e93f6922 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1564 microversion: 2.1 time: 0.550854 Jun 25 21:12:57.949973 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2181/4791] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:57 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1564 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:57.960339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:57.966772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:57.982485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.983017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:57.983840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:57.984276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:58.367526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:58.384085 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef721d33-c37a-4438-94dd-83408756bdc5 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1673 microversion: 2.1 time: 0.428698 Jun 25 21:12:58.386390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2182/4792] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:57 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1673 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:58.459448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b33eaeb4-b4fb-4180-8830-57f6f8e388dd tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.910151 Jun 25 21:12:58.469360 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2611/4793] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:57 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:12:58.772234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:58.772789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:58.775138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:12:58.783032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:58.783609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:58.784763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:58.785407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:58.825889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:12:59.025733 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1bf16cb2-373e-4afb-ba79-b869ff36956a tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 204 len: 0 microversion: 2.32 time: 0.638134 Jun 25 21:12:59.026349 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2183/4794] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:12:58 2022] DELETE /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:12:59.050410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:59.051337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:59.063341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.064133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.066424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.067975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.403537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:59.404255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:59.421197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.422283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.423232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.424236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.480886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:59.495325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:59.503616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:12:59.505323 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62f03fd9-a918-4833-ab5d-90f863409fc4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2956 microversion: 2.32 time: 0.474242 Jun 25 21:12:59.511521 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2612/4795] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:12:59 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2956 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:12:59.520818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:12:59.521694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:12:59.539010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.539628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.541797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:12:59.544133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:12:59.821332 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6f773e1-14a2-4056-8d0e-a47fe5ee9300 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.308370 Jun 25 21:12:59.822205 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2613/4796] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:59 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:00.240925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-aae21500-ab3c-4e21-89b7-eb7c6ebc5d55 req-7b45a9d0-e73e-46f8-9482-732135bf7a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1663ba2d-bd8d-4eec-94df-bf348f58996a", "tag": "96612d03-1443-42f6-bf4b-1dcf50b8ada8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:00.251143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-aae21500-ab3c-4e21-89b7-eb7c6ebc5d55 req-7b45a9d0-e73e-46f8-9482-732135bf7a1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:00.253559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-aae21500-ab3c-4e21-89b7-eb7c6ebc5d55 req-7b45a9d0-e73e-46f8-9482-732135bf7a1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:00.293113 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-aae21500-ab3c-4e21-89b7-eb7c6ebc5d55 req-7b45a9d0-e73e-46f8-9482-732135bf7a1e service nova] Creating event network-changed:96612d03-1443-42f6-bf4b-1dcf50b8ada8 for instance 1663ba2d-bd8d-4eec-94df-bf348f58996a on nch1-master-1 Jun 25 21:13:00.298331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-aae21500-ab3c-4e21-89b7-eb7c6ebc5d55 req-7b45a9d0-e73e-46f8-9482-732135bf7a1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322970 Jun 25 21:13:00.299494 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2614/4797] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:00.506521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:00.521010 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a010b49f-b312-4ce9-a3c4-8eee87860e77 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1673 microversion: 2.1 time: 1.121437 Jun 25 21:13:00.523382 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2184/4798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:12:59 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1673 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:00.539744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:00.541231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:00.555323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:00.555323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:00.555323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:00.555323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:00.840733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:00.841791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:00.860328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:00.861915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:00.864337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:00.877313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:00.887359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:00.903530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:00.907769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:00.913740 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-93401be9-5ff4-4101-b890-7f4dad4f8bd4 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2956 microversion: 2.32 time: 0.376277 Jun 25 21:13:00.916300 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2615/4799] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:00 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2956 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:01.382489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-035bf523-c2ff-4f34-9bd2-7cbc98442fe4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.546016 Jun 25 21:13:01.387277 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2185/4800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:00 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:01.540718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:01.542116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:01.559596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:01.560215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:01.561509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:01.564163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:01.576074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:01.728932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d2a473cf-dda3-49ec-bff4-9f972bebba14 req-29891349-c586-4b6f-908d-db05e73a2235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26365fd2-d8a1-4c59-a24e-7ebc35313000", "name": "network-vif-deleted", "tag": "2d258606-be3a-423d-9adf-aea92f13d512"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:01.750580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d2a473cf-dda3-49ec-bff4-9f972bebba14 req-29891349-c586-4b6f-908d-db05e73a2235 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:01.753751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d2a473cf-dda3-49ec-bff4-9f972bebba14 req-29891349-c586-4b6f-908d-db05e73a2235 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:01.794301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d2a473cf-dda3-49ec-bff4-9f972bebba14 req-29891349-c586-4b6f-908d-db05e73a2235 service nova] Creating event network-vif-deleted:2d258606-be3a-423d-9adf-aea92f13d512 for instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 on nch1-master-1 Jun 25 21:13:01.819974 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d2a473cf-dda3-49ec-bff4-9f972bebba14 req-29891349-c586-4b6f-908d-db05e73a2235 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095121 Jun 25 21:13:01.824931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2186/4801] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:13:01.936793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:01.937709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:01.956056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:01.958063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:01.960515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:01.961673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:01.986423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:01.999729 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-977d5fea-b2ae-4955-92d1-357cffce0e6d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 200 len: 1605 microversion: 2.1 time: 0.462648 Jun 25 21:13:02.002585 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2616/4802] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:01 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 1605 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:02.134070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:02.393353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:02.406798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:02.407771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:02.421698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:02.424111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:02.429828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:02.430325 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-792283ba-f05a-4490-ab24-29b7092bf016 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2956 microversion: 2.32 time: 0.495947 Jun 25 21:13:02.431525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:02.432618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2187/4803] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:01 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2956 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:13:02.432867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:02.433603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:02.791192 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-934cc916-fa04-4c35-bdbb-b274f5080308 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.390781 Jun 25 21:13:02.802903 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2617/4804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:02 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:03.019858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:03.020499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:03.031649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.032025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:03.040528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.041584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:03.060124 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 HTTP/1.1 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '26365fd2-d8a1-4c59-a24e-7ebc35313000'} Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:03.061966 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-622984bc-28f0-44fa-afc6-5fcab2872011 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 404 len: 111 microversion: 2.1 time: 0.049021 Jun 25 21:13:03.074588 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2188/4805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:03 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:03.078821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-071c33f0-2fbf-4731-878d-9cf62ae19a3a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '.version_select at 0x7f984f62f430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:03.104532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-071c33f0-2fbf-4731-878d-9cf62ae19a3a tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661154111" status: 202 len: 0 microversion: 2.1 time: 0.033786 Jun 25 21:13:03.105565 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2618/4806] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:13:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661154111 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:13:03.461649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:03.462437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:03.473474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.475177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:03.476462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.477218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:03.823574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:03.824275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:03.836839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:03.840220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:03.844594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:03.852197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.857176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:03.858566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:03.859419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:04.044096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:04.062840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:04.064510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:04.065888 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a81eff2f-df6a-4a0a-932b-c43784d3643e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2956 microversion: 2.32 time: 0.616091 Jun 25 21:13:04.066492 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2189/4807] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:03 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2956 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:04.282737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-563c2a81-658f-44e9-bdfe-f352c2e439a8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.472233 Jun 25 21:13:04.285409 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2619/4808] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:03 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:04.585546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdc2651a-d4a7-4f0a-9391-fd4edb30c5c7 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: .version_select at 0x7f984f714700>, body: {"keypair": {"name": "tempest-keypair-930261041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD/Xw4ZsA6Yd8OJkSSQ2OjjLnqwgfvBCWZCCeEWCfmu64vTqNhUznpvoN3vWnbI4LGh41D2c+Lbg+6rbAjEvxlVBXboUpvd+bqJGEBfjkwxnQ2WVLv+Yzxk72MCEO/MFg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:04.623872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bdc2651a-d4a7-4f0a-9391-fd4edb30c5c7 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:04.644139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bdc2651a-d4a7-4f0a-9391-fd4edb30c5c7 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for user 6bcfb45bd9404205aefe7d1d2b33cd25 and project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:04.736608 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdc2651a-d4a7-4f0a-9391-fd4edb30c5c7 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.155552 Jun 25 21:13:04.749552 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2190/4809] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:13:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:05.104528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:05.108000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:05.122085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:05.123342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:05.124768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:05.126132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:05.312596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:05.315079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:05.329072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:05.330234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:05.331549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:05.332296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:05.557864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:05.568102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:05.569979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:05.571821 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecab128a-9123-4343-888b-1596ff39d285 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2935 microversion: 2.32 time: 0.486298 Jun 25 21:13:05.573010 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2620/4810] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:05 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2935 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:05.909619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-03e86513-81e1-4539-a519-1ba16ea8a0a1 req-894fd88f-39e8-4f1f-bcde-5e729fdbfb12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "7ea183c3-f749-4eb9-8da7-cf65b316e82d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:05.913333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:05.931980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-03e86513-81e1-4539-a519-1ba16ea8a0a1 req-894fd88f-39e8-4f1f-bcde-5e729fdbfb12 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:05.933965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-03e86513-81e1-4539-a519-1ba16ea8a0a1 req-894fd88f-39e8-4f1f-bcde-5e729fdbfb12 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:05.974706 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-03e86513-81e1-4539-a519-1ba16ea8a0a1 req-894fd88f-39e8-4f1f-bcde-5e729fdbfb12 service nova] Creating event network-vif-unplugged:7ea183c3-f749-4eb9-8da7-cf65b316e82d for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:05.984470 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-03e86513-81e1-4539-a519-1ba16ea8a0a1 req-894fd88f-39e8-4f1f-bcde-5e729fdbfb12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078584 Jun 25 21:13:05.985775 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2621/4811] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:13:06.182845 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00d62d62-74db-48d1-ad88-7da13254d155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.885670 Jun 25 21:13:06.189215 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2191/4812] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:05 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:06.600635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:06.601634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:06.625577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:06.626070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:06.630418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:06.631082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:07.157601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:07.179708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:07.183491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:07.184888 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce6ff19e-cf82-419a-82e8-1984db5216f0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2914 microversion: 2.32 time: 0.595142 Jun 25 21:13:07.186030 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2622/4813] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:06 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2914 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:07.206103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:07.206982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:07.220724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:07.224892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:07.224892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:07.225309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:07.828816 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bfb232b-8ec0-4d74-91e9-fa1a4684f456 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.626876 Jun 25 21:13:07.830210 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2192/4814] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:07 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:08.051792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "b3347e88-190a-4637-80a6-61afca27cb1b"}, {"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "febbd08b-81b9-4e73-a726-475aaee4e08b"}, {"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "83606aab-a9e6-48e1-84e5-271f3f683537"}, {"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-unplugged", "status": "completed", "tag": "48c08606-e1db-4c6a-81c5-188382208a7b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:08.074696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:08.075162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:08.108148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Creating event network-vif-unplugged:b3347e88-190a-4637-80a6-61afca27cb1b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:08.110797 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Creating event network-vif-unplugged:febbd08b-81b9-4e73-a726-475aaee4e08b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:08.111139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Creating event network-vif-unplugged:83606aab-a9e6-48e1-84e5-271f3f683537 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:08.112883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] Creating event network-vif-unplugged:48c08606-e1db-4c6a-81c5-188382208a7b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:08.128249 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9667f441-6d69-455f-a1ba-e2c5bb332d78 req-cf1070f7-3b90-44fd-bd5e-01e8cd598b39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.078129 Jun 25 21:13:08.133839 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2623/4815] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:08.208471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:08.209243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:08.228385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:08.228977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:08.230704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:08.231704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:08.455650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-522675619", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1eb20bd-61f4-4d72-bc42-77788c0f534a"}], "security_groups": [{"name": "tempest-securitygroup--484859376"}], "key_name": "tempest-keypair-930261041", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:08.660771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] validate_networks() for [('d1eb20bd-61f4-4d72-bc42-77788c0f534a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:13:08.887425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:08.890545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:08.923259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:08.925059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:08.926764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5af0ae48-8241-4bc3-bec6-3ddb3756fb23 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2914 microversion: 2.32 time: 0.723097 Jun 25 21:13:08.927520 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2193/4816] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:08 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2914 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:08.943121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:08.943761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:08.953638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:08.954165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:08.954958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:08.959021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:09.629080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:13:09.630033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:13:09.630712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:13:09.631029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:13:09.632714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:13:09.647056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:09.647509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:09.648698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:09.649333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:09.676059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:09.682500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Getting quotas for user 6bcfb45bd9404205aefe7d1d2b33cd25 and project a5b521724c3d49069bb1aa8c2428b75c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:09.697766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:13:09.700267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:13:09.765098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-055ea971-c872-4716-904b-1281241eeafd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.320433 Jun 25 21:13:09.766150 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2624/4817] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:13:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:13:09.778521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b5ad114-551e-4e10-b56e-fdf62c0daa27 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:09.779617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b5ad114-551e-4e10-b56e-fdf62c0daa27 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:09.850989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b5ad114-551e-4e10-b56e-fdf62c0daa27 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:09.860017 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b5ad114-551e-4e10-b56e-fdf62c0daa27 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1236 microversion: 2.1 time: 0.086580 Jun 25 21:13:09.862252 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2625/4818] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:09 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:09.954881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:09.955859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:09.965294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:09.966088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:09.967417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:09.968183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:10.060575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b31eff06-77e7-45af-8b51-b79a5eadc7ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 1.131675 Jun 25 21:13:10.062685 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2194/4819] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:08 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:10.216147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:10.229204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:10.231674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:10.234338 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c01ffdb1-9b56-4819-a012-741bbe7a877c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2867 microversion: 2.32 time: 0.287480 Jun 25 21:13:10.236681 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2626/4820] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:09 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2867 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:13:10.510191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e9798ebc-eb16-4acf-9175-1649df90fc33 req-b212ea67-6396-4df9-8f6e-4fc71ced5070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1663ba2d-bd8d-4eec-94df-bf348f58996a", "name": "network-vif-plugged", "status": "completed", "tag": "96612d03-1443-42f6-bf4b-1dcf50b8ada8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:10.526820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e9798ebc-eb16-4acf-9175-1649df90fc33 req-b212ea67-6396-4df9-8f6e-4fc71ced5070 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:10.527562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e9798ebc-eb16-4acf-9175-1649df90fc33 req-b212ea67-6396-4df9-8f6e-4fc71ced5070 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:10.545347 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e9798ebc-eb16-4acf-9175-1649df90fc33 req-b212ea67-6396-4df9-8f6e-4fc71ced5070 service nova] Creating event network-vif-plugged:96612d03-1443-42f6-bf4b-1dcf50b8ada8 for instance 1663ba2d-bd8d-4eec-94df-bf348f58996a on nch1-master-1 Jun 25 21:13:10.553050 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e9798ebc-eb16-4acf-9175-1649df90fc33 req-b212ea67-6396-4df9-8f6e-4fc71ced5070 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047665 Jun 25 21:13:10.557665 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2195/4821] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:10.705742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e972d372-18b5-4853-aec2-d36b0b093620 req-06176572-879b-4268-868b-cf2d6c65889c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-deleted", "tag": "febbd08b-81b9-4e73-a726-475aaee4e08b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:10.731788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e972d372-18b5-4853-aec2-d36b0b093620 req-06176572-879b-4268-868b-cf2d6c65889c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:10.732336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e972d372-18b5-4853-aec2-d36b0b093620 req-06176572-879b-4268-868b-cf2d6c65889c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:10.762007 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e972d372-18b5-4853-aec2-d36b0b093620 req-06176572-879b-4268-868b-cf2d6c65889c service nova] Creating event network-vif-deleted:febbd08b-81b9-4e73-a726-475aaee4e08b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:10.778287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e972d372-18b5-4853-aec2-d36b0b093620 req-06176572-879b-4268-868b-cf2d6c65889c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084819 Jun 25 21:13:10.779695 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2627/4822] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:10.895739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:10.896953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:10.910845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:10.913408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:10.915590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:10.916368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:11.081729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:11.082966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:11.097223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:11.098116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:11.099280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:11.100179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:11.108542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:11.122909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce55868e-6f5e-4bd3-81e1-ebd621392aea tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1288 microversion: 2.1 time: 0.244927 Jun 25 21:13:11.123542 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2196/4823] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:10 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1288 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:11.257861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:11.258620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:11.274155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:11.275756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:11.277824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:11.278282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:11.334678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a82503db-7f2b-461a-a8b7-4c47c02ff3c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1463 microversion: 2.1 time: 0.259516 Jun 25 21:13:11.337202 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2628/4824] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:11 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:11.891661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:11.913453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:11.919851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:11.923013 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ffd57f9-8041-4b39-a377-989b1dc41bd0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2580 microversion: 2.32 time: 0.671353 Jun 25 21:13:11.928379 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2197/4825] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:11 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2580 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:13:12.145181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:12.146761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:12.174312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.176611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:12.177710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.178561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:12.362410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:12.363895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:12.376850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:12.385899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.386658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:12.387893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.389245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:12.393069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-345229d7-e494-45cd-b81b-f3c40db168f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1294 microversion: 2.1 time: 0.252443 Jun 25 21:13:12.406670 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2629/4826] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:12 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:12.959041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:12.959671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:12.974470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.982833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:12.985927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:12.991846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.504053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:13.520628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:13.522140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:13.523397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e764c1a-7128-44b3-9a07-eb46773d1152 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2580 microversion: 2.32 time: 0.578603 Jun 25 21:13:13.526305 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2630/4827] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:12 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2580 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:13.536480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:13.537280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:13.552681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:13.553528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.556257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:13.561397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.616646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d2052c04-3a53-4f99-942b-dd1c313b31ad tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1647 microversion: 2.1 time: 1.258970 Jun 25 21:13:13.620048 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2198/4828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:12 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1647 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:13.626266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-11b61d83-ee1c-4410-a082-bfac5b77bfaf req-c9dc6bc3-c8af-416a-b0a6-28c453d24e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-deleted", "tag": "48c08606-e1db-4c6a-81c5-188382208a7b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:13.651902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-11b61d83-ee1c-4410-a082-bfac5b77bfaf req-c9dc6bc3-c8af-416a-b0a6-28c453d24e8f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:13.652656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-11b61d83-ee1c-4410-a082-bfac5b77bfaf req-c9dc6bc3-c8af-416a-b0a6-28c453d24e8f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.668229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-11b61d83-ee1c-4410-a082-bfac5b77bfaf req-c9dc6bc3-c8af-416a-b0a6-28c453d24e8f service nova] Creating event network-vif-deleted:48c08606-e1db-4c6a-81c5-188382208a7b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:13.676004 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-11b61d83-ee1c-4410-a082-bfac5b77bfaf req-c9dc6bc3-c8af-416a-b0a6-28c453d24e8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053234 Jun 25 21:13:13.677463 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2199/4829] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:13.685703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:13.688336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:13.708070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:13.709810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.718258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:13.719013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:13.846395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:13.856004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-418c2b06-1194-4b55-91cf-8f72384fe718 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1294 microversion: 2.1 time: 0.327662 Jun 25 21:13:13.860899 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2631/4830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:13 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1294 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:14.184023 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-933432a5-f54f-4197-80dc-ca550b9ea242 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1647 microversion: 2.1 time: 0.504795 Jun 25 21:13:14.185882 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2200/4831] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:13 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1647 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:14.219146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:14.219907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:14.238157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:14.238923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:14.240075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:14.240731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:14.545918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:14.547329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:14.589416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:14.592400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:14.592977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:14.598740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:14.668468 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fee19a1a-8797-4af2-bf56-e26dfb15acc4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1647 microversion: 2.1 time: 0.460874 Jun 25 21:13:14.672463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2632/4832] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:14 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1647 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:14.688804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:14.878392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1452199377", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "2dfc3781-c596-4666-9e65-f053a8b13578"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:15.015030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] validate_networks() for [('2dfc3781-c596-4666-9e65-f053a8b13578', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:13:15.220829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:15.233849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:15.246891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:15.248319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ba45025-384c-44dc-9501-35b480fa092c tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2419 microversion: 2.32 time: 0.708393 Jun 25 21:13:15.256769 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2201/4833] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:14 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2419 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:13:15.274363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:15.275265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:15.311412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:15.314059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:15.318721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:15.319424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.307355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:16.318052 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-050ab355-cc3f-49c9-9bcf-15764be757cd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 1.059640 Jun 25 21:13:16.323859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2202/4834] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:15 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:16.332567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-617860e6-7141-495b-93bd-6a4476780e05 req-6bfd0124-4b99-4f37-9364-94b550499381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-deleted", "tag": "b3347e88-190a-4637-80a6-61afca27cb1b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:16.350622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-617860e6-7141-495b-93bd-6a4476780e05 req-6bfd0124-4b99-4f37-9364-94b550499381 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:16.351295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-617860e6-7141-495b-93bd-6a4476780e05 req-6bfd0124-4b99-4f37-9364-94b550499381 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.377277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-617860e6-7141-495b-93bd-6a4476780e05 req-6bfd0124-4b99-4f37-9364-94b550499381 service nova] Creating event network-vif-deleted:b3347e88-190a-4637-80a6-61afca27cb1b for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:16.386171 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-617860e6-7141-495b-93bd-6a4476780e05 req-6bfd0124-4b99-4f37-9364-94b550499381 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060039 Jun 25 21:13:16.387582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2203/4835] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:16.395030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:16.397798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:16.419560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:16.420476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.422088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:16.422772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.685896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:13:16.686378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:13:16.686789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:13:16.687691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:13:16.688116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:13:16.729193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:16.729658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.730487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:16.730928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:16.844990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Getting quotas for project 113e8385615d430ca60af9afcc5a3e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:16.863143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Getting quotas for user 6e277a300e4e4947b2e08d668daa9ed3 and project 113e8385615d430ca60af9afcc5a3e5b. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:16.899582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:13:16.903257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:13:16.990433 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab5e64ff-455d-4ef4-9e69-34e37740c155 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.117676 Jun 25 21:13:16.995298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2633/4836] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:13:17.026421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb566554-3605-4e8d-8281-f4a4267c2c5b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:17.028123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb566554-3605-4e8d-8281-f4a4267c2c5b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:17.307865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:17.329587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:17.351432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:17.357906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-911761f4-373a-4e12-974c-33602f5c519f tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2372 microversion: 2.32 time: 0.963671 Jun 25 21:13:17.359322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2204/4837] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:16 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2372 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:17.381237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:17.381878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:17.404524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:17.411248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:17.412270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:17.412741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:17.458746 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb566554-3605-4e8d-8281-f4a4267c2c5b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1329 microversion: 2.1 time: 0.443790 Jun 25 21:13:17.463788 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2634/4838] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:17 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1329 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:18.216479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:18.229455 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0703d5d-e67f-4d12-bce8-8be4700dac8b tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.862676 Jun 25 21:13:18.232970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2205/4839] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:17 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:18.380477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:18.381330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:18.391469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:18.392141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:18.393072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:18.393902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:18.408857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Calling method '.version_select at 0x7f984e7800d0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:18.434137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:13:18.435051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Neutron security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:13:18.435586 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] HTTP exception thrown: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.435586 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Request method failure captured: Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/89b410a0-2f48-464c-b3cf-5b39a09b85cc HTTP/1.1 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pu7q5xUnWq9hFrCHJgPz3rTgRdqFTtxbyReSCltaHiWOieIKyXdJRddeXaKuU9Q3jopdzKhjwaYhyhkfw-hyz_owVANRRHQTfjRm9Q8xMQkPVnVdSSty07HADg27OA4j5fxp4pKcj8sJzzMt8PcZ9r-4dK-r2MT7Bp45_VUiUqh7k Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}] Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5bb232b046fa4ecc86c1490daf6da5e4 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '89b410a0-2f48-464c-b3cf-5b39a09b85cc'} Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:13:18.438099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] Jun 25 21:13:18.441988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.446287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Returning 404 to user: Security group 89b410a0-2f48-464c-b3cf-5b39a09b85cc does not exist Jun 25 21:13:18.446287 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-68aa61bf-65c8-4473-af2d-3f6edb4d7ec1'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:18.447303 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f48ce84-15c5-4ce5-bda7-a54a364eb28e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/89b410a0-2f48-464c-b3cf-5b39a09b85cc" status: 404 len: 194 microversion: 2.1 time: 0.196250 Jun 25 21:13:18.452543 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2635/4840] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:13:18 2022] DELETE /compute/v2.1/os-security-groups/89b410a0-2f48-464c-b3cf-5b39a09b85cc => generated 194 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:18.458598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0a38a9e-5cf3-4516-9a2e-b65fd57b621c tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004775 Jun 25 21:13:18.459222 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2636/4841] 10.222.0.39 () {58 vars in 1163 bytes} [Sat Jun 25 21:13:18 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 21:13:18.469013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bae79b64-2dea-4a0d-8768-bfa9b633f0b8 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Calling method '.version_select at 0x7f984f59c160>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:18.682127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bae79b64-2dea-4a0d-8768-bfa9b633f0b8 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.216938 Jun 25 21:13:18.683192 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2637/4842] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:13:18 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:18.688750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:18.690015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:18.699852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:18.700654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:18.701581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:18.702096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:18.788394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-beb84fa7-4e8d-4c20-a818-e3968a080659 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1424 microversion: 2.1 time: 0.103612 Jun 25 21:13:18.789201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2638/4843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:18 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:18.804663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Calling method '.version_select at 0x7f984e780670>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:18.956575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:13:18.958320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] HTTP exception thrown: Insufficient rights for removing default security group. Jun 25 21:13:18.958320 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Request method failure captured: Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-security-groups/6189ea0a-7993-4c46-b819-2a2cf9182f60 HTTP/1.1 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pu7q5xUnWq9hFrCHJgPz3rTgRdqFTtxbyReSCltaHiWOieIKyXdJRddeXaKuU9Q3jopdzKhjwaYhyhkfw-hyz_owVANRRHQTfjRm9Q8xMQkPVnVdSSty07HADg27OA4j5fxp4pKcj8sJzzMt8PcZ9r-4dK-r2MT7Bp45_VUiUqh7k Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}] Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5bb232b046fa4ecc86c1490daf6da5e4 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: exception: Insufficient rights for removing default security group. Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6189ea0a-7993-4c46-b819-2a2cf9182f60'} Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:13:18.963223 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Returning 400 to user: Insufficient rights for removing default security group. Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-7d5c78a1-11ac-4e12-9690-cde62af2f87f'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53046826-48eb-426f-a327-32b593b31c2e tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "DELETE /compute/v2.1/os-security-groups/6189ea0a-7993-4c46-b819-2a2cf9182f60" status: 400 len: 182 microversion: 2.1 time: 0.167712 Jun 25 21:13:18.969754 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2639/4844] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:13:18 2022] DELETE /compute/v2.1/os-security-groups/6189ea0a-7993-4c46-b819-2a2cf9182f60 => generated 182 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:13:18.982023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3363b9bb-9ca3-4712-98bd-6ee0bc2eb148 req-39907401-a4d0-4788-997b-45d294ae54e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-deleted", "tag": "83606aab-a9e6-48e1-84e5-271f3f683537"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:18.992655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3363b9bb-9ca3-4712-98bd-6ee0bc2eb148 req-39907401-a4d0-4788-997b-45d294ae54e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:18.993409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3363b9bb-9ca3-4712-98bd-6ee0bc2eb148 req-39907401-a4d0-4788-997b-45d294ae54e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:19.011106 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3363b9bb-9ca3-4712-98bd-6ee0bc2eb148 req-39907401-a4d0-4788-997b-45d294ae54e5 service nova] Creating event network-vif-deleted:83606aab-a9e6-48e1-84e5-271f3f683537 for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:19.017566 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3363b9bb-9ca3-4712-98bd-6ee0bc2eb148 req-39907401-a4d0-4788-997b-45d294ae54e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046316 Jun 25 21:13:19.019077 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2640/4845] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:19.024109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Calling method '.version_select at 0x7f984e780dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:19.050336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:13:19.051391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Neutron security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:13:19.051927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] HTTP exception thrown: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.051927 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Request method failure captured: Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-security-groups/5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 HTTP/1.1 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pu7q5xUnWq9hFrCHJgPz3rTgRdqFTtxbyReSCltaHiWOieIKyXdJRddeXaKuU9Q3jopdzKhjwaYhyhkfw-hyz_owVANRRHQTfjRm9Q8xMQkPVnVdSSty07HADg27OA4j5fxp4pKcj8sJzzMt8PcZ9r-4dK-r2MT7Bp45_VUiUqh7k Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}] Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5bb232b046fa4ecc86c1490daf6da5e4 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '5cf98087-42d2-4ce6-aa1e-10d50dbf64d8'} Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:13:19.054969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Returning 404 to user: Security group 5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 does not exist Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-5335039c-4101-4da3-9631-6be6756818c6'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3481ba9f-1b9b-431e-bebe-5a39971b5b1f tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "GET /compute/v2.1/os-security-groups/5cf98087-42d2-4ce6-aa1e-10d50dbf64d8" status: 404 len: 194 microversion: 2.1 time: 0.036932 Jun 25 21:13:19.067243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2641/4846] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:13:19 2022] GET /compute/v2.1/os-security-groups/5cf98087-42d2-4ce6-aa1e-10d50dbf64d8 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:19.074303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Action: 'update', calling method: .version_select at 0x7f984e7fadc0>, body: {"security_group": {"name": "tempest-sg-448116906", "description": "tempest-description-2050129346"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:19.102890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG neutronclient.v2_0.client [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist", "detail": ""}} {{(pid=137461) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jun 25 21:13:19.104416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.security_group_api [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Neutron security group 906c44f5-26c0-4979-9374-3c2e0d599b6d not found {{(pid=137461) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jun 25 21:13:19.107824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] HTTP exception thrown: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.107824 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Request method failure captured: Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: request: PUT /compute/v2.1/os-security-groups/906c44f5-26c0-4979-9374-3c2e0d599b6d HTTP/1.1 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 101 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pu7q5xUnWq9hFrCHJgPz3rTgRdqFTtxbyReSCltaHiWOieIKyXdJRddeXaKuU9Q3jopdzKhjwaYhyhkfw-hyz_owVANRRHQTfjRm9Q8xMQkPVnVdSSty07HADg27OA4j5fxp4pKcj8sJzzMt8PcZ9r-4dK-r2MT7Bp45_VUiUqh7k Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_41ad5eda252e437fbe013b86b0bb5361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/41ad5eda252e437fbe013b86b0bb5361"}]}] Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 41ad5eda252e437fbe013b86b0bb5361 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-318949023 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 5bb232b046fa4ecc86c1490daf6da5e4 Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-318949023-project Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: {"security_group": {"name": "tempest-sg-448116906", "description": "tempest-description-2050129346"}} Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: exception: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '906c44f5-26c0-4979-9374-3c2e0d599b6d', 'body': {'security_group': {'name': 'tempest-sg-448116906', 'description': 'tempest-description-2050129346'}}} Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jun 25 21:13:19.110241 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] Returning 404 to user: Security group 906c44f5-26c0-4979-9374-3c2e0d599b6d does not exist Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: Neutron server returns request_ids: ['req-c4f0b2f7-8ed4-4566-8017-9805b57dbb3b'] {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ef17734c-7122-476e-b470-43e85491e682 tempest-SecurityGroupsNegativeTestJSON-318949023 tempest-SecurityGroupsNegativeTestJSON-318949023-project] 10.222.0.39 "PUT /compute/v2.1/os-security-groups/906c44f5-26c0-4979-9374-3c2e0d599b6d" status: 404 len: 194 microversion: 2.1 time: 0.045751 Jun 25 21:13:19.120737 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2642/4847] 10.222.0.39 () {60 vars in 1289 bytes} [Sat Jun 25 21:13:19 2022] PUT /compute/v2.1/os-security-groups/906c44f5-26c0-4979-9374-3c2e0d599b6d => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:19.249247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:19.249994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:19.261682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:19.262520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:19.263612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:19.264933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:19.625726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:19.638221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c37b5cf7-fb18-46cf-9fd3-53e46bd82790 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.394009 Jun 25 21:13:19.642597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2643/4848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:19 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:19.817885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:19.818581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:19.839605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:19.841578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:19.844562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:19.845298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:19.911563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:19.934516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:19.936068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:19.944509 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3e947ec-1355-4f4f-938c-61e8bf3706ac tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 2167 microversion: 2.32 time: 1.569339 Jun 25 21:13:19.945102 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2206/4849] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:18 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 2167 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:13:19.970567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4a59678-cf69-45dd-90de-9a2e91e8bd08 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1422 microversion: 2.1 time: 0.168000 Jun 25 21:13:19.973486 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2644/4850] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:19 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1422 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:20.661159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:20.661785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:20.683112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:20.683873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:20.686137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:20.687370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:20.965287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:20.967149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:20.989113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:20.989949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:20.991037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:20.992397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:21.252130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:21.271431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:21.286166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:21.288804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec129d5641ef457c99014e8f95fcfb5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e97b91d23b24e7aba5860e7d0bd062c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:21.298985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dd1d6165-ba8a-4dc5-9a5e-9fe0d5c6107b tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 200 len: 1604 microversion: 2.32 time: 0.333516 Jun 25 21:13:21.320047 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2645/4851] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:20 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 1604 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:13:21.333048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:21.333839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:21.372128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:21.373190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:21.374249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:21.374913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:21.431435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:21.448720 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5c51cd1-dd5d-43c5-ae58-8a8a43f1e2b9 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.792406 Jun 25 21:13:21.449332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2207/4852] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:20 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:21.469019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dd281f-fd81-4085-a04e-dcd8615cde4b", "tag": "1aa34794-0b4f-4f73-b692-3a96cf87dccc"}, {"server_uuid": "9f97e051-110d-4666-bfa8-fea177f41fe2", "name": "network-vif-deleted", "tag": "7ea183c3-f749-4eb9-8da7-cf65b316e82d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:21.479602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:21.480257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:21.511162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] Creating event network-changed:1aa34794-0b4f-4f73-b692-3a96cf87dccc for instance 48dd281f-fd81-4085-a04e-dcd8615cde4b on nch2-master-1 Jun 25 21:13:21.513031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] Creating event network-vif-deleted:7ea183c3-f749-4eb9-8da7-cf65b316e82d for instance 9f97e051-110d-4666-bfa8-fea177f41fe2 on nch1-master-1 Jun 25 21:13:21.534438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0e85b177-8b77-4123-8d1c-a591974cfca8 req-594a3cbb-0456-480e-83a4-d90da2f17e9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.080649 Jun 25 21:13:21.536295 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2208/4853] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:21.703423 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01cbad47-2791-4c19-821a-e44b2639f2b0 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.382147 Jun 25 21:13:21.704033 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2646/4854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:21 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:22.323728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:22.325497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:22.345777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.349599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:22.350482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.351009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:22.372167 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] HTTP exception thrown: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Request method failure captured: Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 HTTP/1.1 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3kP1Lc0xuHyprK3XPfBQJJw_ulfGR4o3u38OP9-qCeQ3VQgXtY5_kAmbetWEI0sWayy5s03c16WsldjWNYscuEUava81WfHEzCYTaqAhxxeI1C4YDXWuQAvDOmVFwtGZ03uaAmCGU9KYq6e_Fe4QO-XxkPyvddXbKAczy6mJxjwOhE Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.32 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}] Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ec129d5641ef457c99014e8f95fcfb5d Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '9f97e051-110d-4666-bfa8-fea177f41fe2'} Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:22.375751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:22.381975 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:22.385301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Returning 404 to user: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:22.391570 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e9bc22ad-8657-4702-9a6d-1753147588d1 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 404 len: 111 microversion: 2.32 time: 0.072186 Jun 25 21:13:22.392894 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2209/4855] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:22 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:13:22.401098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-56f3079c-969f-4975-8e83-be9e182649c0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '.version_select at 0x7f984e7a9af0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:22.437917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-56f3079c-969f-4975-8e83-be9e182649c0 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133061501" status: 204 len: 0 microversion: 2.32 time: 0.040483 Jun 25 21:13:22.439273 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2647/4856] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 21:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1133061501 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 25 21:13:22.468965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:22.470663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:22.478754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.479224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:22.480022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.480483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:22.720984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:22.721940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:22.729534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.730311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:22.731402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:22.732168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:23.010243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1d12d06-47de-4997-9c1b-12d1c9704fbf tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.293141 Jun 25 21:13:23.011326 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2648/4857] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:22 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:23.122599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:23.133484 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e9879ac-e069-4bb3-baa9-0a36c3ab7fac tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.668409 Jun 25 21:13:23.134636 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2210/4858] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:22 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:24.028114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:24.030069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:24.062445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:24.070808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:24.104871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:24.106162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:24.281601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c606ce66-4a24-4a95-9d08-49391051a73e req-5699187c-1706-475f-a0df-6b083c7e912c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e10152d-4846-4783-9ee2-81ed6c52876f", "tag": "a79018d8-8a29-4bf9-987e-19342141734a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:24.293290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c606ce66-4a24-4a95-9d08-49391051a73e req-5699187c-1706-475f-a0df-6b083c7e912c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:24.293906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c606ce66-4a24-4a95-9d08-49391051a73e req-5699187c-1706-475f-a0df-6b083c7e912c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:24.318403 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c606ce66-4a24-4a95-9d08-49391051a73e req-5699187c-1706-475f-a0df-6b083c7e912c service nova] Creating event network-changed:a79018d8-8a29-4bf9-987e-19342141734a for instance 1e10152d-4846-4783-9ee2-81ed6c52876f on nch2-master-1 Jun 25 21:13:24.330666 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c606ce66-4a24-4a95-9d08-49391051a73e req-5699187c-1706-475f-a0df-6b083c7e912c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296799 Jun 25 21:13:24.332326 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2211/4859] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:24.340161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:24.343722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:24.352904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:24.353825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:24.355325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:24.357157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:24.804786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:24.819670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f72f11ad-c74a-4b1e-898d-565031aaf5ef tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.483663 Jun 25 21:13:24.831563 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2212/4860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:24 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:25.067721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-649fa3a5-7daf-48f0-b5d7-f693c19d6e5a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 1.044144 Jun 25 21:13:25.069012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2649/4861] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:24 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:25.837757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:25.838356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:25.845631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:25.846270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:25.847208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:25.847817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:26.024516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:26.037645 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf665a67-01d1-47cf-9a5f-19003fdc827c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.203544 Jun 25 21:13:26.039028 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2213/4862] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:25 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:26.087241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:26.088748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:26.095559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:26.096297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:26.097425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:26.098019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:26.485646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee325707-a3a9-4e44-a7f0-de5e315aa302 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.404743 Jun 25 21:13:26.496147 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2650/4863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:26 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:27.056341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:27.057711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:27.067495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.068240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.069202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.069781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.095594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:27.293597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:27.304818 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6394090e-ce93-4f96-a9d5-f04d2b1fd16d tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.251278 Jun 25 21:13:27.312646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2214/4864] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:27 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:27.504277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:27.505948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:27.509827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:27.513893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=16 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:27.522862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.523728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.525418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.526388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.544629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:27.545743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:27.563700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.564247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.565071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:27.565710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:27.650541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f30dc22d-4f61-4c72-809b-b4c155de1bf8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action" status: 200 len: 24574 microversion: 2.1 time: 0.110323 Jun 25 21:13:27.657883 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2215/4865] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:13:27 2022] POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action => generated 24574 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:13:28.034876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0bb5ec1-3a01-47bf-a177-277ea1eb5463 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.534891 Jun 25 21:13:28.038031 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2651/4866] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:27 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:28.093647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ed4654e8-4730-4f82-8edd-97e9c53c7b48 req-3a6320f1-4af7-47e2-91d6-8cf56f7b413a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd281f-fd81-4085-a04e-dcd8615cde4b", "name": "network-vif-plugged", "status": "completed", "tag": "1aa34794-0b4f-4f73-b692-3a96cf87dccc"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:28.115631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed4654e8-4730-4f82-8edd-97e9c53c7b48 req-3a6320f1-4af7-47e2-91d6-8cf56f7b413a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:28.124638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed4654e8-4730-4f82-8edd-97e9c53c7b48 req-3a6320f1-4af7-47e2-91d6-8cf56f7b413a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:28.147511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ed4654e8-4730-4f82-8edd-97e9c53c7b48 req-3a6320f1-4af7-47e2-91d6-8cf56f7b413a service nova] Creating event network-vif-plugged:1aa34794-0b4f-4f73-b692-3a96cf87dccc for instance 48dd281f-fd81-4085-a04e-dcd8615cde4b on nch2-master-1 Jun 25 21:13:28.154338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ed4654e8-4730-4f82-8edd-97e9c53c7b48 req-3a6320f1-4af7-47e2-91d6-8cf56f7b413a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065676 Jun 25 21:13:28.155860 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2216/4867] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:28.322791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:28.324168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:28.333712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:28.335351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:28.336870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:28.338691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:28.715569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:28.729272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8e0f1b8-e406-4e3f-bb2b-6293a4b6fff3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.410722 Jun 25 21:13:28.741380 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2652/4868] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:28 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:29.053430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:29.054970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:29.069811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:29.082339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:29.083722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:29.083722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:29.084378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:29.748756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:29.750942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:29.777731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:29.780014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:29.783127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:29.785536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:29.797708 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07ae3546-5a98-474f-98e2-eb9c35073bda tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.745178 Jun 25 21:13:29.798532 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2217/4869] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:29 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:30.109309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:30.131189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43835f25-4e29-4e19-b7d1-1e61a18e2cf3 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1361 microversion: 2.1 time: 0.387558 Jun 25 21:13:30.134950 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2653/4870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:29 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1361 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:30.819766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:30.821094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:30.836360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:30.839423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:30.840656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:30.845929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:31.151204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:31.153122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:31.181629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9004f96f-487d-4b7a-b6ca-67e256945bf6 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.367985 Jun 25 21:13:31.186644 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2218/4871] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:30 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:31.187951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:31.188914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:31.191351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:31.191961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:31.467704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:31.484628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c44630e-02a7-4807-9d89-e2b80249e13c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1547 microversion: 2.1 time: 0.338631 Jun 25 21:13:31.486499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2654/4872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:31 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1547 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:31.504447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:31.504955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:31.512248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:31.512798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:31.513568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:31.514014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:31.743678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-36962796-cc8d-4f50-92f8-b3d4e8e2b252 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.243813 Jun 25 21:13:31.744689 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2219/4873] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:13:31 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-interface => generated 285 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:32.202242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:32.203221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:32.217920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.218869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.220010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.222166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.639341 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0afdb3ac-ee8b-4834-add3-a8cdf2b6b708 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.441292 Jun 25 21:13:32.641139 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2655/4874] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:32 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:32.736953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:32.739002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:32.752530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.759487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.760590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.761663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.781933 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] HTTP exception thrown: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Request method failure captured: Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 HTTP/1.1 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3kP1Lc0xuHyprK3XPfBQJJw_ulfGR4o3u38OP9-qCeQ3VQgXtY5_kAmbetWEI0sWayy5s03c16WsldjWNYscuEUava81WfHEzCYTaqAhxxeI1C4YDXWuQAvDOmVFwtGZ03uaAmCGU9KYq6e_Fe4QO-XxkPyvddXbKAczy6mJxjwOhE Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.32 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}] Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: ec129d5641ef457c99014e8f95fcfb5d Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '9f97e051-110d-4666-bfa8-fea177f41fe2'} Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:32.785605 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.791647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.802944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Returning 404 to user: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:32.804881 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a79b41e7-9572-4578-aaec-8cabfbfe1f4e tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 404 len: 111 microversion: 2.32 time: 0.071611 Jun 25 21:13:32.806170 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2220/4875] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:13:32 2022] DELETE /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:13:32.815758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:32.816548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] [instance: 9f97e051-110d-4666-bfa8-fea177f41fe2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:32.826693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.827521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.828022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:32.828573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:32.865772 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] HTTP exception thrown: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Request method failure captured: Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 HTTP/1.1 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3kP1Lc0xuHyprK3XPfBQJJw_ulfGR4o3u38OP9-qCeQ3VQgXtY5_kAmbetWEI0sWayy5s03c16WsldjWNYscuEUava81WfHEzCYTaqAhxxeI1C4YDXWuQAvDOmVFwtGZ03uaAmCGU9KYq6e_Fe4QO-XxkPyvddXbKAczy6mJxjwOhE Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.32 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e97b91d23b24e7aba5860e7d0bd062c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e97b91d23b24e7aba5860e7d0bd062c"}]}] Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4e97b91d23b24e7aba5860e7d0bd062c Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TaggedBootDevicesTest-57416562 Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: ec129d5641ef457c99014e8f95fcfb5d Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TaggedBootDevicesTest-57416562-project Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '9f97e051-110d-4666-bfa8-fea177f41fe2'} Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:32.867728 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. Jun 25 21:13:32.872553 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:32.873867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] Returning 404 to user: Instance 9f97e051-110d-4666-bfa8-fea177f41fe2 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:32.874936 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b0389987-8120-4c32-a173-18f2acbad9b2 tempest-TaggedBootDevicesTest-57416562 tempest-TaggedBootDevicesTest-57416562-project] 10.222.0.39 "GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2" status: 404 len: 111 microversion: 2.32 time: 0.064544 Jun 25 21:13:32.876690 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2656/4876] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:13:32 2022] GET /compute/v2.1/servers/9f97e051-110d-4666-bfa8-fea177f41fe2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:13:33.657487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:33.658410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:33.670742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:33.671330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:33.678541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b209551f-acb9-4cb6-8ebd-43b7a73a1094 req-cbca2bf5-6164-45bb-8bb7-880c2299172d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10152d-4846-4783-9ee2-81ed6c52876f", "name": "network-vif-plugged", "status": "completed", "tag": "a79018d8-8a29-4bf9-987e-19342141734a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:33.685795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:33.689123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:33.705475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b209551f-acb9-4cb6-8ebd-43b7a73a1094 req-cbca2bf5-6164-45bb-8bb7-880c2299172d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:33.710215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b209551f-acb9-4cb6-8ebd-43b7a73a1094 req-cbca2bf5-6164-45bb-8bb7-880c2299172d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:33.751996 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b209551f-acb9-4cb6-8ebd-43b7a73a1094 req-cbca2bf5-6164-45bb-8bb7-880c2299172d service nova] Creating event network-vif-plugged:a79018d8-8a29-4bf9-987e-19342141734a for instance 1e10152d-4846-4783-9ee2-81ed6c52876f on nch2-master-1 Jun 25 21:13:33.766187 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b209551f-acb9-4cb6-8ebd-43b7a73a1094 req-cbca2bf5-6164-45bb-8bb7-880c2299172d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091264 Jun 25 21:13:33.772417 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2657/4877] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:13:34.330523 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a86c68ea-6e34-4558-aa53-f4845c27223a tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.677217 Jun 25 21:13:34.333972 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2221/4878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:33 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:35.329428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9b59d7a4-a70f-455d-af92-698cab7d4ba8 req-23cf2597-2757-45ad-ba1b-a533b2700e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48dd281f-fd81-4085-a04e-dcd8615cde4b", "tag": "1aa34794-0b4f-4f73-b692-3a96cf87dccc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:35.341271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:35.343798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9b59d7a4-a70f-455d-af92-698cab7d4ba8 req-23cf2597-2757-45ad-ba1b-a533b2700e15 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:35.344247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9b59d7a4-a70f-455d-af92-698cab7d4ba8 req-23cf2597-2757-45ad-ba1b-a533b2700e15 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:35.354838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:35.356563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:35.365969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:35.366969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:35.369372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:35.370655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:35.372166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9b59d7a4-a70f-455d-af92-698cab7d4ba8 req-23cf2597-2757-45ad-ba1b-a533b2700e15 service nova] Creating event network-changed:1aa34794-0b4f-4f73-b692-3a96cf87dccc for instance 48dd281f-fd81-4085-a04e-dcd8615cde4b on nch2-master-1 Jun 25 21:13:35.389675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9b59d7a4-a70f-455d-af92-698cab7d4ba8 req-23cf2597-2757-45ad-ba1b-a533b2700e15 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061991 Jun 25 21:13:35.390644 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2658/4879] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:36.009952 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1efe9c6b-ac83-421a-9735-120e3cff3cfa tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1464 microversion: 2.1 time: 0.662392 Jun 25 21:13:36.019523 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2222/4880] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:35 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1464 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:37.030359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:37.031697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:37.049131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:37.051074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:37.053097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:37.053566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:37.430522 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-03347671-dbd6-4549-a028-611cb3d8d3c4 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1649 microversion: 2.1 time: 0.404576 Jun 25 21:13:37.439428 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2659/4881] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:37 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1649 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:37.454655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:37.455465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:37.491320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:37.491910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:37.492791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:37.493271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:38.293830 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-129405a5-4d60-466e-9c6a-ec8d996c61d2 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1649 microversion: 2.1 time: 0.844247 Jun 25 21:13:38.294392 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2223/4882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:37 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1649 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:38.310110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:38.310740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:38.322624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:38.329553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:38.330544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:38.331012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:39.131183 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-277d19e0-74a3-4cb7-95cf-b7ddea1e474c tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1649 microversion: 2.1 time: 0.822824 Jun 25 21:13:39.139528 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2660/4883] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:38 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1649 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:39.152596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:39.153832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:39.178190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:39.182162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:39.183352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:39.185771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:39.271644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:13:39.447069 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c6d4ffe-8adc-4e2d-875f-cca068fda9cb tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 204 len: 0 microversion: 2.1 time: 0.288554 Jun 25 21:13:39.449272 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2224/4884] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:13:39 2022] DELETE /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:39.458301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:39.461359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:39.473794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:39.474561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:39.476286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:39.477052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:40.187113 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3664fe5-8607-4c99-a61a-5d323c270dd8 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1655 microversion: 2.1 time: 0.732980 Jun 25 21:13:40.187952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2661/4885] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:39 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1655 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:41.207127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:41.208685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:41.227818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:41.228460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:41.229412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:41.233275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:41.746228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45574e55-25d1-40b2-80c8-667f9e4dc0c9 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1655 microversion: 2.1 time: 0.545063 Jun 25 21:13:41.759301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2225/4886] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:41 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1655 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:41.886373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: .version_select at 0x7f984edc5e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1210556744", "policies": ["affinity"]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:41.918040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:41.930795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:41.996563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.005661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.021305 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7edb5fa8-6a54-41a6-bce7-3ce0008f6748 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.421501 Jun 25 21:13:42.023728 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2662/4887] 10.222.0.39 () {60 vars in 1173 bytes} [Sat Jun 25 21:13:41 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.033450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: .version_select at 0x7f984f4b2f70>, body: {"server_group": {"name": "tempest-server-group-798354168", "policies": ["affinity"]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:42.052390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.060910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.147322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.153919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.176049 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5777a607-9d83-4dde-ae93-c7dc442bd957 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.146946 Jun 25 21:13:42.177567 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2226/4888] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 21:13:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.188160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: .version_select at 0x7f984f62f550>, body: {"server_group": {"name": "tempest-server-group-798354168", "policies": ["affinity"]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:42.234297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.246775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.286715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-daae762b-2652-4c85-9488-7c15c70f1ee3 req-033b0bcd-8e94-4860-8849-3ab16cc289a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e10152d-4846-4783-9ee2-81ed6c52876f", "name": "network-vif-deleted", "tag": "a79018d8-8a29-4bf9-987e-19342141734a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:42.301166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daae762b-2652-4c85-9488-7c15c70f1ee3 req-033b0bcd-8e94-4860-8849-3ab16cc289a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:42.304679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-daae762b-2652-4c85-9488-7c15c70f1ee3 req-033b0bcd-8e94-4860-8849-3ab16cc289a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:42.344470 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-daae762b-2652-4c85-9488-7c15c70f1ee3 req-033b0bcd-8e94-4860-8849-3ab16cc289a1 service nova] Creating event network-vif-deleted:a79018d8-8a29-4bf9-987e-19342141734a for instance 1e10152d-4846-4783-9ee2-81ed6c52876f on nch2-master-1 Jun 25 21:13:42.357282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.357764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-daae762b-2652-4c85-9488-7c15c70f1ee3 req-033b0bcd-8e94-4860-8849-3ab16cc289a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077219 Jun 25 21:13:42.360374 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2227/4889] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:13:42.369158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.406315 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-891e8649-80d3-43cc-8a72-e4cf429e4f14 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.223021 Jun 25 21:13:42.412081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2663/4890] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 21:13:42 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.423710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb8adde2-407b-4ea9-a095-a17f204b1e2f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.457251 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb8adde2-407b-4ea9-a095-a17f204b1e2f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/72ea058f-3344-46da-86fc-8319c42c8995" status: 204 len: 0 microversion: 2.1 time: 0.038634 Jun 25 21:13:42.462295 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2228/4891] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:13:42 2022] DELETE /compute/v2.1/os-server-groups/72ea058f-3344-46da-86fc-8319c42c8995 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:42.468313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd71b747-6769-461e-a8fc-3a3d4ecd5aca tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.493515 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd71b747-6769-461e-a8fc-3a3d4ecd5aca tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.030155 Jun 25 21:13:42.494663 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2664/4892] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:13:42 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.504929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ec89c12-1659-4b81-bb7d-bcdaf919d975 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.544059 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ec89c12-1659-4b81-bb7d-bcdaf919d975 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/87e21479-a3b2-44ca-82bc-bd331dce1a20" status: 204 len: 0 microversion: 2.1 time: 0.043139 Jun 25 21:13:42.545762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2229/4893] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:13:42 2022] DELETE /compute/v2.1/os-server-groups/87e21479-a3b2-44ca-82bc-bd331dce1a20 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:42.554931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d810458b-e06e-4115-bfa4-bd493bd46701 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.573613 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d810458b-e06e-4115-bfa4-bd493bd46701 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.023334 Jun 25 21:13:42.574484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2665/4894] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:13:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.587302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: .version_select at 0x7f984f75e160>, body: {"server_group": {"name": "tempest-server-group-1416357281", "policies": ["affinity"]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:42.619510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.626952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.688592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:42.704143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:42.750889 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94d5952c-3d8c-4f15-9992-e51d648d5ffa tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.167822 Jun 25 21:13:42.751526 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2230/4895] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 21:13:42 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.765175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.770680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-25623b22-8045-4123-8f6d-e996544ca675 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.779562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:42.824634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:42.826993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:42.836951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:42.836951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:42.870995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-25623b22-8045-4123-8f6d-e996544ca675 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3" status: 204 len: 0 microversion: 2.1 time: 0.111005 Jun 25 21:13:42.878366 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2666/4896] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:13:42 2022] DELETE /compute/v2.1/os-server-groups/1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:42.888794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-186e8f6d-3c98-4d39-a2b9-557141708f91 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:42.919329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-186e8f6d-3c98-4d39-a2b9-557141708f91 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035028 Jun 25 21:13:42.920400 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2667/4897] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:13:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:42.926651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:42.926651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:42.926651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lazy-loading 'fault' on Instance uuid 1e10152d-4846-4783-9ee2-81ed6c52876f {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:13:42.938919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: .version_select at 0x7f984e7a9e50>, body: {"server_group": {"name": "tempest-server-group-2103595372", "policies": ["anti-affinity"]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:43.022805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:43.054923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:43.179339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:43.192024 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2dc01b72-0745-44d7-960c-da1bbef5af23 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 200 len: 1454 microversion: 2.1 time: 0.431542 Jun 25 21:13:43.193202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:43.198518 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2231/4898] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:42 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 1454 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:43.210056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:43.245381 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7fc9bb18-77ac-4b73-931c-261dbe3cfa41 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.307822 Jun 25 21:13:43.246920 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2668/4899] 10.222.0.39 () {60 vars in 1172 bytes} [Sat Jun 25 21:13:42 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:43.257822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-034c36b2-87b2-4a25-a95a-7932106d83c8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:43.260817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:43.316631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-034c36b2-87b2-4a25-a95a-7932106d83c8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/5794ef01-11e0-4d3b-ac7c-369a45388d7f" status: 204 len: 0 microversion: 2.1 time: 0.063179 Jun 25 21:13:43.326049 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2232/4900] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:13:43 2022] DELETE /compute/v2.1/os-server-groups/5794ef01-11e0-4d3b-ac7c-369a45388d7f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:13:43.328977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a2a86e3-823c-4d2e-8e27-a95d0d85cd89 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:43.340157 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a2a86e3-823c-4d2e-8e27-a95d0d85cd89 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016821 Jun 25 21:13:43.361522 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2669/4901] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:13:43 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:43.406026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1952130008", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "80278e26-b161-4512-aaee-2d53dec3291b"}]}, "os:scheduler_hints": {"group": "3facf06d-a7b2-447a-a5cb-7ed9d6f3851a"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:43.485190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] validate_networks() for [('80278e26-b161-4512-aaee-2d53dec3291b', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:13:44.218729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:44.219494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1e10152d-4846-4783-9ee2-81ed6c52876f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:44.227503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.228032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.228911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.229415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.244935 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] HTTP exception thrown: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Request method failure captured: Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f HTTP/1.1 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3pT5SDxpK22RYwXP88EDqJ6hU9dm0ySMWXhKrKv8pj-7qSRUSft-h8eGcIqhp4EBICYHEw9c33EQ7xcJghiY9yvcNL6oaVP1PIWEOq3SkN3awwfGcBE8I2EnVVgSv4LIF4Xwxpxqs5H2AZGCo12uoFGq_ORwYea7Yay1-2hLjj2Ggc Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 113e8385615d430ca60af9afcc5a3e5b Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestServerMultinode-670050998 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/113e8385615d430ca60af9afcc5a3e5b"}]}] Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestServerMultinode-670050998 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 113e8385615d430ca60af9afcc5a3e5b Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestServerMultinode-670050998 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestServerMultinode-670050998-project-admin Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6e277a300e4e4947b2e08d668daa9ed3 Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestServerMultinode-670050998-project-admin Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1e10152d-4846-4783-9ee2-81ed6c52876f'} Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:44.247252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. Jun 25 21:13:44.253783 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:13:44.255936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Returning 404 to user: Instance 1e10152d-4846-4783-9ee2-81ed6c52876f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:44.261505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40078e73-c966-4ae8-970f-cfefc5d88dfc tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f" status: 404 len: 111 microversion: 2.1 time: 0.047037 Jun 25 21:13:44.262243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2670/4902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:44 2022] GET /compute/v2.1/servers/1e10152d-4846-4783-9ee2-81ed6c52876f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:13:44.282619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:44.283335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:44.292339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.293021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.294016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.295100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.370577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:13:44.492913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7318e84-7587-4cc9-9d8b-4ca32abaf015 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "DELETE /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 204 len: 0 microversion: 2.1 time: 0.218872 Jun 25 21:13:44.494072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2671/4903] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:13:44 2022] DELETE /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:44.511957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:44.513397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:44.520614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.521569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.522662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.523369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.555489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:44.577837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:13:44.579002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:13:44.579505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:13:44.579925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:13:44.580788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:13:44.614042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.614919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.616369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:44.617018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:44.653271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:44.660333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:44.679546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:13:44.684831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:13:44.760092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:44.771552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:44.872441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:13:44.879315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Getting quotas for user e18c0e3b16574a9d923a1159f08bbbd4 and project 4e4c7c00da2a44ada00ef3be3ffafb30. Resources: {'server_group_members'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:13:44.910298 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-81a47c88-b5c3-48a7-b7cc-2fabb20c77de tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508535 Jun 25 21:13:44.917558 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2233/4904] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:13:44.923785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a769829-21f8-44a0-ac48-3a205bb28058 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:44.925021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9a769829-21f8-44a0-ac48-3a205bb28058 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:45.010539 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b7b1690-f357-427c-8058-b8352354fa61 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1653 microversion: 2.1 time: 0.506671 Jun 25 21:13:45.014342 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2672/4905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:44 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1653 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:45.165863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9a769829-21f8-44a0-ac48-3a205bb28058 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:45.185521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a769829-21f8-44a0-ac48-3a205bb28058 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1213 microversion: 2.1 time: 0.266842 Jun 25 21:13:45.189014 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2234/4906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:44 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1213 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:46.031598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:46.032212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:46.057324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:46.058040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:46.059005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:46.062545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:46.207678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:46.208919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:46.230782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:46.231354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:46.237236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:46.237902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:46.379321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:46.388633 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6452cf7-ded7-4cba-8692-146e78b137d8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1209 microversion: 2.1 time: 0.184150 Jun 25 21:13:46.389767 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2235/4907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:46 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1209 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:46.519493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dc594d54-f171-4b31-91e2-417763589020 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1653 microversion: 2.1 time: 0.491925 Jun 25 21:13:46.523070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2673/4908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:46 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1653 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:47.349826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3ca102a5-3a7a-42ac-b366-44178dc9ad59 req-510c9757-f5cd-4703-9d90-3f2bd5f70bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1663ba2d-bd8d-4eec-94df-bf348f58996a", "name": "network-vif-deleted", "tag": "96612d03-1443-42f6-bf4b-1dcf50b8ada8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:47.377909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3ca102a5-3a7a-42ac-b366-44178dc9ad59 req-510c9757-f5cd-4703-9d90-3f2bd5f70bc4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.380907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3ca102a5-3a7a-42ac-b366-44178dc9ad59 req-510c9757-f5cd-4703-9d90-3f2bd5f70bc4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.414374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:47.415911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:47.423871 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3ca102a5-3a7a-42ac-b366-44178dc9ad59 req-510c9757-f5cd-4703-9d90-3f2bd5f70bc4 service nova] Creating event network-vif-deleted:96612d03-1443-42f6-bf4b-1dcf50b8ada8 for instance 1663ba2d-bd8d-4eec-94df-bf348f58996a on nch1-master-1 Jun 25 21:13:47.432206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.434057 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3ca102a5-3a7a-42ac-b366-44178dc9ad59 req-510c9757-f5cd-4703-9d90-3f2bd5f70bc4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092972 Jun 25 21:13:47.438633 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2236/4909] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:47.447782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.448707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.449150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.541353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:47.544887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:47.572129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.572639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.573436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.573870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.666172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:47.666622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:47.667086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lazy-loading 'fault' on Instance uuid 1663ba2d-bd8d-4eec-94df-bf348f58996a {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:13:47.709048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:47.719510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-247d02ed-4e82-4556-bfba-1bd465d6fbd5 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1271 microversion: 2.1 time: 0.316454 Jun 25 21:13:47.721041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2674/4910] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:47 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:13:47.824731 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-434d08ed-336e-4072-a923-b1477f39939b tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 200 len: 1453 microversion: 2.1 time: 0.288654 Jun 25 21:13:47.831293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2237/4911] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:47 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 1453 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:48.737846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:48.738465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:48.750121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:48.750772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:48.751753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:48.752344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:48.845630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:48.848155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] [instance: 1663ba2d-bd8d-4eec-94df-bf348f58996a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:48.857827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:48.858639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:48.860246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:48.861152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:48.881350 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] HTTP exception thrown: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Request method failure captured: Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a HTTP/1.1 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3pT5SDxpK22RYwXP88EDqJ6hU9dm0ySMWXhKrKv8pj-7qSRUSft-h8eGcIqhp4EBICYHEw9c33EQ7xcJghiY9yvcNL6oaVP1PIWEOq3SkN3awwfGcBE8I2EnVVgSv4LIF4Xwxpxqs5H2AZGCo12uoFGq_ORwYea7Yay1-2hLjj2Ggc Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 113e8385615d430ca60af9afcc5a3e5b Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestServerMultinode-670050998 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_113e8385615d430ca60af9afcc5a3e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/113e8385615d430ca60af9afcc5a3e5b"}]}] Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestServerMultinode-670050998 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 113e8385615d430ca60af9afcc5a3e5b Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestServerMultinode-670050998 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestServerMultinode-670050998-project-admin Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6e277a300e4e4947b2e08d668daa9ed3 Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestServerMultinode-670050998-project-admin Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1663ba2d-bd8d-4eec-94df-bf348f58996a'} Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:13:48.883355 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] Returning 404 to user: Instance 1663ba2d-bd8d-4eec-94df-bf348f58996a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e022b6a9-8ed2-44f1-9014-cdada3b301c7 tempest-TestServerMultinode-670050998 tempest-TestServerMultinode-670050998-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a" status: 404 len: 111 microversion: 2.1 time: 0.046052 Jun 25 21:13:48.887732 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2238/4912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:48 2022] GET /compute/v2.1/servers/1663ba2d-bd8d-4eec-94df-bf348f58996a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:13:49.094632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:49.104604 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ef005db0-99d3-4222-8845-c7f66a9f068b tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.370736 Jun 25 21:13:49.105793 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2675/4913] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:48 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:50.063675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e8698186-670c-4a2f-ac43-7a1dcb01d502 req-c9d30638-1ca7-4644-a9e9-06d55060c367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91627d5e-95d1-4c80-a66d-291ac10ae90a", "tag": "973c4db5-a0ce-4478-9c3e-c8e6c0d08731"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:50.075304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e8698186-670c-4a2f-ac43-7a1dcb01d502 req-c9d30638-1ca7-4644-a9e9-06d55060c367 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:50.076384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e8698186-670c-4a2f-ac43-7a1dcb01d502 req-c9d30638-1ca7-4644-a9e9-06d55060c367 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:50.098117 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e8698186-670c-4a2f-ac43-7a1dcb01d502 req-c9d30638-1ca7-4644-a9e9-06d55060c367 service nova] Creating event network-changed:973c4db5-a0ce-4478-9c3e-c8e6c0d08731 for instance 91627d5e-95d1-4c80-a66d-291ac10ae90a on nch1-master-1 Jun 25 21:13:50.103408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e8698186-670c-4a2f-ac43-7a1dcb01d502 req-c9d30638-1ca7-4644-a9e9-06d55060c367 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043450 Jun 25 21:13:50.107526 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2239/4914] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:50.122062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:50.122684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:50.139730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:50.145043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:50.146534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:50.147891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:50.503674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:50.519547 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1fedc884-d722-4b71-8fe9-19c4678215f1 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.401254 Jun 25 21:13:50.520775 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2676/4915] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:50 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:51.538366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:51.539094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:51.557286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:51.558247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:51.560129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:51.562084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:51.609029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:51.975099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:51.984185 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4059d5cb-74f7-4ff6-ae43-9ca74726f08f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.451094 Jun 25 21:13:51.985052 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2240/4916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:51 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:53.001355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:53.001982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:53.008934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:53.009385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:53.010383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:53.010607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:53.230065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=24 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:53.756816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:53.773169 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e05f8f7-9273-4163-b1bd-0bb34c543561 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.775812 Jun 25 21:13:53.774268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2677/4917] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:52 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:54.793901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:54.794664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:54.798526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:54.848952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:54.850376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:54.851366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:54.851849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:55.114657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:55.130055 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae8d0e05-35bd-47a1-9e44-e7857c122c4f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.342708 Jun 25 21:13:55.130786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2241/4918] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:54 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:56.005012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0fc12876-8664-459e-bf4a-e5efbbd9718d req-d1f5c8b5-25f8-4fd3-8426-69c70e10794a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91627d5e-95d1-4c80-a66d-291ac10ae90a", "name": "network-vif-plugged", "status": "completed", "tag": "973c4db5-a0ce-4478-9c3e-c8e6c0d08731"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:56.024486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0fc12876-8664-459e-bf4a-e5efbbd9718d req-d1f5c8b5-25f8-4fd3-8426-69c70e10794a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:56.026585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0fc12876-8664-459e-bf4a-e5efbbd9718d req-d1f5c8b5-25f8-4fd3-8426-69c70e10794a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:56.044195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0fc12876-8664-459e-bf4a-e5efbbd9718d req-d1f5c8b5-25f8-4fd3-8426-69c70e10794a service nova] Creating event network-vif-plugged:973c4db5-a0ce-4478-9c3e-c8e6c0d08731 for instance 91627d5e-95d1-4c80-a66d-291ac10ae90a on nch1-master-1 Jun 25 21:13:56.051028 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0fc12876-8664-459e-bf4a-e5efbbd9718d req-d1f5c8b5-25f8-4fd3-8426-69c70e10794a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052084 Jun 25 21:13:56.052307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2678/4919] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:56.149860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:56.150540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:56.153792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:13:56.159187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:56.160109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:56.160412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:56.160887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:56.362107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:56.372727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ce49b04-8d61-4bdf-a3c5-4724235c3e3e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1313 microversion: 2.1 time: 0.229326 Jun 25 21:13:56.374781 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2242/4920] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:56 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:57.394566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:57.396142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:57.422009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:57.424167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:57.427719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:57.428921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:57.857164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:57.873680 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d5798f2-3b77-44ec-a1ba-341fb386f01d tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1498 microversion: 2.1 time: 0.485722 Jun 25 21:13:57.874771 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2679/4921] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:57 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1498 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:57.890905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d08286f3-24af-4283-bda0-db6e948a52d4 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:57.914523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_groups [None req-d08286f3-24af-4283-bda0-db6e948a52d4 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Querying cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) for 1 instances {{(pid=137462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 25 21:13:57.916214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d08286f3-24af-4283-bda0-db6e948a52d4 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:57.917157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d08286f3-24af-4283-bda0-db6e948a52d4 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:57.940303 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d08286f3-24af-4283-bda0-db6e948a52d4 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a" status: 200 len: 222 microversion: 2.1 time: 0.053791 Jun 25 21:13:57.941727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2243/4922] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:13:57 2022] GET /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:13:57.961136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:57.962886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:57.981236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:57.982178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:57.983313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:57.984082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.033544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:58.034192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:58.064168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.064790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.065635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.066075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.083207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:13:58.237388 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5498ebbe-fb30-4777-830a-89b2d4feb10f tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 204 len: 0 microversion: 2.1 time: 0.288544 Jun 25 21:13:58.238783 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2680/4923] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:13:57 2022] DELETE /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:13:58.257113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:58.261126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:58.270131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.271275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.272898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.273535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.535085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:58.570618 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9e64a3e-ef95-4af0-b317-b35edc2cdac9 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1504 microversion: 2.1 time: 0.325772 Jun 25 21:13:58.573123 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2681/4924] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:58 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1504 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:58.679876 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-deec654b-bf55-4b51-a181-eff6b8b75e8d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1833 microversion: 2.1 time: 0.662153 Jun 25 21:13:58.697110 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2244/4925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:58 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1833 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:58.700471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:58.701812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:58.710033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.711077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:58.712552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:58.715837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.291030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:13:59.299705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fd9df0e-f34b-458a-a141-f26f125bbbf1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1682 microversion: 2.1 time: 0.604908 Jun 25 21:13:59.313216 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2682/4926] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:58 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1682 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:13:59.476001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:59.477772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:59.508099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.508523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.509350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.509813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.590164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:13:59.591429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:59.595033 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6523f40f-1b62-46a1-a3b4-d83d84669d43 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action" status: 200 len: 32645 microversion: 2.1 time: 0.123893 Jun 25 21:13:59.595990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2245/4927] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:13:59 2022] POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action => generated 32645 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:13:59.600543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.601661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.602685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.605182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.831551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:13:59.832584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:13:59.850096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.850805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:13:59.853680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:13:59.857058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:00.060650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:00.073635 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5d270bc-bfb4-4c4b-a2ad-0fe85a4b5f29 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1504 microversion: 2.1 time: 0.486796 Jun 25 21:14:00.089879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2683/4928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:13:59 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1504 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:00.183711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cbb3982e7c3445209fea090c37590c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60c9d2e9f84e6f98b1681f72b9e35f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:00.184883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] flavor_id is None. Assuming migration. {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 25 21:14:00.185524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:14:00.700028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4addf1ba-01ea-49c3-9031-af0de3240423 req-53da00d5-426a-42cf-8738-91d9d8e1f398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91627d5e-95d1-4c80-a66d-291ac10ae90a", "name": "network-vif-deleted", "tag": "973c4db5-a0ce-4478-9c3e-c8e6c0d08731"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:00.721249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4addf1ba-01ea-49c3-9031-af0de3240423 req-53da00d5-426a-42cf-8738-91d9d8e1f398 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:00.721957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4addf1ba-01ea-49c3-9031-af0de3240423 req-53da00d5-426a-42cf-8738-91d9d8e1f398 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:00.741496 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4addf1ba-01ea-49c3-9031-af0de3240423 req-53da00d5-426a-42cf-8738-91d9d8e1f398 service nova] Creating event network-vif-deleted:973c4db5-a0ce-4478-9c3e-c8e6c0d08731 for instance 91627d5e-95d1-4c80-a66d-291ac10ae90a on nch1-master-1 Jun 25 21:14:00.784070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4addf1ba-01ea-49c3-9031-af0de3240423 req-53da00d5-426a-42cf-8738-91d9d8e1f398 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091935 Jun 25 21:14:00.788580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2684/4929] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:14:00.901175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-534f9c6a-fded-4d54-ac1a-78c0cb24d8ef tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action" status: 202 len: 0 microversion: 2.1 time: 1.075592 Jun 25 21:14:00.913855 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2246/4930] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:13:59 2022] POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action => generated 0 bytes in 1089 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:14:00.923691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:00.924851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:00.948319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:00.955477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:00.957576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:00.959989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:01.092615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:01.093295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:01.113791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:01.118620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:01.121251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:01.140460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:01.264282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:01.266891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:01.268892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lazy-loading 'fault' on Instance uuid 91627d5e-95d1-4c80-a66d-291ac10ae90a {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:14:01.314467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:01.327892 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a86bb62a-b4f2-462d-ae45-b6e991e630d5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1691 microversion: 2.1 time: 0.409269 Jun 25 21:14:01.331003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2685/4931] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:00 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1691 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:01.395812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e18c0e3b16574a9d923a1159f08bbbd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e4c7c00da2a44ada00ef3be3ffafb30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:01.411039 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6ac3a01a-bb78-4852-b2f2-a0cb5a559f44 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 200 len: 1303 microversion: 2.1 time: 0.323198 Jun 25 21:14:01.424501 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2247/4932] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:01 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 1303 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:02.347419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.348618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:02.363285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.363922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.365984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.367141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.435221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.435843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:02.448147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.448631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.449460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.449894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.490493 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a HTTP/1.1 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '91627d5e-95d1-4c80-a66d-291ac10ae90a'} Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.492171 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.497040 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.502564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:02.506301 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9ef6825-3177-42cc-8345-f53e8a918af8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 404 len: 111 microversion: 2.1 time: 0.074762 Jun 25 21:14:02.508536 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2248/4933] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:02 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:02.523868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e1b79af-ea6b-49fb-beb7-25b5fad0c708 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.561650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_groups [None req-5e1b79af-ea6b-49fb-beb7-25b5fad0c708 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Querying cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) for 1 instances {{(pid=137462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 25 21:14:02.562930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e1b79af-ea6b-49fb-beb7-25b5fad0c708 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.563686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e1b79af-ea6b-49fb-beb7-25b5fad0c708 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.577197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e1b79af-ea6b-49fb-beb7-25b5fad0c708 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.061765 Jun 25 21:14:02.578409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2249/4934] 10.222.0.39 () {58 vars in 1151 bytes} [Sat Jun 25 21:14:02 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:02.591590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd7bf97e-c711-458b-b731-6f263a860d33 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.617872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_groups [None req-fd7bf97e-c711-458b-b731-6f263a860d33 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Querying cell db7644c9-31fa-4cfc-be56-1224ee9c28fa(cell1) for 1 instances {{(pid=137462) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jun 25 21:14:02.618755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7bf97e-c711-458b-b731-6f263a860d33 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.625959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7bf97e-c711-458b-b731-6f263a860d33 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.636604 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd7bf97e-c711-458b-b731-6f263a860d33 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a" status: 200 len: 184 microversion: 2.1 time: 0.050154 Jun 25 21:14:02.639002 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2250/4935] 10.222.0.39 () {58 vars in 1262 bytes} [Sat Jun 25 21:14:02 2022] GET /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a => generated 184 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:02.658009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.660674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:02.676466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.677929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.681675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.682241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.716663 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a HTTP/1.1 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '91627d5e-95d1-4c80-a66d-291ac10ae90a'} Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:02.720353 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.725981 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.728055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:02.729759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c291ab81-1c00-4b3e-a208-588d60e1de7a tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 404 len: 111 microversion: 2.1 time: 0.082356 Jun 25 21:14:02.730676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2251/4936] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:14:02 2022] DELETE /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:14:02.767820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.775132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] [instance: 91627d5e-95d1-4c80-a66d-291ac10ae90a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:02.786781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:02.800466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.802219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.807931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:02.808623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:02.852850 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a HTTP/1.1 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '91627d5e-95d1-4c80-a66d-291ac10ae90a'} Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.856115 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance 91627d5e-95d1-4c80-a66d-291ac10ae90a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:02.864881 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e34e2859-7797-4492-825a-79418eebb535 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a" status: 404 len: 111 microversion: 2.1 time: 0.096404 Jun 25 21:14:02.866508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2252/4937] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:02 2022] GET /compute/v2.1/servers/91627d5e-95d1-4c80-a66d-291ac10ae90a => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:02.883838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5aca7962-8e2c-460d-8235-0d661c50baf8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.906523 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-5aca7962-8e2c-460d-8235-0d661c50baf8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5aca7962-8e2c-460d-8235-0d661c50baf8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-server-groups/5794ef01-11e0-4d3b-ac7c-369a45388d7f HTTP/1.1 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '5794ef01-11e0-4d3b-ac7c-369a45388d7f'} Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.921693 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. Jun 25 21:14:02.928018 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.933579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5aca7962-8e2c-460d-8235-0d661c50baf8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance group 5794ef01-11e0-4d3b-ac7c-369a45388d7f could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:02.936759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5aca7962-8e2c-460d-8235-0d661c50baf8 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/5794ef01-11e0-4d3b-ac7c-369a45388d7f" status: 404 len: 117 microversion: 2.1 time: 0.068835 Jun 25 21:14:02.943132 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2253/4938] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:14:02 2022] DELETE /compute/v2.1/os-server-groups/5794ef01-11e0-4d3b-ac7c-369a45388d7f => generated 117 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:02.951535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b93e7bd-4b6a-4acd-96dc-0a83d693b59e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.966210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6b93e7bd-4b6a-4acd-96dc-0a83d693b59e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b93e7bd-4b6a-4acd-96dc-0a83d693b59e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-server-groups/1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 HTTP/1.1 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3'} Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.967932 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. Jun 25 21:14:02.972590 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.974544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b93e7bd-4b6a-4acd-96dc-0a83d693b59e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance group 1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:02.974544 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b93e7bd-4b6a-4acd-96dc-0a83d693b59e tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3" status: 404 len: 117 microversion: 2.1 time: 0.028314 Jun 25 21:14:02.978359 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2254/4939] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:14:02 2022] DELETE /compute/v2.1/os-server-groups/1c0e6ea2-cc86-46d0-83a5-792cb6fad0b3 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:02.984107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecd96a5-bd67-40ce-a1c4-25a9fbd08922 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:02.991438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7ecd96a5-bd67-40ce-a1c4-25a9fbd08922 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecd96a5-bd67-40ce-a1c4-25a9fbd08922 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-server-groups/87e21479-a3b2-44ca-82bc-bd331dce1a20 HTTP/1.1 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '87e21479-a3b2-44ca-82bc-bd331dce1a20'} Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:02.994515 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. Jun 25 21:14:02.998908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.010297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ecd96a5-bd67-40ce-a1c4-25a9fbd08922 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance group 87e21479-a3b2-44ca-82bc-bd331dce1a20 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:03.019919 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ecd96a5-bd67-40ce-a1c4-25a9fbd08922 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/87e21479-a3b2-44ca-82bc-bd331dce1a20" status: 404 len: 117 microversion: 2.1 time: 0.040376 Jun 25 21:14:03.025134 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2255/4940] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:14:02 2022] DELETE /compute/v2.1/os-server-groups/87e21479-a3b2-44ca-82bc-bd331dce1a20 => generated 117 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:03.034524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a65547a-78d4-401a-90d2-78eb50299d02 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:03.045466 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6a65547a-78d4-401a-90d2-78eb50299d02 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] HTTP exception thrown: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a65547a-78d4-401a-90d2-78eb50299d02 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Request method failure captured: Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/os-server-groups/72ea058f-3344-46da-86fc-8319c42c8995 HTTP/1.1 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3qF-xjHBeXMoXaJob43b2t6haWgNkxiQRLFGBUU8GgDfJwVDoiVRrlbsO1IZt2oCdA-fKF2ap32ntL21GziT4z1phqM7bbuGV5C5ys3Z5fYuT7SYCt00mzbz9NPnMI13FYhP_XvycRr6VWzfJgFsi1Kxy1Kh68eamyTSZy2o5E8y_g Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4e4c7c00da2a44ada00ef3be3ffafb30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4e4c7c00da2a44ada00ef3be3ffafb30"}]}] Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 4e4c7c00da2a44ada00ef3be3ffafb30 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerGroupTestJSON-1111653679 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e18c0e3b16574a9d923a1159f08bbbd4 Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerGroupTestJSON-1111653679-project Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '72ea058f-3344-46da-86fc-8319c42c8995'} Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.047962 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. Jun 25 21:14:03.053419 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:03.059005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:03.066042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a65547a-78d4-401a-90d2-78eb50299d02 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Returning 404 to user: Instance group 72ea058f-3344-46da-86fc-8319c42c8995 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:03.067605 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a65547a-78d4-401a-90d2-78eb50299d02 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/72ea058f-3344-46da-86fc-8319c42c8995" status: 404 len: 117 microversion: 2.1 time: 0.040055 Jun 25 21:14:03.068346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2256/4941] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:14:03 2022] DELETE /compute/v2.1/os-server-groups/72ea058f-3344-46da-86fc-8319c42c8995 => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:03.085472 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bd39f29-4f13-4814-8f94-793fb0daa4bd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1691 microversion: 2.1 time: 0.738721 Jun 25 21:14:03.086966 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2686/4942] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:02 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1691 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:03.090784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94402e56-4f10-419d-97d5-05632297e037 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:03.158177 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94402e56-4f10-419d-97d5-05632297e037 tempest-ServerGroupTestJSON-1111653679 tempest-ServerGroupTestJSON-1111653679-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a" status: 204 len: 0 microversion: 2.1 time: 0.084860 Jun 25 21:14:03.159145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2257/4943] 10.222.0.39 () {58 vars in 1265 bytes} [Sat Jun 25 21:14:03 2022] DELETE /compute/v2.1/os-server-groups/3facf06d-a7b2-447a-a5cb-7ed9d6f3851a => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:14:04.084510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:04.085547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:04.097495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.098362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.100539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.101141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.104367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:04.104969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:04.121613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.122127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.122925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.123406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.163290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:14:04.255875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:04.325723 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-273b7bae-fc3a-4c04-92bd-34d5aede8a64 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 204 len: 0 microversion: 2.42 time: 0.553092 Jun 25 21:14:04.326908 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2687/4944] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:14:03 2022] DELETE /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:14:04.337691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:04.338963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:04.346115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.346838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.347722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:04.348259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:04.831096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:04.839901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9832160d-2c98-4c8f-80ca-d607fb2fcf46 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1691 microversion: 2.1 time: 0.740597 Jun 25 21:14:04.851236 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2258/4945] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:04 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1691 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:04.884853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:04.898247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:04.901452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:04.903216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-da6bb1f9-a6c3-4783-bb91-2b21ad57dbac tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2957 microversion: 2.42 time: 0.571738 Jun 25 21:14:04.917372 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2688/4946] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:04 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2957 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:05.862368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:05.862994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:05.872457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:05.872968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:05.873805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:05.874405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:05.927189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:05.928450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:05.936878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:05.937805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:05.938891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:05.939514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:06.037614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:06.047047 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f52e758e-b9a0-4430-ab28-0d815e0d351b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1691 microversion: 2.1 time: 0.192638 Jun 25 21:14:06.058932 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2259/4947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:05 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1691 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:07.065569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:07.066991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:07.102097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:07.113377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:07.116228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:07.129820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:07.281092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:07.300638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:07.302379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:07.306023 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51556c6c-c251-4232-a00c-5c50d300aad9 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2957 microversion: 2.42 time: 1.386256 Jun 25 21:14:07.316032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2689/4948] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:05 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2957 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:07.442825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:07.454498 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9432a73e-23b2-48fc-976e-35365634b58c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.393663 Jun 25 21:14:07.456153 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2260/4949] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:07 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:08.328818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:08.330128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:08.342271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:08.347170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:08.348537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:08.350509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:08.487997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:08.489802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:08.499948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:08.500936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:08.501953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:08.502988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:08.700186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:08.718533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:08.728349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:08.737451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebebd8e4-fade-47c9-bb9f-5059fc50bdbf tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2957 microversion: 2.42 time: 0.413578 Jun 25 21:14:08.738094 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2690/4950] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:08 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2957 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:09.037104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:09.054682 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59b27bd0-4683-4473-819f-cf1e612dab19 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.578181 Jun 25 21:14:09.060546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2261/4951] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:08 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:09.769673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:09.771265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:09.778977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:09.779671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:09.780726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:09.781454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:10.073385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:10.074138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:10.094168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:10.100789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:10.104205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:10.105405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:10.282453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:10.293030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:10.294633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:10.296169 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8eb63ade-a604-4edc-ab9b-1bd97d45d678 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2915 microversion: 2.42 time: 0.540769 Jun 25 21:14:10.308506 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2691/4952] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:09 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2915 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:10.313517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f371f397-b8a0-4e99-b5c2-d115ec143be0 req-6e82e5d3-b5b3-44f1-a2cf-640ea974516c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-deleted", "tag": "3e15991d-09ea-4734-acf7-f1ade6cf8701"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:10.322819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f371f397-b8a0-4e99-b5c2-d115ec143be0 req-6e82e5d3-b5b3-44f1-a2cf-640ea974516c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:10.323565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f371f397-b8a0-4e99-b5c2-d115ec143be0 req-6e82e5d3-b5b3-44f1-a2cf-640ea974516c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:10.340080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f371f397-b8a0-4e99-b5c2-d115ec143be0 req-6e82e5d3-b5b3-44f1-a2cf-640ea974516c service nova] Creating event network-vif-deleted:3e15991d-09ea-4734-acf7-f1ade6cf8701 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:10.345770 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f371f397-b8a0-4e99-b5c2-d115ec143be0 req-6e82e5d3-b5b3-44f1-a2cf-640ea974516c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035815 Jun 25 21:14:10.347005 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2692/4953] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:10.391082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:10.400117 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9406550b-1007-42d9-9c9a-1b243936d0e1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.330847 Jun 25 21:14:10.400999 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2262/4954] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:10 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:10.827712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-94c6460d-da95-445b-ba10-7055febdbffd req-f9f3f8b6-ee7c-4e9f-8361-7e0eef9e4bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-unplugged", "status": "completed", "tag": "ad635ecf-1213-4110-bff9-f73db63dd9ca"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:10.838537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-94c6460d-da95-445b-ba10-7055febdbffd req-f9f3f8b6-ee7c-4e9f-8361-7e0eef9e4bb0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:10.839376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-94c6460d-da95-445b-ba10-7055febdbffd req-f9f3f8b6-ee7c-4e9f-8361-7e0eef9e4bb0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:10.858883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-94c6460d-da95-445b-ba10-7055febdbffd req-f9f3f8b6-ee7c-4e9f-8361-7e0eef9e4bb0 service nova] Creating event network-vif-unplugged:ad635ecf-1213-4110-bff9-f73db63dd9ca for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:10.867139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-94c6460d-da95-445b-ba10-7055febdbffd req-f9f3f8b6-ee7c-4e9f-8361-7e0eef9e4bb0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045393 Jun 25 21:14:10.868648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2693/4955] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:11.317641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:11.319191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:11.330488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:11.331341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:11.332487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:11.333180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:11.421971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:11.423030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:11.432367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:11.432955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:11.434104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:11.434483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:11.693018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:11.702654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:11.710346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:11.713253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:11.715230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44d1c95a-8b11-4e80-b794-0cb7470d8b86 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2709 microversion: 2.42 time: 0.403049 Jun 25 21:14:11.717441 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2263/4956] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:11 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2709 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:11.978958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:12.002990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2865495e-0fd2-413f-8e73-7772b24ff339 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.588026 Jun 25 21:14:12.004123 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2694/4957] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:11 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:12.401955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-be8dfa4c-dc72-4a30-b500-b192ba67ae64 req-7684f7cf-9dbb-4724-83d8-64df55964d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-deleted", "tag": "54514947-c78f-4902-a825-cefd7ad64e30"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:12.425391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-be8dfa4c-dc72-4a30-b500-b192ba67ae64 req-7684f7cf-9dbb-4724-83d8-64df55964d59 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:12.426627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-be8dfa4c-dc72-4a30-b500-b192ba67ae64 req-7684f7cf-9dbb-4724-83d8-64df55964d59 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:12.441902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-be8dfa4c-dc72-4a30-b500-b192ba67ae64 req-7684f7cf-9dbb-4724-83d8-64df55964d59 service nova] Creating event network-vif-deleted:54514947-c78f-4902-a825-cefd7ad64e30 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:12.449663 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-be8dfa4c-dc72-4a30-b500-b192ba67ae64 req-7684f7cf-9dbb-4724-83d8-64df55964d59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051346 Jun 25 21:14:12.452132 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2264/4958] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:12.740751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:12.741309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:12.754732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:12.755248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:12.756070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:12.756716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:12.904395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-unplugged", "status": "completed", "tag": "13deb6b0-1f80-429a-ba4c-9fa21b1c1903"}, {"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-unplugged", "status": "completed", "tag": "15049829-d7b6-48d4-95ad-10d35343c6bc"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:12.925377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:12.926374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:12.959188 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] Creating event network-vif-unplugged:13deb6b0-1f80-429a-ba4c-9fa21b1c1903 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:12.959708 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] Creating event network-vif-unplugged:15049829-d7b6-48d4-95ad-10d35343c6bc for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:12.967107 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-64f05c26-d2d6-4548-b475-516b6f3ce6fa req-2a9525fb-6533-4fd4-b140-5528dfd59895 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.067216 Jun 25 21:14:12.968481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2265/4959] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:13.022691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:13.022840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:13.048272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:13.056807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:13.057725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:13.058212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:13.666538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:13.685677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:13.687414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:13.688921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d62ea71d-d71d-4fcf-9703-320de492ac55 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2549 microversion: 2.42 time: 0.952457 Jun 25 21:14:13.690384 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2695/4960] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:12 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2549 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:13.720459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:13.738585 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d82fcfe4-aebe-4843-b352-a0821d76e0ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.719676 Jun 25 21:14:13.740840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2266/4961] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:13 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:14.509510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-deleted", "tag": "ad635ecf-1213-4110-bff9-f73db63dd9ca"}, {"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-deleted", "tag": "15049829-d7b6-48d4-95ad-10d35343c6bc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:14.528995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:14.549618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:14.555363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:14.585917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] Creating event network-vif-deleted:ad635ecf-1213-4110-bff9-f73db63dd9ca for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:14.587101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] Creating event network-vif-deleted:15049829-d7b6-48d4-95ad-10d35343c6bc for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:14.595805 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-612c748c-947a-40ef-8dc0-75d891d9f66c req-f4efe8aa-6f7f-44f8-b229-b70416df0f4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089998 Jun 25 21:14:14.597410 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2696/4962] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:14.714708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:14.715350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:14.729701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:14.730930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:14.732362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:14.735396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:14.760512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:14.761489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:14.788730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:14.789466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:14.792773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:14.792773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:15.015511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:15.030466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:15.034407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '48103c7f170a4a97a3aa0402a52428c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094538b7d28d413fbea48441d35cad09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:15.039565 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-871588c5-85c0-497e-b83a-5c5eb29279b5 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 200 len: 2030 microversion: 2.42 time: 0.330767 Jun 25 21:14:15.040364 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2267/4963] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:14 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 2030 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:15.538251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:15.550549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4572e994-da59-4904-8c0b-60250bb58e18 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.796556 Jun 25 21:14:15.562002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2697/4964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:14 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:16.060331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:16.061471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:16.079012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:16.079726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:16.082554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:16.083758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:16.129687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] HTTP exception thrown: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Request method failure captured: Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 HTTP/1.1 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3lG-RpNSMJac5qLtZbdaqrcEw1VoSW8KuK2A6TZmNq-2aHStoZSi0pPe_aEABUIxYkxvh11IGv5HbK2jKVzWwPg_o805kTnNyqVmJcsBHUw-0vvYh6CjBhcq_tDuCs_r2L4uaaqK7DxtVzdqpOm-_wsAAYgVg7wrglanGFoa6zXuXQ Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.42 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094538b7d28d413fbea48441d35cad09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094538b7d28d413fbea48441d35cad09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}] Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 48103c7f170a4a97a3aa0402a52428c2 Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6c90b516-ecb6-4190-bd3f-59c3a3385391'} Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:16.135156 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:16.141472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Returning 404 to user: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:16.143631 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-deb9ba29-5cbf-4122-ba67-0e1ba92c484b tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 404 len: 111 microversion: 2.42 time: 0.086738 Jun 25 21:14:16.143631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2268/4965] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:16 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:14:16.157927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d088125b-affc-4812-8a55-e5adff3e87a2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '.version_select at 0x7f984e70d3a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:16.203492 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d088125b-affc-4812-8a55-e5adff3e87a2 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170691039" status: 204 len: 0 microversion: 2.42 time: 0.047837 Jun 25 21:14:16.204719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2698/4966] 10.222.0.39 () {60 vars in 1258 bytes} [Sat Jun 25 21:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170691039 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:14:16.580038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:16.582332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:16.594180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:16.595935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:16.598109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:16.598771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:16.674521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4a69a425-2f88-41bc-b1e5-413402d0ea38 req-e7797734-7fad-429a-99c1-d155520a28cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c90b516-ecb6-4190-bd3f-59c3a3385391", "name": "network-vif-deleted", "tag": "13deb6b0-1f80-429a-ba4c-9fa21b1c1903"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:16.689473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4a69a425-2f88-41bc-b1e5-413402d0ea38 req-e7797734-7fad-429a-99c1-d155520a28cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:16.690408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4a69a425-2f88-41bc-b1e5-413402d0ea38 req-e7797734-7fad-429a-99c1-d155520a28cc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:16.704095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4a69a425-2f88-41bc-b1e5-413402d0ea38 req-e7797734-7fad-429a-99c1-d155520a28cc service nova] Creating event network-vif-deleted:13deb6b0-1f80-429a-ba4c-9fa21b1c1903 for instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 on nch2-master-1 Jun 25 21:14:16.711768 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4a69a425-2f88-41bc-b1e5-413402d0ea38 req-e7797734-7fad-429a-99c1-d155520a28cc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041023 Jun 25 21:14:16.713038 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2699/4967] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:17.010807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:17.019901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17c8908b-e928-402d-aeaf-280e538c4bfa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.455227 Jun 25 21:14:17.021845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2269/4968] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:16 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:17.510979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-350654991", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:17.582049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:14:17.584171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:14:17.585990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:14:17.587822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:14:17.588510 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:14:17.608149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:17.609886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:17.611050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:17.613426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:17.650273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Getting quotas for project 19bc4d4b7a084a9994b64ccde8c9e254. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:14:17.657706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Getting quotas for user 3af9776accbe457cab8de3da006d1be4 and project 19bc4d4b7a084a9994b64ccde8c9e254. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:14:17.673391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:14:17.676292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:14:17.747337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d504bc1a-2c15-4979-9eaa-6d7546398888 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.507009 Jun 25 21:14:17.761831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:17.763331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:17.770392 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2700/4969] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:14:17.856096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:17.867423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:17.869887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:17.871543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ad61451-c9ef-4cfd-ba89-81fed9bd7073 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 200 len: 1277 microversion: 2.47 time: 0.114855 Jun 25 21:14:17.881621 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2270/4970] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:17 2022] GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:18.038158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:18.039234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:18.061349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:18.063926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:18.066815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:18.068764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:18.283162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1111013717", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "70963d49-3c31-4f6c-9985-a9bdaad7d025"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:18.352222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] validate_networks() for [('70963d49-3c31-4f6c-9985-a9bdaad7d025', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:14:18.394467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:18.407139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63d956ee-ec73-4fd1-bf59-f771064f98e6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.373067 Jun 25 21:14:18.418503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2271/4971] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:18 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:18.426251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1499509761", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": "none"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:18.501475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:14:18.503591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:14:18.505983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:14:18.507021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:14:18.508334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:14:18.536173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:18.536653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:18.538322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:18.538764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:18.566937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Getting quotas for project 19bc4d4b7a084a9994b64ccde8c9e254. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:14:18.574885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Getting quotas for user 3af9776accbe457cab8de3da006d1be4 and project 19bc4d4b7a084a9994b64ccde8c9e254. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:14:18.599165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:14:18.605405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:14:18.720175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47bef89b-52f1-4ffb-9d76-b28ce464c7a7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.299320 Jun 25 21:14:18.721203 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2272/4972] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:14:18.733152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-731b6fe1-8fed-447d-b8a3-f5e9ce7fa2ca tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:18.734571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-731b6fe1-8fed-447d-b8a3-f5e9ce7fa2ca tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:18.801042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-731b6fe1-8fed-447d-b8a3-f5e9ce7fa2ca tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "PUT /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 992 microversion: 2.47 time: 0.073088 Jun 25 21:14:18.801736 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2273/4973] 10.222.0.39 () {62 vars in 1296 bytes} [Sat Jun 25 21:14:18 2022] PUT /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 992 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:14:18.817032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:18.818059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:18.890810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:18.899683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:18.901956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:18.903341 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4d1568b1-4d9e-4cfd-b102-0b4a6f7dc59c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1278 microversion: 2.47 time: 0.090571 Jun 25 21:14:18.915387 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2274/4974] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:18 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1278 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:19.425257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:19.425882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:19.437091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:19.437767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:19.439241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:19.439688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:19.790579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:19.805990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68e97bad-58b7-4434-a12d-96be84e97484 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.386260 Jun 25 21:14:19.809214 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2275/4975] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:19 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:19.923475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:19.924106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:19.931070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:19.931851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:19.933097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:19.933762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:20.046293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:20.059058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:20.060710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:20.062278 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba81ed7c-65ff-4ca6-bb16-f29c5cd5f80c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1330 microversion: 2.47 time: 0.143622 Jun 25 21:14:20.072563 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2276/4976] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:19 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1330 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:20.216713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:14:20.217166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:14:20.217606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:14:20.218343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:14:20.218827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:14:20.231899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:20.232366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:20.233214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:20.233658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:20.309442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Getting quotas for project f14f834f94d74057abd079c04562b60e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:14:20.328521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Getting quotas for user 441d9cda34564fca81f9aa538b70f00d and project f14f834f94d74057abd079c04562b60e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:14:20.371636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:14:20.375255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:14:20.432342 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29ce5c27-0cfb-4066-8cef-795162d83d53 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.590280 Jun 25 21:14:20.435396 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2701/4977] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:14:20.443788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45b9c18b-ed6f-444e-8325-aec2d0cf7af2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:20.444591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45b9c18b-ed6f-444e-8325-aec2d0cf7af2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:20.571286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45b9c18b-ed6f-444e-8325-aec2d0cf7af2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:20.580538 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45b9c18b-ed6f-444e-8325-aec2d0cf7af2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1225 microversion: 2.1 time: 0.140484 Jun 25 21:14:20.591830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2277/4978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:20 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:20.829286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:20.829981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:20.844490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:20.845109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:20.847000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:20.848673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:21.083243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:21.084474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:21.112062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:21.112963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:21.114496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:21.115338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:21.281469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:21.294558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:21.296220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:21.297466 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7607a90f-af09-4543-ab72-9b2bbb469cfe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1338 microversion: 2.47 time: 0.218931 Jun 25 21:14:21.306257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2278/4979] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:21 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1338 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:21.597976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:21.599369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:21.600394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:21.608179 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ab81a0f-d045-42b7-a6a9-7f15a0ed965c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.787390 Jun 25 21:14:21.617728 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2702/4980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:20 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:21.617952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:21.621677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:21.622671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:21.623129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:21.909256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:21.922293 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40c68d81-4007-41ff-b327-0af9ff5f064f tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1277 microversion: 2.1 time: 0.326370 Jun 25 21:14:21.924485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2279/4981] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:21 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:22.318236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:22.319273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:22.349350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.349521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:22.354195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.355062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:22.530429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:22.541839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:22.546013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:22.547226 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84cfe388-d2dd-434b-ae2d-011e07711a6d tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1336 microversion: 2.47 time: 0.233927 Jun 25 21:14:22.551226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2703/4982] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:22 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1336 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:22.626580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:22.628371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:22.644233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.646709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:22.648837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.652327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:22.941087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:22.941713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:22.957243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.958135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:22.960120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:22.960891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.044053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:23.053459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e23926b-4d88-424e-bb60-e722420b92e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.431716 Jun 25 21:14:23.063292 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2280/4983] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:22 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:23.149968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:23.159229 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6bd9582d-a4ac-4438-bea8-656b81bf4263 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1283 microversion: 2.1 time: 0.222609 Jun 25 21:14:23.163458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2704/4984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:22 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1283 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:23.569744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:23.570690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:23.590717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.593322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.596747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.597966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.702092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:23.714703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:23.715207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:23.721771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:23.723699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:23.725075 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48a0bcd5-75e3-4570-912a-411016609a88 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1336 microversion: 2.47 time: 0.160961 Jun 25 21:14:23.726219 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2281/4985] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:23 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1336 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:23.739196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.739842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.740900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.741404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.762917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] HTTP exception thrown: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Request method failure captured: Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 HTTP/1.1 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3lG-RpNSMJac5qLtZbdaqrcEw1VoSW8KuK2A6TZmNq-2aHStoZSi0pPe_aEABUIxYkxvh11IGv5HbK2jKVzWwPg_o805kTnNyqVmJcsBHUw-0vvYh6CjBhcq_tDuCs_r2L4uaaqK7DxtVzdqpOm-_wsAAYgVg7wrglanGFoa6zXuXQ Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.42 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094538b7d28d413fbea48441d35cad09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094538b7d28d413fbea48441d35cad09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}] Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 48103c7f170a4a97a3aa0402a52428c2 Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6c90b516-ecb6-4190-bd3f-59c3a3385391'} Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:23.765784 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Returning 404 to user: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:23.771988 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3b187579-c5da-4dd1-a367-ac79dea1d777 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 404 len: 111 microversion: 2.42 time: 0.061521 Jun 25 21:14:23.774032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2705/4986] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:14:23 2022] DELETE /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:14:23.779917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:23.780618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] [instance: 6c90b516-ecb6-4190-bd3f-59c3a3385391] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:23.799883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.800360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.802408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:23.810827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:23.846231 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] HTTP exception thrown: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Request method failure captured: Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 HTTP/1.1 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3lG-RpNSMJac5qLtZbdaqrcEw1VoSW8KuK2A6TZmNq-2aHStoZSi0pPe_aEABUIxYkxvh11IGv5HbK2jKVzWwPg_o805kTnNyqVmJcsBHUw-0vvYh6CjBhcq_tDuCs_r2L4uaaqK7DxtVzdqpOm-_wsAAYgVg7wrglanGFoa6zXuXQ Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.42 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/094538b7d28d413fbea48441d35cad09"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_094538b7d28d413fbea48441d35cad09"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/094538b7d28d413fbea48441d35cad09"}]}] Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 094538b7d28d413fbea48441d35cad09 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1841146700 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 48103c7f170a4a97a3aa0402a52428c2 Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1841146700-project Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6c90b516-ecb6-4190-bd3f-59c3a3385391'} Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.849335 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. Jun 25 21:14:23.854433 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:14:23.856732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] Returning 404 to user: Instance 6c90b516-ecb6-4190-bd3f-59c3a3385391 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:23.857767 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-349678c9-462c-46d1-b4a4-f644bdd10392 tempest-TaggedBootDevicesTest_v242-1841146700 tempest-TaggedBootDevicesTest_v242-1841146700-project] 10.222.0.39 "GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391" status: 404 len: 111 microversion: 2.42 time: 0.082605 Jun 25 21:14:23.863709 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2282/4987] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:23 2022] GET /compute/v2.1/servers/6c90b516-ecb6-4190-bd3f-59c3a3385391 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:14:24.073569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:24.075069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:24.083980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.085439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:24.088416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.091255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:24.178952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:24.179607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:24.189396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.190377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:24.192217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.192915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:24.294128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:24.304233 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07026e58-72d7-4bb3-ac45-649e62ef9789 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1283 microversion: 2.1 time: 0.130465 Jun 25 21:14:24.308865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2283/4988] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:24 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1283 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:24.577364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:24.588290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b245b15d-2189-4e33-9626-383812eef911 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1696 microversion: 2.1 time: 0.520077 Jun 25 21:14:24.589198 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2706/4989] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:24 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1696 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:24.744868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:24.747897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:24.753713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.754423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:24.755393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:24.755935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.050226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.066655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.069261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.070959 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6616f01-65fa-4604-add3-6ac263fb6fe2 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1357 microversion: 2.47 time: 0.330477 Jun 25 21:14:25.072083 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2284/4990] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:24 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:25.094010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:25.096340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:25.106581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.107344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.109152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.109805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.232440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:14:25.233609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:14:25.234457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:14:25.236042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:14:25.236794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:14:25.322276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:25.323732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:25.331504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.332129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.333291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.333948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.409324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:25.416647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.417621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.418631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.419307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.431205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:25.508969 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae27151d-24f8-4773-b318-fa383b60f07c tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "POST /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3/action" status: 202 len: 1079 microversion: 2.47 time: 0.419267 Jun 25 21:14:25.511739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2707/4991] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:14:25 2022] POST /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3/action => generated 1079 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jun 25 21:14:25.527019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:25.527701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:25.536179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.537325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.538652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.539145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.775281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.797979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.799379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.803251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:25.805717 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0dfc41f2-88b4-4dc8-8e8b-946d6566bb18 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.285132 Jun 25 21:14:25.812312 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2708/4992] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:25 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:25.814939 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cb1ce20-7a0f-41c1-8122-08fc2727038d tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.496615 Jun 25 21:14:25.818288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "name": "network-vif-unplugged", "status": "completed", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:25.825602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2285/4993] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:25 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:25.837146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:25.840933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:25.847622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:25.849342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.849683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.849836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.850476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.862976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:25.863361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:25.878373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] Creating event network-vif-unplugged:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch1-master-1 Jun 25 21:14:25.892361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:14:25.915416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c4a0c6cb-fc36-44b7-b40b-ca99ee526a57 req-48b83f7d-8ac6-4bb4-a2ea-b4ee3e4af802 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101468 Jun 25 21:14:25.916747 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2709/4994] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:26.226865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:26.241139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3cab0b6-5934-4690-b400-56cf4af0d6d2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1695 microversion: 2.1 time: 0.413735 Jun 25 21:14:26.255483 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2286/4995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:25 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1695 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:26.778777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-90583c8d-575d-4839-9cbf-31da49625aa8 req-7e23b570-906c-4bb5-b128-c7c0291287b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0572e92-0556-44dd-bee5-9e87498e7af6", "tag": "1139388a-ffdd-4397-854a-fd56454005dc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:26.802789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-90583c8d-575d-4839-9cbf-31da49625aa8 req-7e23b570-906c-4bb5-b128-c7c0291287b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:26.806444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-90583c8d-575d-4839-9cbf-31da49625aa8 req-7e23b570-906c-4bb5-b128-c7c0291287b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:26.831218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:26.833354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:26.837151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-90583c8d-575d-4839-9cbf-31da49625aa8 req-7e23b570-906c-4bb5-b128-c7c0291287b5 service nova] Creating event network-changed:1139388a-ffdd-4397-854a-fd56454005dc for instance b0572e92-0556-44dd-bee5-9e87498e7af6 on nch2-master-1 Jun 25 21:14:26.848257 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-90583c8d-575d-4839-9cbf-31da49625aa8 req-7e23b570-906c-4bb5-b128-c7c0291287b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077066 Jun 25 21:14:26.848930 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2710/4996] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:26.860304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:26.860890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:26.863001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:26.863743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:26.864241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:26.864929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:26.875465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:26.883258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:26.884386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:26.885025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:27.042486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:27.059680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:27.068834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:27.070311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:27.071555 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-716ff96d-9124-4562-9827-454bbf36b102 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.246526 Jun 25 21:14:27.073652 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2287/4997] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:26 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:27.265546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:27.266634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:27.276099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:27.276947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:27.278332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:27.279078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:27.382329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:27.393847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9aa388b9-a500-4893-9af2-802d47a03fb2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.543274 Jun 25 21:14:27.395973 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2711/4998] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:26 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:27.721324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:27.733173 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5aa6db9e-3d4e-4fe1-9ca2-9da4b08849ca tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1695 microversion: 2.1 time: 0.475184 Jun 25 21:14:27.733786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2288/4999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:27 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1695 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:28.001501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:28.011642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.012361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.026272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] Creating event network-changed:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch1-master-1 Jun 25 21:14:28.032252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:14:28.043493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1b9ae439-2fef-4aa8-8523-92ebff030a81 req-ba0033fc-1a64-47ba-b7aa-9fe8b9e82fbb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045840 Jun 25 21:14:28.044114 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2712/5000] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:28.095577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:28.096196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:28.105850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.106303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.107067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.107702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.195287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:28.206533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:28.208883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:28.210651 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49920f1d-12dc-4cc3-824b-f19d19ad6332 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.119869 Jun 25 21:14:28.211473 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2289/5001] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:28 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:28.411658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:28.412367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:28.419334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.420217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.421141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.421641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.590946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:28.601463 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e39de61-3e16-47c8-8bf5-e81b4d28b7c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.192794 Jun 25 21:14:28.602261 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2713/5002] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:28 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:28.751659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:28.753355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:28.756120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:28.763522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.764108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:28.765184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:28.765693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:29.062390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:29.072585 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3e169b15-2561-4ac6-8508-f0b6f18e0a9c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1693 microversion: 2.1 time: 0.324997 Jun 25 21:14:29.073483 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2290/5003] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:28 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1693 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:29.229896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:29.232129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:29.241019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:29.241625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:29.242597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:29.243309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:29.358680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:29.368837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:29.370514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:29.371945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec753e43-2dbb-4a04-8bc4-578d1b322e94 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.146058 Jun 25 21:14:29.383856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2714/5004] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:29 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:29.618405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:29.619501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:29.653441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:29.654319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:29.655442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:29.656516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:29.925809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:29.938270 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-37f5cddb-b36f-439d-af64-49eba0e4bbf3 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.323586 Jun 25 21:14:29.940544 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2291/5005] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:29 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:30.092927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:30.093407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:30.101712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.102176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.102962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.103412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.252457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:30.320261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:30.337063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f250e69-d8eb-44ad-a049-9707c6b7ab1b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1690 microversion: 2.1 time: 0.248895 Jun 25 21:14:30.339305 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2715/5006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:30 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:30.359081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:30.359664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:30.366481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.367098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.368138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.368817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.390213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:30.391132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:30.393366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:30.408116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.408642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.415833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.416328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.502236 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99aabed9-1252-4896-9354-1548f8e457a2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action" status: 204 len: 0 microversion: 2.1 time: 0.151638 Jun 25 21:14:30.503254 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2292/5007] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:14:30 2022] POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:14:30.513809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:30.514863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:30.526396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.527014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.528007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.528655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.550884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:30.567832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:30.571894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:30.575457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c57e9ad2-0f1e-40e5-aa62-1567378872fd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.189064 Jun 25 21:14:30.578613 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2716/5008] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:30 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:30.580973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:30.938612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:30.950348 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-582426a6-c6a0-4485-81a2-504568f72669 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1690 microversion: 2.1 time: 0.441060 Jun 25 21:14:30.953780 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2293/5009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:30 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1690 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:30.960326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:30.961666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:30.978043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.979054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:30.980263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:30.981019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:31.290480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:31.300225 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e9d0bb6a-001b-46e8-a124-23f63350595c tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.347176 Jun 25 21:14:31.302169 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2717/5010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:30 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:31.595226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:31.596347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:31.603712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:31.604590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:31.605650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:31.606292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:31.733726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:31.742943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:31.745187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:31.745907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e07d0cc9-7500-4d39-843d-791cb78f6f75 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.154756 Jun 25 21:14:31.757974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2294/5011] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:31 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:31.968554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:31.969188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:31.976390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:31.977139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:31.977917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:31.978354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:32.139286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:32.155080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-493cabaa-7118-4443-a70f-03a144401cfe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1690 microversion: 2.1 time: 0.189869 Jun 25 21:14:32.155718 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2718/5012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:31 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1690 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:32.318369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:32.318975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:32.329258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:32.329716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:32.330494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:32.331117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:32.765551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:32.766985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:32.774995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:32.775874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:32.782739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:32.783661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:32.878703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:32.888475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:32.890521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:32.891967 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ec21093-3d73-4e4e-a7a3-b4aab3a636cd tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.130544 Jun 25 21:14:32.893356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2719/5013] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:32 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:33.000985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:33.065172 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-103d4c77-6fba-4470-8047-742ffe5578e7 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.750687 Jun 25 21:14:33.066747 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2295/5014] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:32 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:33.177269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:33.178961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:33.193864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:33.195809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:33.198406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:33.198864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:33.913615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:33.914244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:33.927363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:33.927913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:33.930458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:33.930911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:33.999681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:34.015509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5d221650-2c8b-4c33-acf4-16feefffe766 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1690 microversion: 2.1 time: 0.845620 Jun 25 21:14:34.026300 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2720/5015] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:33 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1690 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:34.083119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:34.084076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:34.095600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:34.096060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:34.096914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:34.109972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:34.163469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:34.179946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:34.193793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:34.207592 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec517adc-dffb-4e1d-ae22-1cfcc2b12a67 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.300097 Jun 25 21:14:34.209282 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2296/5016] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:33 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:34.447571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-84947f9e-8229-4a24-b49d-9a745a83a39f req-eaa97028-9ecb-47fe-8290-a3b4479ab1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "name": "network-vif-plugged", "status": "completed", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:34.466386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-84947f9e-8229-4a24-b49d-9a745a83a39f req-eaa97028-9ecb-47fe-8290-a3b4479ab1b9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:34.467672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-84947f9e-8229-4a24-b49d-9a745a83a39f req-eaa97028-9ecb-47fe-8290-a3b4479ab1b9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:34.499279 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-84947f9e-8229-4a24-b49d-9a745a83a39f req-eaa97028-9ecb-47fe-8290-a3b4479ab1b9 service nova] Creating event network-vif-plugged:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch1-master-1 Jun 25 21:14:34.505722 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-84947f9e-8229-4a24-b49d-9a745a83a39f req-eaa97028-9ecb-47fe-8290-a3b4479ab1b9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062669 Jun 25 21:14:34.507189 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2297/5017] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:34.653834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:34.663093 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df9a5b72-fd7f-4930-8362-b08bce867838 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.583880 Jun 25 21:14:34.664559 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2721/5018] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:34 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:35.038095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:35.040062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:35.078546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.079004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:35.079799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.083985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:35.226779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:35.228367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:35.249979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.260559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:35.262706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.263394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:35.412991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:35.425544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:35.436468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:35.438118 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7024d542-578c-440c-8886-55c75c7a146e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.215659 Jun 25 21:14:35.439422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2722/5019] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:35 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:35.452039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:35.470588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b19cb35-2102-40ad-904c-7abef70e04c1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1682 microversion: 2.1 time: 0.438342 Jun 25 21:14:35.488307 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2298/5020] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:35 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1682 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:35.681550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:35.682230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:35.689051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.689526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:35.690335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:35.690766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:36.024171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:36.040140 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f685e562-e7b3-4e5e-9d3b-1821a3d9cd80 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.360402 Jun 25 21:14:36.044801 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2723/5021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:35 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:36.463448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:36.464228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:36.474635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:36.477619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:36.478640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:36.479344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:36.553586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fa24d033-658a-40d2-8725-04dbf11b9209 req-603588fc-cd61-49c4-b9b2-fc24ecd69e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0572e92-0556-44dd-bee5-9e87498e7af6", "name": "network-vif-plugged", "status": "completed", "tag": "1139388a-ffdd-4397-854a-fd56454005dc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:36.568852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa24d033-658a-40d2-8725-04dbf11b9209 req-603588fc-cd61-49c4-b9b2-fc24ecd69e0c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:36.571108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa24d033-658a-40d2-8725-04dbf11b9209 req-603588fc-cd61-49c4-b9b2-fc24ecd69e0c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:36.597951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fa24d033-658a-40d2-8725-04dbf11b9209 req-603588fc-cd61-49c4-b9b2-fc24ecd69e0c service nova] Creating event network-vif-plugged:1139388a-ffdd-4397-854a-fd56454005dc for instance b0572e92-0556-44dd-bee5-9e87498e7af6 on nch2-master-1 Jun 25 21:14:36.618426 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fa24d033-658a-40d2-8725-04dbf11b9209 req-603588fc-cd61-49c4-b9b2-fc24ecd69e0c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072773 Jun 25 21:14:36.619049 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2724/5022] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:14:36.631311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:36.641094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:36.642750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:36.645859 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ec22aca-194b-4c8f-9c22-79da445e8f3e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.186996 Jun 25 21:14:36.649189 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2299/5023] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:36 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:37.069449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:37.077877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:37.089621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:37.092008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:37.092991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:37.094013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:37.346292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:37.358090 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91699841-c6e0-4101-b76c-e43d11bab4c6 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.301241 Jun 25 21:14:37.359541 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2725/5024] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:37 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:37.667861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:37.669132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:37.677516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:37.678326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:37.679364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:37.680037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:37.808086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:37.824484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:37.826083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:37.827330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0c739c7-0bbe-4ec6-ad6b-a79ba58a79a0 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.164026 Jun 25 21:14:37.831543 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2300/5025] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:37 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:38.377737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:38.379532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:38.394152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:38.395205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:38.396265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:38.397152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:38.402353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:38.690440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:38.700138 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cbe5b2de-7170-4556-aa27-cc678ed31cd1 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1325 microversion: 2.1 time: 0.328259 Jun 25 21:14:38.701566 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2726/5026] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:38 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:38.848544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:38.858605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:38.880751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:38.881578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:38.883068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:38.883945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:38.978752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:39.004594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:39.007404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:39.008866 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cffdf0c6-b3f7-48b5-bb05-205ff57a6840 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.166065 Jun 25 21:14:39.009951 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2301/5027] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:38 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:39.719700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:39.720338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:39.733916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:39.734364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:39.735144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:39.735576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.015928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:40.028131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:40.028842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:40.034831 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f2d4e6e-2144-4aeb-878e-dd458c050e20 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1522 microversion: 2.1 time: 0.319358 Jun 25 21:14:40.041752 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2727/5028] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:39 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:40.042817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.043429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.044371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.045001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.058487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:40.062431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:40.081923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.083907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.086015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.086458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.150380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] HTTP exception thrown: Instance is not a member of specified network Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Request method failure captured: Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6/ips/invalid HTTP/1.1 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3qpfVLbuQgMFygHqdvvA-duh0anYXDt_d5SuuX14_pEQmI5moVUba-DBxMwiQr0Qcw9RKEK5WCQgZwBqy5EsMV5tcDwBOzlFa-MW93N_N950JvkEjZzbuB1lppIobK_f2A6FiO8C8TQ_ya_K17k997IMOaZrprVOa_JbQwNIpnCh3M Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f14f834f94d74057abd079c04562b60e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f14f834f94d74057abd079c04562b60e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}] Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 441d9cda34564fca81f9aa538b70f00d Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance is not a member of specified network Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': 'b0572e92-0556-44dd-bee5-9e87498e7af6', 'id': 'invalid'} Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jun 25 21:14:40.161301 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.165810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Returning 404 to user: Instance is not a member of specified network {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:40.165810 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ac59fb28-5627-484a-8d85-0712e0bf5992 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.109436 Jun 25 21:14:40.167751 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2728/5029] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:14:40 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6/ips/invalid => generated 91 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:14:40.172527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:40.175555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Failed to fetch instance by id 999 {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2926}} Jun 25 21:14:40.181693 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] HTTP exception thrown: Instance 999 could not be found. Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Request method failure captured: Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3qpfVLbuQgMFygHqdvvA-duh0anYXDt_d5SuuX14_pEQmI5moVUba-DBxMwiQr0Qcw9RKEK5WCQgZwBqy5EsMV5tcDwBOzlFa-MW93N_N950JvkEjZzbuB1lppIobK_f2A6FiO8C8TQ_ya_K17k997IMOaZrprVOa_JbQwNIpnCh3M Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f14f834f94d74057abd079c04562b60e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f14f834f94d74057abd079c04562b60e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}] Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 441d9cda34564fca81f9aa538b70f00d Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 999 could not be found. Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '999'} Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jun 25 21:14:40.183560 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:40.188372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:40.189474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Returning 404 to user: Instance 999 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:40.190470 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77f520ba-ff59-4892-a315-b9a5409f3523 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.021758 Jun 25 21:14:40.195229 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2729/5030] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:14:40 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 21:14:40.200187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:40.204847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:40.205332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:40.205465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:40.208407 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e337022-5669-4763-8429-9a2666d5eb40 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.185018 Jun 25 21:14:40.213174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:40.217755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.218207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.219103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.219542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.222302 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2302/5031] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:40 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:40.249208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:14:40.373628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f86a81f9-b550-4ff5-8a37-62c7f03b0b14 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 204 len: 0 microversion: 2.1 time: 0.176627 Jun 25 21:14:40.374797 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2730/5032] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:14:40 2022] DELETE /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:14:40.384044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:40.385528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:40.394293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.395007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.396571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:40.397829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:40.550020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:40.554769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:40.560242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd7c8c7b-ab6c-4621-b4dc-aff9680ae4f4 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1528 microversion: 2.1 time: 0.181491 Jun 25 21:14:40.560867 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2303/5033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:40 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1528 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:41.229937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:41.231541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:41.242675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:41.243494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:41.247306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:41.249290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:41.397707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:41.410246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:41.416639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:41.420068 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-021f642f-bb38-4a06-9d41-95b85ad4a165 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.194925 Jun 25 21:14:41.423480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2731/5034] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:41 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:41.578656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:41.580281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:41.590807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:41.591794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:41.593088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:41.593688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:41.829280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:41.838798 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0778f99-5f14-457d-9503-09663511a1f5 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1528 microversion: 2.1 time: 0.265084 Jun 25 21:14:41.839586 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2304/5035] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:41 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1528 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:42.442493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:42.443104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:42.452676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:42.453541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:42.454938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:42.455780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:42.555295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:42.570743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:42.577208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:42.580704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa6e7abc-f3d7-4d0f-a1fa-40acfc842381 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.140562 Jun 25 21:14:42.580704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2732/5036] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:42 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:42.812178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-597c767d-8b47-4027-8e0a-355c3be9b9c7 req-373bf78f-915a-495e-9cfd-9e4df38c10c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0572e92-0556-44dd-bee5-9e87498e7af6", "name": "network-vif-deleted", "tag": "1139388a-ffdd-4397-854a-fd56454005dc"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:42.838743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-597c767d-8b47-4027-8e0a-355c3be9b9c7 req-373bf78f-915a-495e-9cfd-9e4df38c10c8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:42.839613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-597c767d-8b47-4027-8e0a-355c3be9b9c7 req-373bf78f-915a-495e-9cfd-9e4df38c10c8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:42.855452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:42.856525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:42.874509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:42.874986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:42.882995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:42.883939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:42.893447 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-597c767d-8b47-4027-8e0a-355c3be9b9c7 req-373bf78f-915a-495e-9cfd-9e4df38c10c8 service nova] Creating event network-vif-deleted:1139388a-ffdd-4397-854a-fd56454005dc for instance b0572e92-0556-44dd-bee5-9e87498e7af6 on nch2-master-1 Jun 25 21:14:42.911544 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-597c767d-8b47-4027-8e0a-355c3be9b9c7 req-373bf78f-915a-495e-9cfd-9e4df38c10c8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099248 Jun 25 21:14:42.925604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2305/5037] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:43.037024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '441d9cda34564fca81f9aa538b70f00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f834f94d74057abd079c04562b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:43.047771 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-987f347e-4dc3-4c65-8b3f-0fa99d54b292 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 200 len: 1310 microversion: 2.1 time: 0.196386 Jun 25 21:14:43.051305 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2733/5038] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:42 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 1310 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:14:43.600858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:43.601365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:43.622647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:43.623871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:43.625390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:43.628874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:43.775373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:43.785100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:43.786612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:43.787803 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ece292e-5e5b-420b-8c89-7c28dc9994b7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.194096 Jun 25 21:14:43.790347 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2306/5039] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:43 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:44.067959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:44.069493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] [instance: b0572e92-0556-44dd-bee5-9e87498e7af6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:44.077239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:44.077984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:44.079076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:44.079858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:44.104172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] HTTP exception thrown: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Request method failure captured: Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 HTTP/1.1 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3qpfVLbuQgMFygHqdvvA-duh0anYXDt_d5SuuX14_pEQmI5moVUba-DBxMwiQr0Qcw9RKEK5WCQgZwBqy5EsMV5tcDwBOzlFa-MW93N_N950JvkEjZzbuB1lppIobK_f2A6FiO8C8TQ_ya_K17k997IMOaZrprVOa_JbQwNIpnCh3M Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f14f834f94d74057abd079c04562b60e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f14f834f94d74057abd079c04562b60e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f14f834f94d74057abd079c04562b60e"}]}] Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f14f834f94d74057abd079c04562b60e Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-994209306 Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 441d9cda34564fca81f9aa538b70f00d Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-994209306-project Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b0572e92-0556-44dd-bee5-9e87498e7af6'} Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:44.107260 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. Jun 25 21:14:44.112335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:14:44.118059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] Returning 404 to user: Instance b0572e92-0556-44dd-bee5-9e87498e7af6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:14:44.119131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e84d9a96-b36c-4067-9d8f-3a7c806e9ec2 tempest-ServerAddressesNegativeTestJSON-994209306 tempest-ServerAddressesNegativeTestJSON-994209306-project] 10.222.0.39 "GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6" status: 404 len: 111 microversion: 2.1 time: 0.055517 Jun 25 21:14:44.119773 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2734/5040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:44 2022] GET /compute/v2.1/servers/b0572e92-0556-44dd-bee5-9e87498e7af6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:14:44.809131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:44.809908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:44.820963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:44.821193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:44.821872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:44.826826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:44.954347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:44.964713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:44.967072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:44.969700 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79fdf6de-7228-47c7-a273-5cfb0a06a550 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.166208 Jun 25 21:14:44.971096 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2307/5041] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:44 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:45.990532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:45.991928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:46.033281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:46.033882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:46.034764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:46.035444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:46.197784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:46.204397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:46.206181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:46.207499 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72e69d66-675c-43a0-8f04-63b091d27c33 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.221825 Jun 25 21:14:46.208170 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2735/5042] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:45 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:47.227913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:47.229096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:47.245471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:47.245952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:47.247637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:47.248102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:47.360344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:47.377835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:47.382085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:47.386881 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d11d15b-4819-4627-8ac7-1d78973253fe tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.163887 Jun 25 21:14:47.388129 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2308/5043] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:47 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:48.406966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:48.407646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:48.419614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:48.433213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:48.434336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:48.434929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:48.581604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:48.606350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:48.612190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:48.613558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64de3a9a-e056-4445-9953-a0ecd6dac379 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.211915 Jun 25 21:14:48.614162 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2736/5044] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:48 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:49.635031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:49.636814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:49.652550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:49.653450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:49.654803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:49.655806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:49.792378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:49.815672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:49.826935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:49.828463 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44c060df-db88-46c8-8476-d9122527456b tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.199157 Jun 25 21:14:49.829704 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2309/5045] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:49 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:50.182717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:50.183574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:50.190831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:50.191532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:50.192489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:50.193081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:50.234241 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a8d8cf6d-6ae5-4a02-95b6-c96bb88f331f tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/ips" status: 200 len: 146 microversion: 2.1 time: 0.055592 Jun 25 21:14:50.236096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2737/5046] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:14:50 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/ips => generated 146 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:50.856128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:50.857031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:50.871439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:50.872042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:50.874257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:50.874891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:51.071340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:51.090419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:51.099649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:51.103745 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d05b8f7-c1a3-43e2-8682-7b51a1428aaf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.257110 Jun 25 21:14:51.108196 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2310/5047] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:50 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:51.930542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2673345e-0e06-4c27-a28f-280fa1677d48"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:51.932300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:51.946765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:51.947173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:51.955479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:51.956106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:52.124129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:52.124953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:52.147957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:52.149835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:52.150765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:52.151235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:52.292335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:52.304531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:52.311505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:52.319072 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63257804-0d9b-45d7-b684-f64fae38a09e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.193376 Jun 25 21:14:52.337209 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2311/5048] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:52 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:52.473983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3ca3bed-94bb-4923-9944-18bbb817f157 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547139 Jun 25 21:14:52.476561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2738/5049] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:14:51 2022] POST /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:53.345957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:53.346754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:53.357664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:53.361125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:53.363176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:53.363936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:53.534061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:53.543746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:53.545299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:53.557837 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-250d42fa-99b8-4d7c-b70e-9acacaa143c9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.217579 Jun 25 21:14:53.560940 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2312/5050] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:53 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:54.439284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-249271500", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:54.520860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] validate_networks() for [('266d1588-40d0-4a62-9bb5-f34a7c7d3d85', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:14:54.579399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:54.580359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:54.589091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:54.589560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:54.590512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:54.591495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:54.687669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:54.698321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:54.703968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:54.705473 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db3b0bad-be33-4f95-ae00-fb64128092cf tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.130237 Jun 25 21:14:54.707411 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2313/5051] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:54 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:55.726400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:55.727872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:55.741820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:55.746334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:55.747455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:55.748272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:55.876794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:55.892309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:55.896604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:55.901943 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16064215-3b6d-4d8b-bc5e-0ba75a6fd873 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.179565 Jun 25 21:14:55.904560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2314/5052] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:55 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:14:55.915289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:14:55.916567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:14:55.917248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:14:55.917851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:14:55.918477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:14:55.937152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:55.938557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:55.941022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:55.943972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:55.978638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Getting quotas for project 0a0dcb1380ad41328b6779588f0e91f6. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:14:55.988359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Getting quotas for user 1554f1d20e344432b617857d279f6d37 and project 0a0dcb1380ad41328b6779588f0e91f6. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:14:56.016925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:14:56.020317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:14:56.095787 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf09b70c-bd64-4259-9a3b-f04856638ece tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.847625 Jun 25 21:14:56.097871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:56.098026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2739/5053] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:14:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 1857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:14:56.099113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:56.117001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=58 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:56.117762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8925d4d-c698-4c83-a39f-9ad239ad8dcd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:56.119818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8925d4d-c698-4c83-a39f-9ad239ad8dcd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:56.127504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.128258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:56.129279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.132063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:56.220230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-461cc5c2-2d47-4991-bb3f-5080c1438767 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134098 Jun 25 21:14:56.233130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2315/5054] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:14:56 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:56.243633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:56.244249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:56.270047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.270478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:56.271303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.271747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:56.366445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8925d4d-c698-4c83-a39f-9ad239ad8dcd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:56.374723 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8925d4d-c698-4c83-a39f-9ad239ad8dcd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1213 microversion: 2.1 time: 0.268850 Jun 25 21:14:56.379733 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2740/5055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:56 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1213 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:56.383497 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3aa2f19-45d9-46e4-a77c-4034653efa96 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48" status: 200 len: 194 microversion: 2.1 time: 0.147461 Jun 25 21:14:56.385621 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2316/5056] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 25 21:14:56 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:56.922411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:56.923880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:56.937469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.941046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:56.948183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:56.949037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:57.183852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:57.198796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:57.201473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:57.202711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72e1d569-1f96-46eb-975e-211d255265d6 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1366 microversion: 2.47 time: 0.285429 Jun 25 21:14:57.203289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2741/5057] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:56 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:14:57.402023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:57.402759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:57.422315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:57.424107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:57.425758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:57.428020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:57.603883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:57.625656 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b45be77-2463-4084-a573-4716c8d6c959 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1209 microversion: 2.1 time: 0.229986 Jun 25 21:14:57.629234 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2317/5058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:57 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1209 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:57.728304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:57.730186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:57.738907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:57.740675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:57.742150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:57.743872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.117401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f59969f-4d18-4fe6-8ebe-8f673720b514"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:14:58.118982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:58.133319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.133778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.136886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.137350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.554371 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d468d763-b8e7-45b3-8822-3d078183848a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action" status: 200 len: 24524 microversion: 2.1 time: 0.829918 Jun 25 21:14:58.583527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2742/5059] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:14:57 2022] POST /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79/action => generated 24524 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:14:58.599284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:58.600410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:58.639349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.641359 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c583c7a6-3501-47bc-ad2d-70dfff1f511c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "POST /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527909 Jun 25 21:14:58.643470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.644806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.644998 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2318/5060] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:14:58 2022] POST /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:14:58.666526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.690637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:14:58.692966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:14:58.734476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.743133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.744320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:14:58.748527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:14:58.966427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:58.971694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:14:58.975330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:58.982473 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9afc04f3-f712-49f1-b094-8833e0be19cc tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1271 microversion: 2.1 time: 0.311542 Jun 25 21:14:58.984520 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2319/5061] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:58 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1271 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:14:58.999762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:59.007621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:14:59.008900 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47b533d0-68ff-4b35-a4ea-0e39449c5acc tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1372 microversion: 2.47 time: 0.424532 Jun 25 21:14:59.017211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2743/5062] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:14:58 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1372 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:00.003345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:00.004118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:00.030330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:00.031267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:00.033186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:00.033824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:00.036164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:00.037201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:00.052383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:00.056133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:00.058655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:00.060809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:00.078289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:00.225959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:00.240872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:00.242803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:00.244964 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc396bfc-d3df-47fe-9cc9-36f256902852 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1372 microversion: 2.47 time: 0.219854 Jun 25 21:15:00.261738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2744/5063] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:00 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:00.387996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:00.398513 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-67154a5c-4b96-4d56-bf7a-256f292cde5c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.400513 Jun 25 21:15:00.401332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2320/5064] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:14:59 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:01.068738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e43cebf2-d555-4c62-929c-cfc08a87041c req-2ef00029-85b4-4105-b4ad-d24d14b36b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a57a50f-f503-4fde-b5ae-7feccfd74520", "tag": "4f313a90-c23e-4c8f-9357-696f919c3d23"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:01.086846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e43cebf2-d555-4c62-929c-cfc08a87041c req-2ef00029-85b4-4105-b4ad-d24d14b36b07 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.087305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e43cebf2-d555-4c62-929c-cfc08a87041c req-2ef00029-85b4-4105-b4ad-d24d14b36b07 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.115533 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e43cebf2-d555-4c62-929c-cfc08a87041c req-2ef00029-85b4-4105-b4ad-d24d14b36b07 service nova] Creating event network-changed:4f313a90-c23e-4c8f-9357-696f919c3d23 for instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 on nch2-master-1 Jun 25 21:15:01.129228 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e43cebf2-d555-4c62-929c-cfc08a87041c req-2ef00029-85b4-4105-b4ad-d24d14b36b07 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060395 Jun 25 21:15:01.130029 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2745/5065] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:01.265923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:01.266542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:01.281902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.282996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.287227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.290719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.421170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:01.421886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:01.446953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.448964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.450143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.452920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.517313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:01.527515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:01.534756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:01.539008 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b0d19c3-d6ac-4979-84bf-4e6355cdffaa tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1357 microversion: 2.47 time: 0.277138 Jun 25 21:15:01.539698 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2321/5066] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:01 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:01.560804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:01.564979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:01.569681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Searching by: {'deleted': False, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:15:01.581447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.587773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.589837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:01.591990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:01.908406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:15:02.053106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.062816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:02.068658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:02.082522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.084961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.211902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e4714112-caa8-47cf-99ac-4e45420bbdb7 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.656264 Jun 25 21:15:02.212909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2322/5067] 10.222.0.39 () {60 vars in 1186 bytes} [Sat Jun 25 21:15:01 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:02.239370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:02.239901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:02.256934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:02.257408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:02.258181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:02.258618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:02.365348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:15:02.526519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.541733 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef2f2cd5-acfe-468c-bd20-3c0de7496f25 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 204 len: 0 microversion: 2.47 time: 0.306001 Jun 25 21:15:02.544119 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d62fd11a-aa4a-4dd0-a3fd-e6489d216980 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 1.127107 Jun 25 21:15:02.544588 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2323/5068] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:15:02 2022] DELETE /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:15:02.545266 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2746/5069] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:01 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:02.563984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:02.566141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:02.578020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:02.579642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:02.583019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:02.583799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:02.722717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.733742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.735362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:02.736787 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4afec385-21c1-4a95-bcbd-028e401f1ea3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1363 microversion: 2.47 time: 0.179765 Jun 25 21:15:02.737527 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2324/5070] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:02 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:03.278523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.279768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:03.310726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.311209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.312138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.312634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.389051 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d19d29fc-32d0-4a4c-b9f3-a4a7235c05a2 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.114638 Jun 25 21:15:03.393991 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2325/5071] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:03.535054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.535695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:03.548193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.548675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.549561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.550010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.612471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Action: 'create', calling method: .version_select at 0x7f984e684160>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:03.616929 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00dc24f1-daee-494a-8470-c1063e2fb00c tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48" status: 200 len: 194 microversion: 2.1 time: 0.086138 Jun 25 21:15:03.623797 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2326/5072] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:03.633379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.635444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:03.640765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Getting quotas for project fe9b4f7c6bf847b98feca7f1340cd68d. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:03.644933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.645621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.646603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.647034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Getting quotas for user 58ca5a1327194ea6a6c6bba2810e2b25 and project fe9b4f7c6bf847b98feca7f1340cd68d. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:03.647506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.691489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Getting quotas for project fe9b4f7c6bf847b98feca7f1340cd68d. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:03.697626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Getting quotas for user 58ca5a1327194ea6a6c6bba2810e2b25 and project fe9b4f7c6bf847b98feca7f1340cd68d. Resources: {'server_groups'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:03.712693 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e7aa098-d030-42e4-81e6-c3c64ba00127 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] 10.222.0.39 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.634523 Jun 25 21:15:03.714685 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2747/5073] 10.222.0.39 () {62 vars in 1213 bytes} [Sat Jun 25 21:15:03 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:15:03.720043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.720563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:03.727844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.728313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.729165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.729799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.831307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lazy-loading 'services' on Instance uuid 48dd281f-fd81-4085-a04e-dcd8615cde4b {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:15:03.856402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:03.870727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92e38f5f-2145-45e2-b0b0-b330458a7ace tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.245403 Jun 25 21:15:03.871338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2327/5074] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:03.902732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b8260c9-998e-416f-9f31-7b0f0c8f0a8e tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.922579 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b8260c9-998e-416f-9f31-7b0f0c8f0a8e tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.032107 Jun 25 21:15:03.925941 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2328/5075] 10.222.0.39 () {60 vars in 1192 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:15:03.935155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.936865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:03.938896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-38fb012e-03dc-4132-8b91-19a450b7a3ae tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48" status: 202 len: 0 microversion: 2.1 time: 0.222551 Jun 25 21:15:03.939967 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2748/5076] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:15:03 2022] DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/2673345e-0e06-4c27-a28f-280fa1677d48 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:15:03.949995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb1a0102-517a-4ac0-a78c-b44c203dfaee tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:03.954752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.955218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.958175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:03.958624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:03.969536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb1a0102-517a-4ac0-a78c-b44c203dfaee tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] 10.222.0.39 "GET /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d" status: 200 len: 235 microversion: 2.64 time: 0.028143 Jun 25 21:15:03.971390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2749/5077] 10.222.0.39 () {60 vars in 1303 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d => generated 235 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:15:03.980746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce5a4c2c-f087-4e0d-b8b9-71080569f050 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:04.047350 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce5a4c2c-f087-4e0d-b8b9-71080569f050 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d" status: 204 len: 0 microversion: 2.64 time: 0.069805 Jun 25 21:15:04.048850 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2750/5078] 10.222.0.39 () {60 vars in 1306 bytes} [Sat Jun 25 21:15:03 2022] DELETE /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:15:04.060412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27995754-f08d-4769-be80-0d5d347c7d39 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:04.071726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-27995754-f08d-4769-be80-0d5d347c7d39 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] HTTP exception thrown: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. Jun 25 21:15:04.073265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27995754-f08d-4769-be80-0d5d347c7d39 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Request method failure captured: Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d HTTP/1.1 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rWP1Kx4tj4bM9vBwKW0DoBGH59UFswAPV1IrPuYT2Uy42w_KCDWL2qat-IqVGoBlo6DtlJlhtramwtGKcKarwyUksVf2i7Btht69Y6U2TxmFbPYlTYEegaQspuoc8OzWm5t0nlZ1PSlSiznAGeX_bbRelR9x5TM06e1-JWElbRSf0 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.64 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: fe9b4f7c6bf847b98feca7f1340cd68d Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerGroup264TestJSON-1121430131 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/fe9b4f7c6bf847b98feca7f1340cd68d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe9b4f7c6bf847b98feca7f1340cd68d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_fe9b4f7c6bf847b98feca7f1340cd68d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/fe9b4f7c6bf847b98feca7f1340cd68d"}]}] Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerGroup264TestJSON-1121430131 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: fe9b4f7c6bf847b98feca7f1340cd68d Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1121430131 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerGroup264TestJSON-1121430131-project Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 58ca5a1327194ea6a6c6bba2810e2b25 Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerGroup264TestJSON-1121430131-project Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6431d113-6eb1-4bf7-9607-fdd9651dd03d'} Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:04.076749 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. Jun 25 21:15:04.082479 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:04.084806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-27995754-f08d-4769-be80-0d5d347c7d39 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] Returning 404 to user: Instance group 6431d113-6eb1-4bf7-9607-fdd9651dd03d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:04.091537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-27995754-f08d-4769-be80-0d5d347c7d39 tempest-ServerGroup264TestJSON-1121430131 tempest-ServerGroup264TestJSON-1121430131-project] 10.222.0.39 "DELETE /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d" status: 404 len: 117 microversion: 2.64 time: 0.032110 Jun 25 21:15:04.092702 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2751/5079] 10.222.0.39 () {60 vars in 1306 bytes} [Sat Jun 25 21:15:04 2022] DELETE /compute/v2.1/os-server-groups/6431d113-6eb1-4bf7-9607-fdd9651dd03d => generated 117 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:15:04.094487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:04.096262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:04.097721 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6199e320-96ce-45c8-801e-208b0458aa2a tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 200 len: 1363 microversion: 2.47 time: 0.169307 Jun 25 21:15:04.099267 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2329/5080] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:03 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:04.760864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:04.761622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:04.782032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:04.782503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:04.783312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:04.786991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:04.896988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:04.897583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:04.905488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:04.905937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:04.921805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:04.922425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.054786 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e367ec7-41bb-4fb4-afa4-82b3d3abb2a2 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1833 microversion: 2.1 time: 0.298002 Jun 25 21:15:05.056120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2752/5081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:04 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1833 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:05.119437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:05.120119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: a5999ed4-914f-4896-b90d-464a4ca707c3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:05.123344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:05.131886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.137433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.138361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.138816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.193124 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] HTTP exception thrown: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Request method failure captured: Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 HTTP/1.1 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3qoNDttabv9UZr_ugXJ9y1BcFzdrDlwhaf6fkfhtIJDO2nyPAlaT0465iJLfoR-Ak1bw6wBH2cqgXNvCRkKk5Vv-neVk3LFWU28Ih5uVjCKYjSHt_pJcA7LjMveGgmcIn_yoWANjVxd0UYFzJ9Ar_emdjReXETrxceg-H3J6oaKNIY Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.47 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 19bc4d4b7a084a9994b64ccde8c9e254 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19bc4d4b7a084a9994b64ccde8c9e254"}]}] Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 19bc4d4b7a084a9994b64ccde8c9e254 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerShowV247Test-1112446131-project Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3af9776accbe457cab8de3da006d1be4 Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerShowV247Test-1112446131-project Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a5999ed4-914f-4896-b90d-464a4ca707c3'} Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:05.194741 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Returning 404 to user: Instance a5999ed4-914f-4896-b90d-464a4ca707c3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:05.200011 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47c4e76a-cf04-4f70-aa11-69a910aecee3 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3" status: 404 len: 111 microversion: 2.47 time: 0.082341 Jun 25 21:15:05.211254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2753/5082] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:05 2022] GET /compute/v2.1/servers/a5999ed4-914f-4896-b90d-464a4ca707c3 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:15:05.235311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:05.236572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:05.255951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.256392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.257394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.257998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.315607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:15:05.494591 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-753949bf-5d2f-4c64-b3e6-907af5dbd22e tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 204 len: 0 microversion: 2.47 time: 0.267889 Jun 25 21:15:05.497665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2754/5083] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:15:05 2022] DELETE /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:15:05.506953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:05.509327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:05.521738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.522310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.523198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:05.523703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:05.744554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:05.764292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:05.765026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a0bf396a-269a-44c9-b321-fcb9edfd7ac2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.871431 Jun 25 21:15:05.787831 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2330/5084] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:04 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:05.789304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:05.795718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:05.802304 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abed8eea-1f78-4ebe-b492-2558f5d23789 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 200 len: 1362 microversion: 2.47 time: 0.296844 Jun 25 21:15:05.815050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2755/5085] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:05 2022] GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:15:06.246603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:06.247122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:06.258145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.258615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.264932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.268342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.348121 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c33799c-cf33-4d34-b588-9f86639cba75 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/3f59969f-4d18-4fe6-8ebe-8f673720b514" status: 200 len: 194 microversion: 2.1 time: 0.109086 Jun 25 21:15:06.349265 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2331/5086] 10.222.0.39 () {58 vars in 1412 bytes} [Sat Jun 25 21:15:06 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/3f59969f-4d18-4fe6-8ebe-8f673720b514 => generated 194 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:06.359525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:06.360034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:06.362216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:06.375250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.375717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.380662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.381195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.607401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lazy-loading 'services' on Instance uuid 48dd281f-fd81-4085-a04e-dcd8615cde4b {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:15:06.757632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-642a8972-8718-41ae-a3a3-f799e2efabd6 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/3f59969f-4d18-4fe6-8ebe-8f673720b514" status: 202 len: 0 microversion: 2.1 time: 0.402310 Jun 25 21:15:06.758432 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2756/5087] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:15:06 2022] DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments/3f59969f-4d18-4fe6-8ebe-8f673720b514 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:15:06.784114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:06.785025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:06.797689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.801567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.804089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.806830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.827784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:06.828531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:06.854491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.855101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:06.859653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:06.860197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:07.214680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:07.231554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:07.233659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:07.235098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f157c70c-a364-4666-bb7a-1e0974051555 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 200 len: 1362 microversion: 2.47 time: 0.416687 Jun 25 21:15:07.238226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2757/5088] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:06 2022] GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:15:07.246139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:07.263795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f47b6cdc-56cf-42a1-8776-74b35266253f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.483737 Jun 25 21:15:07.264780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:07.274133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:07.275031 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2332/5089] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:06 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:07.281695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1428f257-be67-4dca-9c62-9e8150ddaf7c req-3ed26f6d-00b5-4140-9367-850748577431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:07.293818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1428f257-be67-4dca-9c62-9e8150ddaf7c req-3ed26f6d-00b5-4140-9367-850748577431 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:07.295051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1428f257-be67-4dca-9c62-9e8150ddaf7c req-3ed26f6d-00b5-4140-9367-850748577431 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:07.312376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1428f257-be67-4dca-9c62-9e8150ddaf7c req-3ed26f6d-00b5-4140-9367-850748577431 service nova] Creating event network-changed:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch1-master-1 Jun 25 21:15:07.333151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:07.334651 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1428f257-be67-4dca-9c62-9e8150ddaf7c req-3ed26f6d-00b5-4140-9367-850748577431 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057565 Jun 25 21:15:07.334988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:07.338405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2333/5090] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:07.339404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:07.342451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:07.387612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:15:07.578464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c85cb544-5622-448d-9bd6-8679484a48c5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 204 len: 0 microversion: 2.1 time: 0.338697 Jun 25 21:15:07.582723 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2758/5091] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:15:07 2022] DELETE /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:15:07.588670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:07.589387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:07.620217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:07.620873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:07.621727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:07.622172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.060632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:08.071894 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-255c2f42-eac4-4e5d-b399-5f77c0a87593 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1688 microversion: 2.1 time: 0.487811 Jun 25 21:15:08.086334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2334/5092] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:07 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1688 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:08.212197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:08.214203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:08.233994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.236960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.237718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.238152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.257137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:08.257770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:08.274539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.276557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.277422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.277865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.336988 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28266115-ccbf-49b3-9b26-b9a5033edadf tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126609 Jun 25 21:15:08.338055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2759/5093] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:15:08 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:15:08.342707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:08.343320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:08.355021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.355469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.355926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lazy-loading 'fault' on Instance uuid fb1e235b-7c6d-4338-8b13-fca2cc228342 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:15:08.363431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.363883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.364771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.365281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.366128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:08.451747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:08.461440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:08.463041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3af9776accbe457cab8de3da006d1be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bc4d4b7a084a9994b64ccde8c9e254', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:08.464403 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ac1fd672-d893-48ba-8803-53ee62b7c210 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 200 len: 1367 microversion: 2.47 time: 0.212031 Jun 25 21:15:08.465332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2335/5094] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:08 2022] GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:15:08.581358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:08.582705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:08.593724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.596705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.599135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.602425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.682200 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e8341b7f-9e1b-4dcb-98ed-47fb381b0cfa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105436 Jun 25 21:15:08.683699 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2336/5095] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:15:08 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:15:08.777418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:08.778039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:08.792711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.794069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.795230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:08.797463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:08.882021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:15:09.008340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:09.034142 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-010f51c9-92cd-429a-af88-aaf832963410 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.691959 Jun 25 21:15:09.046473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2760/5096] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:08 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:09.099648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:09.100690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:09.101514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ab2c9fc-d0fe-49af-a675-f711dd73d2f0 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 204 len: 0 microversion: 2.1 time: 0.325551 Jun 25 21:15:09.108172 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2337/5097] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:15:08 2022] DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:15:09.120199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.120990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.124098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.126854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:09.127574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:09.128223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.146984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.150606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.151659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.173542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.173732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:09.732761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:09.741467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0206cd8a-4799-46b4-8708-8b0a5c608d4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1688 microversion: 2.1 time: 0.651586 Jun 25 21:15:09.748915 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2761/5098] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:09 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1688 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:09.757076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:09.758908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] [instance: fb1e235b-7c6d-4338-8b13-fca2cc228342] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:09.775534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.781571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.782656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:09.783835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:09.842692 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] HTTP exception thrown: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Request method failure captured: Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 HTTP/1.1 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3qoNDttabv9UZr_ugXJ9y1BcFzdrDlwhaf6fkfhtIJDO2nyPAlaT0465iJLfoR-Ak1bw6wBH2cqgXNvCRkKk5Vv-neVk3LFWU28Ih5uVjCKYjSHt_pJcA7LjMveGgmcIn_yoWANjVxd0UYFzJ9Ar_emdjReXETrxceg-H3J6oaKNIY Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.47 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 19bc4d4b7a084a9994b64ccde8c9e254 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19bc4d4b7a084a9994b64ccde8c9e254"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19bc4d4b7a084a9994b64ccde8c9e254"}]}] Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 19bc4d4b7a084a9994b64ccde8c9e254 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerShowV247Test-1112446131 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerShowV247Test-1112446131-project Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3af9776accbe457cab8de3da006d1be4 Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerShowV247Test-1112446131-project Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'fb1e235b-7c6d-4338-8b13-fca2cc228342'} Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:09.844714 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. Jun 25 21:15:09.849211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:09.850985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] Returning 404 to user: Instance fb1e235b-7c6d-4338-8b13-fca2cc228342 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:09.852687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aaf992ef-5e0d-487c-ad91-852baa0860d9 tempest-ServerShowV247Test-1112446131 tempest-ServerShowV247Test-1112446131-project] 10.222.0.39 "GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342" status: 404 len: 111 microversion: 2.47 time: 0.101871 Jun 25 21:15:09.853642 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2762/5099] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:15:09 2022] GET /compute/v2.1/servers/fb1e235b-7c6d-4338-8b13-fca2cc228342 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:15:10.031530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:10.051376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:10.051997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:10.052290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-17eb4b4a-dd0f-470f-ac54-6d6296dc6beb tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1672 microversion: 2.1 time: 0.931745 Jun 25 21:15:10.053969 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2338/5100] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:09 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1672 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:10.072409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.072894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.078111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.078695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.543299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:10.551654 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79992784-550e-4565-ae8d-5ee2e40fefe7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.504122 Jun 25 21:15:10.558104 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2763/5101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:10 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:10.578585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-828ea4dd-27ab-4c9a-a24b-d34af1fe7af9 req-6ea76297-05f8-487c-b326-488c86ddc8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834f23f4-735f-4b1f-9682-da6f7f67bc79", "name": "network-vif-deleted", "tag": "97b4ca4f-4b8e-4229-b5df-f4271aa99ea5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:10.595120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-828ea4dd-27ab-4c9a-a24b-d34af1fe7af9 req-6ea76297-05f8-487c-b326-488c86ddc8a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.596121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-828ea4dd-27ab-4c9a-a24b-d34af1fe7af9 req-6ea76297-05f8-487c-b326-488c86ddc8a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.612146 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-828ea4dd-27ab-4c9a-a24b-d34af1fe7af9 req-6ea76297-05f8-487c-b326-488c86ddc8a1 service nova] Creating event network-vif-deleted:97b4ca4f-4b8e-4229-b5df-f4271aa99ea5 for instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 on nch1-master-1 Jun 25 21:15:10.619026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-828ea4dd-27ab-4c9a-a24b-d34af1fe7af9 req-6ea76297-05f8-487c-b326-488c86ddc8a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046789 Jun 25 21:15:10.621113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2339/5102] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:10.763306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:10.763971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:10.773428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.774149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.776265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.777671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.856519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:10.856976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:10.858582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lazy-loading 'fault' on Instance uuid 834f23f4-735f-4b1f-9682-da6f7f67bc79 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:15:10.969782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:10.978288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dde0195d-eef1-4309-93f2-5a3306689faa tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 200 len: 1356 microversion: 2.1 time: 0.219929 Jun 25 21:15:11.003606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2764/5103] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:10 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 1356 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:11.073630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:11.074432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:11.089755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:11.090231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:11.091041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:11.091489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:11.569461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:11.570460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:11.578254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:11.587223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:11.588754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:11.589417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:11.750896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:11.759827 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f559ceba-2903-444e-8abb-d9fb170d1b38 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1672 microversion: 2.1 time: 0.691755 Jun 25 21:15:11.766629 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2340/5104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:11 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1672 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:11.781230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f2f1b6e9-b354-4b22-9005-8e3c8bb91b32 req-831f154d-25ad-4eac-9ca0-03985b071d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a57a50f-f503-4fde-b5ae-7feccfd74520", "name": "network-vif-plugged", "status": "completed", "tag": "4f313a90-c23e-4c8f-9357-696f919c3d23"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:11.786648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:11.797458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f2f1b6e9-b354-4b22-9005-8e3c8bb91b32 req-831f154d-25ad-4eac-9ca0-03985b071d5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:11.798210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f2f1b6e9-b354-4b22-9005-8e3c8bb91b32 req-831f154d-25ad-4eac-9ca0-03985b071d5f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:11.813797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f2f1b6e9-b354-4b22-9005-8e3c8bb91b32 req-831f154d-25ad-4eac-9ca0-03985b071d5f service nova] Creating event network-vif-plugged:4f313a90-c23e-4c8f-9357-696f919c3d23 for instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 on nch2-master-1 Jun 25 21:15:11.822261 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f2f1b6e9-b354-4b22-9005-8e3c8bb91b32 req-831f154d-25ad-4eac-9ca0-03985b071d5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056126 Jun 25 21:15:11.829501 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2341/5105] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:11.874026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:11.890851 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a67c0ce-9246-41f4-aa17-50b2a20d539b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.324542 Jun 25 21:15:11.894142 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2765/5106] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:11 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:12.022173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:12.023170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 834f23f4-735f-4b1f-9682-da6f7f67bc79] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:12.032100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.032912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:12.034092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.034526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:12.050230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:12.052548 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] HTTP exception thrown: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Request method failure captured: Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 HTTP/1.1 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oppHqyw4EeiDOlRZTssoyBnr4Fvha7OXgevHlVi_-Lo2Z8Iq2TjW5wdFnz53ddpd5IgdjOJUqfVFPdDF6ZhziXRhgRcBe3CuTOpGuDMlw8qliC1Zo9kBCF2HZU7ccN2avzoIa76kuxMJD3iDdl2bUmkbWRqsMNWpNI2_jlCuUlHsA Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}] Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: aa2aaa29e0dd479283202bd6575b4c25 Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '834f23f4-735f-4b1f-9682-da6f7f67bc79'} Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:12.054826 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. Jun 25 21:15:12.060478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:15:12.062620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Returning 404 to user: Instance 834f23f4-735f-4b1f-9682-da6f7f67bc79 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:12.063741 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-96aff96e-5c02-4324-b05d-50097335be88 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79" status: 404 len: 111 microversion: 2.1 time: 0.046604 Jun 25 21:15:12.085481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2342/5107] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:12 2022] GET /compute/v2.1/servers/834f23f4-735f-4b1f-9682-da6f7f67bc79 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:15:12.781599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:12.782570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:12.795392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.795948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:12.799160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.799948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:12.909297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:12.909909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:12.917714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.918159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:12.918945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:12.919371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:13.079684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:13.111843 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb2c7526-d12c-4ef3-9052-4909bbb5d476 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1672 microversion: 2.1 time: 0.334417 Jun 25 21:15:13.112790 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2766/5108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:12 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1672 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:13.478813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:13.496951 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc52f5ac-9450-4f56-95e8-d447ebdd5f7b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1313 microversion: 2.1 time: 0.587625 Jun 25 21:15:13.498815 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2343/5109] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:12 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:13.902611 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b51c6a2d-8df2-44aa-9483-fef2744c8a44 req-d5f2f367-45f9-4a06-9314-ef20b8362ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48dd281f-fd81-4085-a04e-dcd8615cde4b", "name": "network-vif-deleted", "tag": "1aa34794-0b4f-4f73-b692-3a96cf87dccc"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:13.914513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=16 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:13.942437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b51c6a2d-8df2-44aa-9483-fef2744c8a44 req-d5f2f367-45f9-4a06-9314-ef20b8362ba3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:13.943198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b51c6a2d-8df2-44aa-9483-fef2744c8a44 req-d5f2f367-45f9-4a06-9314-ef20b8362ba3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:13.975909 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b51c6a2d-8df2-44aa-9483-fef2744c8a44 req-d5f2f367-45f9-4a06-9314-ef20b8362ba3 service nova] Creating event network-vif-deleted:1aa34794-0b4f-4f73-b692-3a96cf87dccc for instance 48dd281f-fd81-4085-a04e-dcd8615cde4b on nch2-master-1 Jun 25 21:15:13.995445 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b51c6a2d-8df2-44aa-9483-fef2744c8a44 req-d5f2f367-45f9-4a06-9314-ef20b8362ba3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099065 Jun 25 21:15:14.000524 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2767/5110] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:14.134442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:14.136498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:14.158890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:14.161064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:14.162108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:14.163156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:14.323563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bcfb45bd9404205aefe7d1d2b33cd25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b521724c3d49069bb1aa8c2428b75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:14.337099 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3401ef85-2862-4a15-ad9c-c3822d037289 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 200 len: 1321 microversion: 2.1 time: 0.205452 Jun 25 21:15:14.338050 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2344/5111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:14 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:14.519349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:14.520375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:14.530023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:14.530751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:14.531794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:14.532564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.016729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:15.025744 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22ed6f88-62ad-42e3-bf0c-faf874936e8a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1498 microversion: 2.1 time: 0.513706 Jun 25 21:15:15.041130 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2768/5112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:14 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1498 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:15.054446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:15.059827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:15.070058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.070516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.071302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.072153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.123051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lazy-loading 'flavor' on Instance uuid 3a57a50f-f503-4fde-b5ae-7feccfd74520 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:15:15.273719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0519ded7-f9fe-4933-90cb-25117425c3a2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "POST /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520/action" status: 200 len: 32 microversion: 2.1 time: 0.229657 Jun 25 21:15:15.275992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2769/5113] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:15:15 2022] POST /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:15:15.287030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:15.289198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:15.303211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.303677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.304513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.304948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.342703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f39bb88-46ea-4ed7-935a-434bae820e3e tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Calling method '.version_select at 0x7f984f2f5940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:15.624146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:15.637114 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-241643e8-c934-41df-9940-938a9967203e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.351548 Jun 25 21:15:15.638374 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2770/5114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:15 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:15.646344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:15.650624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:15.666528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.667300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.668252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:15.669517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:15.729588 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b HTTP/1.1 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '48dd281f-fd81-4085-a04e-dcd8615cde4b'} Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:15.733519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64f9cd9f-f267-4091-aed3-81e68b3dd424 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 404 len: 111 microversion: 2.1 time: 0.095060 Jun 25 21:15:15.739095 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2771/5115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:15 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:15:15.764161 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f39bb88-46ea-4ed7-935a-434bae820e3e tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f/defaults" status: 200 len: 371 microversion: 2.1 time: 1.014543 Jun 25 21:15:15.770323 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2345/5116] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:15:14 2022] GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f/defaults => generated 371 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:15.777986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ed3f893-e752-467c-b7ea-99a2d4169fca tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '.version_select at 0x7f984e684430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:15.784703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-accebd39-6706-4cdb-a64a-cc106ad737d0 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Calling method '.version_select at 0x7f984f2f5dc0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:15.836229 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ed3f893-e752-467c-b7ea-99a2d4169fca tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-930261041" status: 202 len: 0 microversion: 2.1 time: 0.088594 Jun 25 21:15:15.843214 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2772/5117] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:15:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-930261041 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:15:16.146387 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-accebd39-6706-4cdb-a64a-cc106ad737d0 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f" status: 200 len: 371 microversion: 2.1 time: 0.371975 Jun 25 21:15:16.148931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2346/5118] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:15:15 2022] GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f => generated 371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:16.183352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a65e5eef-081f-41d1-be29-64bea42e4bb6 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Calling method '.version_select at 0x7f984e693790>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:16.659818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:16.660446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:16.665637 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a65e5eef-081f-41d1-be29-64bea42e4bb6 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.502862 Jun 25 21:15:16.667629 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2773/5119] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:15:16 2022] GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f/defaults => generated 371 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:15:16.689011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-244f23bc-b92a-4656-8877-83522cba34b0 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Calling method '.version_select at 0x7f984e6d71f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:16.694667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:16.695135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:16.695928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:16.696369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:16.886418 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-244f23bc-b92a-4656-8877-83522cba34b0 tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f" status: 200 len: 371 microversion: 2.1 time: 0.208254 Jun 25 21:15:16.887792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2774/5120] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:15:16 2022] GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f => generated 371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:16.900581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d420693f-d3eb-4eb6-98aa-877e958c728d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] Calling method '.version_select at 0x7f984e696550>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:17.283104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d420693f-d3eb-4eb6-98aa-877e958c728d tempest-QuotasTestJSON-1125207445 tempest-QuotasTestJSON-1125207445-project] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f?user_id=75597b592cd74155892958c5de989c57" status: 200 len: 371 microversion: 2.1 time: 0.388411 Jun 25 21:15:17.286087 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2775/5121] 10.222.0.39 () {58 vars in 1322 bytes} [Sat Jun 25 21:15:16 2022] GET /compute/v2.1/os-quota-sets/14937708696448d9b414d5dbbe55377f?user_id=75597b592cd74155892958c5de989c57 => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:17.335180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:17.346502 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-097ab8f4-8f31-463f-bec4-2ee1398250b8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.694583 Jun 25 21:15:17.357515 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2347/5122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:16 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:18.364551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:18.366508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:18.383420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:18.383880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:18.385448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:18.385905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:18.823648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:18.842062 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5636d313-d59a-46de-a397-47907ea41991 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.481517 Jun 25 21:15:18.854476 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2776/5123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:18 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:19.862104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:19.863677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:19.875069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:19.876371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:19.877480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:19.878102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:20.139099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1f47f35-c68b-4f64-860f-d7246ced60a1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '.version_select at 0x7f984e693b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:20.203469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1f47f35-c68b-4f64-860f-d7246ced60a1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-801685190" status: 202 len: 0 microversion: 2.1 time: 0.069432 Jun 25 21:15:20.204235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2777/5124] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 21:15:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-801685190 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:15:20.214455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:20.215201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:20.224029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:20.224767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:20.225720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:20.226319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:20.255748 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b HTTP/1.1 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '48dd281f-fd81-4085-a04e-dcd8615cde4b'} Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:20.267283 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.274505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.278552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:20.285906 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af8f6056-e1c2-470f-b767-d78bcfb10baa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 404 len: 111 microversion: 2.1 time: 0.079586 Jun 25 21:15:20.289946 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2778/5125] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:15:20 2022] DELETE /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:15:20.295395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-602bb191-c9e6-4c2b-a179-a903b26f77a9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: .version_select at 0x7f984e684af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-668324150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkb0p53Fo18qFUb7LhZ77ckoVCFRZCigg+i049nxcqPipnZ2hlbtttMKrFaPHzC3uPklSqAGpZ7ecEU2pT4PufeLtyWT6k4om2XHmX1M3Ozbz+Q8Msz6hRc73g0gMNXAQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:20.315759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-602bb191-c9e6-4c2b-a179-a903b26f77a9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:20.323895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-602bb191-c9e6-4c2b-a179-a903b26f77a9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:20.377478 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-602bb191-c9e6-4c2b-a179-a903b26f77a9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.088886 Jun 25 21:15:20.383349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:20.388667 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2779/5126] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:15:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:20.396126 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a5c011f8-c921-44bc-b030-96e5f3e40196 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.538533 Jun 25 21:15:20.407533 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2348/5127] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:19 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:20.409048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:20.409700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 48dd281f-fd81-4085-a04e-dcd8615cde4b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:20.432812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:20.433695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:20.434863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:20.435703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:20.453348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b HTTP/1.1 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '48dd281f-fd81-4085-a04e-dcd8615cde4b'} Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:20.455493 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. Jun 25 21:15:20.460925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:20.465337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 48dd281f-fd81-4085-a04e-dcd8615cde4b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:20.466811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed3b174c-5da1-4e3b-863d-b071e17e63aa tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b" status: 404 len: 111 microversion: 2.1 time: 0.077067 Jun 25 21:15:20.468277 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2780/5128] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:20 2022] GET /compute/v2.1/servers/48dd281f-fd81-4085-a04e-dcd8615cde4b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:15:21.415738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:21.416798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:21.437015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.439359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.445208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.446039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.708952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:21.709869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:21.718471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.719006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.719872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.720379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.736139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 HTTP/1.1 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '26365fd2-d8a1-4c59-a24e-7ebc35313000'} Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:21.739446 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.744021 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.749334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:21.750483 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f338db8e-fa9f-4c61-a8d5-13c4c762c4dd tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 404 len: 111 microversion: 2.1 time: 0.048098 Jun 25 21:15:21.754456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2781/5129] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:15:21 2022] DELETE /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:15:21.762238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:21.763878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] [instance: 26365fd2-d8a1-4c59-a24e-7ebc35313000] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:21.773059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.773797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.775430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:21.776106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:21.804968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] HTTP exception thrown: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Request method failure captured: Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 HTTP/1.1 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3mrtGNjdn0ryFxdJgLOHSomEZLjJjD9blXET-Mvv4oOENNc6TIFoXrbD5fLHuckHmtg_RkdZaNkEn7-UxUzXJaZpMoPcvRkg7iqDVrVqBtEmLTpYuYmY5y4oMQ3Z6QNKn0Qt3nqyTdruGE3lDTKnahcxs5P6uHmSrA4ZDkrzYUjsLY Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a5b521724c3d49069bb1aa8c2428b75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a5b521724c3d49069bb1aa8c2428b75c"}]}] Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a5b521724c3d49069bb1aa8c2428b75c Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeTestJSON-931041757 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6bcfb45bd9404205aefe7d1d2b33cd25 Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeTestJSON-931041757-project Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '26365fd2-d8a1-4c59-a24e-7ebc35313000'} Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:15:21.807671 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] Returning 404 to user: Instance 26365fd2-d8a1-4c59-a24e-7ebc35313000 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:15:21.812170 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86ebe3ea-3832-427b-8020-4e45bb0a7492 tempest-AttachVolumeTestJSON-931041757 tempest-AttachVolumeTestJSON-931041757-project] 10.222.0.39 "GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000" status: 404 len: 111 microversion: 2.1 time: 0.053873 Jun 25 21:15:21.820281 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2782/5130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:21 2022] GET /compute/v2.1/servers/26365fd2-d8a1-4c59-a24e-7ebc35313000 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:15:22.013472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:22.046145 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d13f6b7-71c1-4466-b0f4-09c2e7ba028a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.635640 Jun 25 21:15:22.058818 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2349/5131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:21 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:23.066946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:23.067614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:23.083689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:23.085896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:23.087144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:23.088928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:23.120036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0cfdcc31-0e12-4979-92ae-a040ce29b1c7 tempest-ComputeTenantNetworksTest-1627147014 tempest-ComputeTenantNetworksTest-1627147014-project] Calling method '.version_select at 0x7f984e7803a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:23.599503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:23.613065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3d0147b-3cb4-4f88-8372-8695676f3600 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.550963 Jun 25 21:15:23.617076 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2350/5132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:23 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:24.015417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0cfdcc31-0e12-4979-92ae-a040ce29b1c7 tempest-ComputeTenantNetworksTest-1627147014 tempest-ComputeTenantNetworksTest-1627147014-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.098720 Jun 25 21:15:24.017127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2783/5133] 10.222.0.39 () {58 vars in 1157 bytes} [Sat Jun 25 21:15:22 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:24.027691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c26abe7a-3904-4759-ac1f-9cd06d5c605e tempest-ComputeTenantNetworksTest-1627147014 tempest-ComputeTenantNetworksTest-1627147014-project] Calling method '.version_select at 0x7f9861fd43a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:24.333410 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c26abe7a-3904-4759-ac1f-9cd06d5c605e tempest-ComputeTenantNetworksTest-1627147014 tempest-ComputeTenantNetworksTest-1627147014-project] 10.222.0.39 "GET /compute/v2.1/os-tenant-networks/6dc24f2a-ca13-4fde-bc77-30b53fdb5cdf" status: 200 len: 139 microversion: 2.1 time: 0.308630 Jun 25 21:15:24.340962 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2351/5134] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:15:24 2022] GET /compute/v2.1/os-tenant-networks/6dc24f2a-ca13-4fde-bc77-30b53fdb5cdf => generated 139 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:24.635926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:24.636773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:24.649010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:24.649535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:24.650898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:24.651351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:25.079195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:25.088170 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7af32ab7-fde1-4188-84de-d7961a00bf58 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.457557 Jun 25 21:15:25.112237 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2784/5135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:24 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:26.120620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:26.124498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:26.136384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:26.142062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:26.143103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:26.145095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:26.147132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:27.004717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:27.017073 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-618092aa-7dd4-4181-98b7-fc08b130299b tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.906201 Jun 25 21:15:27.017790 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2352/5136] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:26 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:28.035165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:28.035827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:28.051499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:28.051954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:28.058599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:28.060905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:28.500783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:28.514372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-630b64aa-85d5-4805-b320-2f3b8666d7c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.483511 Jun 25 21:15:28.515626 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2785/5137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:28 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:28.553599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1206419454", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "c2cb8bfa-1d07-437b-913e-d0d7fbfa2eea"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:28.576212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:28.629414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] validate_networks() for [('c2cb8bfa-1d07-437b-913e-d0d7fbfa2eea', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:29.440649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1857401822", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:29.547961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:30.339319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:30.340555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:30.341422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:30.342017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:30.343283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:30.346524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:30.357307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.357976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.359109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.360121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.387816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Getting quotas for project 731db346121f4334bd2e30ba916e85be. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:30.400005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Getting quotas for user 83af31935cce49c5b97d9dd2a4774e73 and project 731db346121f4334bd2e30ba916e85be. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:30.415473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:30.418478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:30.488069 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f49174ab-dee8-430a-a566-c97040313931 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.938874 Jun 25 21:15:30.489355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2353/5138] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:15:30.496709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:30.497604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:30.505999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.506467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.508371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.509555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.527209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:30.527692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:30.528302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:30.528773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:30.529193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:30.534282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:30.555075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.558703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.559587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:30.563178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:30.590950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:30.597205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:30.611704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:30.614646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:30.717120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7afbe910-d37d-47c1-a89c-b02908ef9c39 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.620280 Jun 25 21:15:30.718473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2786/5139] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:15:30.724594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c3919ec-da11-4d71-a7fe-4ff74e7fff9f tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:30.725533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c3919ec-da11-4d71-a7fe-4ff74e7fff9f tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:30.798437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c3919ec-da11-4d71-a7fe-4ff74e7fff9f tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:30.838176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c3919ec-da11-4d71-a7fe-4ff74e7fff9f tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1214 microversion: 2.1 time: 0.118123 Jun 25 21:15:30.843583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2787/5140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:30 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1214 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:30.850820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5eddd2f7-a36c-4149-afd9-2b72c0648ced tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:30.851453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5eddd2f7-a36c-4149-afd9-2b72c0648ced tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:30.964947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5eddd2f7-a36c-4149-afd9-2b72c0648ced tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:30.980082 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5eddd2f7-a36c-4149-afd9-2b72c0648ced tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1193 microversion: 2.1 time: 0.135361 Jun 25 21:15:30.981048 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2788/5141] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:30 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1193 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:31.046665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:31.056041 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3abe67b5-f682-4e36-ac33-3a67d1c595f8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.565461 Jun 25 21:15:31.061967 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2354/5142] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:30 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:31.860539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:31.861250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:31.905018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:31.905621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:31.906866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:31.907780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:31.997991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:31.998607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:32.012353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:32.020477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:32.021652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:32.022343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:32.202361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:32.214016 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9893932-d79d-4288-99e4-7f8dedbe017b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1266 microversion: 2.1 time: 0.357966 Jun 25 21:15:32.214880 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2789/5143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:31 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1266 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:32.232763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:32.233392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:32.255945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:32.257240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:32.260157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:32.260847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:32.328597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:32.575289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:32.592355 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c4ff683-7271-47e5-91de-7858e99ec4f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1197 microversion: 2.1 time: 0.598180 Jun 25 21:15:32.593451 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2355/5144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:31 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1197 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:32.799873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:32.812812 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce916a6a-55f7-4fab-b4c7-c7b61cd5a9de tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.596704 Jun 25 21:15:32.814062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2790/5145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:32 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:33.238923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:33.241097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:33.262431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.266672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.272037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.273134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.340835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:33.536360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:33.547652 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb269890-a407-4da8-b52d-ee80f7f0306a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1272 microversion: 2.1 time: 0.316881 Jun 25 21:15:33.549693 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2356/5146] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:33 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:33.613169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:33.614586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:33.630014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.630661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.633698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.635853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.830536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:33.831438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:33.843621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.844524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.845516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:33.847451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:33.902365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:33.913070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aae7902c-6f3e-4724-a602-14e154cd0bd6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1251 microversion: 2.1 time: 0.306394 Jun 25 21:15:33.919537 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2791/5147] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:33 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1251 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:34.567367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:34.568035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:34.576860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:34.582910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:34.587056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:34.589981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:34.790738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:34.833456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c7f60b5-605b-45f7-8e77-5ac9a660dab7 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1272 microversion: 2.1 time: 0.270030 Jun 25 21:15:34.849151 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2792/5148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:34 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1272 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:34.939668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:34.943141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:34.961878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:34.964540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:34.968707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:34.971164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:35.639885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:35.656321 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b675bf2-4313-4c77-8f8a-1f44fcc9af46 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 1.829474 Jun 25 21:15:35.657258 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2357/5149] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:33 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:35.830302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:35.839555 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcb42945-01f8-4bb7-9f20-4b4d677cfec2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 0.909260 Jun 25 21:15:35.848991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2793/5150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:34 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:35.854039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:35.854653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:35.869531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:35.878522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:35.885403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:35.886160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:36.607377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:36.620914 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0fd4d6e-23ca-4a51-b794-db69bfa06027 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.768363 Jun 25 21:15:36.634339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2358/5151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:35 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:36.673772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:36.674457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:36.692329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:36.693010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:36.694144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:36.694765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:36.865931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:36.866805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:36.877788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:36.882726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:36.883750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:36.884279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:37.148325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:37.167184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc832703-fb21-40bb-8396-2e27ab8fb5ba tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.497098 Jun 25 21:15:37.180888 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2794/5152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:36 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:37.189928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0619879d-f3bd-416f-98d8-8a5a62a715d1 req-e7587f0f-f7cf-4298-80da-17a1c438891e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ec2c2b-3958-48a4-b84e-d4c56c30e03e", "tag": "4bfeec90-381f-4bb3-a1b9-2f5b2225edd3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:37.205966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0619879d-f3bd-416f-98d8-8a5a62a715d1 req-e7587f0f-f7cf-4298-80da-17a1c438891e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:37.213177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0619879d-f3bd-416f-98d8-8a5a62a715d1 req-e7587f0f-f7cf-4298-80da-17a1c438891e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:37.248863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0619879d-f3bd-416f-98d8-8a5a62a715d1 req-e7587f0f-f7cf-4298-80da-17a1c438891e service nova] Creating event network-changed:4bfeec90-381f-4bb3-a1b9-2f5b2225edd3 for instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e on nch1-master-1 Jun 25 21:15:37.263141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0619879d-f3bd-416f-98d8-8a5a62a715d1 req-e7587f0f-f7cf-4298-80da-17a1c438891e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080574 Jun 25 21:15:37.266976 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2795/5153] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:37.641036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:37.641754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:37.653261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:37.653734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:37.654506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:37.655047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:37.923956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:37.935538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a889f18-8cd5-4325-a39f-52695702ab1e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.298619 Jun 25 21:15:37.936155 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2796/5154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:37 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:38.149239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:38.168068 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7509f6d-284b-429b-8b1c-6f96c52f72f6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 1.306170 Jun 25 21:15:38.173145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2359/5155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:36 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:38.185485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:38.186734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:38.196213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:38.196949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:38.198594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:38.199651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:38.609954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:38.624339 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-922f3ec1-ed10-4051-81c2-45b2c8cd05b9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.442204 Jun 25 21:15:38.640648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2797/5156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:38 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:38.956344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:38.956983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:38.978217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:38.981135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:38.982597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:38.983641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:39.188572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:39.189197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:39.204511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:39.204511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:39.205015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:39.205457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:39.632917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:39.646727 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48eab0b7-479b-45c4-816f-d960d584f237 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.696963 Jun 25 21:15:39.658962 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2360/5157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:38 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:39.664303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:39.669534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:39.679839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:39.681243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:39.682338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:39.682939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:39.759621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:39.782445 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6fbb091f-f315-4a77-bbab-ed9fa422d8be tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 0.589857 Jun 25 21:15:39.783280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2798/5158] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:39 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:40.374442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:40.409199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:40.548175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:40.558660 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e52f942-f791-4a8c-aae3-d8393aaa5b70 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.897845 Jun 25 21:15:40.561619 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2361/5159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:39 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:40.667626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:40.668915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:40.681572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:40.685053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:40.693679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:40.697593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:40.698646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:40.805540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:40.807779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:40.822908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:40.823810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:40.826460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:40.829342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:40.980607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:41.214100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:41.246495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fba4b58-ae9a-4660-9e42-be8210bbfd74 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.573097 Jun 25 21:15:41.247235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2799/5160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:40 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:41.464218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-82d4d15a-441c-4308-b649-8000c5a0e246 req-f5fa59f6-9c5c-4f95-92e1-c65a6e92b0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a172d8f-2ddd-4e08-9981-7bb893f7576f", "tag": "349625a2-5d2a-4861-9ba8-aa58a99d0b78"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:41.482222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82d4d15a-441c-4308-b649-8000c5a0e246 req-f5fa59f6-9c5c-4f95-92e1-c65a6e92b0a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:41.485616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82d4d15a-441c-4308-b649-8000c5a0e246 req-f5fa59f6-9c5c-4f95-92e1-c65a6e92b0a1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:41.518102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-82d4d15a-441c-4308-b649-8000c5a0e246 req-f5fa59f6-9c5c-4f95-92e1-c65a6e92b0a1 service nova] Creating event network-changed:349625a2-5d2a-4861-9ba8-aa58a99d0b78 for instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f on nch1-master-1 Jun 25 21:15:41.527797 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-82d4d15a-441c-4308-b649-8000c5a0e246 req-f5fa59f6-9c5c-4f95-92e1-c65a6e92b0a1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068366 Jun 25 21:15:41.528942 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2800/5161] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:41.584511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:41.585230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:41.600579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:41.600909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:41.601709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:41.602215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:41.621766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:41.654661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-897bd06d-18f6-4dd7-a60d-e390f3fe2da7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 0.854283 Jun 25 21:15:41.667641 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2362/5162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:40 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:15:42.018598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:42.031201 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64f173e0-95eb-40a3-b588-6c5afff82e8e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.451243 Jun 25 21:15:42.032127 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2801/5163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:41 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:42.270349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:42.270969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:42.299738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:42.300560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:42.302075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:42.302736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:42.675598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:42.676516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:42.685803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:42.689292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:42.690267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:42.692486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:43.525333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:43.533788 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e21a2c1-04cf-4e6a-9295-e30518a3336b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 1.270890 Jun 25 21:15:43.537344 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2363/5164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:42 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:43.550526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:43.551535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:43.561636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:43.573215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:43.575014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:43.575630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:43.861430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:43.871035 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6877f39-8636-4c5e-8ce3-ef46a33f6384 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 1.199441 Jun 25 21:15:43.875709 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2802/5165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:42 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:43.880729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b541168c-90b2-4876-8d1c-146f55121b89 req-e4ecd0b6-000a-4605-82ae-01afbe338471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ec2c2b-3958-48a4-b84e-d4c56c30e03e", "name": "network-vif-plugged", "status": "completed", "tag": "4bfeec90-381f-4bb3-a1b9-2f5b2225edd3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:43.900093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b541168c-90b2-4876-8d1c-146f55121b89 req-e4ecd0b6-000a-4605-82ae-01afbe338471 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:43.902434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b541168c-90b2-4876-8d1c-146f55121b89 req-e4ecd0b6-000a-4605-82ae-01afbe338471 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:43.931057 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b541168c-90b2-4876-8d1c-146f55121b89 req-e4ecd0b6-000a-4605-82ae-01afbe338471 service nova] Creating event network-vif-plugged:4bfeec90-381f-4bb3-a1b9-2f5b2225edd3 for instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e on nch1-master-1 Jun 25 21:15:43.948016 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b541168c-90b2-4876-8d1c-146f55121b89 req-e4ecd0b6-000a-4605-82ae-01afbe338471 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070681 Jun 25 21:15:43.949032 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2803/5166] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:44.103746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:44.112649 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa188069-7652-4dc3-bc19-22dc35dba041 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.573434 Jun 25 21:15:44.121356 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2364/5167] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:43 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:44.555468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:44.556444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:44.563888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:44.568684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:44.576841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:44.578707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:44.891484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:44.892685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:44.901468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:44.920531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:44.921484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:44.921924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:45.015972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:45.029814 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b96da43-bf37-43ee-91bf-bb9131ba7f58 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.479384 Jun 25 21:15:45.037392 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2804/5168] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:44 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:45.144981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:45.145831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:45.160265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:45.163798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:45.165084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:45.167509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:45.556519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:45.570426 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-844c8194-d69c-43cc-8c64-bd3825377a91 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1293 microversion: 2.1 time: 0.682919 Jun 25 21:15:45.571886 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2365/5169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:44 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1293 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:45.607737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:45.620375 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a556cbf-5cff-4c54-8f29-d50ca29105e8 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1504 microversion: 2.1 time: 0.485295 Jun 25 21:15:45.629997 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2805/5170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:45 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1504 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:46.061484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:46.062303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:46.094310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:46.095173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:46.097129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:46.098221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:46.590525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:46.591374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:46.617930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:46.620453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:46.626296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:46.630671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:46.972158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:46.980841 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57ba537c-c891-475a-8fb0-b6904c09b405 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1473 microversion: 2.1 time: 0.396863 Jun 25 21:15:47.007492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2806/5171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:46 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:47.031386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:47.032015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:47.101798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:47.102369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:47.103212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:47.103653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:47.108894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:47.116757 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dfc7dd02-292e-409e-95a8-8316387a6215 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 1.066670 Jun 25 21:15:47.119478 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2366/5172] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:46 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:47.516025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:47.524490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5d3d526d-58fa-443e-a4f5-500496a4b351 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1484 microversion: 2.1 time: 0.512782 Jun 25 21:15:47.525429 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2807/5173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:47 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1484 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:47.528654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35c85761-3792-4fd4-8faf-7447735817e6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: .version_select at 0x7f984f2f5a60>, body: {"keypair": {"name": "tempest-keypair-2069586746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhFOEpXCTaq4xgJtDXbF8Uwwb4TTVEnI/8SyLYTXctnUHst4jGtcwBbBS62mU/TcUX3y+ULrILxdEWzwtGa1v7BAbahO0tVEqoJZu3pkT0t7Ads4oX9qoe3HHI0ISpoGQ=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:47.531633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1535205856", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:47.554636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-35c85761-3792-4fd4-8faf-7447735817e6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:47.597400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-35c85761-3792-4fd4-8faf-7447735817e6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:47.651938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:47.704545 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35c85761-3792-4fd4-8faf-7447735817e6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.583642 Jun 25 21:15:47.705176 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2367/5174] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:15:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:47.710821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1416928865", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:47.826969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] validate_networks() for [('266d1588-40d0-4a62-9bb5-f34a7c7d3d85', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:48.373140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:48.373576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:48.374063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:48.374486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:48.374909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:48.402203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:48.402792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:48.415458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:48.415921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:48.498695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:48.513731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:48.566060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:48.568350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:48.690686 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-730eca9b-b2fb-4863-8517-398d0079a8a4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163791 Jun 25 21:15:48.698845 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2808/5175] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:15:48.705666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-202434043", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "ff06c17c-5f66-4a00-b991-ca3dcc45232f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-668324150", "security_groups": [{"name": "tempest-secgroup-smoke-907031763"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:49.002822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] validate_networks() for [('ff06c17c-5f66-4a00-b991-ca3dcc45232f', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:49.306805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:49.307347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:49.307688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:49.308915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:49.309497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:49.337014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:49.341078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:49.342392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:49.343028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:49.414556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Getting quotas for project 0a0dcb1380ad41328b6779588f0e91f6. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:49.428319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Getting quotas for user 1554f1d20e344432b617857d279f6d37 and project 0a0dcb1380ad41328b6779588f0e91f6. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:49.462315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:49.469505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:49.572880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90ff0b42-7c24-4530-a99e-4e1fb0c700df tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.866327 Jun 25 21:15:49.573800 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2368/5176] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:15:49.579421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:49.580277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:49.618043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:49.618332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:49.625579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:49.638562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:50.419168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:50.419754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:50.420320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:50.420854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:50.421575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:50.442278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:50.442949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:50.444201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:50.452416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:50.500072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:50.513806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:50.546474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:50.549357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:50.658809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c32a3ec-8d11-45f5-a159-2cc683595df9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.957687 Jun 25 21:15:50.664804 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2809/5177] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:15:50.675875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:50.681518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:50.698040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:50.702187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:50.703213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:50.703839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:50.710366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:50.780986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:15:50.838250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:50.846335 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f237c356-cc88-49ef-a42e-a1abc509f97e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 1.271452 Jun 25 21:15:50.846955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2369/5178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:49 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:51.056416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:51.074308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-416316a1-03e0-4fa7-b008-544d74607bdb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 204 len: 0 microversion: 2.1 time: 0.405521 Jun 25 21:15:51.074935 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2810/5179] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:15:50 2022] DELETE /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:15:51.094104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:51.094889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:51.128976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:51.131830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:51.133358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:51.135245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:51.625434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85549320-dba7-49c7-908a-03daaeaa0309 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: .version_select at 0x7f984f295a60>, body: {"keypair": {"name": "tempest-keypair-1869360770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8K4Zm7vqRvUJsNgAMra+05BAiCkVt0tkN/ALVdz3MBvslwH/mU2U31mPPBAXvmDzLMLy6ee641gv0C9IJtt5WTQ4hrtU1iAay+GjkjiI2fb3V4shpmnfK1F3NnoQrClA=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:51.675677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-85549320-dba7-49c7-908a-03daaeaa0309 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:51.689452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-85549320-dba7-49c7-908a-03daaeaa0309 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for user c845f86f1b6244f7a53996329294f2cd and project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:51.748548 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85549320-dba7-49c7-908a-03daaeaa0309 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.900505 Jun 25 21:15:51.749592 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2370/5180] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 21:15:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 902 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:15:51.764898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:51.765836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:51.781964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:51.782622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:51.784751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:51.785372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:52.004157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:52.016364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ccdd6f9-b9b0-4c35-802e-372eefe779c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1266 microversion: 2.1 time: 0.934397 Jun 25 21:15:52.016984 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2811/5181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:51 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1266 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:52.030743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:52.031571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:52.047295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:52.048040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:52.049065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:52.052469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:52.328932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:52.338755 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22b20155-3e10-4afb-a215-cbe4df9ea2c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1267 microversion: 2.1 time: 0.320673 Jun 25 21:15:52.352935 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2812/5182] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:52 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1267 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:52.358357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:52.359383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:52.374591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:52.375276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:52.376753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:52.377439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:52.463094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:52.478419 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6c8b54a-9a78-4e97-a2c6-b13935a69752 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1269 microversion: 2.1 time: 0.723017 Jun 25 21:15:52.479336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2371/5183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:51 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1269 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:52.743536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:52.754356 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-66051638-45a0-41c0-9ef6-42c32483a547 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.399794 Jun 25 21:15:52.754978 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2813/5184] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:52 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:53.033371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:53.038435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:53.065619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.066596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.067935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.068849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.372313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:53.374021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:53.391555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.392588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.393729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.394394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.579466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:53.588618 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e97f420c-c604-4cd8-9a3e-f3fcd39f02d7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1267 microversion: 2.1 time: 0.222803 Jun 25 21:15:53.594139 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2814/5185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:53 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:53.606549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:53.607957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:53.628048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.628543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.635354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.635939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.803383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:53.811538 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8bf6aaa0-76f5-4e28-a278-8ff0504ff609 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1323 microversion: 2.1 time: 0.216156 Jun 25 21:15:53.812295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2815/5186] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:53 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:53.826725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:53.827555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:53.835495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.836238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:53.837248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:53.837853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:54.239709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:54.274820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73bb9adf-bf31-4062-95fd-497aedfcada6 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.447881 Jun 25 21:15:54.291352 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2816/5187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:53 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:54.612325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:54.612976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:54.625726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:54.632896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:54.633893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:54.634342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:54.780102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:54.798039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c6fa6f3-4c18-457d-898b-976ecc3a2d70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1267 microversion: 2.1 time: 0.190555 Jun 25 21:15:54.810375 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2817/5188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:54 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:54.817307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2002518227", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15adaf3c-53a3-47ee-a619-76a812ef788d"}], "security_groups": [{"name": "tempest-securitygroup--732437906"}], "key_name": "tempest-keypair-2069586746", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:54.945359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:54.967405 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ada17e9c-9c1b-487c-b6d4-afb886784c37 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 1.938102 Jun 25 21:15:54.969343 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2372/5189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:53 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:54.998222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:54.999091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:55.016403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.017143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.018708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.019499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.141106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] validate_networks() for [('15adaf3c-53a3-47ee-a619-76a812ef788d', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:55.191182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:55.213175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12a86b69-0e1c-4220-80d0-a749949f3829 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1323 microversion: 2.1 time: 0.237283 Jun 25 21:15:55.220025 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2373/5190] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:54 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:55.323622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:55.324631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:55.344216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.345662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.346686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.347794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.854203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:55.864462 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f75f45e0-2b2b-431a-b7ac-5400151260c1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.570602 Jun 25 21:15:55.868559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2374/5191] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:55 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:55.874114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-923e052a-deb2-4079-b7b1-8c1ac115fe0e req-7b62cac7-e589-4a44-bcef-af411bef9a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c5b032-40de-4d58-be36-ebff5ed40c57", "tag": "b656b12a-0f60-4045-b263-c168401086bf"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:55.902456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-923e052a-deb2-4079-b7b1-8c1ac115fe0e req-7b62cac7-e589-4a44-bcef-af411bef9a6f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.907385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-923e052a-deb2-4079-b7b1-8c1ac115fe0e req-7b62cac7-e589-4a44-bcef-af411bef9a6f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.927162 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-923e052a-deb2-4079-b7b1-8c1ac115fe0e req-7b62cac7-e589-4a44-bcef-af411bef9a6f service nova] Creating event network-changed:b656b12a-0f60-4045-b263-c168401086bf for instance 99c5b032-40de-4d58-be36-ebff5ed40c57 on nch2-master-1 Jun 25 21:15:55.941906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-923e052a-deb2-4079-b7b1-8c1ac115fe0e req-7b62cac7-e589-4a44-bcef-af411bef9a6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071702 Jun 25 21:15:55.942904 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2375/5192] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:55.952660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:55.959277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:55.967382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.977994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:55.993074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:55.993668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:56.034083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:56.396706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:56.412081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20ed82b1-e696-4697-9c82-12beb130f5a8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1309 microversion: 2.1 time: 0.467844 Jun 25 21:15:56.413086 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2376/5193] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:55 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1309 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:56.427485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:56.428391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:56.435469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:56.436217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:56.437203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:56.437865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.277933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:57.290467 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5eb523f4-70ef-42be-94cb-408faa9dba41 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.866851 Jun 25 21:15:57.291072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2377/5194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:56 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:57.324213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:57.326233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:57.335834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.337153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.338145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.338805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.397733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:15:57.399015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:15:57.400632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:15:57.401324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:15:57.401950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:15:57.413743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.414766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.415760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.419874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.446237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:15:57.458049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:15:57.478419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:15:57.481086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:15:57.552281 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32916c28-a8dd-407d-a478-9a873e996007 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.739816 Jun 25 21:15:57.553397 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2818/5195] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:15:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:15:57.564349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c3af7864-7c34-466c-9324-42975a148104 req-027a844f-63d5-4ee3-b73c-d25cdde0b5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a172d8f-2ddd-4e08-9981-7bb893f7576f", "name": "network-vif-plugged", "status": "completed", "tag": "349625a2-5d2a-4861-9ba8-aa58a99d0b78"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:57.576066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c3af7864-7c34-466c-9324-42975a148104 req-027a844f-63d5-4ee3-b73c-d25cdde0b5b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.577577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c3af7864-7c34-466c-9324-42975a148104 req-027a844f-63d5-4ee3-b73c-d25cdde0b5b5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.593394 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c3af7864-7c34-466c-9324-42975a148104 req-027a844f-63d5-4ee3-b73c-d25cdde0b5b5 service nova] Creating event network-vif-plugged:349625a2-5d2a-4861-9ba8-aa58a99d0b78 for instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f on nch1-master-1 Jun 25 21:15:57.600204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c3af7864-7c34-466c-9324-42975a148104 req-027a844f-63d5-4ee3-b73c-d25cdde0b5b5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039992 Jun 25 21:15:57.601687 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2819/5196] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:57.608844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:57.610157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:57.618692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.619395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.620567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.622161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.799082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:57.823974 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7b0b863d-284d-4b3b-9eea-1c7d7eac7a06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.509165 Jun 25 21:15:57.828145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2378/5197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:57 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:57.833282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:57.838908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:57.860169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:57.878958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.890969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:57.894898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:57.895504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:58.452551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:58.481342 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fd37b53-0044-410f-80c7-08ff06ee8f44 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.878149 Jun 25 21:15:58.481929 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2820/5198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:57 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:58.501753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30f948cb-4012-4590-972e-5f312c6480d0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:58.503993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30f948cb-4012-4590-972e-5f312c6480d0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:58.567094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:58.575166 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-caf9dc34-cc20-4e45-8f0b-639c02137ae3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1309 microversion: 2.1 time: 0.745666 Jun 25 21:15:58.589580 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2379/5199] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:57 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1309 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:58.595152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:58.595586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:58.607610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:58.608273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:58.609285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:58.609895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:58.980320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30f948cb-4012-4590-972e-5f312c6480d0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:58.990398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:58.994896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30f948cb-4012-4590-972e-5f312c6480d0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1242 microversion: 2.1 time: 0.509719 Jun 25 21:15:58.995947 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2821/5200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:58 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1242 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:59.000608 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd844311-29ab-4d45-9fbd-3b9d053daed9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.409516 Jun 25 21:15:59.003624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:59.004255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:59.011672 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2380/5201] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:58 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:59.036373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.055242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.056113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.056609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.057591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c9642556-7287-40f0-b0ee-ad8ed76b207b req-c1aa4cfa-804d-4823-9f40-20b8c625cce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca40e812-49b8-4fe6-b362-6a1182fc3731", "tag": "71bd5819-4974-4d4a-a69d-124ec9ca945b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:59.069178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c9642556-7287-40f0-b0ee-ad8ed76b207b req-c1aa4cfa-804d-4823-9f40-20b8c625cce0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.069723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c9642556-7287-40f0-b0ee-ad8ed76b207b req-c1aa4cfa-804d-4823-9f40-20b8c625cce0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.100126 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c9642556-7287-40f0-b0ee-ad8ed76b207b req-c1aa4cfa-804d-4823-9f40-20b8c625cce0 service nova] Creating event network-changed:71bd5819-4974-4d4a-a69d-124ec9ca945b for instance ca40e812-49b8-4fe6-b362-6a1182fc3731 on nch2-master-1 Jun 25 21:15:59.109688 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c9642556-7287-40f0-b0ee-ad8ed76b207b req-c1aa4cfa-804d-4823-9f40-20b8c625cce0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056898 Jun 25 21:15:59.113837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2381/5202] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:15:59.194366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-155125761", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "086f218c-0564-4b53-bd70-7d37fb224369"}], "security_groups": [{"name": "tempest-securitygroup--576836238"}], "key_name": "tempest-keypair-1869360770", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:15:59.373298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:15:59.389587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:59.408104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a50dd2c0-ad18-43df-bb7f-8dcf19bd1d6b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.403264 Jun 25 21:15:59.435929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] validate_networks() for [('086f218c-0564-4b53-bd70-7d37fb224369', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:15:59.437560 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2822/5203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:58 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:59.499860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:59.501637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:59.518877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.519662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.520892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.521690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.704574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:59.713813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09155b0d-0d28-438e-ae9d-3d95fbc10035 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1314 microversion: 2.1 time: 0.218184 Jun 25 21:15:59.715490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2823/5204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:59 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:15:59.720480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:15:59.721051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:15:59.727355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.727805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.728814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:15:59.729258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:15:59.937437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:15:59.946031 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aac88c47-2301-4da3-9172-f9c15b1ab2eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1309 microversion: 2.1 time: 0.228767 Jun 25 21:15:59.959569 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2824/5205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:15:59 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1309 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:00.017770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.018887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.034146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.037822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.038962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.041127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.106301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:00.107394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:00.108051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:00.108671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:00.109391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:00.122515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.125086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.126322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.126946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.151603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.166917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83e1a4d8-73b8-4107-9749-776b3d9c4eca tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1312 microversion: 2.1 time: 0.152017 Jun 25 21:16:00.180531 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2825/5206] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:00.190000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:00.190851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.191370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.197740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.199128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.199964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.200453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.205583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for user c845f86f1b6244f7a53996329294f2cd and project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:00.225917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:00.230041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:00.302636 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3a693be1-6f8c-44ec-915a-3bd92c91795c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.113415 Jun 25 21:16:00.304089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2382/5207] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:15:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 25 21:16:00.327367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.331909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.466205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.478225 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-308a5ca1-3387-4d76-88a2-ddef27952007 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.296461 Jun 25 21:16:00.478832 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2826/5208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:00.491063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.491823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.514334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.514938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.515737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.516178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.531999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:00.575606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.585663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.587550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.588861 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-26ccf6a1-a528-44df-8a67-ed0e7420ee4a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1281 microversion: 2.20 time: 0.271508 Jun 25 21:16:00.590024 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2383/5209] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:00.734271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.735377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.744529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.744529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.744529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.744964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.775243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:00.785585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4eeaf623-6cef-4881-8049-6b7e1917243e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.305680 Jun 25 21:16:00.787980 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2827/5210] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:00.965476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:00.966112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:00.976934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.977393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:00.978449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:00.978891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.047658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.059670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-080371fa-9b7c-4b50-a61d-ff8e4c8e1c34 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1498 microversion: 2.1 time: 0.330289 Jun 25 21:16:01.061138 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2384/5211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1498 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:01.167097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d913665b-2360-41ae-b353-62774441914a req-0f6124b2-7c50-4150-aad1-5efca08aaa59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:01.189405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d913665b-2360-41ae-b353-62774441914a req-0f6124b2-7c50-4150-aad1-5efca08aaa59 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.190107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d913665b-2360-41ae-b353-62774441914a req-0f6124b2-7c50-4150-aad1-5efca08aaa59 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.206250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d913665b-2360-41ae-b353-62774441914a req-0f6124b2-7c50-4150-aad1-5efca08aaa59 service nova] Creating event network-changed:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:16:01.231361 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d913665b-2360-41ae-b353-62774441914a req-0f6124b2-7c50-4150-aad1-5efca08aaa59 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069479 Jun 25 21:16:01.233004 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2385/5212] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:01.240130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:01.241473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:01.258780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.259243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.260275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.260749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.378475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.387640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99490726-a9eb-4999-9480-c90b580267f3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1300 microversion: 2.1 time: 0.152601 Jun 25 21:16:01.393427 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2386/5213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:01 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:01.417002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.426850 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d20ecb7-7a97-4e45-9af7-40cb8115e56a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1309 microversion: 2.1 time: 0.468521 Jun 25 21:16:01.427776 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2828/5214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:00 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1309 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:01.504795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:01.505825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:01.513171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.519864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.520786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.521233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.571976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:01.572590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:01.584994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.585760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.586752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.587328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.639387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:01.801752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e7c4ee3-a8cb-48b5-8ee8-26160772b73a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 204 len: 0 microversion: 2.1 time: 0.237509 Jun 25 21:16:01.802298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2829/5215] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:01 2022] DELETE /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:16:01.819740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:01.823948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:01.843537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.844020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.845014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:01.845456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:01.980282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.993185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.994718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:01.995875 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3136bd4d-79dd-4493-a5cd-4849a12df367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1351 microversion: 2.20 time: 0.186121 Jun 25 21:16:02.002135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:02.005871 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2830/5216] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:01 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:02.016912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba78407d-3a86-4848-9fe3-80fbe65f6c24 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.525689 Jun 25 21:16:02.020087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2387/5217] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:01 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:02.023857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:02.024726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:02.032474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:02.033074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:02.040065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.040913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.041946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.042677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.044077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.044677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.045367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.045809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.347297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:02.351435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:02.363450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd479403-a7b7-4923-9946-5918b67a02b7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.356292 Jun 25 21:16:02.365225 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2831/5218] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:02 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:02.371686 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-956658f8-761a-4893-8d23-653661ce6bb3 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1504 microversion: 2.1 time: 0.348024 Jun 25 21:16:02.372961 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2388/5219] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:02 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1504 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:02.410522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:02.411289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:02.419854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.420366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.421301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.421834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.447991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:02.449062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:02.455942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.456792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.458202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:02.459339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:02.667055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:02.676821 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-208f9ca6-4b22-44c6-989d-575a3d4320bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.271522 Jun 25 21:16:02.677803 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2832/5220] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:02 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:02.725224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:02.738973 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dc858866-9a45-45df-bf96-4479ee8ed7c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1309 microversion: 2.1 time: 0.298252 Jun 25 21:16:02.750172 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2389/5221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:02 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1309 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:03.015534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:03.016533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:03.023343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.023788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.024814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.025530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.039677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:03.041470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:03.064972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.065469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.070312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.071044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.171854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:03.181905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:03.183603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:03.184811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c10537fe-5957-4fae-9449-4b1e9e39882f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1339 microversion: 2.20 time: 0.173291 Jun 25 21:16:03.198913 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2833/5222] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:03 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:03.382610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:03.383679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:03.384537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:03.397745 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d686c9e-2f03-40c5-9599-6e628c6d067a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.363971 Jun 25 21:16:03.410932 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2390/5223] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:03 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:03.411349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.411349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.411349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.411349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.411710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:03.411800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:03.426624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.427075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.427843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.439147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.880296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:03.889827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c14020c-06d2-4ec6-8177-4d28162f454b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.510880 Jun 25 21:16:03.900464 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2834/5224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:03 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:03.905877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:03.907009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:03.914605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.915524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:03.916556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:03.917210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.371739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:04.389065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aa08f524-a354-40a4-ae4a-877aa6e4589a tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1504 microversion: 2.1 time: 0.984836 Jun 25 21:16:04.404553 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2391/5225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:03 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1504 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:04.411442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:04.412540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:04.422209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.423001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.424079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.425072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.530009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:04.540682 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a0739647-4392-481c-98d7-dbfd16594ada tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1211 microversion: 2.1 time: 0.134206 Jun 25 21:16:04.541491 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2392/5226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:04 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:04.547553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:04.548513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:04.556861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.557419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.558297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.558811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.760342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:04.778342 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-437be7bd-ccd9-4c95-b1e7-7c14d3516901 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.876223 Jun 25 21:16:04.783268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2835/5227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:03 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:04.803258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:04.807341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:04.828912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.832285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:04.835056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:04.836710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.022346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.032866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.034893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.037411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b2669d2-cba4-4d43-97a3-a46bc9272a3d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.494773 Jun 25 21:16:05.048786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2393/5228] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:04 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:05.054984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a1312ba1-caed-44a8-b0d8-165f9825ac46 req-d0475d77-8dbb-4f78-8abb-21c10f8e13c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca40e812-49b8-4fe6-b362-6a1182fc3731", "name": "network-vif-deleted", "tag": "71bd5819-4974-4d4a-a69d-124ec9ca945b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:05.065753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a1312ba1-caed-44a8-b0d8-165f9825ac46 req-d0475d77-8dbb-4f78-8abb-21c10f8e13c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.066471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a1312ba1-caed-44a8-b0d8-165f9825ac46 req-d0475d77-8dbb-4f78-8abb-21c10f8e13c0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.079615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_external_events [req-a1312ba1-caed-44a8-b0d8-165f9825ac46 req-d0475d77-8dbb-4f78-8abb-21c10f8e13c0 service nova] Unable to find a host for instance ca40e812-49b8-4fe6-b362-6a1182fc3731. Dropping event network-vif-deleted {{(pid=137462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:16:05.081531 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a1312ba1-caed-44a8-b0d8-165f9825ac46 req-d0475d77-8dbb-4f78-8abb-21c10f8e13c0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031422 Jun 25 21:16:05.082661 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2394/5229] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:16:05.087854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:05.088733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:05.095858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.101459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.102371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.103351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.356091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.372060 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ced68c9a-4217-422b-9c5c-4254c5cc0cc6 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.288121 Jun 25 21:16:05.378582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2395/5230] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:05 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:05.399268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e9dc094f-e0b8-4656-9be6-20e987d574bd req-210608f0-2e5b-4fdc-bcda-b6040457a1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a172d8f-2ddd-4e08-9981-7bb893f7576f", "name": "network-vif-deleted", "tag": "349625a2-5d2a-4861-9ba8-aa58a99d0b78"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:05.418154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e9dc094f-e0b8-4656-9be6-20e987d574bd req-210608f0-2e5b-4fdc-bcda-b6040457a1f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.425796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e9dc094f-e0b8-4656-9be6-20e987d574bd req-210608f0-2e5b-4fdc-bcda-b6040457a1f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.436668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.449358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cab15635-4366-4205-868a-114ad65aea93 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.663154 Jun 25 21:16:05.455617 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2836/5231] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:04 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:05.461337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:05.463996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:05.465598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e9dc094f-e0b8-4656-9be6-20e987d574bd req-210608f0-2e5b-4fdc-bcda-b6040457a1f8 service nova] Creating event network-vif-deleted:349625a2-5d2a-4861-9ba8-aa58a99d0b78 for instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f on nch1-master-1 Jun 25 21:16:05.477461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.478193 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e9dc094f-e0b8-4656-9be6-20e987d574bd req-210608f0-2e5b-4fdc-bcda-b6040457a1f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096536 Jun 25 21:16:05.479053 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2396/5232] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:05.479472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.480729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.481176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.555253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.555730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.556350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lazy-loading 'fault' on Instance uuid 4a172d8f-2ddd-4e08-9981-7bb893f7576f {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:05.559132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:05.559852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:05.581400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.582031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.582943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.583844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.591290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:05.704153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.723680 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d01d62a6-e670-4642-950c-e60fa6485e5f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 200 len: 1211 microversion: 2.1 time: 0.167832 Jun 25 21:16:05.726978 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2397/5233] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:05 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:05.814567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:05.817311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:05.841641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.842845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.847819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.851603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:05.861635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:05.872148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f84b442a-99c9-433f-af14-a306ee5788be tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 200 len: 1304 microversion: 2.1 time: 0.420170 Jun 25 21:16:05.886282 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2837/5234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:05 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 1304 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:05.962804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e1455dbd-da51-4e66-837a-49941926d716 req-bdd73a9e-2e6e-4812-b175-74628b1d09e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c5b032-40de-4d58-be36-ebff5ed40c57", "name": "network-vif-plugged", "status": "completed", "tag": "b656b12a-0f60-4045-b263-c168401086bf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:05.979454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e1455dbd-da51-4e66-837a-49941926d716 req-bdd73a9e-2e6e-4812-b175-74628b1d09e7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:05.979972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e1455dbd-da51-4e66-837a-49941926d716 req-bdd73a9e-2e6e-4812-b175-74628b1d09e7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.006585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e1455dbd-da51-4e66-837a-49941926d716 req-bdd73a9e-2e6e-4812-b175-74628b1d09e7 service nova] Creating event network-vif-plugged:b656b12a-0f60-4045-b263-c168401086bf for instance 99c5b032-40de-4d58-be36-ebff5ed40c57 on nch2-master-1 Jun 25 21:16:06.015416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e1455dbd-da51-4e66-837a-49941926d716 req-bdd73a9e-2e6e-4812-b175-74628b1d09e7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057662 Jun 25 21:16:06.016730 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2838/5235] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:06.056120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:06.057320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:06.073175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.075687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.077001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.080260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.381298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.389952 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d4da826b-6864-4d68-921a-ef60eb399b00 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.594328 Jun 25 21:16:06.394536 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2398/5236] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:05 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:06.403402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:06.408741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:06.420813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.421583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.422648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.423288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.500739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.514495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.516086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.517655 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8abf7e23-21ad-4a0f-90e6-215fe7fd5874 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.466086 Jun 25 21:16:06.518641 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2839/5237] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:06 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:16:06.534607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:06.535681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:06.544627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.545570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.546759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.547476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.667347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.675550 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38e6a2a6-fd46-483b-ab87-35dc52e1314a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.279422 Jun 25 21:16:06.676608 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2399/5238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:06 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:06.723835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:06.732549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1c10a26-d380-40ef-ae1e-d57aa0bd58d5 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.212619 Jun 25 21:16:06.733372 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2840/5239] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:06 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:06.743384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:06.743993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:06.750540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.751213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.751986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.752415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.782220 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 HTTP/1.1 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ca40e812-49b8-4fe6-b362-6a1182fc3731'} Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.784359 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:16:06.790206 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.795712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:06.797553 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e4512ff-e7c7-44f8-96a0-142e45175e31 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 404 len: 111 microversion: 2.1 time: 0.058403 Jun 25 21:16:06.798149 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2400/5240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:06 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:06.900784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:06.901411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 4a172d8f-2ddd-4e08-9981-7bb893f7576f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:06.909013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.909474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.910263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:06.910728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:06.933761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] HTTP exception thrown: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Request method failure captured: Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f HTTP/1.1 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ruDBiRpqXToFiEBvOzDoj2jtX0ak5yQALwZrLb24SJAlbvEj1IYY435r3xsQXEAdIhI6Bfy5anMm-nDC5eZ2XuN2x9XHh7KY1HsWrJieFaZ5cTtR4TV6ZgUGC4JWzm-hvTas7UwCS_x_dRmPffexjhx00AEp5g1fsmbZNjBh5EF8w Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 731db346121f4334bd2e30ba916e85be Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesActionsTest-745630661 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/731db346121f4334bd2e30ba916e85be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/731db346121f4334bd2e30ba916e85be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_731db346121f4334bd2e30ba916e85be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/731db346121f4334bd2e30ba916e85be"}]}] Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesActionsTest-745630661 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 731db346121f4334bd2e30ba916e85be Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesActionsTest-745630661 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesActionsTest-745630661-project Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 83af31935cce49c5b97d9dd2a4774e73 Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesActionsTest-745630661-project Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '4a172d8f-2ddd-4e08-9981-7bb893f7576f'} Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:06.935642 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Returning 404 to user: Instance 4a172d8f-2ddd-4e08-9981-7bb893f7576f could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-063529c7-3092-4472-bf55-1a67b39e39e1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f" status: 404 len: 111 microversion: 2.1 time: 0.040683 Jun 25 21:16:06.940417 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2841/5241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:06 2022] GET /compute/v2.1/servers/4a172d8f-2ddd-4e08-9981-7bb893f7576f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:06.966426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-129924159", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:07.032684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:16:07.061911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1910606077", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "c2cb8bfa-1d07-437b-913e-d0d7fbfa2eea"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:07.122895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] validate_networks() for [('c2cb8bfa-1d07-437b-913e-d0d7fbfa2eea', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:16:07.434451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:07.453314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:07.453941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:07.454302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:07.454714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:07.455130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:07.464859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.465305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.466093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.466522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.485383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:07.495138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:07.508468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:07.511114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:07.528299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:07.529467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:07.530104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:07.531137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:07.532093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:07.543933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.544459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.545472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.546031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.564903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Getting quotas for project 731db346121f4334bd2e30ba916e85be. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:07.566059 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf2f8e85-64ef-42c4-9c8f-9adb84ca2191 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604434 Jun 25 21:16:07.572081 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2401/5242] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:16:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:16:07.572258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Getting quotas for user 83af31935cce49c5b97d9dd2a4774e73 and project 731db346121f4334bd2e30ba916e85be. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:07.572775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0a8ba70c-b15b-430d-98b1-de8b0d0538ac req-500f39fa-b985-4149-9530-d539791df063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e6c722-541c-41aa-972a-83e1fe6fdc34", "tag": "76a07f9b-c0b6-40ee-9895-f6751613413c"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:07.584128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0a8ba70c-b15b-430d-98b1-de8b0d0538ac req-500f39fa-b985-4149-9530-d539791df063 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.584743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0a8ba70c-b15b-430d-98b1-de8b0d0538ac req-500f39fa-b985-4149-9530-d539791df063 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.597057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:07.598124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:07.598634 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0a8ba70c-b15b-430d-98b1-de8b0d0538ac req-500f39fa-b985-4149-9530-d539791df063 service nova] Creating event network-changed:76a07f9b-c0b6-40ee-9895-f6751613413c for instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 on nch1-master-1 Jun 25 21:16:07.601866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:07.604624 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0a8ba70c-b15b-430d-98b1-de8b0d0538ac req-500f39fa-b985-4149-9530-d539791df063 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036187 Jun 25 21:16:07.609960 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2402/5243] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:07.616232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:07.617270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:07.624671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.625345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.626064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.626583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.699397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b815b841-dbe3-4257-a451-ebb84e3a03b4 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642836 Jun 25 21:16:07.705957 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2842/5244] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:16:07.712287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-89503184-3ff1-4faa-bd91-39b252f3bef6 req-5ec075b9-0ed2-4ff5-9ca9-990ab329e64a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:07.723850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-89503184-3ff1-4faa-bd91-39b252f3bef6 req-5ec075b9-0ed2-4ff5-9ca9-990ab329e64a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.724302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-89503184-3ff1-4faa-bd91-39b252f3bef6 req-5ec075b9-0ed2-4ff5-9ca9-990ab329e64a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.739567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-89503184-3ff1-4faa-bd91-39b252f3bef6 req-5ec075b9-0ed2-4ff5-9ca9-990ab329e64a service nova] Creating event network-changed:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch2-master-1 Jun 25 21:16:07.749350 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-89503184-3ff1-4faa-bd91-39b252f3bef6 req-5ec075b9-0ed2-4ff5-9ca9-990ab329e64a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041149 Jun 25 21:16:07.750276 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2843/5245] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:07.759295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:07.759906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:07.766765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.767452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.768731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:07.769166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:07.878586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:07.894750 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f739b27-de6d-4a3b-9695-991e40b3d4dd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.282571 Jun 25 21:16:07.901041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2403/5246] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:07 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:07.906188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a9da730-d219-4589-8527-e67ef5df4ee4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:07.914962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a9da730-d219-4589-8527-e67ef5df4ee4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:08.021308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5a9da730-d219-4589-8527-e67ef5df4ee4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.028602 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a9da730-d219-4589-8527-e67ef5df4ee4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1220 microversion: 2.1 time: 0.126117 Jun 25 21:16:08.033217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2404/5247] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:07 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1220 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:08.050853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:08.052001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:08.060389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.061268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.061841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.062352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.129512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.132415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:08.145653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.147796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.149503 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a4bf050d-fd25-4121-8cc9-8733ac68538b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.397692 Jun 25 21:16:08.161808 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2844/5248] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:07 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:08.168811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-785c246d-3220-40a4-a549-90fde76d504e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:08.169687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-785c246d-3220-40a4-a549-90fde76d504e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:08.290309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-785c246d-3220-40a4-a549-90fde76d504e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.300679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.302194 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-785c246d-3220-40a4-a549-90fde76d504e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1214 microversion: 2.1 time: 0.137210 Jun 25 21:16:08.302816 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2845/5249] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:08 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:08.309560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:08.310698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:08.318071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51a49b3d-a760-439d-9592-1b6c83890baf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.280483 Jun 25 21:16:08.318704 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2405/5250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:08 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:08.331528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0b474466-75bd-4a11-a42b-e54b04f16e7c req-1a797277-c974-414f-aaa0-f9c63eb50df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-plugged", "status": "completed", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:08.341328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.342003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.343091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.343958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.372579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0b474466-75bd-4a11-a42b-e54b04f16e7c req-1a797277-c974-414f-aaa0-f9c63eb50df8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.373781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0b474466-75bd-4a11-a42b-e54b04f16e7c req-1a797277-c974-414f-aaa0-f9c63eb50df8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.395336 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0b474466-75bd-4a11-a42b-e54b04f16e7c req-1a797277-c974-414f-aaa0-f9c63eb50df8 service nova] Creating event network-vif-plugged:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:16:08.403148 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0b474466-75bd-4a11-a42b-e54b04f16e7c req-1a797277-c974-414f-aaa0-f9c63eb50df8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081349 Jun 25 21:16:08.403822 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2406/5251] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:08.629090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:08.638985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f725659e-943a-408d-9494-6b985307cc42 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1314 microversion: 2.1 time: 0.334856 Jun 25 21:16:08.639696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2846/5252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:08 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:08.922769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:08.923754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:08.932687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.933419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:08.934187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:08.934627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.049198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:09.049824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.063890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.065245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.066446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.066942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.114037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.127491 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-15521821-011f-4d08-814c-b3b59bd875df tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.211995 Jun 25 21:16:09.129270 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2407/5253] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:08 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:09.152513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.161102 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04410e67-2194-46cf-800b-15f6fd06ba5a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1280 microversion: 2.1 time: 0.116590 Jun 25 21:16:09.161683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2847/5254] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:09 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:09.170062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:09.170774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.177321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.177710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.178485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.178928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.314731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.319276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:09.320005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.323654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.325217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.326263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.326376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83d53936-2585-4ef8-8ec5-6adc8ca1d01e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.160648 Jun 25 21:16:09.326714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.326987 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2408/5255] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:09 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:09.327800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.328233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.339259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:09.339898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.346199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.346657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.347426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.347870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.396944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.403616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8809ec75-3e4e-4b26-9ae3-a6f967146297 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1266 microversion: 2.1 time: 0.088248 Jun 25 21:16:09.404565 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2848/5256] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:09 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:09.526102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.536492 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6ec30297-abac-499e-bd20-ad117219da8d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1390 microversion: 2.1 time: 0.205280 Jun 25 21:16:09.537230 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2409/5257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:09 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1390 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:09.656314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:09.656972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.664471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.664922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.666029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.666476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.833822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:09.842157 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3a84b40-2f30-446d-a8f9-d97ca437d2c2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1500 microversion: 2.1 time: 0.189732 Jun 25 21:16:09.844469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2849/5258] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:09 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1500 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:09.860456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:09.861636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:09.868998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.870058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.870867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:09.871330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:09.900619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lazy-loading 'flavor' on Instance uuid 99c5b032-40de-4d58-be36-ebff5ed40c57 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:10.002399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66889588-09db-4157-b8f7-15703f1838f4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "POST /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57/action" status: 200 len: 32 microversion: 2.1 time: 0.146173 Jun 25 21:16:10.004401 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2410/5259] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:16:09 2022] POST /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:16:10.014649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.016257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.023349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.024077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.025124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.025725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.149084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.150477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.164110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.164589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.169743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.170289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.446518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.457044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c522ce33-9f52-4a53-b960-b6e85beb3d90 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.447059 Jun 25 21:16:10.457791 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2850/5260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:10.463396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.464006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.471750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.472210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.473269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.473849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.494158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.501825 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9838e524-9b3c-4a01-a165-851041d0b172 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.359362 Jun 25 21:16:10.502653 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2411/5261] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:10.518252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.519873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.524998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:10.530483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.531268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.534091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.534942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.870193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.879374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.880975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.882210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d768497e-d7c5-4061-b26a-722d0d5e69fb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.378783 Jun 25 21:16:10.882854 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2412/5262] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:10.902436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.906406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.913578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:10.919803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.920266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.921203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.921579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.923975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f7d1419a-22d9-459a-aa6c-1cfed2318b69 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.464339 Jun 25 21:16:10.934519 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2851/5263] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:10.942921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:10.943543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:10.965968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.966436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:10.977363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:10.977929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.051469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:11.061666 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-43d757b0-e699-4a4c-b6cb-aa47989684bf tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1272 microversion: 2.1 time: 0.167776 Jun 25 21:16:11.062277 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2413/5264] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1272 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:11.464689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:11.478890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:11.480921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:11.497991 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28e8f957-66e5-4366-9c72-2c16bdb9b993 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1561 microversion: 2.1 time: 0.560160 Jun 25 21:16:11.501437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.502214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.503343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.504273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.505365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2852/5265] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:10 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1561 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:11.518669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:11.520282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:11.542233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.544519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.554659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.555563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.809556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:11.830959 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-667069fc-3598-4c2f-b593-7eff8f85fc89 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.358907 Jun 25 21:16:11.831851 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2414/5266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:11 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:11.845419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:11.846100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:11.854186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.854645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.855459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:11.855895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:11.892517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:12.008293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.016980 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f5ff1ab-ef0a-478d-baae-43deb8060078 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1561 microversion: 2.1 time: 0.506461 Jun 25 21:16:12.017798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2853/5267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:11 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1561 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:12.022888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:12.023567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:12.030120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.030898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.031677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.032338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.161146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.169490 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-91a7f9e3-41f7-4378-8401-8630780c19b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.336344 Jun 25 21:16:12.170446 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2415/5268] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:11 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:12.183603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:12.184463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:12.193685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.194658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.195922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.196685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.440974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.452701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c6262c9-0099-49bd-a74c-640c5378c46a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.280795 Jun 25 21:16:12.453920 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2416/5269] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:12 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:12.469982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:12.470726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:12.499164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.502910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.506911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.507496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.547500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.556454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.561314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.565498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6af3fdc4-0c0e-4a0a-ab82-758b4ae3e7b0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.546464 Jun 25 21:16:12.568108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2854/5270] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:12 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:12.581028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d51d4c41-5097-427c-afa8-c9436b5c0148 req-3266b56a-05a4-425a-9d13-b45513afda17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0e05923-b259-475c-a6ab-2b47b72ebfb8", "tag": "ea83642c-6970-4696-9d61-6cabd346c624"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:12.598323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d51d4c41-5097-427c-afa8-c9436b5c0148 req-3266b56a-05a4-425a-9d13-b45513afda17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.599323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d51d4c41-5097-427c-afa8-c9436b5c0148 req-3266b56a-05a4-425a-9d13-b45513afda17 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.621571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d51d4c41-5097-427c-afa8-c9436b5c0148 req-3266b56a-05a4-425a-9d13-b45513afda17 service nova] Creating event network-changed:ea83642c-6970-4696-9d61-6cabd346c624 for instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 on nch1-master-1 Jun 25 21:16:12.641362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d51d4c41-5097-427c-afa8-c9436b5c0148 req-3266b56a-05a4-425a-9d13-b45513afda17 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060333 Jun 25 21:16:12.643419 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2855/5271] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:12.853624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:12.854681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:12.864677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.866107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.867669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:12.870171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:12.876260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:12.888906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-df41cb89-29bf-4498-a202-00bf282b0bcb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.433737 Jun 25 21:16:12.890615 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2417/5272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:12 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:13.041274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-eab1e000-472d-4f5a-b325-605f306e0876 req-39d68d62-9e75-4085-8b3a-6454bd982bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e6c722-541c-41aa-972a-83e1fe6fdc34", "name": "network-vif-plugged", "status": "completed", "tag": "76a07f9b-c0b6-40ee-9895-f6751613413c"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:13.058692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-eab1e000-472d-4f5a-b325-605f306e0876 req-39d68d62-9e75-4085-8b3a-6454bd982bda service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.059662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-eab1e000-472d-4f5a-b325-605f306e0876 req-39d68d62-9e75-4085-8b3a-6454bd982bda service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.078482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-eab1e000-472d-4f5a-b325-605f306e0876 req-39d68d62-9e75-4085-8b3a-6454bd982bda service nova] Creating event network-vif-plugged:76a07f9b-c0b6-40ee-9895-f6751613413c for instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 on nch1-master-1 Jun 25 21:16:13.085672 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-eab1e000-472d-4f5a-b325-605f306e0876 req-39d68d62-9e75-4085-8b3a-6454bd982bda service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048151 Jun 25 21:16:13.087113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2418/5273] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:13.188230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:13.189007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:13.196343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.196707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.205397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.206495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.287331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.297701 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ba2b0e7-3fdf-4ef2-aad2-4033fd79d048 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.452238 Jun 25 21:16:13.299261 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2856/5274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:12 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:13.470279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:13.470902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:13.478011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.478900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.479930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.480627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.524767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.534783 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f70c9ebd-df8b-498b-b0bb-d6ead6ad3365 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.351184 Jun 25 21:16:13.535396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2419/5275] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:13 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:13.588645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:13.589638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:13.600266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.601412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.602470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.603214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.761911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.773253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.775493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.776850 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87fa3d6a-5146-4bc9-a8b6-4ff9ede02071 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.194013 Jun 25 21:16:13.787988 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2420/5276] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:13 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:13.825630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:13.835407 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-116d549a-3147-4ab3-bff4-974f4506ec26 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.368767 Jun 25 21:16:13.836153 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2857/5277] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:13 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:13.906778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:13.907729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:13.914522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.915217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:13.915977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:13.916602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.065317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.075565 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4139656-53d2-4b0f-bb4f-065eae589d7b tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.172295 Jun 25 21:16:14.077147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-abecd710-4c3d-4d9b-860b-91f81ff3539e req-00aada67-89c2-4b32-98cc-4f90314961b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e9ce77c-fdfb-46ed-910d-03495c91712b", "tag": "e006b012-8bd7-40ab-aba8-e5e5283b1793"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:14.077493 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2421/5278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:13 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:14.088089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-abecd710-4c3d-4d9b-860b-91f81ff3539e req-00aada67-89c2-4b32-98cc-4f90314961b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.088562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-abecd710-4c3d-4d9b-860b-91f81ff3539e req-00aada67-89c2-4b32-98cc-4f90314961b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.100995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-abecd710-4c3d-4d9b-860b-91f81ff3539e req-00aada67-89c2-4b32-98cc-4f90314961b1 service nova] Creating event network-changed:e006b012-8bd7-40ab-aba8-e5e5283b1793 for instance 3e9ce77c-fdfb-46ed-910d-03495c91712b on nch1-master-1 Jun 25 21:16:14.106458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-abecd710-4c3d-4d9b-860b-91f81ff3539e req-00aada67-89c2-4b32-98cc-4f90314961b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036903 Jun 25 21:16:14.107120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2858/5279] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:14.315757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:14.316593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:14.324097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.327358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.331196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.332034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.498164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.507941 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d1140636-75d4-4804-9daa-1b52477202b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.196477 Jun 25 21:16:14.509164 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2422/5280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:14 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:14.556487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:14.557223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:14.564794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.565246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.566024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.566460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.795561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:14.796175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:14.804323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.805218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.806018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.806704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.881148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.891476 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f433d3a5-13ce-4978-8a15-475e109a59b8 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1367 microversion: 2.1 time: 0.341389 Jun 25 21:16:14.904742 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2859/5281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:14 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:14.910549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:14.911162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:14.917822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.918465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.919251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:14.919687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:14.969852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.993266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.994902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:14.996062 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-781d65cd-d3c4-4f03-bb9a-17767a0a5dcd tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.204836 Jun 25 21:16:14.998262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2423/5282] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:14 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:16:15.094223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:15.094845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:15.103692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.105294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.106305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.106918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.283721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:15.292817 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d96c4c9d-ccec-4aa0-b3d0-5867f7092156 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.386406 Jun 25 21:16:15.293836 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2860/5283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:14 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:15.298808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a0afe4ca-1963-4382-a795-ee9ed4e49cf8 req-7b5f2cab-45ed-43de-a41f-84f0e5a834cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "name": "network-vif-plugged", "status": "completed", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:15.308703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a0afe4ca-1963-4382-a795-ee9ed4e49cf8 req-7b5f2cab-45ed-43de-a41f-84f0e5a834cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.309258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a0afe4ca-1963-4382-a795-ee9ed4e49cf8 req-7b5f2cab-45ed-43de-a41f-84f0e5a834cf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.322982 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a0afe4ca-1963-4382-a795-ee9ed4e49cf8 req-7b5f2cab-45ed-43de-a41f-84f0e5a834cf service nova] Creating event network-vif-plugged:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch2-master-1 Jun 25 21:16:15.329980 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a0afe4ca-1963-4382-a795-ee9ed4e49cf8 req-7b5f2cab-45ed-43de-a41f-84f0e5a834cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034062 Jun 25 21:16:15.330946 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2861/5284] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:15.345246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:15.362895 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1393bdb2-a453-44a7-a690-2f6ff4c150a2 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.272183 Jun 25 21:16:15.381082 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2424/5285] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:15 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:15.526742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:15.527907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:15.537714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.538382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.539429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.540083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.886953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:15.897269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:15.898433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:15.903239 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-711e709c-1cc0-4a6c-b2a0-a303664a322f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.381722 Jun 25 21:16:15.904174 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2862/5286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:15 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:15.907286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.908112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.909139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.909810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.911584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:15.912309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:15.918895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.919680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:15.920764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:15.921421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.064217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.074365 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf9b60de-2767-47cd-8215-d3ccdd7849ef tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1561 microversion: 2.1 time: 0.181024 Jun 25 21:16:16.093966 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2425/5287] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:15 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:16.107140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:16.107782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:16.128565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.129315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.130481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.130937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.230993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.241023 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e264a49e-90eb-456d-93ca-c85c36915697 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1556 microversion: 2.1 time: 0.333431 Jun 25 21:16:16.253205 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2863/5288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:15 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1556 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:16.258900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-730b9536-7b20-4a38-83e8-427d883b1497 req-52ef09f9-353c-4ebe-bfe9-a9236d0740e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:16.268664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-730b9536-7b20-4a38-83e8-427d883b1497 req-52ef09f9-353c-4ebe-bfe9-a9236d0740e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.269142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-730b9536-7b20-4a38-83e8-427d883b1497 req-52ef09f9-353c-4ebe-bfe9-a9236d0740e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.282004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-730b9536-7b20-4a38-83e8-427d883b1497 req-52ef09f9-353c-4ebe-bfe9-a9236d0740e5 service nova] Creating event network-changed:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:16:16.287828 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-730b9536-7b20-4a38-83e8-427d883b1497 req-52ef09f9-353c-4ebe-bfe9-a9236d0740e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033325 Jun 25 21:16:16.289144 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2864/5289] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:16.295685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:16.308061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:16.317466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.318246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.319306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.320671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.327075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:16.362766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.375596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.380043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.380587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23e6a7e8-029a-4888-bde5-d9c24297b2da tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1406 microversion: 2.20 time: 0.284832 Jun 25 21:16:16.381896 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2426/5290] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:16 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:16.397179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:16.399156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:16.410212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.411184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.412685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.413392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.429726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c91f3f97-c60c-4869-906b-114880fa020b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138970 Jun 25 21:16:16.430465 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2865/5291] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:16:16 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:16.436750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:16.437655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:16.444913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.445365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.446145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.446869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.605985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.616753 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4153aba-a1ac-4fc1-98c0-906d3a81ddee tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.184701 Jun 25 21:16:16.617475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2866/5292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:16 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:16.772621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:16.781201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-991c9317-2013-41e1-bb62-d350024b04a3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.397964 Jun 25 21:16:16.792518 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2427/5293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:16 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:16.919557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:16.921038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:16.934497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.935252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:16.936313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:16.937097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.132391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:17.142450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4dad1943-fe06-4cf6-bc14-c5637d8ee2a6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.226753 Jun 25 21:16:17.143784 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2867/5294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:16 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:17.399614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:17.400231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:17.407237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.408037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.408882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.409298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.476654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:17.634572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:17.635110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:17.637984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:17.644292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.644776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.645569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.646010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.858551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:17.866762 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54cd9fbc-65c4-49d6-8900-5cf45ac0e91e tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.236303 Jun 25 21:16:17.867987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2868/5295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:17 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:17.872883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:17.873737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:17.880122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.880827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.881774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.882417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.927262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:17.937222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:17.939080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:17.940300 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e8b5a4b-d6b5-450f-8b3f-2592033ba417 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1599 microversion: 2.20 time: 0.544919 Jun 25 21:16:17.940929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2428/5296] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:16:17 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1599 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:16:17.963481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:17.964167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:17.971472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.972071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:17.973280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:17.973949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:18.031236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=30 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:18.068373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:18.077923 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e7e2308-7a2a-4efa-94e3-3debd073284a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.208598 Jun 25 21:16:18.078510 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2869/5297] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:17 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:18.151178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-854c79be-2c9e-45b1-b430-3c35ecbefef9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.189874 Jun 25 21:16:18.152604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2429/5298] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:16:17 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 21:16:18.157127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ea3dbe2f-6bf2-43cb-9ded-cf47476efaf1 req-77ce3f75-96e6-4661-899a-d1a101fc3ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e6c722-541c-41aa-972a-83e1fe6fdc34", "tag": "76a07f9b-c0b6-40ee-9895-f6751613413c"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:18.164859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:18.166111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:18.174313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:18.175178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:18.176499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:18.177217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:18.187919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ea3dbe2f-6bf2-43cb-9ded-cf47476efaf1 req-77ce3f75-96e6-4661-899a-d1a101fc3ccf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:18.188477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ea3dbe2f-6bf2-43cb-9ded-cf47476efaf1 req-77ce3f75-96e6-4661-899a-d1a101fc3ccf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:18.203466 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ea3dbe2f-6bf2-43cb-9ded-cf47476efaf1 req-77ce3f75-96e6-4661-899a-d1a101fc3ccf service nova] Creating event network-changed:76a07f9b-c0b6-40ee-9895-f6751613413c for instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 on nch1-master-1 Jun 25 21:16:18.211201 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ea3dbe2f-6bf2-43cb-9ded-cf47476efaf1 req-77ce3f75-96e6-4661-899a-d1a101fc3ccf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058651 Jun 25 21:16:18.212163 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2870/5299] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:18.511061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:18.521336 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4be09644-908f-49dc-8d1b-3edd405cdfec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.365840 Jun 25 21:16:18.531837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2430/5300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:18 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:18.880740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=28 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:18.887150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:18.888194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:18.902114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:18.902567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:18.903365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:18.903803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.098526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:19.099719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:19.118901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:19.121140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.123867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:19.126633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.158167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:19.173073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a66ed41f-4003-4721-8a3d-76692987b2dd tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.293210 Jun 25 21:16:19.187574 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2871/5301] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:18 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:19.250226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9711bbe8-13c2-4890-a3ff-de3a538b6a38 req-3fd03120-5322-41d3-a636-e6aecc4cd6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e05923-b259-475c-a6ab-2b47b72ebfb8", "name": "network-vif-plugged", "status": "completed", "tag": "ea83642c-6970-4696-9d61-6cabd346c624"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:19.269429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9711bbe8-13c2-4890-a3ff-de3a538b6a38 req-3fd03120-5322-41d3-a636-e6aecc4cd6f7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:19.270414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9711bbe8-13c2-4890-a3ff-de3a538b6a38 req-3fd03120-5322-41d3-a636-e6aecc4cd6f7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.308894 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9711bbe8-13c2-4890-a3ff-de3a538b6a38 req-3fd03120-5322-41d3-a636-e6aecc4cd6f7 service nova] Creating event network-vif-plugged:ea83642c-6970-4696-9d61-6cabd346c624 for instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 on nch1-master-1 Jun 25 21:16:19.314918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9711bbe8-13c2-4890-a3ff-de3a538b6a38 req-3fd03120-5322-41d3-a636-e6aecc4cd6f7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069175 Jun 25 21:16:19.317296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2872/5302] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:19.539488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:19.541014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:19.548925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:19.549666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.551218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:19.551849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:19.553480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:19.583042 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99677616-4f91-4e11-b36d-36e3e66d2746 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.489532 Jun 25 21:16:19.585759 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2431/5303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:19 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:19.737322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:19.747497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7401940b-dcce-47a8-a971-38086659307c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.212572 Jun 25 21:16:19.749036 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2873/5304] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:19 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:20.190101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:20.190716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:20.197724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.198183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.198969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.199404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.239553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cbc8536e-1d6d-4d3d-88cf-562bbbdec7a1 req-e413101f-1cfa-431f-bad6-293dbe42a3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:20.249007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cbc8536e-1d6d-4d3d-88cf-562bbbdec7a1 req-e413101f-1cfa-431f-bad6-293dbe42a3c9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.249560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cbc8536e-1d6d-4d3d-88cf-562bbbdec7a1 req-e413101f-1cfa-431f-bad6-293dbe42a3c9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.262214 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cbc8536e-1d6d-4d3d-88cf-562bbbdec7a1 req-e413101f-1cfa-431f-bad6-293dbe42a3c9 service nova] Creating event network-changed:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch2-master-1 Jun 25 21:16:20.267862 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cbc8536e-1d6d-4d3d-88cf-562bbbdec7a1 req-e413101f-1cfa-431f-bad6-293dbe42a3c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032156 Jun 25 21:16:20.269530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2874/5305] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:20.354450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:20.365573 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-538033a8-9715-4a83-bf06-ac5ec6de6dd1 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.179471 Jun 25 21:16:20.366275 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2432/5306] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:20 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:20.604026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:20.604906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:20.617425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.617991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.618677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.623085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.769076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:20.769915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:20.783642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.790037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.793235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:20.796075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:20.852547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:20.852861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:20.866178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a6d99dc2-8991-426b-8641-fca4dfb7e106 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1320 microversion: 2.1 time: 0.267079 Jun 25 21:16:20.866805 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2875/5307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:20 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:21.036228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:21.046119 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc2a0ed2-2371-4797-b3d1-12549030a5b4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.283849 Jun 25 21:16:21.046441 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2433/5308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:20 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:21.342691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3fc32ec1-fc1d-4851-ada6-64dd587fc403 req-e3e0d263-9010-4f22-be1e-1df6c1f609e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9ce77c-fdfb-46ed-910d-03495c91712b", "name": "network-vif-plugged", "status": "completed", "tag": "e006b012-8bd7-40ab-aba8-e5e5283b1793"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:21.354017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3fc32ec1-fc1d-4851-ada6-64dd587fc403 req-e3e0d263-9010-4f22-be1e-1df6c1f609e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:21.354467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3fc32ec1-fc1d-4851-ada6-64dd587fc403 req-e3e0d263-9010-4f22-be1e-1df6c1f609e5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:21.365840 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3fc32ec1-fc1d-4851-ada6-64dd587fc403 req-e3e0d263-9010-4f22-be1e-1df6c1f609e5 service nova] Creating event network-vif-plugged:e006b012-8bd7-40ab-aba8-e5e5283b1793 for instance 3e9ce77c-fdfb-46ed-910d-03495c91712b on nch1-master-1 Jun 25 21:16:21.370756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3fc32ec1-fc1d-4851-ada6-64dd587fc403 req-e3e0d263-9010-4f22-be1e-1df6c1f609e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033228 Jun 25 21:16:21.371333 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2876/5309] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:21.382783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:21.383396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:21.390841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:21.391319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:21.392231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:21.392564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:21.585242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:21.596958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a275beb-d4cd-41e8-9852-869f36773cfb tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.217862 Jun 25 21:16:21.597711 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2434/5310] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:21 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:21.883940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:21.884681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:21.891511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:21.892164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:21.893006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:21.893422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.047907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:22.056080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88f9c739-c0ea-4e53-b299-c7609176d66c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1500 microversion: 2.1 time: 0.176526 Jun 25 21:16:22.056692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2877/5311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:21 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1500 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:22.065041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:22.065669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:22.072173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:22.072994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:22.073295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.073758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.074544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.075174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.079463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.080176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.081140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.081575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.225482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:22.228373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:22.235562 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f704c399-258e-49b3-b3e3-faed96baaefd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.175848 Jun 25 21:16:22.236647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2435/5312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:22 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:22.237627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a85fa33a-2178-4196-b23f-0d7ddf09823f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1500 microversion: 2.1 time: 0.169343 Jun 25 21:16:22.238212 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2878/5313] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:22 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:22.254250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:22.254754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:22.261145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.261595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.262355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.262790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.289485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:22.385063 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1a2e85da-2104-4b66-915c-ce7b9e3058ed tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 204 len: 0 microversion: 2.1 time: 0.134597 Jun 25 21:16:22.385576 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2436/5314] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:22 2022] DELETE /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:22.394173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:22.394792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:22.402041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.402500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.403235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.403707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.535195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:22.543012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-55beca9a-c1f4-4fd1-ae5b-c0aa97643900 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1506 microversion: 2.1 time: 0.152857 Jun 25 21:16:22.543600 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2879/5315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:22 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:22.619160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:22.620093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:22.629942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.630558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.631592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:22.632180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:22.775014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:22.783034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f851fd8-6c97-4197-9150-c421bbc81dda tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1314 microversion: 2.1 time: 0.170919 Jun 25 21:16:22.783624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2437/5316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:22 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:23.253456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:23.254086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:23.262200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.262588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.263361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.263801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.414058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:23.422368 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-491a519f-4743-418f-9bc5-04d732001ad4 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.173148 Jun 25 21:16:23.422968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2880/5317] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:23 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:23.563467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:23.564136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:23.572141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.572642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.573601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.574049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.715764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:23.723805 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e487f14-deee-425d-a0f6-24dd006dfdb6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1506 microversion: 2.1 time: 0.165757 Jun 25 21:16:23.724393 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2438/5318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:23 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:23.800915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:23.801528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:23.808991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.809555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.810362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:23.810937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:23.948886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:23.956477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8aac54f1-b728-4ea6-891d-d403441bb555 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1498 microversion: 2.1 time: 0.160092 Jun 25 21:16:23.957088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2881/5319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:23 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:24.404926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:24.405550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:24.411950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.412660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.413649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.414251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.439039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:24.440271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:24.447692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.449423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.456666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:24.457869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.458902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.624701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a58c7e6e-7d27-4088-898e-8c816b1b51ad tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 204 len: 0 microversion: 2.1 time: 0.223437 Jun 25 21:16:24.629423 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2439/5320] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:24 2022] DELETE /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:24.637789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c4dc389b-2b72-4c15-a2fe-e139d2de04f8 req-66f30c02-1ce6-490d-a011-5e33e832b54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0e05923-b259-475c-a6ab-2b47b72ebfb8", "name": "network-vif-deleted", "tag": "ea83642c-6970-4696-9d61-6cabd346c624"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:24.650563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c4dc389b-2b72-4c15-a2fe-e139d2de04f8 req-66f30c02-1ce6-490d-a011-5e33e832b54c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.651599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c4dc389b-2b72-4c15-a2fe-e139d2de04f8 req-66f30c02-1ce6-490d-a011-5e33e832b54c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.677154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c4dc389b-2b72-4c15-a2fe-e139d2de04f8 req-66f30c02-1ce6-490d-a011-5e33e832b54c service nova] Creating event network-vif-deleted:ea83642c-6970-4696-9d61-6cabd346c624 for instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 on nch1-master-1 Jun 25 21:16:24.682962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c4dc389b-2b72-4c15-a2fe-e139d2de04f8 req-66f30c02-1ce6-490d-a011-5e33e832b54c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051084 Jun 25 21:16:24.683830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2440/5321] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:24.689786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:24.690498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:24.703079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.703542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.709256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.709865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.739907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:24.756779 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e147154-1ba1-410f-9a41-4e046f5b3929 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.321374 Jun 25 21:16:24.757592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2882/5322] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:24 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:24.762381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:24.763037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:24.772392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.772880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.773665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:24.774190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:24.870713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:24.879852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bdc3c2f5-843a-4be2-b7f6-62074c9cdc80 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1464 microversion: 2.1 time: 0.121092 Jun 25 21:16:24.880590 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2883/5323] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:24 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1464 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:24.927694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:24.935691 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e74b4560-b35f-4101-96a5-53abf10cbb50 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1504 microversion: 2.1 time: 0.250541 Jun 25 21:16:24.936273 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2441/5324] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:24 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:25.776564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:25.777345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:25.784364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.784844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.785620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.786277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.898361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:25.899797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:25.907159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.908120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.910730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.911363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.939934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:25.952379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:25.961570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.962126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.962513 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89d81e26-0cdd-4cbe-bd37-3b48686bcdf6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.190305 Jun 25 21:16:25.962646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lazy-loading 'fault' on Instance uuid b0e05923-b259-475c-a6ab-2b47b72ebfb8 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:25.963699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2884/5325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:25 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:25.968434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:25.969212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:25.975811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.976361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:25.977171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:25.977607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:26.017360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:26.025678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7bf3ef6a-b19a-48a0-8d6f-fc03bb56ef73 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 200 len: 1310 microversion: 2.1 time: 0.132254 Jun 25 21:16:26.026276 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2442/5326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:25 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 1310 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:26.136243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:26.144915 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a57dfae9-2fb7-448b-8708-90926b6eef60 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1504 microversion: 2.1 time: 0.179893 Jun 25 21:16:26.145667 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2885/5327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:25 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:26.698042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-58d323c6-93d6-462b-b12c-d7141e23dc5c req-a0481d6d-5b88-4ef1-9a4c-5905878f1232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e9ce77c-fdfb-46ed-910d-03495c91712b", "name": "network-vif-deleted", "tag": "e006b012-8bd7-40ab-aba8-e5e5283b1793"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:26.707814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-58d323c6-93d6-462b-b12c-d7141e23dc5c req-a0481d6d-5b88-4ef1-9a4c-5905878f1232 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:26.709037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-58d323c6-93d6-462b-b12c-d7141e23dc5c req-a0481d6d-5b88-4ef1-9a4c-5905878f1232 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:26.721682 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-58d323c6-93d6-462b-b12c-d7141e23dc5c req-a0481d6d-5b88-4ef1-9a4c-5905878f1232 service nova] Creating event network-vif-deleted:e006b012-8bd7-40ab-aba8-e5e5283b1793 for instance 3e9ce77c-fdfb-46ed-910d-03495c91712b on nch1-master-1 Jun 25 21:16:26.727485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-58d323c6-93d6-462b-b12c-d7141e23dc5c req-a0481d6d-5b88-4ef1-9a4c-5905878f1232 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033482 Jun 25 21:16:26.728105 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2443/5328] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:26.979666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:26.980280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:26.987483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:26.987940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:26.988725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:26.989167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.048022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:27.048770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:27.055796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.056255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.057081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.057518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.071736 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 HTTP/1.1 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'b0e05923-b259-475c-a6ab-2b47b72ebfb8'} Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:27.073641 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f330752a-71f3-4d46-8051-e8f14cb15719 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 404 len: 111 microversion: 2.1 time: 0.035533 Jun 25 21:16:27.078937 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2444/5329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:27 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:27.092338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c72a40c2-03c9-4c16-98eb-5d845838bcdf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: .version_select at 0x7f984f64b790>, body: {"keypair": {"name": "tempest-key-1739392905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhUp9kC3CaKVGm+pQ0SzMf/SxQN4g55exq556TfcF73fM4NQ2yETWXycVelteY38Jyg5Pa4AUP0gPTrDnPLItR7GUjSXk27ghiQYeVmPo8xf3VBokB//9L9NWuEIIbWog=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:27.109262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c72a40c2-03c9-4c16-98eb-5d845838bcdf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:27.116040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c72a40c2-03c9-4c16-98eb-5d845838bcdf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:27.141903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:27.158435 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4dc3c623-d213-4686-bc78-cf17c4ceaaed tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.180871 Jun 25 21:16:27.168979 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2886/5330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:26 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:27.169110 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c72a40c2-03c9-4c16-98eb-5d845838bcdf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.064147 Jun 25 21:16:27.169110 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2445/5331] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:16:27 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:27.169302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:27.169302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:27.173582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e74b2472-2df0-4b17-b7e2-c1a1af190e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '.version_select at 0x7f984fd8e550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:27.178238 ncdv-master-1 devstack@n-api.service[137462]: WARNING oslo_db.sqlalchemy.utils [None req-e74b2472-2df0-4b17-b7e2-c1a1af190e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Unique keys not in sort_keys. The sorting order may be unstable. Jun 25 21:16:27.184846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.186865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.187775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.188219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.190517 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e74b2472-2df0-4b17-b7e2-c1a1af190e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.020778 Jun 25 21:16:27.194315 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2446/5332] 10.222.0.39 () {58 vars in 1136 bytes} [Sat Jun 25 21:16:27 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:27.252355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.252824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.253538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lazy-loading 'fault' on Instance uuid 3e9ce77c-fdfb-46ed-910d-03495c91712b {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:27.313610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83af31935cce49c5b97d9dd2a4774e73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '731db346121f4334bd2e30ba916e85be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:27.313942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1697256786", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-key-1739392905", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:27.322611 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c5fdcd7-fd3a-4650-b05a-0be55b096d71 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 200 len: 1304 microversion: 2.1 time: 0.162124 Jun 25 21:16:27.323652 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2887/5333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:27 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:27.373433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:16:27.751566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:27.752023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:27.752515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:27.752933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:27.753352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:27.762773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.763229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.764030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:27.764495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:27.776455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:27.783289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:27.790427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:27.803291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:27.805770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:27.856236 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a605a1c1-06a4-4630-a418-710b0e1e094b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546119 Jun 25 21:16:27.857071 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2447/5334] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:16:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:16:27.867213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b44129c-26c8-415d-a40d-4400f25d3ca7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:27.867894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8b44129c-26c8-415d-a40d-4400f25d3ca7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:27.871061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:27.935457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b44129c-26c8-415d-a40d-4400f25d3ca7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:27.942391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b44129c-26c8-415d-a40d-4400f25d3ca7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1229 microversion: 2.1 time: 0.079312 Jun 25 21:16:27.943367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2888/5335] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:27 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1229 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:28.176062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:28.176717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:28.187486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.187951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:28.188763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.189222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:28.337416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:28.342875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:28.347621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] [instance: 3e9ce77c-fdfb-46ed-910d-03495c91712b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:28.357903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.358425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-246d2508-a293-4e46-b2dc-767264a82436 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.186492 Jun 25 21:16:28.358605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:28.359577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.359702 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2448/5336] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:28 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:28.360317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:28.376784 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] HTTP exception thrown: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Request method failure captured: Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b HTTP/1.1 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3ruDBiRpqXToFiEBvOzDoj2jtX0ak5yQALwZrLb24SJAlbvEj1IYY435r3xsQXEAdIhI6Bfy5anMm-nDC5eZ2XuN2x9XHh7KY1HsWrJieFaZ5cTtR4TV6ZgUGC4JWzm-hvTas7UwCS_x_dRmPffexjhx00AEp5g1fsmbZNjBh5EF8w Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 731db346121f4334bd2e30ba916e85be Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesActionsTest-745630661 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/731db346121f4334bd2e30ba916e85be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/731db346121f4334bd2e30ba916e85be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_731db346121f4334bd2e30ba916e85be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/731db346121f4334bd2e30ba916e85be"}]}] Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesActionsTest-745630661 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 731db346121f4334bd2e30ba916e85be Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesActionsTest-745630661 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesActionsTest-745630661-project Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 83af31935cce49c5b97d9dd2a4774e73 Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesActionsTest-745630661-project Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3e9ce77c-fdfb-46ed-910d-03495c91712b'} Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:28.378487 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] Returning 404 to user: Instance 3e9ce77c-fdfb-46ed-910d-03495c91712b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:28.383110 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b666a1f-da13-4589-8ee2-b61f11980611 tempest-VolumesActionsTest-745630661 tempest-VolumesActionsTest-745630661-project] 10.222.0.39 "GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b" status: 404 len: 111 microversion: 2.1 time: 0.040951 Jun 25 21:16:28.389117 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2889/5337] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:28 2022] GET /compute/v2.1/servers/3e9ce77c-fdfb-46ed-910d-03495c91712b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:28.962207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:28.963250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:28.973814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.974703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:28.976671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:28.977732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:29.082878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:29.091019 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-798864e5-ec83-4cc3-9292-df191435f60d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1299 microversion: 2.1 time: 0.134904 Jun 25 21:16:29.091624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2449/5338] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:28 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:29.376050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:29.376957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:29.398312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:29.398777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:29.399578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:29.400003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:29.651403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:29.666720 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-693d14c4-f8b5-4638-b40e-9a3e689c2ab2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.294028 Jun 25 21:16:29.677059 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2890/5339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:29 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:30.109175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:30.109980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:30.124751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:30.128862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:30.130277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:30.134196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:30.468834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:30.476953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:30.484790 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-babd0b42-9241-4b52-b80c-ffa75f0d2f62 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.379944 Jun 25 21:16:30.492488 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2450/5340] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:30 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:30.688077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:30.689272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:30.698508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:30.698973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:30.699756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:30.700197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:30.863189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:30.872785 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a1b0de4-72c6-447b-8217-4263a2cad758 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.189860 Jun 25 21:16:30.873589 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2891/5341] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:30 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:31.021992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8a35a081-3fdb-49cc-8df8-fc69d867090a req-1d2c95c6-ace1-427b-b601-3c101cbad863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65436a4d-647b-4ac2-a352-e713d95839cf", "tag": "2fb34a05-736d-4bc4-95c5-10d9c47efca5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:31.036718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8a35a081-3fdb-49cc-8df8-fc69d867090a req-1d2c95c6-ace1-427b-b601-3c101cbad863 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:31.037445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8a35a081-3fdb-49cc-8df8-fc69d867090a req-1d2c95c6-ace1-427b-b601-3c101cbad863 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:31.050980 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8a35a081-3fdb-49cc-8df8-fc69d867090a req-1d2c95c6-ace1-427b-b601-3c101cbad863 service nova] Creating event network-changed:2fb34a05-736d-4bc4-95c5-10d9c47efca5 for instance 65436a4d-647b-4ac2-a352-e713d95839cf on nch1-master-1 Jun 25 21:16:31.056046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8a35a081-3fdb-49cc-8df8-fc69d867090a req-1d2c95c6-ace1-427b-b601-3c101cbad863 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044420 Jun 25 21:16:31.056715 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2451/5342] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:31.503289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:31.504202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:31.512586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:31.513504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:31.514304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:31.515020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:31.679074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:31.686948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ab9f807-86c3-4736-90d6-90e96ba6a77d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.188404 Jun 25 21:16:31.687519 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2892/5343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:31 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:31.896203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:31.898308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:31.906992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:31.907762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:31.909356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:31.910378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:32.105902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:32.114138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14279807-6ccc-42f4-92b1-e3cd3dcb3a45 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.224281 Jun 25 21:16:32.124350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2452/5344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:31 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:32.706730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:32.709062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:32.721663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:32.722246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:32.723295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:32.724168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:32.962135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:32.974927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcc48d45-a661-4715-a77e-dd3f1f803fcd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.274918 Jun 25 21:16:32.976467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2893/5345] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:32 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:33.131586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:33.132238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:33.156490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:33.156950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:33.157733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:33.158172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:33.393669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:33.402852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92880673-b0de-4a46-9e79-dee0763167f2 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.275608 Jun 25 21:16:33.404146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2453/5346] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:33 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:33.993112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:33.994500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:34.013912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:34.013912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:34.013912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:34.013912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:34.198760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:34.207856 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fd35cfb2-3697-4a4b-92c7-c9e1eab7b7f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.219174 Jun 25 21:16:34.209491 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2894/5347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:33 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:34.420272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:34.420964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:34.428014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:34.429121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:34.430274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:34.430815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:34.598235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:34.608489 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-28dc4320-c72a-49d3-bec8-8c2b49c772cd tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.192146 Jun 25 21:16:34.618782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2454/5348] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:34 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:35.227245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:35.227924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:35.248783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:35.249546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:35.250519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:35.251303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:35.487878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:35.500524 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea422a9c-a5ab-42b9-9e10-4ff86e7f1fbf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.276855 Jun 25 21:16:35.503722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2895/5349] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:35 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:35.629313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:35.630845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:35.641539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:35.643165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:35.644690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:35.645364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:35.820746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:35.828795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ef3b16c-4994-4cd2-ab37-90d4af566381 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.206771 Jun 25 21:16:35.829388 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2455/5350] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:35 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:36.523493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:36.524588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:36.536654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.537467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.538329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.538766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.694724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:36.705128 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07e4234b-c462-45ca-81e8-452746196612 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.188217 Jun 25 21:16:36.706141 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2896/5351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:36 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:36.828901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:36.833472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:36.851542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:36.853011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:36.859373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.860083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.861081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.861307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.861766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.862303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.862921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:36.863762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:36.947067 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03b163cc-f4d5-4ea0-9f38-f00d043714cb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action" status: 200 len: 24575 microversion: 2.1 time: 0.128426 Jun 25 21:16:36.947658 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2456/5352] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:16:36 2022] POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action => generated 24575 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:16:37.069157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:37.083618 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84962bb7-5b6a-48a9-9fbc-994ae8962106 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.235949 Jun 25 21:16:37.086667 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2897/5353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:36 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:37.207901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5fb9e94b-85ff-42c8-ab72-d167b5dadda6 req-647fa0c4-3895-41b0-814d-7a0c5b14d17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65436a4d-647b-4ac2-a352-e713d95839cf", "name": "network-vif-plugged", "status": "completed", "tag": "2fb34a05-736d-4bc4-95c5-10d9c47efca5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:37.221737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5fb9e94b-85ff-42c8-ab72-d167b5dadda6 req-647fa0c4-3895-41b0-814d-7a0c5b14d17d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:37.222653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5fb9e94b-85ff-42c8-ab72-d167b5dadda6 req-647fa0c4-3895-41b0-814d-7a0c5b14d17d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:37.247718 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5fb9e94b-85ff-42c8-ab72-d167b5dadda6 req-647fa0c4-3895-41b0-814d-7a0c5b14d17d service nova] Creating event network-vif-plugged:2fb34a05-736d-4bc4-95c5-10d9c47efca5 for instance 65436a4d-647b-4ac2-a352-e713d95839cf on nch1-master-1 Jun 25 21:16:37.256131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5fb9e94b-85ff-42c8-ab72-d167b5dadda6 req-647fa0c4-3895-41b0-814d-7a0c5b14d17d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051322 Jun 25 21:16:37.257251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2457/5354] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:37.722919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:37.723646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:37.731528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:37.731982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:37.733029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:37.733645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:37.941647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:37.943993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:37.951699 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3bec8c3-10a4-47bd-ab6d-2579b9e9c739 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1329 microversion: 2.1 time: 0.232979 Jun 25 21:16:37.952298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2898/5355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:37 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1329 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:38.099508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:38.100724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:38.106714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:38.107615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:38.114693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:38.115382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:38.116506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:38.117103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:38.294819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:38.304799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d72b322d-e1e9-47af-adf7-8570d0954d2c tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.206925 Jun 25 21:16:38.305819 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2458/5356] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:38 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:38.969898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:38.970524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:38.986046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:38.986833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:38.987633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:38.988253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.252971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:39.263509 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf1407e8-b876-402e-986f-1fa6aa5baef8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1509 microversion: 2.1 time: 0.298435 Jun 25 21:16:39.280656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:39.282051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:39.287637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2899/5357] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:38 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:39.291462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.292170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.293203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.293865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.328153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:39.329477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:39.338213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.339190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.340204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.340890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.588439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:39.601085 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7f2429f-1a4a-42d6-b0b9-c4029f1bf66f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.278986 Jun 25 21:16:39.612679 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2900/5358] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:39 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:39.616856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:39.627948 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ea7a9324-a33e-4fdb-8088-296f240b4a8c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1509 microversion: 2.1 time: 0.351507 Jun 25 21:16:39.639301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2459/5359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:39 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:39.646969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:39.647681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:39.661402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.662420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.664983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.665489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.727386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:39.811198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:39.885321 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e022787-cc1d-449a-b61c-936c2a5c1164 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 204 len: 0 microversion: 2.1 time: 0.241518 Jun 25 21:16:39.886225 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2901/5360] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:39 2022] DELETE /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:39.896488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:39.897697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:39.905037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.905754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:39.906691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:39.907308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.094696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:40.106909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-931dd757-8cff-453a-b307-319d4ee85c97 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1515 microversion: 2.1 time: 0.214614 Jun 25 21:16:40.110939 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2460/5361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:39 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1515 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:40.618075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:40.619446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:40.626745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.627201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.627972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.628632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.798515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:40.807131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7aedf00-4040-4340-b17a-fd3dfd50b103 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1486 microversion: 2.1 time: 0.193478 Jun 25 21:16:40.811812 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2902/5362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:40 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1486 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:40.828654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:40.830930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:40.841594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.842140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.842949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.843569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.934643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dfde8ffb-80ac-48b7-a8d8-70349a30befb tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "POST /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57/action" status: 202 len: 0 microversion: 2.1 time: 0.110518 Jun 25 21:16:40.939070 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2461/5363] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:16:40 2022] POST /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:16:40.948928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:40.950187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:40.971432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.973118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:40.975035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:40.975843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:41.129935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:41.131050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:41.156998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:41.157974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:41.168273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:41.170287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:41.284065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:41.299495 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16563cb3-3a21-43cd-bb83-bdd1a07d493a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1494 microversion: 2.1 time: 0.356392 Jun 25 21:16:41.300366 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2903/5364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:40 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1494 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:41.468596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:41.477974 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23034624-c7b6-48ba-a6cc-7fc37d0a27a1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1515 microversion: 2.1 time: 0.354877 Jun 25 21:16:41.491544 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2462/5365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:41 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1515 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:42.318097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:42.319464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:42.343815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.348089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.356210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.358454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.358737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-97619d8c-605e-4247-83a8-2c663eec31a7 req-d4c9019c-8284-4f15-8b04-c8fa1595cfce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65436a4d-647b-4ac2-a352-e713d95839cf", "name": "network-vif-deleted", "tag": "2fb34a05-736d-4bc4-95c5-10d9c47efca5"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:42.378593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-97619d8c-605e-4247-83a8-2c663eec31a7 req-d4c9019c-8284-4f15-8b04-c8fa1595cfce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.385792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-97619d8c-605e-4247-83a8-2c663eec31a7 req-d4c9019c-8284-4f15-8b04-c8fa1595cfce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.410814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-97619d8c-605e-4247-83a8-2c663eec31a7 req-d4c9019c-8284-4f15-8b04-c8fa1595cfce service nova] Creating event network-vif-deleted:2fb34a05-736d-4bc4-95c5-10d9c47efca5 for instance 65436a4d-647b-4ac2-a352-e713d95839cf on nch1-master-1 Jun 25 21:16:42.417138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-97619d8c-605e-4247-83a8-2c663eec31a7 req-d4c9019c-8284-4f15-8b04-c8fa1595cfce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063324 Jun 25 21:16:42.435980 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2463/5366] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:42.497323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:42.498620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:42.510940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.524993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.526962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.529358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.613937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:42.614382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:42.615030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lazy-loading 'fault' on Instance uuid 65436a4d-647b-4ac2-a352-e713d95839cf {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:42.674852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:42.683743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0aec875e-1174-4bbe-9fd6-084b636971c5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 200 len: 1319 microversion: 2.1 time: 0.192797 Jun 25 21:16:42.684380 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2464/5367] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:42 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:42.689606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-805077388", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:42.717647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:42.728901 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3df072ca-453a-4915-a5a2-3eae1fe66335 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1494 microversion: 2.1 time: 0.415657 Jun 25 21:16:42.730211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2904/5368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:42 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1494 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:42.748220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:16:43.138626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:43.139047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:43.139998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:43.140449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:43.140861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:43.155618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.156554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.157913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.159350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.181456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Getting quotas for project 15f9fd4b47d743aa9ba0081392ed3fc5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:43.187572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Getting quotas for user f6d2a50d421e4b28a78565f06bb6d3a0 and project 15f9fd4b47d743aa9ba0081392ed3fc5. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:43.203186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:43.205561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:43.257343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5e5f660-989b-45ae-b2c6-bfce5080ad96 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571479 Jun 25 21:16:43.258027 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2465/5369] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:16:43.269796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a6f353f-92d7-4365-98c0-93b048132e3a tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:43.270875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a6f353f-92d7-4365-98c0-93b048132e3a tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:43.376294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a6f353f-92d7-4365-98c0-93b048132e3a tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:43.384833 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a6f353f-92d7-4365-98c0-93b048132e3a tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1214 microversion: 2.1 time: 0.120181 Jun 25 21:16:43.398030 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2905/5370] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:43 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:43.703634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:43.705460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:43.716041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.716770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.717808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.718417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.744846 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf HTTP/1.1 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '65436a4d-647b-4ac2-a352-e713d95839cf'} Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:43.746818 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:43.752621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:43.753485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f433d6a6-8539-4fa0-97f1-d9a34f3b35cb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 404 len: 111 microversion: 2.1 time: 0.054093 Jun 25 21:16:43.754339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2466/5371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:43 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:43.767429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:43.767429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:43.767728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-767014ec-ce89-47da-aa4e-6728b8eacba2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '.version_select at 0x7f984f4bae50>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:43.772030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.772537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.773389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:43.773988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:43.786231 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-767014ec-ce89-47da-aa4e-6728b8eacba2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-key-1739392905" status: 202 len: 0 microversion: 2.1 time: 0.026649 Jun 25 21:16:43.786870 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2467/5372] 10.222.0.39 () {58 vars in 1208 bytes} [Sat Jun 25 21:16:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1739392905 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:16:43.970939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-621624154", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:44.009546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:44.020308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2df3c920-12b5-4431-9354-d2547af2354a tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1494 microversion: 2.1 time: 0.262488 Jun 25 21:16:44.024376 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2906/5373] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:43 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1494 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:44.064377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:16:44.404532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:44.405780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:44.418707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:44.421127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:44.422123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:44.424357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:44.497060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:44.510649 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7860176-334c-4d01-8e45-da94b04639d6 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1266 microversion: 2.1 time: 0.112336 Jun 25 21:16:44.511992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2907/5374] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:44 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:44.596256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:16:44.596782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:16:44.597336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:16:44.597856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:16:44.598645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:16:44.608735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:44.609186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:44.609983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:44.610817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:44.687024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:44.694811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:44.723244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:16:44.725860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:16:44.802757 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c0285e9-7919-4dd4-b5e6-4c3367fb6d61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838096 Jun 25 21:16:44.803581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2468/5375] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:16:44.816804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68b02006-7b2e-48e3-85a0-b79beee5f824 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:44.817759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68b02006-7b2e-48e3-85a0-b79beee5f824 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:44.929644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-68b02006-7b2e-48e3-85a0-b79beee5f824 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:44.939109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68b02006-7b2e-48e3-85a0-b79beee5f824 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1208 microversion: 2.1 time: 0.127148 Jun 25 21:16:44.939721 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2908/5376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:44 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1208 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:45.041452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:45.042320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:45.054108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.055724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.057496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.059587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.287393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:45.297409 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-18b463a7-e070-41b6-a4c8-271c8ffb81c1 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1500 microversion: 2.1 time: 0.260116 Jun 25 21:16:45.298573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2469/5377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:45 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1500 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:45.321524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:45.322050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:45.333850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.334465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.335296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.335823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.372195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:45.515625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06c8cccb-3e32-4b0c-85d7-b02fae91261d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 204 len: 0 microversion: 2.1 time: 0.200675 Jun 25 21:16:45.528657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:45.529714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:45.535197 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2909/5378] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:45 2022] DELETE /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:45.545932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.549238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.551716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:45.554366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.555335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.558429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:45.576262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.581008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.583865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.590434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.701371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:45.712603 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3919d19e-7887-4efb-b181-498ebf506d14 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1272 microversion: 2.1 time: 0.175048 Jun 25 21:16:45.713120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2910/5379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:45 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:45.773732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:45.784515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cdc56859-d238-470d-9505-37310db819b7 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.260226 Jun 25 21:16:45.785708 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2470/5380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:45 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:45.956308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:45.959032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:45.970217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.970697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:45.972284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:45.974606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:46.151248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:46.178080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26de70ee-015f-48b9-b29a-23c88f15925c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1212 microversion: 2.1 time: 0.225989 Jun 25 21:16:46.193560 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2911/5381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:45 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1212 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:46.730390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:46.731545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:46.741612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:46.742410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:46.743368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:46.746317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:46.791980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:46.803736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:46.804356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:46.821384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:46.821846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:46.822633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:46.823071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:47.043512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:47.053743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec44bd3c-ee9b-4ea2-8e65-3a24e0cb69f9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 0.327217 Jun 25 21:16:47.056383 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2471/5382] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:46 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:47.147037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:47.159901 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6695d95-19f1-4219-8d17-641d21e0fc2d tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.361176 Jun 25 21:16:47.168847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2912/5383] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:46 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:47.200698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:47.216808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:47.227983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:47.229141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:47.231329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e1ffaebf-9505-48d9-aa84-fedb392f49a1 req-a3c0f39c-a4f1-4416-b9ad-d84f78737f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08", "tag": "243ec7d8-6417-4841-afd3-a755046049d2"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:47.232407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:47.233035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:47.250824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e1ffaebf-9505-48d9-aa84-fedb392f49a1 req-a3c0f39c-a4f1-4416-b9ad-d84f78737f85 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:47.251686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e1ffaebf-9505-48d9-aa84-fedb392f49a1 req-a3c0f39c-a4f1-4416-b9ad-d84f78737f85 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:47.264858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e1ffaebf-9505-48d9-aa84-fedb392f49a1 req-a3c0f39c-a4f1-4416-b9ad-d84f78737f85 service nova] Creating event network-changed:243ec7d8-6417-4841-afd3-a755046049d2 for instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 on nch1-master-1 Jun 25 21:16:47.270324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e1ffaebf-9505-48d9-aa84-fedb392f49a1 req-a3c0f39c-a4f1-4416-b9ad-d84f78737f85 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043832 Jun 25 21:16:47.276679 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2913/5384] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:47.451859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:47.465240 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-004fc2cc-09af-425b-9ecb-0e02b677030e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1212 microversion: 2.1 time: 0.270723 Jun 25 21:16:47.471069 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2472/5385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:47 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1212 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:47.863614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:47.864324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:47.888397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:47.889144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:47.890042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:47.891420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.044895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34c5e952-44bb-4bf5-8f6e-d91e61952be8 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1830 microversion: 2.1 time: 0.186062 Jun 25 21:16:48.053901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2914/5386] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:47 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1830 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:48.061494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:48.063391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:48.072786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:48.073823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:48.081832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.082459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.082772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.083500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.084340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.085084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.086297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.088080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.268855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:48.285514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-136b9793-de7c-4737-8c23-25b53fc81b06 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1679 microversion: 2.1 time: 0.227785 Jun 25 21:16:48.298858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:48.299078 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2473/5387] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:48 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:48.307098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:48.308065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:48.317268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.317868 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35d0d917-dd1c-499e-8a8d-30fd2716388c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 0.246436 Jun 25 21:16:48.318844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.320162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.320830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.322070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2915/5388] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:48 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:48.482922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:48.486727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:48.496769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.497228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.498025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.498459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.585400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:48.597680 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12cf6fa6-f5dc-4389-a387-d2c798d7e764 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.297204 Jun 25 21:16:48.608511 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2474/5389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:48 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:48.615924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:48.616830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:48.626033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.627008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.627847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:48.628938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:48.713837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:48.722144 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4018ae4e-e241-4742-8be3-072ef952255e tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1204 microversion: 2.1 time: 0.110922 Jun 25 21:16:48.722739 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2475/5390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:48 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1204 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:48.891336 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6eb08cc-0c3a-4d07-becc-08a373c085a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action" status: 200 len: 32643 microversion: 2.1 time: 0.413033 Jun 25 21:16:48.896474 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2916/5391] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:16:48 2022] POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action => generated 32643 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 21:16:49.044142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:49.044755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:49.047747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:49.056099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.056620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.057658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.058405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.109461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cbb3982e7c3445209fea090c37590c63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba60c9d2e9f84e6f98b1681f72b9e35f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:49.112764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 1529e81e-bac1-4142-b308-05f212162b18] flavor_id is None. Assuming migration. {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4142}} Jun 25 21:16:49.114195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:16:49.337027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:49.339247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:49.361752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.369748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.371050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.371775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.399093 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-83212ca4-94f4-43a1-a862-b04ad4399ca4 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action" status: 202 len: 0 microversion: 2.1 time: 0.349866 Jun 25 21:16:49.400930 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2476/5392] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:16:49 2022] POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:16:49.412152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:49.414937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:49.426041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.437860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.438789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.439246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.725274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:49.735150 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85beeb74-cad5-44a3-88b1-245a7d77250b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1688 microversion: 2.1 time: 0.329608 Jun 25 21:16:49.743189 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2477/5393] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:49 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1688 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:49.754034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:49.761055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:49.776587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.777045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:49.777831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:49.778271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.127559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:50.147551 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1abe58c1-3760-4352-a4cc-25c2d1d1fb1f tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1506 microversion: 2.1 time: 0.402834 Jun 25 21:16:50.148158 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2478/5394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:49 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:50.162356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:50.162977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:50.170139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:50.170593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.171374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:50.171808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.312485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:50.324333 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-384147e2-7172-4121-9ce1-143803fad45a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1266 microversion: 2.1 time: 0.165895 Jun 25 21:16:50.324975 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2479/5395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:50 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:50.407368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:50.416585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a75e3545-fb1d-4cf3-a415-7ee292ff44ac tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 1.084996 Jun 25 21:16:50.417196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2917/5396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:49 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:50.765033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:50.766150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:50.781331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:50.785564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.786650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:50.788894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.860988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ac680d93-0c55-4f3b-bca6-f58895b62aaf req-e539b5f6-f574-4573-8141-6e1ce7c16679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c5b032-40de-4d58-be36-ebff5ed40c57", "name": "network-vif-deleted", "tag": "b656b12a-0f60-4045-b263-c168401086bf"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:50.895329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ac680d93-0c55-4f3b-bca6-f58895b62aaf req-e539b5f6-f574-4573-8141-6e1ce7c16679 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:50.896090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ac680d93-0c55-4f3b-bca6-f58895b62aaf req-e539b5f6-f574-4573-8141-6e1ce7c16679 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:50.939892 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ac680d93-0c55-4f3b-bca6-f58895b62aaf req-e539b5f6-f574-4573-8141-6e1ce7c16679 service nova] Creating event network-vif-deleted:b656b12a-0f60-4045-b263-c168401086bf for instance 99c5b032-40de-4d58-be36-ebff5ed40c57 on nch2-master-1 Jun 25 21:16:50.966905 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ac680d93-0c55-4f3b-bca6-f58895b62aaf req-e539b5f6-f574-4573-8141-6e1ce7c16679 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113482 Jun 25 21:16:50.974554 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2918/5397] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 25 21:16:51.166481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:51.167364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:51.189672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:51.193825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:51.197963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:51.199781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:51.386930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:51.388392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:51.389353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lazy-loading 'fault' on Instance uuid 99c5b032-40de-4d58-be36-ebff5ed40c57 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:51.418318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:51.727614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:51.740486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-04b490d6-6ded-4cc8-8a92-3b80c401f01e tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 200 len: 1304 microversion: 2.1 time: 0.577053 Jun 25 21:16:51.742232 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2919/5398] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:51 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 1304 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:51.749643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:51.750256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:51.768183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:51.770202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:51.772123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:51.774286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.102402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:52.110590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3796e3ca-41ce-45b5-aaa6-9bc5dd6d8a93 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.366889 Jun 25 21:16:52.122901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2920/5399] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:51 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:52.130118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:52.132275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:52.139158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.139927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.140907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.141503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.288262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:52.301074 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d401c14-7cfa-4609-9127-856ac4349e5d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1688 microversion: 2.1 time: 1.543127 Jun 25 21:16:52.304202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2480/5400] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:50 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1688 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:52.437093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:52.466292 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a41c669a-2ddd-4199-b9d9-06944c888751 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 0.335912 Jun 25 21:16:52.467763 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2921/5401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:52 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:52.769584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:52.770572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 99c5b032-40de-4d58-be36-ebff5ed40c57] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:52.780654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.782572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.784238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.785404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.846515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] HTTP exception thrown: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Request method failure captured: Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 HTTP/1.1 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rOy9KmuSFlttFAqVrUpWU9I3psTYSuobRbdv-PeWggJ7RuSpxcPcoR8_XKtzweWhr0Npt469VdD2BGbzEwe0OTkc1QKvoRnOPNWlSaqO_Vr71LOUzrZLuX8kelFmADlb9SN9d-0HWQO6vw41iQM00ryxZAlNV1C4_ttGRE-MZwc-A Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0a0dcb1380ad41328b6779588f0e91f6 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a0dcb1380ad41328b6779588f0e91f6"}]}] Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0a0dcb1380ad41328b6779588f0e91f6 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueTestJSON-956481267-project Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1554f1d20e344432b617857d279f6d37 Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueTestJSON-956481267-project Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '99c5b032-40de-4d58-be36-ebff5ed40c57'} Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:52.848615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. Jun 25 21:16:52.854223 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:52.864996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Returning 404 to user: Instance 99c5b032-40de-4d58-be36-ebff5ed40c57 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:52.866935 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c73a428c-cd44-4843-a095-283f3a900ef9 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57" status: 404 len: 111 microversion: 2.1 time: 0.112404 Jun 25 21:16:52.871123 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2481/5402] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:52 2022] GET /compute/v2.1/servers/99c5b032-40de-4d58-be36-ebff5ed40c57 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:16:52.880221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:52.880886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:52.896508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.896994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:52.897825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:52.898355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.000681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:53.158494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:53.159697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:53.188631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.189344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.194265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.195781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.231813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8ae9816a-3c86-4d09-8a54-a029e3379967 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 204 len: 0 microversion: 2.1 time: 0.350677 Jun 25 21:16:53.232643 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2922/5403] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:52 2022] DELETE /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:53.247531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:53.252761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:53.272135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.274448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.278208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.278787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.550591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:53.562819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b59dad17-b271-4b7f-a285-91928debb9c0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.420433 Jun 25 21:16:53.569598 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2482/5404] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:53 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:53.574745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-49a2ef8c-ca7f-4ead-8b8d-7a3c4f91e7dc req-88dc39b4-056e-4c97-bc12-def71455408e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655a5cc4-ba12-447f-98ed-95c421f3e4ac", "tag": "00db4f11-776c-4458-b8f2-6366a1ce9577"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:53.595202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-49a2ef8c-ca7f-4ead-8b8d-7a3c4f91e7dc req-88dc39b4-056e-4c97-bc12-def71455408e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.595423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-49a2ef8c-ca7f-4ead-8b8d-7a3c4f91e7dc req-88dc39b4-056e-4c97-bc12-def71455408e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.611719 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-49a2ef8c-ca7f-4ead-8b8d-7a3c4f91e7dc req-88dc39b4-056e-4c97-bc12-def71455408e service nova] Creating event network-changed:00db4f11-776c-4458-b8f2-6366a1ce9577 for instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac on nch2-master-1 Jun 25 21:16:53.619978 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-49a2ef8c-ca7f-4ead-8b8d-7a3c4f91e7dc req-88dc39b4-056e-4c97-bc12-def71455408e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048804 Jun 25 21:16:53.620636 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2483/5405] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:53.631125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:53.631867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:53.640322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.641049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.642605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.643228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.857891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:53.862819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:53.871922 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-51910b06-aec0-406b-8dc9-19fe01806611 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1688 microversion: 2.1 time: 0.249850 Jun 25 21:16:53.873381 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c7e0a28-4a01-4438-b488-74bd9bf3e540 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1490 microversion: 2.1 time: 0.636195 Jun 25 21:16:53.882332 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2484/5406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:53 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:53.886656 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2923/5407] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:53 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1490 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:53.888886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:53.889722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:53.892003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fc370705-c2e3-4603-8f78-c9684a7deaa0 req-b254c928-460e-4d4e-83d4-9abf772494a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08", "name": "network-vif-plugged", "status": "completed", "tag": "243ec7d8-6417-4841-afd3-a755046049d2"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:53.897033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.897504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.898289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.898733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.901544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fc370705-c2e3-4603-8f78-c9684a7deaa0 req-b254c928-460e-4d4e-83d4-9abf772494a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:53.902797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fc370705-c2e3-4603-8f78-c9684a7deaa0 req-b254c928-460e-4d4e-83d4-9abf772494a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:53.928490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fc370705-c2e3-4603-8f78-c9684a7deaa0 req-b254c928-460e-4d4e-83d4-9abf772494a8 service nova] Creating event network-vif-plugged:243ec7d8-6417-4841-afd3-a755046049d2 for instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 on nch1-master-1 Jun 25 21:16:53.936010 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fc370705-c2e3-4603-8f78-c9684a7deaa0 req-b254c928-460e-4d4e-83d4-9abf772494a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047186 Jun 25 21:16:53.937473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2924/5408] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:54.091997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:54.101231 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5ef8b3dd-fd0b-47de-a9b3-5d3b19316266 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 0.217504 Jun 25 21:16:54.111161 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2485/5409] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:53 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:54.580202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:54.580951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:54.584501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:54.588576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.589033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.589899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.590341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.659904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:54.660482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:54.663348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:54.669325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.669767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.670757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.671364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.696527 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a26e397-adc0-44d0-8e83-7a3f4e756b34 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/ips" status: 200 len: 148 microversion: 2.1 time: 0.040780 Jun 25 21:16:54.697129 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2486/5410] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:16:54 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:54.731547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:54.739205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11e38c55-f1bf-4ecc-a6e9-616dda9d1fda tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.163429 Jun 25 21:16:54.739759 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2925/5411] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:54 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:54.891340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:54.891956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:54.892073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:54.892194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:54.895599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:54.898606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.899062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.899836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.900272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.902475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.902933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.904189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:54.907716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:54.938641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:55.111400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:55.125709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-061a225c-6a50-4809-9919-00cfe2fdf562 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1490 microversion: 2.1 time: 0.237985 Jun 25 21:16:55.126620 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2926/5412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:54 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1490 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:55.139220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:55.139876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:55.159822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:55.160601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:55.161564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:55.162258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:55.168100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:55.178084 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-76969391-ef3f-4c7d-a18a-7dd76be47436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.290615 Jun 25 21:16:55.179187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2487/5413] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:54 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:55.353206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:55.364137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83baac40-d526-427f-b6fa-ef60a3986bf3 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1314 microversion: 2.1 time: 0.236422 Jun 25 21:16:55.377467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2927/5414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:55 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:55.756286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:55.757188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:55.764498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:55.765038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:55.765906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:55.766563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:55.783952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:56.081708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:56.091622 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f9aa0a56-cdf3-45e4-b9dd-d527d9570de6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.339285 Jun 25 21:16:56.092546 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2488/5415] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:55 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:56.099770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ebdd798-3bf7-43ca-a95f-02a861d932e8"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:56.104524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.112889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.113794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.114767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.115368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.143321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:56.145117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.154122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.155138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.155978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.156410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.415704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-763ba4f9-8219-4897-a239-7a0a199d545f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320735 Jun 25 21:16:56.416617 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2928/5416] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:16:56 2022] POST /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:56.425507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:56.426607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.437520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.438158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.439065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.440517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.497094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:56.510963 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-018007a9-3e17-4ad9-bf58-1e7e10ed5c98 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1490 microversion: 2.1 time: 0.371639 Jun 25 21:16:56.511568 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2489/5417] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:56 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1490 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:56.516409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:56.517355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.539351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.540275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.543092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.544206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.646586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:56.657372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df7e6b6f-9027-4154-a081-c6229297ac75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.239380 Jun 25 21:16:56.658227 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2929/5418] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:56 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:56.683772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-50f91d35-116d-44b6-a9bd-7fa36baa91cf req-b6b113d9-797e-4cb8-8367-61b464f9a56d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a57a50f-f503-4fde-b5ae-7feccfd74520", "name": "network-vif-deleted", "tag": "4f313a90-c23e-4c8f-9357-696f919c3d23"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:56.694345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50f91d35-116d-44b6-a9bd-7fa36baa91cf req-b6b113d9-797e-4cb8-8367-61b464f9a56d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.695110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50f91d35-116d-44b6-a9bd-7fa36baa91cf req-b6b113d9-797e-4cb8-8367-61b464f9a56d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.711652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-50f91d35-116d-44b6-a9bd-7fa36baa91cf req-b6b113d9-797e-4cb8-8367-61b464f9a56d service nova] Creating event network-vif-deleted:4f313a90-c23e-4c8f-9357-696f919c3d23 for instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 on nch2-master-1 Jun 25 21:16:56.716882 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-50f91d35-116d-44b6-a9bd-7fa36baa91cf req-b6b113d9-797e-4cb8-8367-61b464f9a56d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040787 Jun 25 21:16:56.718626 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2930/5419] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:56.767750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:56.775684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b57063f-4e3e-43aa-ad0c-5ed43a4332e9 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1464 microversion: 2.1 time: 0.263131 Jun 25 21:16:56.776292 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2490/5420] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:56 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:56.820499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:56.821123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.828042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.828542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.829314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.829753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.855717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:16:56.939184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb7bca00-c68f-42cf-806b-eb94edd39635 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "DELETE /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 204 len: 0 microversion: 2.1 time: 0.123219 Jun 25 21:16:56.940085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2931/5421] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:16:56 2022] DELETE /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:16:56.949187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:56.949800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:56.960144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.960144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:56.960144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:56.960144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.109992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:57.111277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:57.118312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.118831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.119673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.120139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.161481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:57.172092 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e93917d4-375f-44fd-bb41-821e8096821f tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1470 microversion: 2.1 time: 0.226894 Jun 25 21:16:57.183272 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2491/5422] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:56 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:57.270645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:57.273604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:16:57.282548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f206d579-4525-40d3-886e-0ac6b154038f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.176675 Jun 25 21:16:57.283269 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2932/5423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:57 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:57.528701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:57.529312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:57.538980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.539387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.540168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.540640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.618609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.619197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.619982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lazy-loading 'fault' on Instance uuid 3a57a50f-f503-4fde-b5ae-7feccfd74520 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:57.675212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:57.675840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:57.683712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:57.686856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.687421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.688390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:57.688906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:57.694574 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d3095af-0b5e-413f-bf04-a853cea7e5ec tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1303 microversion: 2.1 time: 0.170109 Jun 25 21:16:57.695545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2492/5424] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:57 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1303 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:57.839862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:57.847868 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b143514e-fbe3-45a4-89b5-7256c02fbf0d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.177419 Jun 25 21:16:57.848633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2933/5425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:57 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:58.190495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:58.191209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:58.199281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.199795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.200589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.201030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.301181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:58.301805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:58.308518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.308971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.318638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.319315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.409548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:58.420375 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db6b7b24-9b40-4111-a8aa-597bd68c68d2 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1470 microversion: 2.1 time: 0.233829 Jun 25 21:16:58.424501 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2493/5426] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:58 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:58.487051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:58.495923 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f079176b-ec04-4202-ba2b-07c33b19f141 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.199807 Jun 25 21:16:58.496713 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2934/5427] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:58 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:58.713233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:58.714325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:58.722609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.723830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.725008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.726047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.764295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.765067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.765536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lazy-loading 'fault' on Instance uuid 3a57a50f-f503-4fde-b5ae-7feccfd74520 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:58.865344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:58.865882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:58.872807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.873290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.874065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:58.874530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:58.882600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1554f1d20e344432b617857d279f6d37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a0dcb1380ad41328b6779588f0e91f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:58.897388 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-628daf86-8fdb-4738-88af-7964d32699f6 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 200 len: 1303 microversion: 2.1 time: 0.189332 Jun 25 21:16:58.898183 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2494/5428] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:58 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:59.042587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:59.050844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d05f2e77-ea1f-4853-9022-8c851892291d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.189749 Jun 25 21:16:59.061693 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2935/5429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:58 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:16:59.249937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2351b70f-f0c2-48c3-94d9-aa41a1092270 req-b0da0697-97f0-466e-9690-d959d0c20d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08", "name": "network-vif-deleted", "tag": "243ec7d8-6417-4841-afd3-a755046049d2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:59.261986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2351b70f-f0c2-48c3-94d9-aa41a1092270 req-b0da0697-97f0-466e-9690-d959d0c20d0f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.262440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2351b70f-f0c2-48c3-94d9-aa41a1092270 req-b0da0697-97f0-466e-9690-d959d0c20d0f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.296418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2351b70f-f0c2-48c3-94d9-aa41a1092270 req-b0da0697-97f0-466e-9690-d959d0c20d0f service nova] Creating event network-vif-deleted:243ec7d8-6417-4841-afd3-a755046049d2 for instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 on nch1-master-1 Jun 25 21:16:59.306330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2351b70f-f0c2-48c3-94d9-aa41a1092270 req-b0da0697-97f0-466e-9690-d959d0c20d0f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060597 Jun 25 21:16:59.312694 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2495/5430] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:16:59.438033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:59.438734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:59.455429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.455894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.456725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.457173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.513655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:59.514355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:59.520977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.521693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.522846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.523443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.523575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.524124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.524413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lazy-loading 'fault' on Instance uuid 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:16:59.572568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6d2a50d421e4b28a78565f06bb6d3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f9fd4b47d743aa9ba0081392ed3fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:59.581471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72e1fe85-5ce9-4dbb-acf0-ca81769f701c tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 200 len: 1304 microversion: 2.1 time: 0.147152 Jun 25 21:16:59.582491 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2936/5431] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:59 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:59.675479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:16:59.684825 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c38ff7e-0ca4-4420-9ad9-6720d2ab416f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.175340 Jun 25 21:16:59.699922 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2496/5432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:59 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:16:59.824159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20cdbcfb-0b26-43ff-9a92-89751935eba2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: .version_select at 0x7f984ebc85e0>, body: {"keypair": {"name": "tempest-keypair-389429767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcTSjaAIpYETky60OQSXZEiqAyJj++Ndhs/jtPQKcRk2Pr5Zk+uaH212iD2fImRywyj3nJB4zLYAhZupajR8QRUQx+sQeyNeLxCNACSI6l52ciHhg/7rQmiOJ1bmQkfMQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:16:59.842970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-20cdbcfb-0b26-43ff-9a92-89751935eba2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:16:59.848538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-20cdbcfb-0b26-43ff-9a92-89751935eba2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:16:59.875090 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-20cdbcfb-0b26-43ff-9a92-89751935eba2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063555 Jun 25 21:16:59.876029 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2937/5433] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:16:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:16:59.914306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:16:59.915149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] [instance: 3a57a50f-f503-4fde-b5ae-7feccfd74520] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:16:59.921679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.922137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.923093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:16:59.923553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:16:59.937558 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] HTTP exception thrown: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Request method failure captured: Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 HTTP/1.1 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rOy9KmuSFlttFAqVrUpWU9I3psTYSuobRbdv-PeWggJ7RuSpxcPcoR8_XKtzweWhr0Npt469VdD2BGbzEwe0OTkc1QKvoRnOPNWlSaqO_Vr71LOUzrZLuX8kelFmADlb9SN9d-0HWQO6vw41iQM00ryxZAlNV1C4_ttGRE-MZwc-A Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0a0dcb1380ad41328b6779588f0e91f6 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0a0dcb1380ad41328b6779588f0e91f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0a0dcb1380ad41328b6779588f0e91f6"}]}] Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0a0dcb1380ad41328b6779588f0e91f6 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerRescueTestJSON-956481267 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerRescueTestJSON-956481267-project Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 1554f1d20e344432b617857d279f6d37 Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerRescueTestJSON-956481267-project Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '3a57a50f-f503-4fde-b5ae-7feccfd74520'} Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:16:59.939303 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] Returning 404 to user: Instance 3a57a50f-f503-4fde-b5ae-7feccfd74520 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2e181e25-7fd7-45b5-b5fc-97b23516f2c0 tempest-ServerRescueTestJSON-956481267 tempest-ServerRescueTestJSON-956481267-project] 10.222.0.39 "GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520" status: 404 len: 111 microversion: 2.1 time: 0.031061 Jun 25 21:16:59.945389 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2497/5434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:16:59 2022] GET /compute/v2.1/servers/3a57a50f-f503-4fde-b5ae-7feccfd74520 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:00.068738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:00.069453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:00.075920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.076515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.077304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.077744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.249020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:00.257677 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7e018b1-0977-4761-9f1d-6f2b3014d1eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.192973 Jun 25 21:17:00.258310 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2938/5435] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:00 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:00.599880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:00.600808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] [instance: 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:00.608619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.609074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.610061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.610495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.625423 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] HTTP exception thrown: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Request method failure captured: Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 HTTP/1.1 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3s4WqtCCijIWLxcwKOAUDY_Sqv1bmPyVM-ll9uP2H8kczhxhas8C8qt9Q9ZdGQmj0dL-3azY_NrRe1b-T98hatTO5UY_-K5Krg45PhAbDeq6f0KMbVsJxlSIj4gBhmRS774lgNpUc1Knq2VsnbyvZEKgIo9EjrfLy4oa9SV3WZQN-k Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 15f9fd4b47d743aa9ba0081392ed3fc5 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesNegativeTest-1153177309 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15f9fd4b47d743aa9ba0081392ed3fc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15f9fd4b47d743aa9ba0081392ed3fc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15f9fd4b47d743aa9ba0081392ed3fc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15f9fd4b47d743aa9ba0081392ed3fc5"}]}] Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesNegativeTest-1153177309 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 15f9fd4b47d743aa9ba0081392ed3fc5 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesNegativeTest-1153177309 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesNegativeTest-1153177309-project Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: f6d2a50d421e4b28a78565f06bb6d3a0 Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesNegativeTest-1153177309-project Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08'} Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:00.627264 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] Returning 404 to user: Instance 873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:17:00.633614 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f7dea0c7-a06f-49d8-bb0a-fbc6a95c9410 tempest-VolumesNegativeTest-1153177309 tempest-VolumesNegativeTest-1153177309-project] 10.222.0.39 "GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08" status: 404 len: 111 microversion: 2.1 time: 0.032983 Jun 25 21:17:00.635786 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2498/5436] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:00 2022] GET /compute/v2.1/servers/873b42a0-e2a6-4f6b-b8b3-05cbeefb2e08 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:00.721252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:00.722574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:00.731644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.733203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.735151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:00.736193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:00.904540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:00.914518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72449483-23bc-491e-8c90-d7a6aabaed07 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.198626 Jun 25 21:17:00.915722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2939/5437] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:00 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:01.275476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:01.276082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:01.282690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:01.283372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:01.284327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:01.285002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:01.613532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:01.626714 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a5a21e2e-47d7-4712-b539-e4ff59cadc8b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.355103 Jun 25 21:17:01.628037 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2499/5438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:01 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:01.932539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:01.935245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:01.944616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:01.945238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:01.946612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:01.947222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:02.170280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:02.185646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-575db8b0-9ab1-434b-af05-6175c3771814 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.257050 Jun 25 21:17:02.197375 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2940/5439] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:01 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:02.489419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1959050852", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15adaf3c-53a3-47ee-a619-76a812ef788d"}], "security_groups": [{"name": "tempest-securitygroup--568786696"}], "key_name": "tempest-keypair-389429767", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:02.645908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:02.646847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:02.656452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:02.658254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:02.670322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] validate_networks() for [('15adaf3c-53a3-47ee-a619-76a812ef788d', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:17:02.678453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:02.678972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:03.008298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:03.019189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dc9095c-8067-4698-bdd9-fb7f61c93764 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.377883 Jun 25 21:17:03.020531 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2941/5440] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:02 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:03.205118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:17:03.206841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:17:03.207499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:17:03.209189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:17:03.210790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:17:03.213275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:03.220110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:03.237687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:03.242259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:03.242721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:03.243528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:03.243971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:03.247199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:03.248039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:03.248509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:03.303103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:17:03.322986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:17:03.351343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:17:03.352740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:17:03.425432 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb4ce788-cddb-4750-bf53-56bb60400c37 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.951629 Jun 25 21:17:03.426288 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2500/5441] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:17:03.440084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8a33bb1d-69c3-4a19-b749-0f4dabff19a3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:03.441155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8a33bb1d-69c3-4a19-b749-0f4dabff19a3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:03.517303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8a33bb1d-69c3-4a19-b749-0f4dabff19a3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:03.527338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8a33bb1d-69c3-4a19-b749-0f4dabff19a3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1241 microversion: 2.1 time: 0.093466 Jun 25 21:17:03.528141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2501/5442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:03 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:03.611592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:03.625075 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b3645db-626c-4976-a335-0793bb7e8a6a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.424166 Jun 25 21:17:03.627611 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2942/5443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:03 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:03.986723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0543ae24-1c35-4e2b-be66-6324dd387ef3 req-a0492350-721b-4886-aa8f-5a4889be3824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655a5cc4-ba12-447f-98ed-95c421f3e4ac", "name": "network-vif-plugged", "status": "completed", "tag": "00db4f11-776c-4458-b8f2-6366a1ce9577"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:04.002347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0543ae24-1c35-4e2b-be66-6324dd387ef3 req-a0492350-721b-4886-aa8f-5a4889be3824 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.006175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0543ae24-1c35-4e2b-be66-6324dd387ef3 req-a0492350-721b-4886-aa8f-5a4889be3824 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.038829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:04.039478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:04.039609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0543ae24-1c35-4e2b-be66-6324dd387ef3 req-a0492350-721b-4886-aa8f-5a4889be3824 service nova] Creating event network-vif-plugged:00db4f11-776c-4458-b8f2-6366a1ce9577 for instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac on nch2-master-1 Jun 25 21:17:04.050452 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0543ae24-1c35-4e2b-be66-6324dd387ef3 req-a0492350-721b-4886-aa8f-5a4889be3824 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067446 Jun 25 21:17:04.054728 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2502/5444] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:04.056048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.057818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.058634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.059081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.334242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:04.342731 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b0615744-b0ad-4b6f-97ff-5d57e903275f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.310102 Jun 25 21:17:04.344469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2943/5445] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:04 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:04.547501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:04.548576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:04.557304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.558114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.559276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.559924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.643372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:04.644104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:04.654976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.655590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.656851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:04.657543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:04.709950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:04.743376 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7353a78d-a62b-4bb7-a6e9-01db19898fc9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1293 microversion: 2.1 time: 0.201765 Jun 25 21:17:04.773374 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2503/5446] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:04 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1293 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:04.907429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:04.917756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b19c8898-6679-4a18-b410-e668422d797f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1308 microversion: 2.1 time: 0.279094 Jun 25 21:17:04.918856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2944/5447] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:04 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1308 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:05.359822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:05.360470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:05.368255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.370196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:05.370196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.370196 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:05.511620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:05.521515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fed065f0-48b6-444e-9211-e9d56de0ef95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1693 microversion: 2.1 time: 0.165194 Jun 25 21:17:05.522242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2504/5448] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:05 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:05.766193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:05.767084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:05.775279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.775805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:05.776702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.777209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:05.856625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:05.865829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-413c928f-1e5c-47ea-b5bd-de3e71510e52 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1301 microversion: 2.1 time: 0.105139 Jun 25 21:17:05.876758 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2945/5449] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:05 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1301 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:05.936522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:05.937545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:05.944372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.944908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:05.945778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:05.946150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:06.538831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:06.539623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:06.546241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:06.546851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:06.547935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:06.548493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:06.692642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:06.701746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0d45d05f-e0d7-4715-9347-9ffe90010ae2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1488 microversion: 2.1 time: 0.769265 Jun 25 21:17:06.702355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2505/5450] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:05 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1488 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:06.738238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:06.747035 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2e3f2bf6-bc86-49a5-a54b-54e9a8bf74fe tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1692 microversion: 2.1 time: 0.212280 Jun 25 21:17:06.748901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2946/5451] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:06 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:06.875991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-621624154", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:06.886752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:06.887384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:06.904014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:06.904476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:06.905236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:06.905676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:06.982139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:17:07.000842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:07.012865 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ea60243-33a6-4560-bdec-c1c7064dadf2 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1299 microversion: 2.1 time: 0.130595 Jun 25 21:17:07.013991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2947/5452] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:06 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:07.684080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-unplugged", "status": "completed", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:07.699640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:07.700240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:07.722097 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] Creating event network-vif-unplugged:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch2-master-1 Jun 25 21:17:07.731116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] Instance 1529e81e-bac1-4142-b308-05f212162b18 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:17:07.750925 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f8178fb1-3903-4b02-bde6-5a05c1b1c3d4 req-261fe263-7bdb-4f76-bdb6-45f9feb9c364 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090128 Jun 25 21:17:07.752619 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2948/5453] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:07.766355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:07.767166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:07.783898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:07.784523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:07.785696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:07.786553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:08.109324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:17:08.110484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:17:08.111283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:17:08.111923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:17:08.114761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:17:08.157147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:08.162126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:08.163436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:08.165313 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57d7d9c4-4ffc-4a81-9cad-272214fac0bc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1692 microversion: 2.1 time: 0.403935 Jun 25 21:17:08.168304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:08.169407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:08.169544 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2949/5454] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:07 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1692 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:08.175980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:08.176835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:08.194318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:08.197097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:08.199545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:08.200300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:08.213048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:17:08.226009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:17:08.246446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:08.274455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:17:08.280045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:17:08.382066 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-84550ea4-178b-4b28-9aa6-0879953c346c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.511622 Jun 25 21:17:08.384927 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2506/5455] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:17:08.407842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-58886fd7-2183-4f20-8bd4-b1da850a0b4c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:08.410772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-58886fd7-2183-4f20-8bd4-b1da850a0b4c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:08.418720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:08.615115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:08.624317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e03534ce-81eb-4190-94e9-af7168429802 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.453756 Jun 25 21:17:08.624507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-58886fd7-2183-4f20-8bd4-b1da850a0b4c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:08.625646 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2950/5456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:08 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:08.641915 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-58886fd7-2183-4f20-8bd4-b1da850a0b4c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1208 microversion: 2.1 time: 0.242016 Jun 25 21:17:08.642605 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2507/5457] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:08 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1208 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:09.189496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:09.190030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:09.214502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.214984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.215792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.216295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.430782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:09.440288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80abac9b-f5e9-4bdb-a8c0-a0375e0d812a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1692 microversion: 2.1 time: 0.254746 Jun 25 21:17:09.441152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2951/5458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:09 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1692 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:09.646908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:09.647726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:09.657237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.657694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.658693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.659319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.661910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:09.662501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:09.675250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.675883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.679637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.680707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.793149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:09.811951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92d3f164-ad8c-4218-9b23-072759c04850 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1268 microversion: 2.1 time: 0.156420 Jun 25 21:17:09.813450 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2952/5459] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:09 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:09.842893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:09.858545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:09.859305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:09.864989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:09.877335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] Creating event network-changed:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch2-master-1 Jun 25 21:17:09.885402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] Instance 1529e81e-bac1-4142-b308-05f212162b18 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:17:09.898296 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d9df3319-8347-4cab-a169-e58817207261 req-267b51d0-a87c-4567-8bca-f5e752708c5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062682 Jun 25 21:17:09.899633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2953/5460] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:17:10.461864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:10.462607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:10.477955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:10.480619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:10.481614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:10.485239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:10.768761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:10.781725 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c93a63a-6c52-416e-98ce-2e268a0ac7fd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 1.141616 Jun 25 21:17:10.782376 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2508/5461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:09 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:10.830417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:10.831044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:10.845043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:10.845776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:10.850686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:10.851173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:10.855285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:10.865652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f859ae7-3d8e-4d63-a5a7-179221e675f8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1692 microversion: 2.1 time: 0.410541 Jun 25 21:17:10.866685 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2954/5462] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:10 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:11.030283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:11.043205 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aa6023ae-480c-4c79-822b-176cd397b5e9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1266 microversion: 2.1 time: 0.214029 Jun 25 21:17:11.044947 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2509/5463] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:10 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:11.809160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:11.812577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:11.838149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:11.839503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:11.848061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:11.849030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:11.888119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:11.890058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:11.915247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:11.915875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:11.921528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:11.921748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:11.938569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:12.214882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:12.227003 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54cf7408-f803-493a-bb60-15cc9011126a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.425813 Jun 25 21:17:12.228637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2955/5464] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:11 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:12.235454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e0373b17-7813-409d-8f3e-f09f31dac001 req-c8fa6cfc-7f47-4dbf-952b-babd395791fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28f89650-ba09-4528-a880-99c11aa84659", "tag": "3bf17f37-3871-4c1a-9342-70654d7405b8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:12.245013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e0373b17-7813-409d-8f3e-f09f31dac001 req-c8fa6cfc-7f47-4dbf-952b-babd395791fb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:12.245459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e0373b17-7813-409d-8f3e-f09f31dac001 req-c8fa6cfc-7f47-4dbf-952b-babd395791fb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:12.261005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e0373b17-7813-409d-8f3e-f09f31dac001 req-c8fa6cfc-7f47-4dbf-952b-babd395791fb service nova] Creating event network-changed:3bf17f37-3871-4c1a-9342-70654d7405b8 for instance 28f89650-ba09-4528-a880-99c11aa84659 on nch1-master-1 Jun 25 21:17:12.268166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e0373b17-7813-409d-8f3e-f09f31dac001 req-c8fa6cfc-7f47-4dbf-952b-babd395791fb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037594 Jun 25 21:17:12.270989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2956/5465] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:12.278040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:12.279101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:12.286375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:12.287040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:12.288227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:12.288847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:12.401613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:12.412656 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ab271e2-51f9-4a82-a70b-5afdae934767 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1266 microversion: 2.1 time: 0.139551 Jun 25 21:17:12.422418 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2957/5466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:12 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:12.500042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:12.509901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-58bd363c-a90f-4425-994e-cbe10a2c6279 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1692 microversion: 2.1 time: 0.629013 Jun 25 21:17:12.511081 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2510/5467] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:11 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1692 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:13.250489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:13.252655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:13.259752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.260471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:13.261450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.262189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:13.425223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:13.431490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:13.432268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:13.434125 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d85e152-266b-46f4-8fc2-43229babb498 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.190826 Jun 25 21:17:13.435186 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2958/5468] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:13 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:13.440043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.440631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:13.441401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.442081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:13.633659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:13.642990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2413edb-c7f5-48e6-bc56-c62323d7cef1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.217406 Jun 25 21:17:13.643764 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2511/5469] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:13 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:13.825863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:13.826781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:13.836401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.837557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:13.838953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:13.839614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:14.005239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:14.016100 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f8c6512-f8b1-4fee-bcd2-a46e573bdc86 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1690 microversion: 2.1 time: 0.492454 Jun 25 21:17:14.029426 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2959/5470] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:13 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1690 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:14.453006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:14.453635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:14.462456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:14.463321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:14.464391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:14.465061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:14.674701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:14.682789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:14.683523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:14.693784 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00da8fd3-bab0-41ce-a846-b2b838988a70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.245835 Jun 25 21:17:14.696264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2512/5471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:14 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:14.707084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:14.708909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:14.709812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:14.711974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:15.036073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:15.043120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:15.070227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:15.084408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:15.085286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:15.085721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:15.097890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:15.115645 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-451854b2-1cbb-4dd4-b8d7-f0a53c9fb8ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.455648 Jun 25 21:17:15.118374 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2960/5472] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:14 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:15.567411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:15.581040 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f088a74f-1b38-477d-bd4e-7dd6f0b094cc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1690 microversion: 2.1 time: 0.551392 Jun 25 21:17:15.581974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2513/5473] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:15 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1690 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:15.718530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:15.719205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:15.731243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:15.731590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:15.732821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:15.733634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.029864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:16.038294 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40e3cd68-02dc-442d-8a93-8e60aa382a82 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.326176 Jun 25 21:17:16.042558 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2961/5474] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:15 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:16.136002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:16.136667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:16.177459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:16.177924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.178710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:16.179154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.475681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:16.495830 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-09b5eada-35de-43af-b337-7d71dd939980 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.360168 Jun 25 21:17:16.497278 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2514/5475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:16 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:16.617902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:16.620734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:16.622373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3e57b546-6b41-4bec-bd42-300b69beda7c req-719cc852-94ff-4f71-a700-7b6f29088112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe3ffc5-48f4-4953-9039-43bdcddd5537", "tag": "84070454-1f2c-4014-a8f8-35936e20774b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:16.636812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:16.637803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.642961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:16.646457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.656392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3e57b546-6b41-4bec-bd42-300b69beda7c req-719cc852-94ff-4f71-a700-7b6f29088112 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:16.657860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3e57b546-6b41-4bec-bd42-300b69beda7c req-719cc852-94ff-4f71-a700-7b6f29088112 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:16.690195 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3e57b546-6b41-4bec-bd42-300b69beda7c req-719cc852-94ff-4f71-a700-7b6f29088112 service nova] Creating event network-changed:84070454-1f2c-4014-a8f8-35936e20774b for instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 on nch2-master-1 Jun 25 21:17:16.698854 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3e57b546-6b41-4bec-bd42-300b69beda7c req-719cc852-94ff-4f71-a700-7b6f29088112 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097367 Jun 25 21:17:16.702302 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2515/5476] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:16.985722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:16.996664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bd2f6b6-7eeb-4e71-a2f5-a34d34404a95 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1687 microversion: 2.1 time: 0.401201 Jun 25 21:17:16.997619 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2962/5477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:16 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1687 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:17.019957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:17.028909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:17.049309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.049767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.050572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.055888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.058443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:17.059400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:17.066969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.068062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.070661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.072219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.307283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59330f0f-8f82-4481-b3c1-655da29e383a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action" status: 202 len: 0 microversion: 2.1 time: 0.290855 Jun 25 21:17:17.310087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2516/5478] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:17:17 2022] POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:17:17.310609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:17.320226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:17.321330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:17.325498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bbb33885-e6fb-463b-a846-ba821087b595 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.270528 Jun 25 21:17:17.327259 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2963/5479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:17 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:17.330785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.333365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.334584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.335208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.514264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:17.515238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:17.526030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.526685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.527661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:17.528291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:17.818960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:17.853644 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b83e8b6-fdd0-487f-ba88-68b6075ddc4d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.343654 Jun 25 21:17:17.854683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2964/5480] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:17 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:17.907376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:17.919678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f09dad5-baba-4d32-8f5a-527007d0842d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.605533 Jun 25 21:17:17.922235 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2517/5481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:17 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:18.153205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-plugged", "status": "completed", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:18.177857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.185527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.206844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] Creating event network-vif-plugged:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch2-master-1 Jun 25 21:17:18.215816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] Instance 1529e81e-bac1-4142-b308-05f212162b18 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:17:18.240308 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9feada41-1cde-4004-b5d6-e258826f790c req-2c4c7866-87bc-45d9-99b8-4a6a81482818 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102810 Jun 25 21:17:18.241910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2965/5482] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:18.356326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:18.357940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:18.366264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:18.369139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.369605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.370539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.371342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.571001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:18.579942 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22244292-08c1-4f05-b257-045cea430190 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.239438 Jun 25 21:17:18.580559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2518/5483] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:18 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:18.873871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:18.875013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:18.879163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:18.883735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.884478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.885260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.885692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.956497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:18.959920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:18.962626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=16 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:18.976895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.977934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:18.979028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:18.979301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:19.105418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:19.116397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ea39659-4d91-40c7-9ec5-4622b13855b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.246473 Jun 25 21:17:19.117879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2966/5484] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:18 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:19.191278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:19.207074 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16b7dd14-0198-441b-98ad-618101d7439a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.257143 Jun 25 21:17:19.208130 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2519/5485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:18 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:19.600293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:19.601200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:19.616503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:19.617680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:19.618502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:19.619114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:19.813575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:19.822364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d909ec83-df8e-481c-9876-e8847f3f1dbd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.227188 Jun 25 21:17:19.823416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2967/5486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:19 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:20.131527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:20.132146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:20.140504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.141272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.142207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.142863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.226998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:20.227891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:20.238042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.239111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.241106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.241771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.270601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:20.436614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:20.447665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88820821-3449-488a-ba03-b192aad70597 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.222768 Jun 25 21:17:20.448138 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2968/5487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:20 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:20.453450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e892cd41-b163-4936-99fd-a17c515b1cf7 req-fe522165-3540-475b-8e66-683d712dbad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f89650-ba09-4528-a880-99c11aa84659", "name": "network-vif-plugged", "status": "completed", "tag": "3bf17f37-3871-4c1a-9342-70654d7405b8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:20.468251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e892cd41-b163-4936-99fd-a17c515b1cf7 req-fe522165-3540-475b-8e66-683d712dbad7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.469073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e892cd41-b163-4936-99fd-a17c515b1cf7 req-fe522165-3540-475b-8e66-683d712dbad7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.511767 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e892cd41-b163-4936-99fd-a17c515b1cf7 req-fe522165-3540-475b-8e66-683d712dbad7 service nova] Creating event network-vif-plugged:3bf17f37-3871-4c1a-9342-70654d7405b8 for instance 28f89650-ba09-4528-a880-99c11aa84659 on nch1-master-1 Jun 25 21:17:20.519003 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e892cd41-b163-4936-99fd-a17c515b1cf7 req-fe522165-3540-475b-8e66-683d712dbad7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069393 Jun 25 21:17:20.520932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2969/5488] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:20.602106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:20.625041 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-99400b1f-fb73-482e-b9ce-a6ffdfcafb9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.497251 Jun 25 21:17:20.626536 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2520/5489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:20 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:20.843420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:20.845548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:20.855086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.858601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:20.865784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:20.866553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:21.065063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:21.084067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2a4d1045-7e9c-4cae-aaeb-82c24fd1ece7 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.247720 Jun 25 21:17:21.085714 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2970/5490] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:20 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:21.467253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:21.467892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:21.475733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:21.476273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:21.477243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:21.477740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:21.644320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:21.645369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:21.655109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:21.655682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:21.657047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:21.657755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:21.663041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:21.672947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8d1d60f6-2312-4624-9db6-062f6fa5385b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.210019 Jun 25 21:17:21.688390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2521/5491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:21 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:21.947608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:21.959582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bc6cc66-ca2b-4bec-8969-f963e343d310 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.320740 Jun 25 21:17:21.965691 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2971/5492] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:21 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:22.103979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:22.104625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:22.115928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.117717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:22.120969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.123770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:22.367479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:22.388112 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9fd01f21-c772-4d18-8bc1-8f566b04053b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1366 microversion: 2.1 time: 0.288751 Jun 25 21:17:22.389344 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2522/5493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:22 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:22.707131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:22.708548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:22.716833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.717576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:22.718540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.719597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:22.982226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:22.983792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:22.995938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.996646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:22.997791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:22.998408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:23.168037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:23.181287 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-450f27de-c4ad-483d-b9c7-8361591abeb0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.206967 Jun 25 21:17:23.182742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2523/5494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:22 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:23.306155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:23.318357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7e426df-2577-47ea-863b-f7a4c527ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.616390 Jun 25 21:17:23.320981 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2972/5495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:22 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:23.407333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:23.408296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:23.419718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:23.420477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:23.421545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:23.422155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:23.653783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:23.666801 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70e54c84-46f2-4728-929f-e6d656b5fb23 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1556 microversion: 2.1 time: 0.263544 Jun 25 21:17:23.667422 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2524/5496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:23 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1556 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:23.685993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:23.686644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:23.704915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:23.704915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:23.704915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:23.704915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:23.908129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94c05a81-4d26-44b2-a65c-27b18a4f0c70 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.226933 Jun 25 21:17:23.909273 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2973/5497] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:17:23 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/os-interface => generated 285 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:24.199063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:24.199313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cee627cb-d202-4ecc-a68b-dd3b91711a44 req-d9acb20d-e3e9-491d-ab9c-892dadf40358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe3ffc5-48f4-4953-9039-43bdcddd5537", "name": "network-vif-plugged", "status": "completed", "tag": "84070454-1f2c-4014-a8f8-35936e20774b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:24.200548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:24.215162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:24.215966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:24.217221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:24.217871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:24.222467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cee627cb-d202-4ecc-a68b-dd3b91711a44 req-d9acb20d-e3e9-491d-ab9c-892dadf40358 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:24.225474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cee627cb-d202-4ecc-a68b-dd3b91711a44 req-d9acb20d-e3e9-491d-ab9c-892dadf40358 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:24.248759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cee627cb-d202-4ecc-a68b-dd3b91711a44 req-d9acb20d-e3e9-491d-ab9c-892dadf40358 service nova] Creating event network-vif-plugged:84070454-1f2c-4014-a8f8-35936e20774b for instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 on nch2-master-1 Jun 25 21:17:24.256643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cee627cb-d202-4ecc-a68b-dd3b91711a44 req-d9acb20d-e3e9-491d-ab9c-892dadf40358 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062960 Jun 25 21:17:24.258654 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2525/5498] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:24.337404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:24.338338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:24.360600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:24.361443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:24.362508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:24.363159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:24.385165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:24.490974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:24.506605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-948253f2-093d-46ca-880f-98d957c67677 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.311154 Jun 25 21:17:24.508330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2974/5499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:24 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:24.904005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:24.913456 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b477c2c3-d3a1-43b3-a821-6b6e9a184441 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.581746 Jun 25 21:17:24.923714 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2526/5500] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:24 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:25.524345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:25.525106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:25.539921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:25.540756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:25.545896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:25.546923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:25.732071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:25.743624 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-652d9f2a-b460-462b-adc6-a6d7e9238c0d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1308 microversion: 2.1 time: 0.223032 Jun 25 21:17:25.745987 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2975/5501] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:25 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:25.766372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-unplugged", "status": "completed", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:25.784365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:25.785084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:25.834573 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] Creating event network-vif-unplugged:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:17:25.842879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] Instance 1529e81e-bac1-4142-b308-05f212162b18 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:17:25.883989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-811972f4-4a69-465c-8d2a-6e9611300d27 req-045ecd35-49d5-41be-b27d-df1140a579d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120264 Jun 25 21:17:25.885194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2527/5502] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:25.931394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:25.932254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:25.954953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:25.955556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:25.956838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:25.957240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:26.204680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:26.225987 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23ad92e1-7215-42d3-9d74-a4afe891ba8c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.298386 Jun 25 21:17:26.233529 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2976/5503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:25 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:26.778179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:26.780289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:26.795286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:26.795991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:26.799156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:26.799626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.224185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:27.241581 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bafbb1fa-a755-4410-aa8d-0cc627d5c455 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1488 microversion: 2.1 time: 0.473037 Jun 25 21:17:27.244660 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2528/5504] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:26 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1488 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:27.261767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:27.262770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:27.263047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:27.263906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:27.277338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.278091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.278997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.282455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.286967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.290378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.291215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.291949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.587405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:27.607983 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8ca36124-f5bd-4a39-bdad-26220a923d1c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.353390 Jun 25 21:17:27.620079 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2977/5505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:27 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:27.648357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:27.659235 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c2c81d3-1265-42a9-b408-1e6761ce2063 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1488 microversion: 2.1 time: 0.401550 Jun 25 21:17:27.672928 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2529/5506] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:27 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1488 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:27.680011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:27.683961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:27.692956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.693617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.698838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.699641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.930517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:27.935133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}, {"name": "network-changed", "server_uuid": "28f89650-ba09-4528-a880-99c11aa84659", "tag": "3bf17f37-3871-4c1a-9342-70654d7405b8"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:27.939637 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-271d8dd9-f8ee-4935-a4e6-0bacc31af853 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1488 microversion: 2.1 time: 0.266422 Jun 25 21:17:27.940648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2978/5507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:27 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1488 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:27.947848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.948453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.958594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:27.959386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:27.967618 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.968765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.970398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:27.971151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:27.996814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Creating event network-changed:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:17:27.997343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Creating event network-changed:3bf17f37-3871-4c1a-9342-70654d7405b8 for instance 28f89650-ba09-4528-a880-99c11aa84659 on nch1-master-1 Jun 25 21:17:28.005720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] Instance 1529e81e-bac1-4142-b308-05f212162b18 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:17:28.029181 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fd3237c4-d5b2-4602-8202-5e24091cc652 req-29d5b448-0f47-402b-a672-4d02f996b76c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099991 Jun 25 21:17:28.030204 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2530/5508] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:17:28.030343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:17:28.208143 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81d55ede-ebc3-4a6a-a25c-423857f6dd95 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 204 len: 0 microversion: 2.1 time: 0.254916 Jun 25 21:17:28.215193 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2979/5509] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:17:27 2022] DELETE /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:28.229026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:28.230029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:28.256477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:28.257663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:28.260850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:28.262044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:28.471896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:28.482750 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94fb75cf-0d3c-4755-8e74-383bbb1bfc81 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1494 microversion: 2.1 time: 0.265964 Jun 25 21:17:28.483433 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2531/5510] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:28 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1494 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:28.629276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:28.631571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:28.642190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:28.642679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:28.643464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:28.644106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:28.841809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:28.851791 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3b68844-2e40-45a8-8e4c-8bf72874ec4b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1686 microversion: 2.1 time: 0.227631 Jun 25 21:17:28.852535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2980/5511] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:28 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1686 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:29.502664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:29.503384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:29.512234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:29.513136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:29.513544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:29.514814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:29.857150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:29.867272 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e01c57c3-8c50-4a38-8f2a-ef279cefc8b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1494 microversion: 2.1 time: 0.369767 Jun 25 21:17:29.870999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:29.872155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:29.878731 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2532/5512] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:29 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1494 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:29.881096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:29.881772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:29.884192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:29.884671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:30.068292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:30.080891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bcc8ad8-cc1c-4eb8-9076-7446b37d6e3d tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1679 microversion: 2.1 time: 0.213965 Jun 25 21:17:30.083115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2981/5513] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:29 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:30.890623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:30.891388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:30.902008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:30.902529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:30.903673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:30.904274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:30.931127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a9701f3e-cf0d-4a48-9465-af7c9c2e262f req-8254cdfb-1b5b-4d6d-b70d-2acd465e4f82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe3ffc5-48f4-4953-9039-43bdcddd5537", "name": "network-vif-deleted", "tag": "84070454-1f2c-4014-a8f8-35936e20774b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:30.954166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a9701f3e-cf0d-4a48-9465-af7c9c2e262f req-8254cdfb-1b5b-4d6d-b70d-2acd465e4f82 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:30.955014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a9701f3e-cf0d-4a48-9465-af7c9c2e262f req-8254cdfb-1b5b-4d6d-b70d-2acd465e4f82 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:30.970574 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a9701f3e-cf0d-4a48-9465-af7c9c2e262f req-8254cdfb-1b5b-4d6d-b70d-2acd465e4f82 service nova] Creating event network-vif-deleted:84070454-1f2c-4014-a8f8-35936e20774b for instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 on nch2-master-1 Jun 25 21:17:30.978032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a9701f3e-cf0d-4a48-9465-af7c9c2e262f req-8254cdfb-1b5b-4d6d-b70d-2acd465e4f82 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067149 Jun 25 21:17:30.991811 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2982/5514] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:31.023435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:31.038219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-36c583d3-1954-456b-93d1-cf310f5a3ee2 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 200 len: 1452 microversion: 2.1 time: 0.152402 Jun 25 21:17:31.039162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2533/5515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:30 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:32.057032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:32.058387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:32.064886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.065350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.066158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.066595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.080655 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 HTTP/1.1 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '2fe3ffc5-48f4-4953-9039-43bdcddd5537'} Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:32.082932 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d0f72c91-41f4-487a-8e7b-70b7ad840628 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 404 len: 111 microversion: 2.1 time: 0.033227 Jun 25 21:17:32.088819 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2983/5516] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:32 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:32.093850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:32.094382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:32.101628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.102090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.102944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.103305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.129405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:17:32.219108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b5f76dc-f2e6-45a6-9318-19bbfb1fa403 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 204 len: 0 microversion: 2.1 time: 0.128879 Jun 25 21:17:32.220396 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2534/5517] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:17:32 2022] DELETE /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:17:32.238157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:32.238867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:32.248371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.253246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.254326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:32.254821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:32.361861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-426530311", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "358aad43-2693-4079-8b92-b34ee4b03afc"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:32.401803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:32.411341 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-413689de-518e-4595-925a-eeaf7c1b7a98 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1494 microversion: 2.1 time: 0.177087 Jun 25 21:17:32.412126 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2984/5518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:32 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1494 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:32.414989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] validate_networks() for [('358aad43-2693-4079-8b92-b34ee4b03afc', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:17:33.131689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:17:33.132261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:17:33.132664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:17:33.133081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:17:33.133522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:17:33.142563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:33.143016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:33.143814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:33.144248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:33.161545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Getting quotas for project 5a7efe5a3d7f4380b6e1ee40d4628ea8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:17:33.166765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Getting quotas for user 871c269a6b15425d8b79a6c653c56402 and project 5a7efe5a3d7f4380b6e1ee40d4628ea8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:17:33.179517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:17:33.181978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:17:33.228901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a0a11a1-7511-413f-b364-4a93150a4c22 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.871436 Jun 25 21:17:33.230073 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2535/5519] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:17:33.240713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39937e7d-9992-44c5-bcf6-2c2f96f8808c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:33.241423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-39937e7d-9992-44c5-bcf6-2c2f96f8808c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:33.315064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39937e7d-9992-44c5-bcf6-2c2f96f8808c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:33.325781 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39937e7d-9992-44c5-bcf6-2c2f96f8808c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1218 microversion: 2.1 time: 0.088656 Jun 25 21:17:33.326589 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2985/5520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:33 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:33.429232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:33.429845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:33.439276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:33.440046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:33.440940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:33.441602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:33.547678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-79316dfe-16c7-48fa-aef9-044f39b989f3 req-a46fe70b-aca0-4d4f-b98e-96d8ab2309be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-plugged", "status": "completed", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:33.568035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-79316dfe-16c7-48fa-aef9-044f39b989f3 req-a46fe70b-aca0-4d4f-b98e-96d8ab2309be service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:33.568780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-79316dfe-16c7-48fa-aef9-044f39b989f3 req-a46fe70b-aca0-4d4f-b98e-96d8ab2309be service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:33.591440 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-79316dfe-16c7-48fa-aef9-044f39b989f3 req-a46fe70b-aca0-4d4f-b98e-96d8ab2309be service nova] Creating event network-vif-plugged:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:17:33.603828 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-79316dfe-16c7-48fa-aef9-044f39b989f3 req-a46fe70b-aca0-4d4f-b98e-96d8ab2309be service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061843 Jun 25 21:17:33.605660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2986/5521] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:33.632710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:33.645102 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cbf2ec2b-e476-4356-a7a0-4617f469e624 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1494 microversion: 2.1 time: 0.219828 Jun 25 21:17:33.645882 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2536/5522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:33 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1494 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:34.262000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8b635d86-5ae4-4e73-88c2-db042fafd5e8 req-5c44630a-a8b5-451a-9793-3a4fbd03f1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655a5cc4-ba12-447f-98ed-95c421f3e4ac", "name": "network-vif-deleted", "tag": "00db4f11-776c-4458-b8f2-6366a1ce9577"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:34.287414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8b635d86-5ae4-4e73-88c2-db042fafd5e8 req-5c44630a-a8b5-451a-9793-3a4fbd03f1f9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.287877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8b635d86-5ae4-4e73-88c2-db042fafd5e8 req-5c44630a-a8b5-451a-9793-3a4fbd03f1f9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.343602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:34.344219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:34.349080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8b635d86-5ae4-4e73-88c2-db042fafd5e8 req-5c44630a-a8b5-451a-9793-3a4fbd03f1f9 service nova] Creating event network-vif-deleted:00db4f11-776c-4458-b8f2-6366a1ce9577 for instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac on nch2-master-1 Jun 25 21:17:34.356142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.356639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.360913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8b635d86-5ae4-4e73-88c2-db042fafd5e8 req-5c44630a-a8b5-451a-9793-3a4fbd03f1f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103896 Jun 25 21:17:34.362651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.363508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.368637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2987/5523] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:34.459439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:34.467597 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae63ef29-6961-4e46-b2bc-e0a1053b1cb6 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1270 microversion: 2.1 time: 0.127926 Jun 25 21:17:34.468189 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2537/5524] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:34 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:34.662812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:34.663547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:34.670553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.670927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.671693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.672125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.674913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:34.712761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:34.713215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:34.713674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lazy-loading 'fault' on Instance uuid 655a5cc4-ba12-447f-98ed-95c421f3e4ac {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:17:34.757143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:34.765122 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-389d1841-e82e-4263-9584-66306bf746bd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 200 len: 1298 microversion: 2.1 time: 0.106630 Jun 25 21:17:34.765791 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2988/5525] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:34 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:35.286106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:35.286624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:35.295770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.296367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.297334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.297777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.328065 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8191553e-e64f-4a0a-93cf-743a0189420b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/ips" status: 200 len: 152 microversion: 2.20 time: 0.047506 Jun 25 21:17:35.329126 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2538/5526] 10.222.0.39 () {60 vars in 1288 bytes} [Sat Jun 25 21:17:35 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/ips => generated 152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:17:35.487715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:35.489350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:35.499014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.499942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.501024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.501775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.685098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:35.697665 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d694c3b7-cf5e-4bf0-92a7-e673060949aa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.215290 Jun 25 21:17:35.698267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2989/5527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:35 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:35.783436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:35.784816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:35.793980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.795320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.796949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:35.797611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:35.815876 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac HTTP/1.1 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '655a5cc4-ba12-447f-98ed-95c421f3e4ac'} Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:35.818924 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:17:35.822996 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:17:35.825994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:17:35.827279 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8267330d-636e-434f-8223-f2d09834a75f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 404 len: 111 microversion: 2.1 time: 0.048796 Jun 25 21:17:35.834964 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2539/5528] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:35 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:35.956740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-288083491", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:36.032604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:17:36.444333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:17:36.445044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:17:36.445673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:17:36.446229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:17:36.447219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:17:36.460996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:36.461661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:36.462609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:36.463191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:36.484174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:17:36.489987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:17:36.504951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:17:36.507418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:17:36.562317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5954b1a-fd3c-45f3-a89a-c06f9a2c381c tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609848 Jun 25 21:17:36.568901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2990/5529] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:17:36.584581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf40fccb-b029-4be6-909b-628439f2446a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:36.585271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf40fccb-b029-4be6-909b-628439f2446a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:36.603081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-855ab98c-2c84-46f1-a5d1-bf302f02af8c req-d4567ced-1081-4384-a624-d839c3892045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c10ea5c5-4e57-4c39-9c86-49e350cafb7a", "tag": "aa3fdfda-cc96-46fd-9f45-b05ac068217e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:36.618225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-855ab98c-2c84-46f1-a5d1-bf302f02af8c req-d4567ced-1081-4384-a624-d839c3892045 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:36.619339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-855ab98c-2c84-46f1-a5d1-bf302f02af8c req-d4567ced-1081-4384-a624-d839c3892045 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:36.632316 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-855ab98c-2c84-46f1-a5d1-bf302f02af8c req-d4567ced-1081-4384-a624-d839c3892045 service nova] Creating event network-changed:aa3fdfda-cc96-46fd-9f45-b05ac068217e for instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a on nch2-master-1 Jun 25 21:17:36.637451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-855ab98c-2c84-46f1-a5d1-bf302f02af8c req-d4567ced-1081-4384-a624-d839c3892045 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038416 Jun 25 21:17:36.638424 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2991/5530] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:36.672953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bf40fccb-b029-4be6-909b-628439f2446a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:36.682315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf40fccb-b029-4be6-909b-628439f2446a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1208 microversion: 2.1 time: 0.112416 Jun 25 21:17:36.682909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2540/5531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:36 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:36.715908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:36.716669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:36.724859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:36.725324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:36.726119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:36.726563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:36.945822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:36.954607 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-241b4973-eab8-49cc-9ea0-8fdb941b06c9 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.242986 Jun 25 21:17:36.955659 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2992/5532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:36 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:37.272113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:37.272695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:37.279982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.280458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.281259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.281684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.305544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lazy-loading 'flavor' on Instance uuid e0092220-c4b5-40be-a315-fabad4d12562 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:17:37.564495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49f126cd-117c-49f5-8be9-2e57bdfdc13f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/action" status: 202 len: 0 microversion: 2.20 time: 0.298609 Jun 25 21:17:37.565148 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2541/5533] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:17:37 2022] POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:37.573656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:37.574189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:37.587299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.587753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.588599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.591530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.699895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:37.700685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:37.707972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.708473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.709266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.709705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.776597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:37.776805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:37.789409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:37.791092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:37.792904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:37.794192 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1855356-0346-4477-b581-5feef827297c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.224679 Jun 25 21:17:37.795433 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2993/5534] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:37 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:37.799284 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bea72cd-a57f-4451-a86d-983493d89a25 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1204 microversion: 2.1 time: 0.103605 Jun 25 21:17:37.799875 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2542/5535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:37 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:37.976964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:37.977582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:37.983952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.984414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:37.985204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:37.985647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:38.126585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:38.134329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d11639b0-da3f-4e9b-84d8-f1f013d8c881 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.161505 Jun 25 21:17:38.135263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2994/5536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:37 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:38.823025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:38.823636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:38.827185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:38.828258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:38.829191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:38.835183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:38.835576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:38.836352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:38.836818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:38.840399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:38.841108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:38.841895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:38.842348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:38.900494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:38.908345 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19e76825-70df-4e49-82f6-c29974ce2154 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1204 microversion: 2.1 time: 0.091039 Jun 25 21:17:38.908985 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2543/5537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:38 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:38.976598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:38.984765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:38.986350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:38.987540 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86df478b-3f65-4113-aae6-4219f19738a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.163857 Jun 25 21:17:38.988122 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2995/5538] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:38 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:39.159319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:39.161330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:39.168856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:39.169678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:39.170721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:39.171563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:39.369207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:39.377780 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aacb179f-a35e-43f9-b67a-c3f9c09d21e3 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.228545 Jun 25 21:17:39.378507 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2544/5539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:39 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:39.926184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:39.926804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:39.934433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:39.934884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:39.935654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:39.936534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:40.008516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:40.019820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:40.023131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5fdc0d1b-0f9c-4464-bb6c-544fdf39ea54 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1266 microversion: 2.1 time: 0.100601 Jun 25 21:17:40.023353 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2996/5540] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:39 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:40.023938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:40.037510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:40.038099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:40.039004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:40.039551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:40.327316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:40.336150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:40.339310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:40.340271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a43f964d-108f-41f2-9e66-8ebb59a8d436 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.330752 Jun 25 21:17:40.341030 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2545/5541] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:40 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:40.395521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:40.396419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:40.403197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:40.403662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:40.404444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:40.404904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:40.536122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:40.545017 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-accd5093-a816-4231-bd24-b95df308297c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.153679 Jun 25 21:17:40.546050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2997/5542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:40 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:41.040849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:41.041617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:41.050483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.051061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:41.052093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.052730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:41.304014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:41.312179 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-42f15618-edcb-40e7-8d68-42b4e533282a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.275409 Jun 25 21:17:41.312802 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2546/5543] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:41 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:41.358791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:41.359486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:41.367048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.367580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:41.368466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.369159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:41.517030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:41.526426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:41.527951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:41.529180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d199570-2538-415f-80b6-84ae1f498da9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.174623 Jun 25 21:17:41.529764 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2998/5544] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:41 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:41.563667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:41.564887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:41.571574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.572133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:41.573021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:41.573455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.093798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:42.102840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec1d8166-eed4-498f-b39d-9f9ec16d5e1c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.544199 Jun 25 21:17:42.112514 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2547/5545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:41 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:42.141866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-41ff4df1-764a-492e-95f6-987432260519 req-f6d0182e-38ce-42da-9f39-05afe63f354b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7fd527-e7f7-412a-94a8-6d498dd5fdc5", "tag": "18396eb9-a9cb-495c-ad5e-2869c5b2ad8d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:42.155013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-41ff4df1-764a-492e-95f6-987432260519 req-f6d0182e-38ce-42da-9f39-05afe63f354b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:42.155496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-41ff4df1-764a-492e-95f6-987432260519 req-f6d0182e-38ce-42da-9f39-05afe63f354b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.174902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-41ff4df1-764a-492e-95f6-987432260519 req-f6d0182e-38ce-42da-9f39-05afe63f354b service nova] Creating event network-changed:18396eb9-a9cb-495c-ad5e-2869c5b2ad8d for instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 on nch2-master-1 Jun 25 21:17:42.179668 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-41ff4df1-764a-492e-95f6-987432260519 req-f6d0182e-38ce-42da-9f39-05afe63f354b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041722 Jun 25 21:17:42.180346 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 2999/5546] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:42.331480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:42.333068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:42.340978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:42.342174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.343103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:42.343671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.549230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:42.550222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:42.555952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:42.557953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:42.558489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.559372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:42.560018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:42.564139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-271aa3fc-68fe-4078-8293-1164114accc1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.237699 Jun 25 21:17:42.564974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2548/5547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:42 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:42.704171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:42.713001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:42.714450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:42.715667 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0eae6758-a73f-4aa3-90a5-f58585039f76 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.171778 Jun 25 21:17:42.716247 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3000/5548] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:42 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:43.122751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:43.123271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:43.130556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.131011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.131778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.132200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.154799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:43.264944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:43.272998 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb148c29-335e-4ba1-83bc-5bd7ede34efa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.155103 Jun 25 21:17:43.273631 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2549/5549] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:43 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:43.584923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:43.585544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:43.593120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.593537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.594353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.594795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.734742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:43.735426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:43.738484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:43.741999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.742458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.743200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.743822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.746579 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-87f2c6a9-bfe7-4ac7-8b8c-7d988b469fe5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.167627 Jun 25 21:17:43.747173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3001/5550] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:43 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:43.877831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:43.886087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:43.887603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:43.888820 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-25bcb697-ede6-4e79-9e22-199e7219900d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.158133 Jun 25 21:17:43.889391 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2550/5551] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:43 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:43.961990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-36240341-2e91-4afa-8d77-ccdb16b1b6b0 req-fc29a3e1-49d3-4672-aa89-29ca6254a41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ea5c5-4e57-4c39-9c86-49e350cafb7a", "name": "network-vif-plugged", "status": "completed", "tag": "aa3fdfda-cc96-46fd-9f45-b05ac068217e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:43.970423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-36240341-2e91-4afa-8d77-ccdb16b1b6b0 req-fc29a3e1-49d3-4672-aa89-29ca6254a41d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:43.970850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-36240341-2e91-4afa-8d77-ccdb16b1b6b0 req-fc29a3e1-49d3-4672-aa89-29ca6254a41d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:43.982712 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-36240341-2e91-4afa-8d77-ccdb16b1b6b0 req-fc29a3e1-49d3-4672-aa89-29ca6254a41d service nova] Creating event network-vif-plugged:aa3fdfda-cc96-46fd-9f45-b05ac068217e for instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a on nch2-master-1 Jun 25 21:17:43.987660 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-36240341-2e91-4afa-8d77-ccdb16b1b6b0 req-fc29a3e1-49d3-4672-aa89-29ca6254a41d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029430 Jun 25 21:17:43.988355 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3002/5552] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:44.292188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:44.292964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:44.302495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.303003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.303790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.304231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.439930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:44.451418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3561d7b-20db-49d5-9d17-ae933d4110cc tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.164067 Jun 25 21:17:44.452249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2551/5553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:44 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:44.764850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:44.765996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:44.774809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.775498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.776351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.776964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.908467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:44.909273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:44.916716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.917292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.918154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:44.918982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:44.925204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:44.933418 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-274593bd-d625-4883-a78d-b7156fdcbd29 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.173090 Jun 25 21:17:44.934012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3003/5554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:44 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:45.108597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:45.117381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:45.118892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:45.120078 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5df5d19c-15de-4826-94b5-c6338c846057 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.216553 Jun 25 21:17:45.120684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2552/5555] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:44 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:45.469652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:45.470274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:45.474069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:45.478215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:45.478750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:45.479638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:45.480152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:45.619706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:45.627445 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb11866d-e7c5-4023-bcc7-9c1f142fa209 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1318 microversion: 2.1 time: 0.162017 Jun 25 21:17:45.627975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3004/5556] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:45 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:45.951089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:45.952746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:45.960386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:45.960876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:45.961654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:45.962124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:46.097517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:46.105670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2e192d5-20c0-4cb8-85a7-bcb5d59e97ad tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.158869 Jun 25 21:17:46.106262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2553/5557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:45 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:46.138789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:46.139417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:46.146525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:46.146967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:46.147731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:46.148169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:46.289181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:46.297902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:46.299430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:46.300661 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2bec38b5-c52f-4f40-89ba-50b7aae94d7c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.165842 Jun 25 21:17:46.301233 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3005/5558] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:46 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:46.645005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:46.645546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:46.652404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:46.652886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:46.653695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:46.654148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:46.676824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=8 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:46.805529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:46.813960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c700549-a1a1-4154-be31-c0b07a8c9639 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1506 microversion: 2.1 time: 0.173193 Jun 25 21:17:46.814570 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2554/5559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:46 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:47.123883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:47.124839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:47.127470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:47.128352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:47.137139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:47.137731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:47.138684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:47.139200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:47.286169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:47.300033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4d578298-24f5-4c0a-a19a-d1df3fedfb9f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.180445 Jun 25 21:17:47.301589 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3006/5560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:47 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:47.320076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:47.320872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:47.330001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:47.330555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:47.331547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:47.331988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:47.477989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:47.491732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:47.493194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:47.494412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb62a631-899c-461b-a205-d32c751b17e4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.178905 Jun 25 21:17:47.495291 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2555/5561] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:47 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:48.108256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-88fe6466-cd51-46a6-a70d-f2bb129ff4c7 req-85fc0166-88df-4f94-b011-f80045b5047c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7fd527-e7f7-412a-94a8-6d498dd5fdc5", "name": "network-vif-plugged", "status": "completed", "tag": "18396eb9-a9cb-495c-ad5e-2869c5b2ad8d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:48.116798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-88fe6466-cd51-46a6-a70d-f2bb129ff4c7 req-85fc0166-88df-4f94-b011-f80045b5047c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:48.117252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-88fe6466-cd51-46a6-a70d-f2bb129ff4c7 req-85fc0166-88df-4f94-b011-f80045b5047c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:48.119802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:48.129362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-88fe6466-cd51-46a6-a70d-f2bb129ff4c7 req-85fc0166-88df-4f94-b011-f80045b5047c service nova] Creating event network-vif-plugged:18396eb9-a9cb-495c-ad5e-2869c5b2ad8d for instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 on nch2-master-1 Jun 25 21:17:48.135149 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-88fe6466-cd51-46a6-a70d-f2bb129ff4c7 req-85fc0166-88df-4f94-b011-f80045b5047c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167001 Jun 25 21:17:48.135750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3007/5562] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:48.320597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:48.321271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:48.328533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:48.330017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:48.331286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:48.331776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:48.470806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:48.478675 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d36e0d35-da43-40df-911a-0328f32586b8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.163494 Jun 25 21:17:48.479262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2556/5563] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:48 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:48.515719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:48.516670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:48.524142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:48.524651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:48.525431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:48.525879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:48.665222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:48.673729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:48.675339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:48.678409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62eae994-133e-47b1-831c-d7ee253a1471 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.168202 Jun 25 21:17:48.679767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3008/5564] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:48 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:49.368971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b95a180-0d11-4045-88c2-16d087818925", "device": "/dev/sdb"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:49.370310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:49.377652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.378081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.378861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.379324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.498425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:49.499262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:49.509039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.509686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.510830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.511446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.654863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:49.662681 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ab4ddb5-b0d6-4b80-8d65-28afa8be3a9b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1308 microversion: 2.1 time: 0.170469 Jun 25 21:17:49.663454 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3009/5565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:49 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1308 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:49.698606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:49.699158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:49.706380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.707832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.709066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:49.709555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:49.864818 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c4008e7-b210-47a3-a0ab-54c96da75a97 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "POST /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.500697 Jun 25 21:17:49.865475 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2557/5566] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:17:49 2022] POST /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a/os-volume_attachments => generated 194 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:49.870406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:49.875897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:49.877760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:49.879048 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-768bdabb-437c-4a52-873f-026da387fb15 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.185497 Jun 25 21:17:49.886821 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3010/5567] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:49 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:50.681230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:50.681917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:50.688946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.689397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.690164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.690613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.693463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:17:50.826838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:50.837526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdac8f7f-5bd5-4822-aa72-1af99af57109 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1488 microversion: 2.1 time: 0.161752 Jun 25 21:17:50.838139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2558/5568] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:50 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1488 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:50.855537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:50.856982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:50.864691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.865144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.865913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.866346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.900798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:50.901567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:50.909749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.910437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.911326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.911920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.935405 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34c9321d-c04c-4801-b02c-14de026325b3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "PUT /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1083 microversion: 2.1 time: 0.083895 Jun 25 21:17:50.936168 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3011/5569] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:17:50 2022] PUT /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1083 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:50.949453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:50.950257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:50.956540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.957392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:50.958198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:50.958626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.061620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.073507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.075465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.077118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7f1fa1d-2a68-47d2-a84b-5df46d5cd15b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1744 microversion: 2.20 time: 0.182263 Jun 25 21:17:51.077704 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2559/5570] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:50 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:51.102055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.109698 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-77f3faea-c336-4adf-9faa-14f5665ce58d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1509 microversion: 2.1 time: 0.164074 Jun 25 21:17:51.110274 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3012/5571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:50 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:17:51.126163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:51.126853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:51.133661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.134114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.134876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.135308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.271125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.279366 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb79b4b5-d3f7-4e4a-827a-a94abffffd4f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1509 microversion: 2.1 time: 0.157168 Jun 25 21:17:51.279955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2560/5572] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:51 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:51.295947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:51.296456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:51.303068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.303522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.304277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.304745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.330481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:17:51.416550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b56e604-f6ad-418e-a256-3448abbbfcff tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 204 len: 0 microversion: 2.1 time: 0.124178 Jun 25 21:17:51.418539 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3013/5573] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:17:51 2022] DELETE /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:17:51.428036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:51.429045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:51.436709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.437153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.437945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:51.438387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:51.578057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:51.586827 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce5ef8b1-a6ab-4f7b-996a-da78965572e1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1515 microversion: 2.1 time: 0.164030 Jun 25 21:17:51.587437 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2561/5574] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:51 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:52.096555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:52.097284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:52.104963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:52.105430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:52.106197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:52.106700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:52.263681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:52.271877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:52.273404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:52.274590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c05ba29b-d5a6-4d58-8d8f-8a4f694e5ef0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1744 microversion: 2.20 time: 0.182798 Jun 25 21:17:52.275173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3014/5575] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:52 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:52.607841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:52.608908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:52.619020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:52.619708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:52.620657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:52.621090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:52.756745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:52.766505 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6dd60d6c-a6cf-479d-bd1d-625563aa20db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1515 microversion: 2.1 time: 0.165028 Jun 25 21:17:52.767181 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2562/5576] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:52 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:53.296652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:53.297665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:53.307278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:53.307664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:53.308486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:53.308878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:53.448285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:53.456622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:53.458564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:53.459778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f80d6e82-f323-4a09-bc92-0c37472f30a8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1744 microversion: 2.20 time: 0.169837 Jun 25 21:17:53.460356 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3015/5577] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:53 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:53.786932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:53.787567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:53.795659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:53.796121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:53.796941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:53.797383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:53.934882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:53.945016 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8dfd5bf-2dc1-4db6-a2bb-a025dacfb0c9 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1515 microversion: 2.1 time: 0.162117 Jun 25 21:17:53.945592 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2563/5578] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:53 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:53.979554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8cd781c2-ee96-48f3-b0d7-7f0575f1472c req-f0609d05-158c-4006-9d19-87e2ad9f5197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "name": "network-vif-plugged", "status": "completed", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:53.989183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8cd781c2-ee96-48f3-b0d7-7f0575f1472c req-f0609d05-158c-4006-9d19-87e2ad9f5197 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:53.989654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8cd781c2-ee96-48f3-b0d7-7f0575f1472c req-f0609d05-158c-4006-9d19-87e2ad9f5197 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:54.002761 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8cd781c2-ee96-48f3-b0d7-7f0575f1472c req-f0609d05-158c-4006-9d19-87e2ad9f5197 service nova] Creating event network-vif-plugged:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch2-master-1 Jun 25 21:17:54.008006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8cd781c2-ee96-48f3-b0d7-7f0575f1472c req-f0609d05-158c-4006-9d19-87e2ad9f5197 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036324 Jun 25 21:17:54.009791 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3016/5579] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:54.477730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:54.478342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:54.486946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:54.493741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:54.494902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:54.495458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:54.497494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ef01fa28-c6de-4700-840e-f41f3e27594b req-8018ad9c-9162-494b-be80-611f87c053d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7fd527-e7f7-412a-94a8-6d498dd5fdc5", "name": "network-vif-deleted", "tag": "18396eb9-a9cb-495c-ad5e-2869c5b2ad8d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:54.512038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ef01fa28-c6de-4700-840e-f41f3e27594b req-8018ad9c-9162-494b-be80-611f87c053d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:54.512754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ef01fa28-c6de-4700-840e-f41f3e27594b req-8018ad9c-9162-494b-be80-611f87c053d4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:54.527484 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ef01fa28-c6de-4700-840e-f41f3e27594b req-8018ad9c-9162-494b-be80-611f87c053d4 service nova] Creating event network-vif-deleted:18396eb9-a9cb-495c-ad5e-2869c5b2ad8d for instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 on nch2-master-1 Jun 25 21:17:54.534737 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ef01fa28-c6de-4700-840e-f41f3e27594b req-8018ad9c-9162-494b-be80-611f87c053d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042759 Jun 25 21:17:54.540405 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3017/5580] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:17:54.695118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:54.704542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:54.706103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:54.707676 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6e26a02f-e7d7-47eb-ae95-cc6afcc9a9e1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1744 microversion: 2.20 time: 0.233748 Jun 25 21:17:54.708283 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2564/5581] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:54 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1744 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:54.963736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:54.964861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:54.973461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:54.974138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:54.975738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:54.976529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:55.016978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:55.017874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:55.018599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lazy-loading 'fault' on Instance uuid eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:17:55.065123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:55.072457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e67fe201-1682-44c1-a824-b573d54177c4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 200 len: 1319 microversion: 2.1 time: 0.113080 Jun 25 21:17:55.073061 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3018/5582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:54 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 1319 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:55.727476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:55.728613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:55.735619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:55.736057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:55.736983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:55.737418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:55.879560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:55.887954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:55.889516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:55.890739 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f29932c1-9133-4702-889b-dee5658f2e6c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1744 microversion: 2.20 time: 0.168385 Jun 25 21:17:55.891312 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2565/5583] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:55 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:56.091154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:56.091840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:56.100188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.100911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.101780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.102278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.117550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 HTTP/1.1 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'eb7fd527-e7f7-412a-94a8-6d498dd5fdc5'} Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:56.119242 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de1234fc-72b2-4c6e-8c21-78cae4070238 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 404 len: 111 microversion: 2.1 time: 0.034094 Jun 25 21:17:56.123012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3019/5584] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:56 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:17:56.223634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1916000678", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "713ebc7e-6bb6-46b2-b2f8-de8f46b02d40"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:56.273998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] validate_networks() for [('713ebc7e-6bb6-46b2-b2f8-de8f46b02d40', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:17:56.326421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:56.327682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:56.335144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.335598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.336433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.336911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.400241 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1bde9fd-23f5-4aec-85f9-637ca4f49606 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action" status: 200 len: 63159 microversion: 2.1 time: 0.078113 Jun 25 21:17:56.401449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3020/5585] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:17:56 2022] POST /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18/action => generated 63159 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 21:17:56.687926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:17:56.688588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:17:56.689075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:17:56.689509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:17:56.689978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:17:56.705570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.706030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.706835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.707641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.736137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:17:56.742818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Getting quotas for user 99a45af5dbf8442d9801f494b794e880 and project 1df9f09e5c7c4f21aca1705769d3c84c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:17:56.759288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:17:56.762865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:17:56.813710 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1bfa1d1c-aaef-4e60-9e44-160d08e5570f tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593838 Jun 25 21:17:56.814448 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2566/5586] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:17:56.829836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99b149a3-0ed8-46a7-9837-0c94fdbd14b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:56.834716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99b149a3-0ed8-46a7-9837-0c94fdbd14b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:56.909701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99b149a3-0ed8-46a7-9837-0c94fdbd14b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:56.910951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:56.911642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:56.919803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.920463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.920567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99b149a3-0ed8-46a7-9837-0c94fdbd14b4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1209 microversion: 2.1 time: 0.098739 Jun 25 21:17:56.921768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:56.922445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:56.931548 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3021/5587] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:56 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:57.068190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:57.079074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:57.080918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:57.083405 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60a599ab-013c-4d70-9228-af6b30dd80dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.176152 Jun 25 21:17:57.093292 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2567/5588] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:56 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:17:57.940934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:57.941543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:57.950386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:57.951150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:57.952120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:57.952967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:58.043450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:58.060330 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-919455c8-4de2-471a-bfb3-914f212db79b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1279 microversion: 2.1 time: 0.124399 Jun 25 21:17:58.061547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3022/5589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:57 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1279 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:58.105169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:58.106656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:58.119508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:58.134459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:58.136955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:58.137803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:58.404275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:58.414707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:58.422486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:58.423745 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-05c5b732-fff6-4bbc-ac33-dacc847e05fe tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.324082 Jun 25 21:17:58.424325 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2568/5590] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:58 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:59.078112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:59.079260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:59.095950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:59.096408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:59.097245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:59.097689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:59.294395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:59.303334 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e6914ba-38cc-4a28-90d7-6a7510890560 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.229041 Jun 25 21:17:59.305242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3023/5591] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:17:59 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:17:59.443451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:17:59.444973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:17:59.453303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:59.454068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:59.455098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:59.455724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:17:59.811652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:59.842672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:59.845939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:17:59.847205 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8d32a5c-4807-4e7b-843c-c0d67581edc4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.409199 Jun 25 21:17:59.848529 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2569/5592] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:17:59 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:17:59.984701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9a2cea78-b124-4a1f-8733-585111bbbcdc req-f2d109f3-0e7a-4abe-a9a9-a63ed373ad64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34dbb2fe-c2dc-48f6-876a-e699a020e392", "tag": "82e96e5e-46a8-4244-bce5-2089d4cb1209"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:17:59.996248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9a2cea78-b124-4a1f-8733-585111bbbcdc req-f2d109f3-0e7a-4abe-a9a9-a63ed373ad64 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:17:59.997080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9a2cea78-b124-4a1f-8733-585111bbbcdc req-f2d109f3-0e7a-4abe-a9a9-a63ed373ad64 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.026675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9a2cea78-b124-4a1f-8733-585111bbbcdc req-f2d109f3-0e7a-4abe-a9a9-a63ed373ad64 service nova] Creating event network-changed:82e96e5e-46a8-4244-bce5-2089d4cb1209 for instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 on nch2-master-1 Jun 25 21:18:00.033069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9a2cea78-b124-4a1f-8733-585111bbbcdc req-f2d109f3-0e7a-4abe-a9a9-a63ed373ad64 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053926 Jun 25 21:18:00.034813 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3024/5593] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:00.323038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:00.323926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:00.334998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.335721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.336850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.339647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.559477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:00.561445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:00.566694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:00.576330 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87354e52-0b18-4e9c-88ff-4a44646ae2ce tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.257596 Jun 25 21:18:00.576981 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2570/5594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:00 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:00.580769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.581708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.588858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.593566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.630469 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d7ff12c-ec2e-4346-8925-7cfccc4db7a6 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/ips" status: 200 len: 149 microversion: 2.1 time: 0.079998 Jun 25 21:18:00.636640 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3025/5595] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:18:00 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/ips => generated 149 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:18:00.646678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ebdd798-3bf7-43ca-a95f-02a861d932e8"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:00.648253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:00.727747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.728881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.729826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.730397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.843561 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/os-volume_attachments HTTP/1.1 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 74 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: {"volumeAttachment": {"volumeId": "5ebdd798-3bf7-43ca-a95f-02a861d932e8"}} Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '28f89650-ba09-4528-a880-99c11aa84659', 'body': {'volumeAttachment': {'volumeId': '5ebdd798-3bf7-43ca-a95f-02a861d932e8'}}} Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:18:00.845578 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 Jun 25 21:18:00.849428 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:00.850616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 400 to user: Invalid volume: volume 5ebdd798-3bf7-43ca-a95f-02a861d932e8 is already attached to instances: a3e6c722-541c-41aa-972a-83e1fe6fdc34 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:00.851796 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d80cd07e-a388-466c-abe7-a6e44a908702 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.211634 Jun 25 21:18:00.852877 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2571/5596] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:18:00 2022] POST /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659/os-volume_attachments => generated 174 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:18:00.865895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:00.866703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:00.867187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:00.867835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:00.875019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.875589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.876596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.877056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.877149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.877889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:00.878170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.878333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:00.885489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:00.912101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:18:01.017896 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0a2157e8-b8a5-4fb6-8e16-6db435d4a2aa tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 204 len: 0 microversion: 2.1 time: 0.155666 Jun 25 21:18:01.020505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2572/5597] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:00 2022] DELETE /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:01.029636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:01.030436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:01.036778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:01.037416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:01.038371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:01.038957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:01.042273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:01.052084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:01.054140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:01.055494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-070302c3-0148-4648-b7fb-9e6a35cb0209 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.193704 Jun 25 21:18:01.056664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3026/5598] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:00 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:01.196927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:01.199389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:01.207776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70c59aab-59c5-46ae-b6ee-6c88f1b46e2b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1680 microversion: 2.1 time: 0.182571 Jun 25 21:18:01.208706 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2573/5599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:01 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:01.605676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:01.606300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:01.614364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:01.615211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:01.616228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:01.617097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:01.769593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:01.778630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bdd1c2f-893f-4812-a32c-c388a2d5df45 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.177045 Jun 25 21:18:01.779814 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3027/5600] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:01 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:02.075772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:02.076674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:02.086838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.088568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.090242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.091128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.227174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:02.227954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:02.235493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.236041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.236922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.237422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.287744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:02.299854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:02.301724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:02.303625 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1c493ac-5bca-4979-9133-39e2d2eb9b98 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.233438 Jun 25 21:18:02.304407 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2574/5601] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:02 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:02.421424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:02.430166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ead315a-68bc-43b6-a326-b3b8a3d3c453 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1680 microversion: 2.1 time: 0.208380 Jun 25 21:18:02.430846 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3028/5602] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:02 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1680 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:02.797605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:02.798932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:02.808749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.811791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.812680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.813457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.849707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:02.850312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:02.856853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.857412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:02.858728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:02.859262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:03.042325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:03.072740 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-01005740-3416-439b-ae16-6096b478f3c1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.279814 Jun 25 21:18:03.074266 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3029/5603] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:02 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:03.328974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:03.329846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:03.347284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:03.348112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:03.349609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:03.352254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:03.541910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:03.552450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:03.554411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:03.555951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eca41ba3-e831-42cc-9578-dd881fcc78dc tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.236238 Jun 25 21:18:03.562303 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3030/5604] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:03 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:03.567424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:03.568110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:03.585754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:03.590774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:03.591704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:03.592166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:03.655637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca929273-b333-4fc6-b592-7d0c9775bb6d tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1830 microversion: 2.1 time: 0.969233 Jun 25 21:18:03.656183 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2575/5605] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:02 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1830 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:03.903225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:03.911438 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8890df0-0fe4-46ca-825e-91cb3a4e4120 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1680 microversion: 2.1 time: 0.347878 Jun 25 21:18:03.912045 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3031/5606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:03 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1680 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:04.096487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:04.097120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:04.110807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.111267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:04.112055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.116539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:04.579254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:04.579869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:04.587338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.587953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:04.588933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.589512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:04.791681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:04.804967 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48a5ad01-f4ca-40ae-b790-19c32e4f5f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.713423 Jun 25 21:18:04.814552 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2576/5607] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:04 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:04.826824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:04.880124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:04.882896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:04.886186 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0395b3ca-cd37-44f0-bc1a-83ef6adabc1a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.309970 Jun 25 21:18:04.888128 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3032/5608] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:04 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:04.928732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:04.929784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:04.943278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.951061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:04.957488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:04.960783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:05.100003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:05.124706 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-236d85b1-e151-4432-9c8d-e98debf74b0a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 200 len: 1613 microversion: 2.1 time: 0.199731 Jun 25 21:18:05.127786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-af9897f6-8300-4f10-98c1-ea3baf71b990 req-74e6f9ab-c076-4355-8e0c-a39c5bc81f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28f89650-ba09-4528-a880-99c11aa84659", "name": "network-vif-deleted", "tag": "3bf17f37-3871-4c1a-9342-70654d7405b8"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:05.155148 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2577/5609] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:04 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 1613 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:05.155788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-af9897f6-8300-4f10-98c1-ea3baf71b990 req-74e6f9ab-c076-4355-8e0c-a39c5bc81f9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:05.156529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-af9897f6-8300-4f10-98c1-ea3baf71b990 req-74e6f9ab-c076-4355-8e0c-a39c5bc81f9d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:05.187920 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-af9897f6-8300-4f10-98c1-ea3baf71b990 req-74e6f9ab-c076-4355-8e0c-a39c5bc81f9d service nova] Creating event network-vif-deleted:3bf17f37-3871-4c1a-9342-70654d7405b8 for instance 28f89650-ba09-4528-a880-99c11aa84659 on nch1-master-1 Jun 25 21:18:05.210718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-af9897f6-8300-4f10-98c1-ea3baf71b990 req-74e6f9ab-c076-4355-8e0c-a39c5bc81f9d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089364 Jun 25 21:18:05.212708 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3033/5610] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:18:05.822056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:05.823542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:05.833442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:05.836451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:05.838666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:05.839290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:05.909132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:05.910232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:05.927359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:05.928968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:05.933207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:05.934172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.219220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:06.230067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:06.230650 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4938348-68c7-40fc-82ab-50e8950337d5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.412496 Jun 25 21:18:06.244716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:06.245229 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2578/5611] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:05 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:06.253903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:06.255281 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-532a5374-f0e8-4cae-83ad-fbfa554e7891 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.352465 Jun 25 21:18:06.256307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3034/5612] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:05 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:06.261091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:06.269476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:06.271422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:06.272104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:06.277922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.278802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.279750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.280340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.289791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.290355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.291151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.291598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.298398 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 HTTP/1.1 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '28f89650-ba09-4528-a880-99c11aa84659'} Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:06.302843 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:18:06.306053 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:06.307808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:06.309844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3af35844-1088-4d46-a2d9-4362b03635bd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 404 len: 111 microversion: 2.1 time: 0.052463 Jun 25 21:18:06.311538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3035/5613] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:06 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:06.322175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2f654df-9dfd-470b-bcd3-43510adf702a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '.version_select at 0x7f984ef4a430>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:06.353901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:18:06.366908 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2f654df-9dfd-470b-bcd3-43510adf702a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-389429767" status: 202 len: 0 microversion: 2.1 time: 0.051649 Jun 25 21:18:06.368480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3036/5614] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:18:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-389429767 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:18:06.497234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-be0ce2af-2642-46e8-9b9b-c58850d277da req-4f6a6d45-d913-43a8-89c9-d8d826d12676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dbb2fe-c2dc-48f6-876a-e699a020e392", "name": "network-vif-plugged", "status": "completed", "tag": "82e96e5e-46a8-4244-bce5-2089d4cb1209"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:06.522092 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-587f1cc5-c432-45b6-8f21-f0bb2f93b6f7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 204 len: 0 microversion: 2.1 time: 0.274344 Jun 25 21:18:06.525358 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2579/5615] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:06 2022] DELETE /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:06.533643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-be0ce2af-2642-46e8-9b9b-c58850d277da req-4f6a6d45-d913-43a8-89c9-d8d826d12676 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.535888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-be0ce2af-2642-46e8-9b9b-c58850d277da req-4f6a6d45-d913-43a8-89c9-d8d826d12676 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.547085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:06.549641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:06.584144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:06.588547 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-be0ce2af-2642-46e8-9b9b-c58850d277da req-4f6a6d45-d913-43a8-89c9-d8d826d12676 service nova] Creating event network-vif-plugged:82e96e5e-46a8-4244-bce5-2089d4cb1209 for instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 on nch2-master-1 Jun 25 21:18:06.595090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.595698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.596592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:06.599733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:06.608876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-be0ce2af-2642-46e8-9b9b-c58850d277da req-4f6a6d45-d913-43a8-89c9-d8d826d12676 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119529 Jun 25 21:18:06.609828 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3037/5616] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:06.722120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:06.752131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:07.106416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:07.118965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec86c4ab-10b6-4d5b-8011-5ac9703d0b0e tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1685 microversion: 2.1 time: 0.587899 Jun 25 21:18:07.136039 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2580/5617] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:06 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1685 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:07.237376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1c7f25e2-45a5-486e-bed8-154e191a2445 req-f89eacc6-b0f3-4cdd-9891-8d61aec268ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:07.252268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:07.252692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:07.253534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:07.268037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:07.270153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:07.271440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1c7f25e2-45a5-486e-bed8-154e191a2445 req-f89eacc6-b0f3-4cdd-9891-8d61aec268ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:07.272042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1c7f25e2-45a5-486e-bed8-154e191a2445 req-f89eacc6-b0f3-4cdd-9891-8d61aec268ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:07.273360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:07.276750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:07.319545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1c7f25e2-45a5-486e-bed8-154e191a2445 req-f89eacc6-b0f3-4cdd-9891-8d61aec268ac service nova] Creating event network-changed:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:18:07.360593 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1c7f25e2-45a5-486e-bed8-154e191a2445 req-f89eacc6-b0f3-4cdd-9891-8d61aec268ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124675 Jun 25 21:18:07.370682 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3038/5618] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:07.388128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:07.388871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:07.417446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:07.417917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:07.418880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:07.425508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:07.643313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:07.654156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8294bf8c-5609-4f69-aaeb-8e4f1eb8f9ba tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1309 microversion: 2.1 time: 0.407180 Jun 25 21:18:07.657404 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2581/5619] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:07 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:08.025765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:08.026336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:08.053517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.053985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.056037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.058710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.080824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:08.110996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:08.123684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:08.125230 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-49a4523d-7d1e-43a2-b79b-17916f6c40f9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.752903 Jun 25 21:18:08.149008 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3039/5620] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:07 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:08.178556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:08.187300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:08.215555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.217684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.220029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.220673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.428048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lazy-loading 'services' on Instance uuid a3e6c722-541c-41aa-972a-83e1fe6fdc34 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:18:08.598285 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-54a3b70e-a9fe-4da3-806a-701c67a2b194 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments/5ebdd798-3bf7-43ca-a95f-02a861d932e8" status: 202 len: 0 microversion: 2.1 time: 0.579593 Jun 25 21:18:08.598872 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2582/5621] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:18:08 2022] DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments/5ebdd798-3bf7-43ca-a95f-02a861d932e8 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:18:08.614377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:08.618895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:08.626100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.626765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.627839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.628477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.688629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86b7bf5c-cd07-47f8-bee4-b5aea6cff4ac tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082712 Jun 25 21:18:08.690982 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2583/5622] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:18:08 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:08.695827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:08.696483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:08.728203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.731842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.732714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:08.733161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:08.787342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:08.797910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1d7002b8-d091-44ea-b8c4-b510d76be071 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 200 len: 1685 microversion: 2.1 time: 0.645441 Jun 25 21:18:08.798770 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3040/5623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:08 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 1685 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:08.995744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:09.007546 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d45409e7-ec3b-41cd-9efb-92cc659b9c24 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1489 microversion: 2.1 time: 0.315364 Jun 25 21:18:09.008414 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2584/5624] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:08 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1489 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:09.024844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1115058577"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:09.026201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.036110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.039692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.041107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.042237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.155265 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8a0d0ef-299f-4167-8a90-1c79844c59d6 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "PUT /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1074 microversion: 2.1 time: 0.135418 Jun 25 21:18:09.157047 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3041/5625] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:18:09 2022] PUT /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1074 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:09.168742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.170040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.180832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.181627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.182649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.183620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.448411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d1819bcc-2d41-45e6-8844-75a6c1ecce94 req-8fbf88f4-e7b0-4adf-975b-96dca3f38c08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1529e81e-bac1-4142-b308-05f212162b18", "name": "network-vif-deleted", "tag": "7680a538-a827-4080-86d3-0147d6fdcc6b"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:09.459926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:09.466947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d1819bcc-2d41-45e6-8844-75a6c1ecce94 req-8fbf88f4-e7b0-4adf-975b-96dca3f38c08 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.467635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d1819bcc-2d41-45e6-8844-75a6c1ecce94 req-8fbf88f4-e7b0-4adf-975b-96dca3f38c08 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.471528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:09.473274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:09.474966 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0356b368-f847-4f24-b4a2-320b34152b85 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.311572 Jun 25 21:18:09.475973 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3042/5626] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:09 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:09.482013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.482935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.490577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.491376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.492525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.493404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.505326 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d1819bcc-2d41-45e6-8844-75a6c1ecce94 req-8fbf88f4-e7b0-4adf-975b-96dca3f38c08 service nova] Creating event network-vif-deleted:7680a538-a827-4080-86d3-0147d6fdcc6b for instance 1529e81e-bac1-4142-b308-05f212162b18 on nch1-master-1 Jun 25 21:18:09.520963 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d1819bcc-2d41-45e6-8844-75a6c1ecce94 req-8fbf88f4-e7b0-4adf-975b-96dca3f38c08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380756 Jun 25 21:18:09.521564 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2585/5627] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:09.705422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.707268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.717946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.719014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.719965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.720599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.756481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:09.788266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35cb4fd6-a1b2-4904-9469-2686dd9ce9cc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1500 microversion: 2.1 time: 0.308563 Jun 25 21:18:09.789951 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3043/5628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:09 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1500 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:09.821509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.822145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.828592 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4636ab7a-e0da-4949-bac8-aeeffaa4fd67 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128214 Jun 25 21:18:09.829444 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2586/5629] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:18:09 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 25 21:18:09.836310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.837219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 1529e81e-bac1-4142-b308-05f212162b18] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.849990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.850674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.851690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.852134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.859174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.862630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.863484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.863938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.876332 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] HTTP exception thrown: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Request method failure captured: Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 HTTP/1.1 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oppHqyw4EeiDOlRZTssoyBnr4Fvha7OXgevHlVi_-Lo2Z8Iq2TjW5wdFnz53ddpd5IgdjOJUqfVFPdDF6ZhziXRhgRcBe3CuTOpGuDMlw8qliC1Zo9kBCF2HZU7ccN2avzoIa76kuxMJD3iDdl2bUmkbWRqsMNWpNI2_jlCuUlHsA Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}] Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: aa2aaa29e0dd479283202bd6575b4c25 Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '1529e81e-bac1-4142-b308-05f212162b18'} Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:09.878065 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. Jun 25 21:18:09.881597 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:09.884269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Returning 404 to user: Instance 1529e81e-bac1-4142-b308-05f212162b18 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:09.885396 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3a922c3-4760-4d85-9116-50150434dbc7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18" status: 404 len: 111 microversion: 2.1 time: 0.055016 Jun 25 21:18:09.886241 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2587/5630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:09 2022] GET /compute/v2.1/servers/1529e81e-bac1-4142-b308-05f212162b18 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:09.922570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:09.923534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:09.938770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.940491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:09.942098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:09.944494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.033529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:18:10.098279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:10.179173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.188742 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f179281-51fc-421a-97fe-6698ee03cb82 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1500 microversion: 2.1 time: 0.382430 Jun 25 21:18:10.189884 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3044/5631] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:09 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1500 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:10.197032 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb85a18d-e1f9-42bd-b011-84c43323493a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 204 len: 0 microversion: 2.1 time: 0.278378 Jun 25 21:18:10.198459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2588/5632] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:09 2022] DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:10.215318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1a7222da-4f13-4870-a7c0-a558603ff772 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:10.225181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:10.232151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:10.236274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a7222da-4f13-4870-a7c0-a558603ff772 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.241080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1a7222da-4f13-4870-a7c0-a558603ff772 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.253309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.253772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.255678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.258451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.285200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1a7222da-4f13-4870-a7c0-a558603ff772 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:18:10.291003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:10.364928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1a7222da-4f13-4870-a7c0-a558603ff772 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "POST /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392/action" status: 202 len: 0 microversion: 2.1 time: 0.161451 Jun 25 21:18:10.369348 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3045/5633] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:18:10 2022] POST /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:18:10.376313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:10.376910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:10.385240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.386062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.387054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.388119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.642797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.653055 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fbd6c2ba-2288-4678-8254-fd0d96657f76 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.282781 Jun 25 21:18:10.653988 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3046/5634] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:10 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:10.674348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:10.675484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:10.682301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.683130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.684175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:10.684893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:10.712375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.727011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0128b4d-9fde-4baf-b3ed-7bf421fdc97f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1680 microversion: 2.1 time: 0.521089 Jun 25 21:18:10.730224 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2589/5635] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:10 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1680 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:10.956185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.966082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.968297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:10.969590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-63670cf4-0dea-424c-9c0a-abc165a3f9b3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.301259 Jun 25 21:18:10.971313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3047/5636] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:10 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:11.677892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:11.678396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:11.689139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:11.689603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:11.690391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:11.692405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:11.746915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:11.747682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:11.768295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:11.770355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:11.770876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:11.771795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:11.777719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:12.085825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:12.095455 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdf47ee9-f7d3-4ff0-a58d-f25bfad852ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.422044 Jun 25 21:18:12.105595 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2590/5637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:11 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:12.105595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:12.105595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:12.111056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:12.122457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e475d7a-29c1-4570-b4a6-4312fad9ec91 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1680 microversion: 2.1 time: 0.379371 Jun 25 21:18:12.124086 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3048/5638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:11 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:12.127337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:12.128355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:12.129558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:12.131596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:12.387469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:12.399938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:12.402143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:12.406010 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b1f82564-d239-4201-b79a-55e0aebb908b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1739 microversion: 2.20 time: 0.304756 Jun 25 21:18:12.406892 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2591/5639] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:12 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:13.113790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:13.114972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:13.132398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.132803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.133587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.135585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.141806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:13.143217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:13.161529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.163765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.167111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.169004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.299420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:13.309345 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50a4e44c-3f93-4e58-9127-d705d2f694d5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 200 len: 1613 microversion: 2.1 time: 0.172328 Jun 25 21:18:13.314890 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2592/5640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:13 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 1613 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:13.425921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:13.440140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:13.458598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.463019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.464018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.466722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.621489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:13.656321 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c09f1058-f794-420a-8063-96817b1eb860 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.547782 Jun 25 21:18:13.664932 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3049/5641] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:13 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:13.683873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c6c81c11-427b-4828-8c48-279cacbb45f2 req-6dec814d-4d58-4a95-a453-a0d6c9065599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e6c722-541c-41aa-972a-83e1fe6fdc34", "name": "network-vif-deleted", "tag": "76a07f9b-c0b6-40ee-9895-f6751613413c"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:13.707400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c6c81c11-427b-4828-8c48-279cacbb45f2 req-6dec814d-4d58-4a95-a453-a0d6c9065599 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:13.708864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c6c81c11-427b-4828-8c48-279cacbb45f2 req-6dec814d-4d58-4a95-a453-a0d6c9065599 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:13.770781 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c6c81c11-427b-4828-8c48-279cacbb45f2 req-6dec814d-4d58-4a95-a453-a0d6c9065599 service nova] Creating event network-vif-deleted:76a07f9b-c0b6-40ee-9895-f6751613413c for instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 on nch1-master-1 Jun 25 21:18:13.789896 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c6c81c11-427b-4828-8c48-279cacbb45f2 req-6dec814d-4d58-4a95-a453-a0d6c9065599 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123284 Jun 25 21:18:13.793437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3050/5642] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:13.963008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:13.974255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:13.976032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:13.977540 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4272947b-4397-4ef7-83d0-701102625667 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1721 microversion: 2.20 time: 0.555691 Jun 25 21:18:13.990517 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2593/5643] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:13 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1721 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:14.331506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:14.337007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:14.353514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:14.354543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:14.355755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:14.356587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:14.377326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 HTTP/1.1 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a3e6c722-541c-41aa-972a-83e1fe6fdc34'} Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:14.379229 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:18:14.382571 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:14.391735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:14.392715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5a0615ea-6626-49d2-965b-9bcb8f6fe6ab tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 404 len: 111 microversion: 2.1 time: 0.067607 Jun 25 21:18:14.399952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3051/5644] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:14 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:14.404737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4763d52a-a7db-40f5-9c17-951c4d1c32db tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '.version_select at 0x7f985c562a60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:14.448931 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4763d52a-a7db-40f5-9c17-951c4d1c32db tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069586746" status: 202 len: 0 microversion: 2.1 time: 0.049465 Jun 25 21:18:14.453148 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2594/5645] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:18:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069586746 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:18:14.685556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:14.686847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:14.700467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:14.701185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:14.702159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:14.709723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:14.999041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:14.999664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:15.018398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:15.019291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:15.020315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:15.036703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:15.115949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:15.135178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c6bcd72-e98e-4a24-81db-1255fbe60e42 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.457687 Jun 25 21:18:15.141373 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3052/5646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:14 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:15.373269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:15.385059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:15.388386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:15.390161 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50999577-f9a6-4aef-aee6-f0953695d36a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1721 microversion: 2.20 time: 0.396912 Jun 25 21:18:15.391328 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2595/5647] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:14 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:15.758861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c5672e0-3c58-4282-bef5-a62f07db5313 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: .version_select at 0x7f9861e9be50>, body: {"keypair": {"name": "tempest-keypair-558399540", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOXizt2QlN3W6x5OkUHEWgCm+Cf50qDWmWIXEFklUS+H1eT+UW5v+QVHVUde47EcnmcwyKWtg5WNQdB5gSuWCL8Kj9TJAz6VEOeOMd8OQ9TOSh0qCs4abzkbL1Ku8mOZQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:15.799629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1c5672e0-3c58-4282-bef5-a62f07db5313 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:18:15.819559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-1c5672e0-3c58-4282-bef5-a62f07db5313 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:18:15.869726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c5672e0-3c58-4282-bef5-a62f07db5313 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.115112 Jun 25 21:18:15.870898 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3053/5648] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:18:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:16.057790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9af0449e-79f8-4eda-b1c2-c94b2d15eb5f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '.version_select at 0x7f985c0433a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:16.109823 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9af0449e-79f8-4eda-b1c2-c94b2d15eb5f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-668324150" status: 202 len: 0 microversion: 2.1 time: 0.055095 Jun 25 21:18:16.110666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2596/5649] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 21:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-668324150 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:18:16.131333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-72cf5294-7cc6-46d7-b826-afded5dee691 req-f9a13b37-8f03-4962-ad42-05c68cf5dd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "name": "network-vif-unplugged", "status": "completed", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:16.151023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f8c0f4e-a404-4001-a42b-a4982d8727b0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: .version_select at 0x7f984fed5c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1221555139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2AfuDz+Mzl+Z1hNs9avBiqVPghrFdPNdUQM3zsOrqgoz4zArvoH7FdUQlCgXKpM8vroptLMnF7RRhKd2iN2GUE5IS3bY7c5CKWP1phYT+bvF6Kh/FPrb71F45IPdDhrg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:16.169670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-72cf5294-7cc6-46d7-b826-afded5dee691 req-f9a13b37-8f03-4962-ad42-05c68cf5dd0a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.170184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-72cf5294-7cc6-46d7-b826-afded5dee691 req-f9a13b37-8f03-4962-ad42-05c68cf5dd0a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.215566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_external_events [req-72cf5294-7cc6-46d7-b826-afded5dee691 req-f9a13b37-8f03-4962-ad42-05c68cf5dd0a service nova] Unable to find a host for instance e0092220-c4b5-40be-a315-fabad4d12562. Dropping event network-vif-unplugged {{(pid=137461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:18:16.218200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-72cf5294-7cc6-46d7-b826-afded5dee691 req-f9a13b37-8f03-4962-ad42-05c68cf5dd0a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.095307 Jun 25 21:18:16.223026 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3054/5650] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 101 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:18:16.229189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6f8c0f4e-a404-4001-a42b-a4982d8727b0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:18:16.233993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:16.234624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:16.253452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6f8c0f4e-a404-4001-a42b-a4982d8727b0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:18:16.259702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.259702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.263622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.264094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.315175 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f8c0f4e-a404-4001-a42b-a4982d8727b0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.167341 Jun 25 21:18:16.324752 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2597/5651] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:18:16 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:16.409780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:16.410422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:16.417436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.417882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.418710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.419144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.519524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:16.530296 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-345b0b40-090a-4ea4-af26-51c16729bac8 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.305554 Jun 25 21:18:16.531151 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3055/5652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:16 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:16.682826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:16.692723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:16.694250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:16.695451 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-341c6c28-af5a-4bf9-bffe-74b5fc9aeff6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1664 microversion: 2.20 time: 0.289917 Jun 25 21:18:16.696467 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2598/5653] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:16 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1664 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:18:16.714012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0d28785-d076-4b06-b8c8-1d55430a8bed"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:16.715215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:16.722190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.722791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:16.723793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:16.724625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.061185 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1fab74bf-a18a-4bdb-8fe7-a267392fa1d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.351247 Jun 25 21:18:17.062066 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3056/5654] 10.222.0.39 () {62 vars in 1363 bytes} [Sat Jun 25 21:18:16 2022] POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments => generated 188 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:18:17.210166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:17.211168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:17.218815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.219366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.220291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.220840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.319048 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f9695ccd-6e23-45e8-8204-3f2ceba93499 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/action" status: 202 len: 0 microversion: 2.20 time: 0.115647 Jun 25 21:18:17.319689 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2599/5655] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:18:17 2022] POST /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:17.340782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:17.342329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:17.354227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.354227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.355140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.355658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.548723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:17.551346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:17.564062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.565971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.568833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:17.569281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:17.613605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:17.631139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:17.635374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:17.640651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88be252b-32f8-4a97-9452-744a58b266c1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1750 microversion: 2.20 time: 0.313893 Jun 25 21:18:17.644345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3057/5656] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:17 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1750 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:17.910281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:17.919465 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd70e5fb-56b9-4b60-bc7d-2c3be5dbfe96 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.375569 Jun 25 21:18:17.920121 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2600/5657] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:17 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:18.224662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1488747232", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15adaf3c-53a3-47ee-a619-76a812ef788d"}], "security_groups": [{"name": "tempest-securitygroup--1842153253"}], "key_name": "tempest-keypair-558399540", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:18.479007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] validate_networks() for [('15adaf3c-53a3-47ee-a619-76a812ef788d', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:18:18.662000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:18.662622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:18.669578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:18.670033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:18.670849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:18.671291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:18.847730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:18.860874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:18.863765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:18.866252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d00b25ad-7a9a-4cf0-a404-ccc6c70ed647 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1752 microversion: 2.20 time: 0.208684 Jun 25 21:18:18.867432 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2601/5658] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:18 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1752 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:18.937018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:18.937634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:18.944556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:18.945013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:18.945845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:18.946279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:19.119551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:19.130178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92a7d61b-5d66-4657-b8f7-2046e2e5ae57 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.196985 Jun 25 21:18:19.131555 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2602/5659] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:18 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:19.254340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:18:19.256489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:18:19.257180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:18:19.258095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:18:19.258714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:18:19.270893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:19.271608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:19.274401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:19.275381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:19.298775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:18:19.305452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:18:19.321370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:18:19.323987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:18:19.415864 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dd5fca7a-89ab-4a34-a193-176ed87ff06f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.195614 Jun 25 21:18:19.417402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3058/5660] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:18:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:18:19.427274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3cd4838b-a417-4f56-b591-d4c54a501bff tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:19.427910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cd4838b-a417-4f56-b591-d4c54a501bff tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:19.528468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3cd4838b-a417-4f56-b591-d4c54a501bff tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:19.544923 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3cd4838b-a417-4f56-b591-d4c54a501bff tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1241 microversion: 2.1 time: 0.121477 Jun 25 21:18:19.545923 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2603/5661] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:19 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:19.889418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:19.890111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:19.903415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:19.903863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:19.904674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:19.905312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:20.147436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:20.148853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:20.157726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:20.158589 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:20.159762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:20.160807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:20.402691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:20.410783 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfc3dfe8-6dc0-4dbd-a091-5411d1513bc0 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.267440 Jun 25 21:18:20.411505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2604/5662] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:20 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:20.449626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:20.459423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:20.461035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:20.462247 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c2282b3-db8f-4c52-aa24-23221d8a38cb tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1752 microversion: 2.20 time: 0.577882 Jun 25 21:18:20.464060 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3059/5663] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:19 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1752 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:20.563842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:20.564247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:20.578391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:20.578949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:20.580130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:20.580629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:20.669507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:20.681421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef6636fb-4589-42cb-b48a-9d4ce45d9166 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1293 microversion: 2.1 time: 0.122380 Jun 25 21:18:20.682757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2605/5664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:20 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1293 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:21.427123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:21.427754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:21.438634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:21.439349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:21.440347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:21.441248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:21.481814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:21.483358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:21.490805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:21.494215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:21.498723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:21.499465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:22.014840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:22.026809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8b3c36e8-f8d3-43d5-bd5c-dc22ffc19fbc tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.603529 Jun 25 21:18:22.038739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3060/5665] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:21 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:22.044629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:22.045563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:22.054143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:22.054866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:22.056072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:22.056735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:22.222420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:22.232574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:22.240042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:22.250641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:22.251947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc5ab453-e210-483b-bdb8-ede92f220866 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.774110 Jun 25 21:18:22.255120 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2606/5666] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:21 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:22.270297 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3e16192-4ea5-4747-b79e-a0f7ce36f400 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1299 microversion: 2.1 time: 0.212863 Jun 25 21:18:22.273936 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3061/5667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:22 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:22.891932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4d0b800f-f36d-44b9-974a-1c86ba51b7fb req-d365f008-3b9b-496c-8052-7bcf7c7aec92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:22.916769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4d0b800f-f36d-44b9-974a-1c86ba51b7fb req-d365f008-3b9b-496c-8052-7bcf7c7aec92 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:22.917470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4d0b800f-f36d-44b9-974a-1c86ba51b7fb req-d365f008-3b9b-496c-8052-7bcf7c7aec92 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:22.938072 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4d0b800f-f36d-44b9-974a-1c86ba51b7fb req-d365f008-3b9b-496c-8052-7bcf7c7aec92 service nova] Creating event network-changed:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch1-master-1 Jun 25 21:18:22.950424 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4d0b800f-f36d-44b9-974a-1c86ba51b7fb req-d365f008-3b9b-496c-8052-7bcf7c7aec92 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062515 Jun 25 21:18:22.965009 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2607/5668] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:23.045122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:23.048822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:23.061170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.075553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:23.077106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.078340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:23.113568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:23.270849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:23.271561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:23.279889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.280346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:23.281161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.282962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:23.304937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:23.697732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:23.709583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:23.722006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:23.723368 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cdb241b4-b64c-4e43-8233-632db838a79e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.456994 Jun 25 21:18:23.723970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2608/5669] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:23 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:23.744945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:23.750558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:23.764815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.765284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:23.772842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:23.773331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:24.277703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:24.301070 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b641b24f-374c-4db3-a5a4-72d4ef119851 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.568245 Jun 25 21:18:24.302893 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2609/5670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:23 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:24.317200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:24.332822 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dcfaaa8-6260-42f2-ad95-9cb81aa066ee tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 1.289151 Jun 25 21:18:24.334502 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3062/5671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:23 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:24.591417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-631afafd-aebf-4300-a84f-2987d0c95da7 req-f2c6cd00-f5c4-4871-8c1c-be0834bf5bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258dc019-3d6d-448a-819f-d7a79ad114e3", "tag": "f3451d7c-fd63-49a2-8b39-7dfb96cfe847"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:24.621789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-631afafd-aebf-4300-a84f-2987d0c95da7 req-f2c6cd00-f5c4-4871-8c1c-be0834bf5bdd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:24.622337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-631afafd-aebf-4300-a84f-2987d0c95da7 req-f2c6cd00-f5c4-4871-8c1c-be0834bf5bdd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:24.656947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-631afafd-aebf-4300-a84f-2987d0c95da7 req-f2c6cd00-f5c4-4871-8c1c-be0834bf5bdd service nova] Creating event network-changed:f3451d7c-fd63-49a2-8b39-7dfb96cfe847 for instance 258dc019-3d6d-448a-819f-d7a79ad114e3 on nch1-master-1 Jun 25 21:18:24.663670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-631afafd-aebf-4300-a84f-2987d0c95da7 req-f2c6cd00-f5c4-4871-8c1c-be0834bf5bdd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.358588 Jun 25 21:18:24.669422 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2610/5672] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:24.742357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:24.743229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:24.750080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:24.750551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:24.751334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:24.751775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:25.051665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:25.061201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:25.062725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:25.063942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02fe16ae-8457-47ae-979d-8e229409a978 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.325745 Jun 25 21:18:25.064890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3063/5673] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:24 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:25.323337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:25.324714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:25.336305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:25.337225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:25.338358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:25.338894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:25.353791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:25.355704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:25.383820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:25.384687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:25.385851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:25.386508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:25.713305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:25.748983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:25.753823 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce261437-4086-4d45-a2ea-bb01d25c601e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.437084 Jun 25 21:18:25.760901 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e32844c-ed1b-4a9d-b651-3963b0fd34eb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.414387 Jun 25 21:18:25.765692 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3064/5674] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:25 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:25.767633 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2611/5675] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:25 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:26.083506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:26.084137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:26.093070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.093527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:26.099779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.100184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:26.552044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:26.567386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:26.579249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:26.580858 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4042abb-a573-4b85-ac74-b210d581d161 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.501886 Jun 25 21:18:26.584034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3065/5676] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:26 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:26.773819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:26.778418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:26.780207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:26.780894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:26.797117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.798258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:26.799126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.802909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.809412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:26.812271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:26.816342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:26.825169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:27.225151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:27.238513 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e1ab7a8d-8c8b-4eb2-9d23-88b1724e19c1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.469166 Jun 25 21:18:27.239999 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2612/5677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:26 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:27.446247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:27.463863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-874102fc-25bb-4471-9100-ad6c82652221 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.690701 Jun 25 21:18:27.464868 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3066/5678] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:26 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:27.603909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:27.604970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:27.621099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:27.626052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:27.630303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:27.630946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.020850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:28.029906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:28.031420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:28.032656 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b339819-7965-4470-8b9d-b57a9df4b1d6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.435124 Jun 25 21:18:28.044306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1382208682", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "57f5c5d8-3510-4942-a07c-56ab5aff29be"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1221555139", "security_groups": [{"name": "tempest-secgroup-smoke-498458260"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:28.051921 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2613/5679] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:27 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:28.190316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] validate_networks() for [('57f5c5d8-3510-4942-a07c-56ab5aff29be', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:18:28.255378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:28.256030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:28.275927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.284998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.285979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.286433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.623409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:28.641166 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f37209ca-c50b-46a9-b883-767e50fb7683 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.389691 Jun 25 21:18:28.643048 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2614/5680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:28 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:28.658037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:28.661591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:28.684387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.685570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.688166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.689126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.939002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:18:28.939527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:18:28.940484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:18:28.941136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:18:28.941568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:18:28.963311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.966930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:28.968844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:28.972456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:29.015490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:29.023541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:18:29.024575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3fefb60-61d6-49cd-837c-663799512242 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.377257 Jun 25 21:18:29.025251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2615/5681] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:28 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:29.036171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:18:29.054469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:29.057962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:29.061066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:18:29.063280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:18:29.066782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:29.067482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:29.068914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:29.069499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:29.166911 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4c2bb11-7808-4765-b8a5-4bff771677dc tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.127781 Jun 25 21:18:29.175603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3067/5682] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:18:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:18:29.195818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bed58330-5688-45d9-8db2-ac8f1d5c9416 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:29.198456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bed58330-5688-45d9-8db2-ac8f1d5c9416 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:29.265470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bed58330-5688-45d9-8db2-ac8f1d5c9416 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:29.275125 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bed58330-5688-45d9-8db2-ac8f1d5c9416 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1267 microversion: 2.1 time: 0.097334 Jun 25 21:18:29.277818 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3068/5683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:29 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:29.407941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:29.420712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:29.422147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:29.423356 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfabcfaa-1a97-483d-a92b-1cd77a64c2ac tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.373596 Jun 25 21:18:29.423934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2616/5684] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:29 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:29.659599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:29.660260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:29.679126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:29.681314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:29.682445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:29.683043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.038898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:30.039464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.044081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:30.044914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:30.049410 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e09e9e14-6713-4b5a-835a-7e2bda76243f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.394029 Jun 25 21:18:30.050203 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3069/5685] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:29 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:30.065021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.065583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.067435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.067895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.295368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:30.296889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:30.299035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.312040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.312799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.318304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.318831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.326655 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6450133e-4566-4e2c-b0bf-9fe860eb9566 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.288029 Jun 25 21:18:30.329875 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2617/5686] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:30 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:30.446087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:30.447088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:30.464717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:30.468730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.469883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.472370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:30.477445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:30.531373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.540722 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c9227df-3853-4404-a80b-d28d5ec91b17 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1271 microversion: 2.1 time: 0.249680 Jun 25 21:18:30.564398 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3070/5687] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:30 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1271 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:30.904256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.918430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.924656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:30.926609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff85c922-f8a0-468e-9751-c20abcbdfa64 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.487756 Jun 25 21:18:30.927362 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2618/5688] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:30 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:31.067285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:31.068135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:31.095770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.096301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.097242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.097698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.292490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-51050efd-a9f7-4f46-8241-4d1feebb7e8e req-194d42fb-c9c9-47a2-b959-7efa1c0b5149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258dc019-3d6d-448a-819f-d7a79ad114e3", "name": "network-vif-plugged", "status": "completed", "tag": "f3451d7c-fd63-49a2-8b39-7dfb96cfe847"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:31.320512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-51050efd-a9f7-4f46-8241-4d1feebb7e8e req-194d42fb-c9c9-47a2-b959-7efa1c0b5149 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.323142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-51050efd-a9f7-4f46-8241-4d1feebb7e8e req-194d42fb-c9c9-47a2-b959-7efa1c0b5149 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.360189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:31.368475 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-51050efd-a9f7-4f46-8241-4d1feebb7e8e req-194d42fb-c9c9-47a2-b959-7efa1c0b5149 service nova] Creating event network-vif-plugged:f3451d7c-fd63-49a2-8b39-7dfb96cfe847 for instance 258dc019-3d6d-448a-819f-d7a79ad114e3 on nch1-master-1 Jun 25 21:18:31.369546 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e10ab36e-ab95-42ca-8e76-f59b7f98746b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.306982 Jun 25 21:18:31.370437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3071/5689] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:31 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:31.376927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:31.377789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:31.379590 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-51050efd-a9f7-4f46-8241-4d1feebb7e8e req-194d42fb-c9c9-47a2-b959-7efa1c0b5149 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092166 Jun 25 21:18:31.384374 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2619/5690] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:18:31.385412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.386210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.387951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.389354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.578378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:31.580583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:31.597965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.598795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.599922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.604591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.883309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:31.897318 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c21d1b0-733d-4e62-a61d-e4aad5308b47 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1327 microversion: 2.1 time: 0.332722 Jun 25 21:18:31.898634 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2620/5691] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:31 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1327 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:31.946817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:31.948408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:31.958368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.959250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:31.960600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:31.961418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:32.158739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:32.173993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:32.175666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:32.181566 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a297e09d-b7e3-476c-b289-7567a8ba8db5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.239434 Jun 25 21:18:32.184477 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2621/5692] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:31 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:18:32.386606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:32.387328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:32.406891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:32.414711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:32.423559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:32.424074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:32.956730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:32.973759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-24852aa7-97d6-490e-8829-be802ba09030 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.591570 Jun 25 21:18:32.974851 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2622/5693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:32 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:33.004229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:33.012606 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8937d653-c292-4efd-83d2-b84e9c87aaeb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 1.640709 Jun 25 21:18:33.017480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:33.021533 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3072/5694] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:31 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:33.021696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:33.029304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:33.029762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:33.030655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:33.031106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:33.150872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:33.163476 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23778fe4-6032-457b-aac5-f4f1a9c0889a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1325 microversion: 2.1 time: 0.174501 Jun 25 21:18:33.165739 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2623/5695] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:32 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:33.210369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:33.211076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:33.230794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:33.231523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:33.232867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:33.233472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:33.499498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:33.510211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:33.512320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:33.513844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f835fa0a-d0a0-4380-997e-8e838fcb61c9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.308446 Jun 25 21:18:33.515445 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3073/5696] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:33 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:33.991602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:33.992391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:34.009430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.009910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.010714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.011157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.039603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:34.040230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:34.047240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.055785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.057802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.058442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.384712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.398862 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93472c76-2f84-4a8c-9b57-09978727bedd tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1367 microversion: 2.1 time: 0.411388 Jun 25 21:18:34.399530 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2624/5697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:33 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:34.418252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:34.419046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:34.425682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.434798 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3d96acb-6328-448a-90b3-cfe2aa87fde5 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.399163 Jun 25 21:18:34.435744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3074/5698] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:34 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:34.444662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.445120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.448487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.448949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.539191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:34.539842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:34.556545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.557295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.560561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:34.561494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:34.582574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.593286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-254159aa-400a-4065-9010-4728046082ce tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1325 microversion: 2.1 time: 0.180669 Jun 25 21:18:34.594576 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2625/5699] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:34 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:34.784978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.795411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.798121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:34.800268 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de5968b2-1245-4066-85ea-f10afe288c92 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.271176 Jun 25 21:18:34.815458 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3075/5700] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:34 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:35.418054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:35.418789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:35.428590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.429087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.429877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.430417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.460157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:35.465180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:35.466165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:35.474816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:35.477962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.478707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.480801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.481469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.634286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:35.647704 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5695a6a0-b23a-4f47-906e-673a75fbee51 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1556 microversion: 2.1 time: 0.233937 Jun 25 21:18:35.648776 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2626/5701] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:35 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1556 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:35.655813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:35.656456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:35.663942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.664807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.665410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.666340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.713548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:35.722424 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4063fe09-dc65-4dc0-b196-13dc651c67db tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.261644 Jun 25 21:18:35.735653 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3076/5702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:35 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:35.743735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:35.744413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:35.749028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:35.753363 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32db560a-7dea-41fd-a7ed-c7fdb575b8ff tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1325 microversion: 2.1 time: 0.102499 Jun 25 21:18:35.762884 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2627/5703] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:35 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:35.766167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.766810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.767774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.768364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.822914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:35.823406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:35.831006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.832011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.833262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:35.833837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:35.936630 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd9f64c4-d690-405a-92d5-1d0aebc15416 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199283 Jun 25 21:18:35.938155 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3077/5704] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:18:35 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:36.048265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:36.062726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:36.065516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:36.067517 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-288da8af-0ad1-4a55-86ec-53a53fa2c7d5 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.249389 Jun 25 21:18:36.069133 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2628/5705] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:35 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:36.741315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:36.741991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:36.748996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:36.749592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:36.750389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:36.750830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:36.777536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:36.778972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:36.790484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:36.790944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:36.791731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:36.792173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:36.908943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:36.918718 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-567d6668-ba2a-4a9b-83bf-32c14d967368 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1325 microversion: 2.1 time: 0.148770 Jun 25 21:18:36.929740 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2629/5706] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:36 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:37.077335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:37.098017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:37.098719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:37.102595 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-971e4c18-02a8-4610-b816-8c46f59187fb tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.366695 Jun 25 21:18:37.104781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3078/5707] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:36 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:37.110739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:37.111200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:37.111963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:37.112467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:37.398616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:37.416864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:37.418697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:37.420124 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53ef694b-535d-4b0c-a6fd-21ec97a507c0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.326632 Jun 25 21:18:37.420909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2630/5708] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:37 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:37.578629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2d7e9a16-55eb-4704-87a5-97782e8197fe req-4fb97441-d9ea-432b-aab6-ae8194e46c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258dc019-3d6d-448a-819f-d7a79ad114e3", "tag": "f3451d7c-fd63-49a2-8b39-7dfb96cfe847"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:37.597374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2d7e9a16-55eb-4704-87a5-97782e8197fe req-4fb97441-d9ea-432b-aab6-ae8194e46c03 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:37.599604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2d7e9a16-55eb-4704-87a5-97782e8197fe req-4fb97441-d9ea-432b-aab6-ae8194e46c03 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:37.636344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2d7e9a16-55eb-4704-87a5-97782e8197fe req-4fb97441-d9ea-432b-aab6-ae8194e46c03 service nova] Creating event network-changed:f3451d7c-fd63-49a2-8b39-7dfb96cfe847 for instance 258dc019-3d6d-448a-819f-d7a79ad114e3 on nch1-master-1 Jun 25 21:18:37.647483 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2d7e9a16-55eb-4704-87a5-97782e8197fe req-4fb97441-d9ea-432b-aab6-ae8194e46c03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074367 Jun 25 21:18:37.654509 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3079/5709] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:37.938220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:37.939449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:37.951355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:37.953261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:37.954259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:37.955052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:38.122812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:38.123520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:38.134527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:38.135074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:38.135805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:38.136245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:38.362997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:38.377768 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f298211e-b13e-4b5e-afa6-07114731089a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.443729 Jun 25 21:18:38.379467 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2631/5710] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:37 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:38.439435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:38.440089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:38.450530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:38.450994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:38.451794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:38.452243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:38.609789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:38.621284 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06d15374-bc36-4782-8086-41c62b34fb75 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.502361 Jun 25 21:18:38.622012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3080/5711] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:38 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:38.645253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:38.655807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:38.657375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:38.658623 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3bb43835-bc94-4e52-95e2-87ec1880fed1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.223397 Jun 25 21:18:38.659580 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2632/5712] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:38 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:18:39.395783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:39.396524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:39.402657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:39.405648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=18 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:39.407844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.408893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.410672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.412751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.639261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:39.640503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:39.648417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.649177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.650130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.650744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.713872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:39.717471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:39.733271 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36bb8904-9192-439e-9d83-557b8b2d81eb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.342128 Jun 25 21:18:39.740050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3081/5713] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:39 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:39.761964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:39.762670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:39.779213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.779673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.780492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:39.780941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:39.881254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:39.890719 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-56bf5292-de81-4c1e-8e2b-42ff13d53f53 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1510 microversion: 2.1 time: 0.255471 Jun 25 21:18:39.891242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2633/5714] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:39 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:40.407446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-222dedf5-286e-4279-b31b-f27a2709fdfc req-2e42507b-a767-4681-9c63-a85564aa3e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:40.420965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-222dedf5-286e-4279-b31b-f27a2709fdfc req-2e42507b-a767-4681-9c63-a85564aa3e4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:40.422334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-222dedf5-286e-4279-b31b-f27a2709fdfc req-2e42507b-a767-4681-9c63-a85564aa3e4a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:40.437075 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-222dedf5-286e-4279-b31b-f27a2709fdfc req-2e42507b-a767-4681-9c63-a85564aa3e4a service nova] Creating event network-changed:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:18:40.443267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-222dedf5-286e-4279-b31b-f27a2709fdfc req-2e42507b-a767-4681-9c63-a85564aa3e4a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042584 Jun 25 21:18:40.444218 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2634/5715] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:18:40.577953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:40.589992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:40.591767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:40.592959 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-475975ff-6397-4ec5-a7a4-e8acf9e92269 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.851741 Jun 25 21:18:40.593529 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3082/5716] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:39 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:40.756457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:40.758016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:40.765202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:40.765857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:40.766827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:40.767270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:40.908487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:40.909166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:40.909880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:40.917202 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-952879e5-60cd-443c-bf71-c7926a1fdffb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.166254 Jun 25 21:18:40.917719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:40.918407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:40.919484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:40.920025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:40.923268 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2635/5717] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:40 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:41.239039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.248908 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ef5826a-b78c-4255-a8a9-b8aea97f1f70 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1487 microversion: 2.1 time: 0.345369 Jun 25 21:18:41.249577 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3083/5718] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:40 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1487 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:41.269909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1203410167"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:41.271573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.278323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.278783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.279569 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.280040 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.355386 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8e611b2-f3e8-4c95-9bd7-ae2252057649 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "PUT /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1060 microversion: 2.1 time: 0.089710 Jun 25 21:18:41.362620 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2636/5719] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:18:41 2022] PUT /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1060 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:41.370312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:41.371137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.377872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.378376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.379222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.379663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.520433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.533444 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c2d59c1a-c8f6-40b6-8ba0-f7d99c655aa1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1487 microversion: 2.1 time: 0.167225 Jun 25 21:18:41.534348 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3084/5720] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:41 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1487 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:41.549224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:41.549837 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.558840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.559472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.560229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.561730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.613739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:41.615504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.630607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.631765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.634164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.635035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.786225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.795104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.796631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.797809 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2d59334d-759f-49b7-829e-b0e175374d79 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.190412 Jun 25 21:18:41.798365 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3085/5721] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:41 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:18:41.818102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:41.826968 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94fc7245-5c2a-4093-87a4-5722f8415530 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1487 microversion: 2.1 time: 0.281608 Jun 25 21:18:41.827562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2637/5722] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:41 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1487 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:41.844130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:41.844813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.851168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.851644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.852409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.852863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.881668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:18:41.934838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:41.935713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:41.947780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.948219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:41.949053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:41.949529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:42.025921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad6f5e45-ed0b-452e-bd13-190f0bfd7675 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 204 len: 0 microversion: 2.1 time: 0.185787 Jun 25 21:18:42.026844 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3086/5723] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:41 2022] DELETE /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:42.041478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:42.042196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:42.049131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:42.049574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:42.050851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:42.051428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:42.311139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:42.323540 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3771c04-ec53-45e2-88ba-9bf7dd9f46f7 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1493 microversion: 2.1 time: 0.292150 Jun 25 21:18:42.326085 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3087/5724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:42 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1493 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:42.591576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:42.604666 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e74e17e5-7ae0-44c5-bcd5-2b080bef6ca8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.673922 Jun 25 21:18:42.605266 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2638/5725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:41 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:42.827195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:42.828775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:42.837105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:42.837655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:42.838796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:42.839434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:43.023893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:43.041084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:43.043534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:43.045008 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed7b310a-bed9-4e9b-a2ee-7bb8979205db tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.231084 Jun 25 21:18:43.045749 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3088/5726] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:42 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:43.342706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:43.343920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:43.351878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:43.352872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:43.353684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:43.354119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:43.573192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:43.582580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-95a872dc-6f2a-4f26-a354-b9bae32619d1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 200 len: 1493 microversion: 2.1 time: 0.244139 Jun 25 21:18:43.583154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2639/5727] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:43 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 1493 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:43.622439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:43.623034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:43.631360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:43.632606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:43.633541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:43.634428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:43.788700 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:43.796774 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5604a91-27f5-469b-880a-84981b17e261 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.178408 Jun 25 21:18:43.797440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3089/5728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:43 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:44.001073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-71fbf57b-1098-4478-b26f-91404716957c req-a4a18138-233e-4f34-9179-55883813a716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34dbb2fe-c2dc-48f6-876a-e699a020e392", "name": "network-vif-deleted", "tag": "82e96e5e-46a8-4244-bce5-2089d4cb1209"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:44.016713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-71fbf57b-1098-4478-b26f-91404716957c req-a4a18138-233e-4f34-9179-55883813a716 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.020304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-71fbf57b-1098-4478-b26f-91404716957c req-a4a18138-233e-4f34-9179-55883813a716 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.044982 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-71fbf57b-1098-4478-b26f-91404716957c req-a4a18138-233e-4f34-9179-55883813a716 service nova] Creating event network-vif-deleted:82e96e5e-46a8-4244-bce5-2089d4cb1209 for instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 on nch2-master-1 Jun 25 21:18:44.052473 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-71fbf57b-1098-4478-b26f-91404716957c req-a4a18138-233e-4f34-9179-55883813a716 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054630 Jun 25 21:18:44.053757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2640/5729] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:44.064824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.067218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.082583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.083699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.085623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.090313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.284057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:44.293706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:44.295203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:44.296574 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f572a96-92cc-4f2e-9c94-0599e193d280 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.236572 Jun 25 21:18:44.303722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3090/5730] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:44.394715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ffc2189f-f17c-47f6-a87f-3316ae78b8ef req-e64de938-df23-46e9-b030-c7f8e7d076d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "name": "network-vif-plugged", "status": "completed", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:44.404868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ffc2189f-f17c-47f6-a87f-3316ae78b8ef req-e64de938-df23-46e9-b030-c7f8e7d076d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.405723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ffc2189f-f17c-47f6-a87f-3316ae78b8ef req-e64de938-df23-46e9-b030-c7f8e7d076d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.418922 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ffc2189f-f17c-47f6-a87f-3316ae78b8ef req-e64de938-df23-46e9-b030-c7f8e7d076d7 service nova] Creating event network-vif-plugged:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch1-master-1 Jun 25 21:18:44.428615 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ffc2189f-f17c-47f6-a87f-3316ae78b8ef req-e64de938-df23-46e9-b030-c7f8e7d076d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043974 Jun 25 21:18:44.429507 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2641/5731] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:44.601216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.602196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.612459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.613190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.614125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.614718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.630542 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 HTTP/1.1 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '34dbb2fe-c2dc-48f6-876a-e699a020e392'} Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.632257 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.635975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17a34fb9-1968-4907-b6a2-843f7a0901cf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 404 len: 111 microversion: 2.1 time: 0.037810 Jun 25 21:18:44.642059 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3091/5732] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:44.654082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.654747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.663371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.664229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.665251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.665828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.686445 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 HTTP/1.1 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '34dbb2fe-c2dc-48f6-876a-e699a020e392'} Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.689063 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.693177 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.694858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.696076 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-32eef615-a4c2-478f-81d4-f5e85ac81a6d tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 404 len: 111 microversion: 2.1 time: 0.047994 Jun 25 21:18:44.700092 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2642/5733] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:44 2022] DELETE /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:44.705027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.705727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 34dbb2fe-c2dc-48f6-876a-e699a020e392] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.714657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.715196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.716711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.717233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.733456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 HTTP/1.1 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '34dbb2fe-c2dc-48f6-876a-e699a020e392'} Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.735035 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. Jun 25 21:18:44.738488 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.739839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 34dbb2fe-c2dc-48f6-876a-e699a020e392 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.740916 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9df68671-84e9-4fc2-97b3-a704f8ad0c43 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392" status: 404 len: 111 microversion: 2.1 time: 0.039870 Jun 25 21:18:44.741504 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3092/5734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/34dbb2fe-c2dc-48f6-876a-e699a020e392 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:44.749747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.750458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.756987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.757444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.758222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.758654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.777602 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 HTTP/1.1 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'eb7fd527-e7f7-412a-94a8-6d498dd5fdc5'} Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.779279 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1466bcbd-cb4c-4ab0-91f0-2a20e1a87edd tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 404 len: 111 microversion: 2.1 time: 0.035670 Jun 25 21:18:44.782847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2643/5735] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:44 2022] DELETE /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:44.791910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.792570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: eb7fd527-e7f7-412a-94a8-6d498dd5fdc5] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.799429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.799905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.800992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.801596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.815768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.816720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.820605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 HTTP/1.1 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'eb7fd527-e7f7-412a-94a8-6d498dd5fdc5'} Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.822361 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. Jun 25 21:18:44.826153 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.826503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.826503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.826503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.826503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.830897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.832259 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62d3e924-06d1-4dde-bbe2-246b15e1ecb1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5" status: 404 len: 111 microversion: 2.1 time: 0.045429 Jun 25 21:18:44.833196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3093/5736] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/eb7fd527-e7f7-412a-94a8-6d498dd5fdc5 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:44.844031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.845258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.853664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.854376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.855692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.856331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.872687 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 HTTP/1.1 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '2fe3ffc5-48f4-4953-9039-43bdcddd5537'} Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.874540 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f44e0994-7cd6-4716-9945-b327adedbc38 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 404 len: 111 microversion: 2.1 time: 0.039750 Jun 25 21:18:44.881721 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3094/5737] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:44 2022] DELETE /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:44.885819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.886440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 2fe3ffc5-48f4-4953-9039-43bdcddd5537] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.894066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.894575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.895359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.896043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.913842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 HTTP/1.1 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '2fe3ffc5-48f4-4953-9039-43bdcddd5537'} Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.915429 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 2fe3ffc5-48f4-4953-9039-43bdcddd5537 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-45f8059a-d385-484b-992a-63bd726f2052 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537" status: 404 len: 111 microversion: 2.1 time: 0.035487 Jun 25 21:18:44.921781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3095/5738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/2fe3ffc5-48f4-4953-9039-43bdcddd5537 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:44.927556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.927826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.935479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.935755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.936648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.937373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.956791 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac HTTP/1.1 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '655a5cc4-ba12-447f-98ed-95c421f3e4ac'} Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.958468 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:44.962462 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-487d8265-23d7-44d1-b097-e15f72af27ea tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 404 len: 111 microversion: 2.1 time: 0.038784 Jun 25 21:18:44.963229 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3096/5739] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:44 2022] DELETE /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:44.972521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:44.973346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 655a5cc4-ba12-447f-98ed-95c421f3e4ac] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:44.979713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.980298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.981293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:44.981811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:44.997978 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac HTTP/1.1 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '655a5cc4-ba12-447f-98ed-95c421f3e4ac'} Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:44.999559 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 655a5cc4-ba12-447f-98ed-95c421f3e4ac could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.003660 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c035bd6-fe11-439f-87bb-22198e3e470a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac" status: 404 len: 111 microversion: 2.1 time: 0.036290 Jun 25 21:18:45.004509 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3097/5740] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/655a5cc4-ba12-447f-98ed-95c421f3e4ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:45.013415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.013919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.028987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.030080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.031138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.032231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.034957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:45.046795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f075d29-78c3-4331-8123-ceeb85ea54e7 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.235717 Jun 25 21:18:45.048806 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf HTTP/1.1 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '65436a4d-647b-4ac2-a352-e713d95839cf'} Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.051255 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b120584-a9c3-4f6a-a0df-4b62e850bc5b tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 404 len: 111 microversion: 2.1 time: 0.043598 Jun 25 21:18:45.060776 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3098/5741] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:45 2022] DELETE /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:45.062662 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2644/5742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:44 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:45.065064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.065680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 65436a4d-647b-4ac2-a352-e713d95839cf] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.072803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.073249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.074010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.074442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.088474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf HTTP/1.1 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '65436a4d-647b-4ac2-a352-e713d95839cf'} Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.090054 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 65436a4d-647b-4ac2-a352-e713d95839cf could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-adb7af90-2e1a-4e9a-b53d-03424921654a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf" status: 404 len: 111 microversion: 2.1 time: 0.030850 Jun 25 21:18:45.094176 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3099/5743] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:45 2022] GET /compute/v2.1/servers/65436a4d-647b-4ac2-a352-e713d95839cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:45.100158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.100693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.106874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.107353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.108076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.109714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.124627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 HTTP/1.1 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'b0e05923-b259-475c-a6ab-2b47b72ebfb8'} Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.126902 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.130918 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20662315-12e4-4629-81db-329a3dc18f61 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 404 len: 111 microversion: 2.1 time: 0.032237 Jun 25 21:18:45.132367 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2645/5744] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:45 2022] DELETE /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:45.137267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.138014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: b0e05923-b259-475c-a6ab-2b47b72ebfb8] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.144852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.145381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.146083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.146555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.161898 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 HTTP/1.1 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b0e05923-b259-475c-a6ab-2b47b72ebfb8'} Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.163501 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance b0e05923-b259-475c-a6ab-2b47b72ebfb8 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a476a6c-c3ce-4bcd-96f1-9edaaf720ab1 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8" status: 404 len: 111 microversion: 2.1 time: 0.031800 Jun 25 21:18:45.167628 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3100/5745] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:45 2022] GET /compute/v2.1/servers/b0e05923-b259-475c-a6ab-2b47b72ebfb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:45.176364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.177566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.186967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.187426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.188203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.188828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.194088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:45.207615 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 HTTP/1.1 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'ca40e812-49b8-4fe6-b362-6a1182fc3731'} Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.209531 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.212960 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.214906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.215993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c977bde-15e6-4e6a-baee-31e3ef78bf05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 404 len: 111 microversion: 2.1 time: 0.045998 Jun 25 21:18:45.216613 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2646/5746] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:45 2022] DELETE /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:45.225240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.225873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: ca40e812-49b8-4fe6-b362-6a1182fc3731] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.233935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.234387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.235392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.235909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.252391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 HTTP/1.1 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'ca40e812-49b8-4fe6-b362-6a1182fc3731'} Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.254346 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. Jun 25 21:18:45.257748 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:45.258074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance ca40e812-49b8-4fe6-b362-6a1182fc3731 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:45.259443 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-daff1a19-36f6-4613-ad72-76d371bb3c05 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731" status: 404 len: 111 microversion: 2.1 time: 0.037903 Jun 25 21:18:45.259443 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3101/5747] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:45 2022] GET /compute/v2.1/servers/ca40e812-49b8-4fe6-b362-6a1182fc3731 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:18:45.268307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.269450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.275494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.275971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.276953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.277394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.307077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:18:45.316226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.317245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.324680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.325358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.326349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.327234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.436181 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b2e905e-3f86-4de2-8ead-cce84ff6047a tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 204 len: 0 microversion: 2.1 time: 0.172172 Jun 25 21:18:45.436887 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2647/5748] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:18:45 2022] DELETE /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:18:45.446209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:45.446947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:45.453376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.453828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.454598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:45.455021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:45.488782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:45.498570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:45.500353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:45.501794 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1f36f56-718e-4aae-9ba1-11a0aac06c0b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.190729 Jun 25 21:18:45.502801 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3102/5749] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:45 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:18:45.597492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:45.605662 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c926e115-0fa1-4fd4-9a57-f18528469edf tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1479 microversion: 2.1 time: 0.164509 Jun 25 21:18:45.606383 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2648/5750] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:45 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1479 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:46.064466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:46.065330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:46.075015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.075676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.076678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.077270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.226460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:46.236987 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-05367731-a07c-4dc9-905b-87ee423a6ca2 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.176452 Jun 25 21:18:46.237691 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3103/5751] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:46 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:46.456703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-55a8b5a9-f4ae-4629-9001-92104994226e req-1ca91d70-ce14-4502-aec2-7307ec7ed9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "name": "network-vif-plugged", "status": "completed", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:46.466207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-55a8b5a9-f4ae-4629-9001-92104994226e req-1ca91d70-ce14-4502-aec2-7307ec7ed9a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.466653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-55a8b5a9-f4ae-4629-9001-92104994226e req-1ca91d70-ce14-4502-aec2-7307ec7ed9a8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.480577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-55a8b5a9-f4ae-4629-9001-92104994226e req-1ca91d70-ce14-4502-aec2-7307ec7ed9a8 service nova] Creating event network-vif-plugged:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:18:46.493087 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-55a8b5a9-f4ae-4629-9001-92104994226e req-1ca91d70-ce14-4502-aec2-7307ec7ed9a8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 Jun 25 21:18:46.493709 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2649/5752] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:46.521245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:46.521984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:46.528526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.529083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.530068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.530851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.535528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:18:46.624091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:46.624864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:46.631898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.632357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.633348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:46.633787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:46.679286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:46.698583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:46.702002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:46.703502 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-95e74117-f31b-4b4d-9dff-a9c73e254f0c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.187508 Jun 25 21:18:46.704883 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3104/5753] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:46 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:46.918323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:46.928163 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a298658f-daf5-4f5a-823b-18a7180a78f4 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1479 microversion: 2.1 time: 0.308345 Jun 25 21:18:46.929045 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2650/5754] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:46 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1479 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:47.255032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:47.256230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:47.263556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.264217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.265209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.265803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.464357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:47.477216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f72ae775-52b7-4ba0-af4a-3ab9a9521d4f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1392 microversion: 2.1 time: 0.226916 Jun 25 21:18:47.478151 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3105/5755] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:47 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1392 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:47.722620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:47.724095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:47.733891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.734627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.735691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.736276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.763321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5ed0add8-dc23-42f9-bc02-975181c8fa3c req-36366c29-60e1-4771-81cb-1e262f412f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ec2c2b-3958-48a4-b84e-d4c56c30e03e", "name": "network-vif-deleted", "tag": "4bfeec90-381f-4bb3-a1b9-2f5b2225edd3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:47.774399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5ed0add8-dc23-42f9-bc02-975181c8fa3c req-36366c29-60e1-4771-81cb-1e262f412f2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.775803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5ed0add8-dc23-42f9-bc02-975181c8fa3c req-36366c29-60e1-4771-81cb-1e262f412f2e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.805783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5ed0add8-dc23-42f9-bc02-975181c8fa3c req-36366c29-60e1-4771-81cb-1e262f412f2e service nova] Creating event network-vif-deleted:4bfeec90-381f-4bb3-a1b9-2f5b2225edd3 for instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e on nch1-master-1 Jun 25 21:18:47.830834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5ed0add8-dc23-42f9-bc02-975181c8fa3c req-36366c29-60e1-4771-81cb-1e262f412f2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066680 Jun 25 21:18:47.833230 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3106/5756] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:18:47.944902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:47.947168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:47.947900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:47.957074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.957722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.958774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:47.959401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:47.959769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:47.962340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:47.964973 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f4f5dc1-7edb-4539-b45e-18f626876852 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1808 microversion: 2.20 time: 0.245286 Jun 25 21:18:47.968604 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2651/5757] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:47 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:48.018899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.019615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.020239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lazy-loading 'fault' on Instance uuid 07ec2c2b-3958-48a4-b84e-d4c56c30e03e {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:18:48.078672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99a45af5dbf8442d9801f494b794e880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df9f09e5c7c4f21aca1705769d3c84c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:48.092120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-953c9a0d-d4bc-4203-b7f8-38b31928ffa3 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 200 len: 1283 microversion: 2.1 time: 0.149750 Jun 25 21:18:48.093859 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3107/5758] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:47 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 1283 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:18:48.501674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:48.502313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:48.512276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.512763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.513562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.514013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.710116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:48.718982 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22fd98b2-55ab-459c-9693-7a672f91d978 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1565 microversion: 2.1 time: 0.226748 Jun 25 21:18:48.719565 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2652/5759] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:48 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1565 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:48.735401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:48.736278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:48.743541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.744004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.744804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.745249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.903259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:48.911065 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-546a0f0f-cecb-4c35-ade3-35077d93b2cf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1565 microversion: 2.1 time: 0.179908 Jun 25 21:18:48.911781 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3108/5760] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:48 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1565 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:48.984134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:48.984803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:48.993575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.994203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:48.995362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:48.996845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:49.112311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:49.113225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] [instance: 07ec2c2b-3958-48a4-b84e-d4c56c30e03e] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:49.125516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:49.126059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:49.126889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:49.127382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:49.138360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:49.148647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:49.150810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:49.151422 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] HTTP exception thrown: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. Jun 25 21:18:49.152628 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7da62dc8-d7c4-42e2-ac46-217d29ff280a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1795 microversion: 2.20 time: 0.173290 Jun 25 21:18:49.153712 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2653/5761] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:18:48 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1795 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Request method failure captured: Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e HTTP/1.1 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3rwfsSEB01_BQtk3nc8-cAVXSpim3_56K-iWsYcbAjg8BSKkkKhamPmqTDwy5M1w_JVEVl6MEsMY7nR65uGNcz83qWKeTlVMS4eIO40Xqh4RYa7lbXNnuxD8iODiF_WjF9Fxcs_4L5SuWpFXIOvi1S-bsJyGIeh0BjfHcp65dF38TA Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1df9f09e5c7c4f21aca1705769d3c84c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1df9f09e5c7c4f21aca1705769d3c84c"}]}] Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersTestJSON-387988234 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 1df9f09e5c7c4f21aca1705769d3c84c Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersTestJSON-387988234 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersTestJSON-387988234-project Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 99a45af5dbf8442d9801f494b794e880 Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersTestJSON-387988234-project Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '07ec2c2b-3958-48a4-b84e-d4c56c30e03e'} Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:49.162249 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. Jun 25 21:18:49.167364 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:18:49.169674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] Returning 404 to user: Instance 07ec2c2b-3958-48a4-b84e-d4c56c30e03e could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:18:49.170804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8968766c-43f6-42fb-ab6e-a4730d8bc716 tempest-ServersTestJSON-387988234 tempest-ServersTestJSON-387988234-project] 10.222.0.39 "GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e" status: 404 len: 111 microversion: 2.1 time: 0.064707 Jun 25 21:18:49.171739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3109/5762] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:49 2022] GET /compute/v2.1/servers/07ec2c2b-3958-48a4-b84e-d4c56c30e03e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:18:51.502182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:51.502803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:18:51.511164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:51.511967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:51.513119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:51.513703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:51.530414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4de66cd0-f4d8-4528-beba-779c58040c47 req-e526a365-0d90-4574-af2c-c42508038ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:18:51.548205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4de66cd0-f4d8-4528-beba-779c58040c47 req-e526a365-0d90-4574-af2c-c42508038ced service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:18:51.548918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4de66cd0-f4d8-4528-beba-779c58040c47 req-e526a365-0d90-4574-af2c-c42508038ced service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:18:51.576670 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4de66cd0-f4d8-4528-beba-779c58040c47 req-e526a365-0d90-4574-af2c-c42508038ced service nova] Creating event network-changed:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:18:51.587711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4de66cd0-f4d8-4528-beba-779c58040c47 req-e526a365-0d90-4574-af2c-c42508038ced service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061131 Jun 25 21:18:51.589977 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3110/5763] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:52.016164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:18:52.027970 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5db97058-3697-425c-aa38-873d5888c2a4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1565 microversion: 2.1 time: 0.530463 Jun 25 21:18:52.041852 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2654/5764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:18:51 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1565 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:56.462747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c231088c-491e-4576-a0ef-577b2b9bd65d tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f9861ec3dc0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:56.513767 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c231088c-491e-4576-a0ef-577b2b9bd65d tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3b8fadb5-427f-48f5-bb04-af450db01a04" status: 200 len: 344 microversion: 2.1 time: 0.055085 Jun 25 21:18:56.514449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3111/5765] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:18:56 2022] GET /compute/v2.1/os-volumes/3b8fadb5-427f-48f5-bb04-af450db01a04 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:57.899586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ee87e9d-a055-4c76-ad20-fcb1a6bcfc4c tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984fd33310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:57.954714 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ee87e9d-a055-4c76-ad20-fcb1a6bcfc4c tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/a89176e1-ef45-4930-aa7a-196aa62bcf51" status: 200 len: 344 microversion: 2.1 time: 0.059000 Jun 25 21:18:57.955784 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2655/5766] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:18:57 2022] GET /compute/v2.1/os-volumes/a89176e1-ef45-4930-aa7a-196aa62bcf51 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:59.321631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18e758f0-591e-41f8-b514-d54125909fe0 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984ef771f0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.375570 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18e758f0-591e-41f8-b514-d54125909fe0 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3c7182f2-6037-4351-86ae-b60e1b1e25f2" status: 200 len: 343 microversion: 2.1 time: 0.058914 Jun 25 21:18:59.376171 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3112/5767] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes/3c7182f2-6037-4351-86ae-b60e1b1e25f2 => generated 343 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:59.390409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5142c505-63fe-4c72-ae23-e9d1047e02bf tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984fe5e790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.483216 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5142c505-63fe-4c72-ae23-e9d1047e02bf tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.098316 Jun 25 21:18:59.496231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a74743b9-fe40-467f-b54e-82d42c7715dc tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984ef77b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.498874 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2656/5768] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:59.590637 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a74743b9-fe40-467f-b54e-82d42c7715dc tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.098725 Jun 25 21:18:59.591235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3113/5769] 10.222.0.39 () {58 vars in 1148 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:59.603308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e161a41-ec0e-494d-b7e8-575b593ae9ca tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984fd49b80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.686137 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e161a41-ec0e-494d-b7e8-575b593ae9ca tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.086762 Jun 25 21:18:59.686817 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2657/5770] 10.222.0.39 () {58 vars in 1133 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:18:59.700142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21d0321d-7ace-4c4c-b2ad-70521897b0f0 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984ef36a60>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.794573 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21d0321d-7ace-4c4c-b2ad-70521897b0f0 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.100463 Jun 25 21:18:59.795284 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3114/5771] 10.222.0.39 () {58 vars in 1166 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:59.807258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d10dfbf9-08e1-41c3-95f2-0fed2f51b98f tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984fd33670>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.891054 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d10dfbf9-08e1-41c3-95f2-0fed2f51b98f tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.088055 Jun 25 21:18:59.891654 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2658/5772] 10.222.0.39 () {58 vars in 1169 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:18:59.905100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f288036a-de4c-4c7d-982a-4afdddf0a50a tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984ee08d30>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:18:59.989324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f288036a-de4c-4c7d-982a-4afdddf0a50a tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.088070 Jun 25 21:18:59.989923 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3115/5773] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:00.001170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b18b17d-1142-4eed-9c90-e4e0fb49f114 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984fd97550>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:00.080258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b18b17d-1142-4eed-9c90-e4e0fb49f114 tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.082972 Jun 25 21:19:00.087513 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2659/5774] 10.222.0.39 () {58 vars in 1187 bytes} [Sat Jun 25 21:18:59 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:00.092997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-037919af-837f-421d-a55f-486b03f8eebc tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] Calling method '.version_select at 0x7f984ef773a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:00.179262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-037919af-837f-421d-a55f-486b03f8eebc tempest-VolumesTestJSON-1491296260 tempest-VolumesTestJSON-1491296260-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.090309 Jun 25 21:19:00.180267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3116/5775] 10.222.0.39 () {58 vars in 1154 bytes} [Sat Jun 25 21:19:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:12.361734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:12.363121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:12.367282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.368581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:12.375984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:12.376621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:12.377603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:12.378109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:12.417428 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23e4ded9-2a39-4c98-a44b-dcc38f7fce07 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/ips" status: 200 len: 149 microversion: 2.1 time: 0.059777 Jun 25 21:19:12.418450 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2660/5776] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:19:12 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:13.909236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:13.910278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=31 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:13.916069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6c6bbb3-c0fb-4f1e-92ee-a93662d20633"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:13.917374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:13.925862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:13.926687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:13.927914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:13.928608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:14.215685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69ee599d-5bd1-481b-9693-fdb2e4eb15c3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308169 Jun 25 21:19:14.216450 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3117/5777] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:19:13 2022] POST /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:16.422683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:16.424049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:16.437636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:16.438379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:16.439326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:16.441489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:16.899421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-143addc1-011d-45d0-b5c9-33f85d095f4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action" status: 200 len: 24568 microversion: 2.1 time: 0.479435 Jun 25 21:19:16.902275 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2661/5778] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:19:16 2022] POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action => generated 24568 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:17.663204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6c6bbb3-c0fb-4f1e-92ee-a93662d20633"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:17.665430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:17.681996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:17.683374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:17.688769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:17.690047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:17.863888 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments HTTP/1.1 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 74 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: {"volumeAttachment": {"volumeId": "c6c6bbb3-c0fb-4f1e-92ee-a93662d20633"}} Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: exception: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '258dc019-3d6d-448a-819f-d7a79ad114e3', 'body': {'volumeAttachment': {'volumeId': 'c6c6bbb3-c0fb-4f1e-92ee-a93662d20633'}}} Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:19:17.869766 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 Jun 25 21:19:17.873617 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:17.876967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 400 to user: Invalid volume: volume c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 is already attached to instances: 258dc019-3d6d-448a-819f-d7a79ad114e3 {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:19:17.878711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-464db577-7d72-4cf1-8de5-25c1c3490e2a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.225913 Jun 25 21:19:17.885437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3118/5779] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:19:17 2022] POST /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments => generated 174 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:19:17.959720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:17.961623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:17.978704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:17.979164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:17.980214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:17.983644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:18.206958 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lazy-loading 'services' on Instance uuid 258dc019-3d6d-448a-819f-d7a79ad114e3 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:19:18.352067 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5d0b9a3-5631-4245-9f9d-61b0aee03ca1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments/c6c6bbb3-c0fb-4f1e-92ee-a93662d20633" status: 202 len: 0 microversion: 2.1 time: 0.397120 Jun 25 21:19:18.357868 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2662/5780] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:19:17 2022] DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments/c6c6bbb3-c0fb-4f1e-92ee-a93662d20633 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:19:18.361975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:18.363299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:18.378273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:18.379452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:18.381549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:18.382661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:18.432796 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29efbd3d-9ac2-4635-9cba-9f2d9c9cb6e4 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075338 Jun 25 21:19:18.437840 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3119/5781] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:19:18 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:19.446759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:19.448639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:19.480503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.482550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:19.483392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.483834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:19.545216 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0600edca-d6cd-4abd-8c80-4d893a59a9d1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103046 Jun 25 21:19:19.546376 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2663/5782] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:19:19 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3/os-volume_attachments => generated 25 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:19:19.657060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:19.657595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:19.673142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.673879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:19.674880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.675464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:19.720311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:19:19.895342 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9e39a23-2eb9-4170-8035-a8c0b91d3583 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 204 len: 0 microversion: 2.1 time: 0.244174 Jun 25 21:19:19.896589 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3120/5783] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:19:19 2022] DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:19:19.911186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:19.911186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:19.926079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.926773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:19.927719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:19.928307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:20.129504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:20.149405 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0ccd1466-69a9-4cf9-a02d-e3cf7adf02d9 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1681 microversion: 2.1 time: 0.248446 Jun 25 21:19:20.153170 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2664/5784] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:19 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:21.179453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:21.180171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:21.193802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:21.194487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:21.195534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:21.196190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:21.404861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:21.413219 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c4ad622b-2be6-4c7f-962a-d4b01768ae28 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1681 microversion: 2.1 time: 0.247242 Jun 25 21:19:21.423952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3121/5785] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:21 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:22.173745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:22.174456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:22.188615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.189630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.189978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.196055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.243346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7d10627-8054-48e3-b3d0-da47584a998b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments/d0d28785-d076-4b06-b8c8-1d55430a8bed" status: 200 len: 194 microversion: 2.20 time: 0.076066 Jun 25 21:19:22.245297 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2665/5786] 10.222.0.39 () {60 vars in 1453 bytes} [Sat Jun 25 21:19:22 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments/d0d28785-d076-4b06-b8c8-1d55430a8bed => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:22.334589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:22.335617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:22.344361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.345037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.346075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.346659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.432036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:22.432725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:22.445858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.447488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.448530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.452354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.461380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lazy-loading 'services' on Instance uuid e0092220-c4b5-40be-a315-fabad4d12562 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:19:22.575957 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec024b3d-561a-4f42-9422-b4093b226a3e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments/d0d28785-d076-4b06-b8c8-1d55430a8bed" status: 202 len: 0 microversion: 2.20 time: 0.245542 Jun 25 21:19:22.580366 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3122/5787] 10.222.0.39 () {60 vars in 1456 bytes} [Sat Jun 25 21:19:22 2022] DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments/d0d28785-d076-4b06-b8c8-1d55430a8bed => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:19:22.593809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:22.596163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:22.611303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.612096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.613728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.614369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.644885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:22.660522 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d5bcd095-8cee-4bd3-b5a0-079ee499ae7d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 200 len: 1613 microversion: 2.1 time: 0.231280 Jun 25 21:19:22.663727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2666/5788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:22 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 1613 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:22.699933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ed880adc-0cb7-484e-a64f-e19dfdfa16c4 req-74e69e38-7c92-4797-b580-2be30158fa7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258dc019-3d6d-448a-819f-d7a79ad114e3", "name": "network-vif-deleted", "tag": "f3451d7c-fd63-49a2-8b39-7dfb96cfe847"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:22.713176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7557fa5f-5b56-4266-8beb-1d9025172ce3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130705 Jun 25 21:19:22.713664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed880adc-0cb7-484e-a64f-e19dfdfa16c4 req-74e69e38-7c92-4797-b580-2be30158fa7e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:22.715810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ed880adc-0cb7-484e-a64f-e19dfdfa16c4 req-74e69e38-7c92-4797-b580-2be30158fa7e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:22.717881 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3123/5789] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 21:19:22 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:22.740155 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ed880adc-0cb7-484e-a64f-e19dfdfa16c4 req-74e69e38-7c92-4797-b580-2be30158fa7e service nova] Creating event network-vif-deleted:f3451d7c-fd63-49a2-8b39-7dfb96cfe847 for instance 258dc019-3d6d-448a-819f-d7a79ad114e3 on nch1-master-1 Jun 25 21:19:22.747855 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ed880adc-0cb7-484e-a64f-e19dfdfa16c4 req-74e69e38-7c92-4797-b580-2be30158fa7e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059705 Jun 25 21:19:22.750657 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2667/5790] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:23.680891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:23.681515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:23.694849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.695726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:23.696799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.697423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:23.713262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 HTTP/1.1 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '258dc019-3d6d-448a-819f-d7a79ad114e3'} Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:23.715447 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:19:23.719328 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:23.721082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:19:23.722188 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ccd8e7b-c8f2-462d-b4eb-d468df936c8d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 404 len: 111 microversion: 2.1 time: 0.045486 Jun 25 21:19:23.723383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3124/5791] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:23 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:19:23.730595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:23.731626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:23.739498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e1a6a7c6-3832-401d-b12a-fb2af504462d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '.version_select at 0x7f984ef8b700>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:23.746417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.746930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:23.748729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.750472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:23.785464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e1a6a7c6-3832-401d-b12a-fb2af504462d tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558399540" status: 202 len: 0 microversion: 2.1 time: 0.049656 Jun 25 21:19:23.786275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3125/5792] 10.222.0.39 () {58 vars in 1217 bytes} [Sat Jun 25 21:19:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558399540 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:19:23.823411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-47d2cbe4-fcde-4f27-9142-dbf91630f702 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.097063 Jun 25 21:19:23.831606 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2668/5793] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 21:19:23 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:23.935507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:23.936164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:23.958508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.960470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:23.962500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:23.966350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:24.037013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:19:24.252621 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a8995c4-7b1a-4e02-a9e4-b688ed550f2d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 204 len: 0 microversion: 2.20 time: 0.309332 Jun 25 21:19:24.257668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3126/5794] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:19:23 2022] DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:19:24.262118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:24.262735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:24.273536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:24.275225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:24.278178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:24.282974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:24.784225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:24.795407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:24.797276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:24.798517 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4f48e58b-c189-4dcb-80f5-67ed04686cc6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.540472 Jun 25 21:19:24.799097 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2669/5795] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:24 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:24.915657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39b1e17e-7d55-48de-9fcf-a14e1217f02e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: .version_select at 0x7f9861eaed30>, body: {"keypair": {"name": "tempest-keypair-1545305760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAV7KlFjXgtkFkz13mVkZA7PWVWfmwCHgGYxs/bV+X+c3tCzjS8Gh1AUEVlrP12fRgO8pzZaQ0IhR6lEeOqLo+7jPg3Mv65ORgHe2Le0tas6ZV6IRzbfmhKW1nKBCjRoQ=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:24.936021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-39b1e17e-7d55-48de-9fcf-a14e1217f02e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:19:24.942717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-39b1e17e-7d55-48de-9fcf-a14e1217f02e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:19:24.981132 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39b1e17e-7d55-48de-9fcf-a14e1217f02e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069754 Jun 25 21:19:24.983401 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3127/5796] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:19:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:25.825727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:25.827187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:25.837436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:25.837890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:25.839719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:25.840765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:26.552216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:26.568079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:26.570212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:26.571784 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-36fed3fc-ee5c-4c73-b6ca-a57fdf2cf5b7 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1723 microversion: 2.20 time: 0.757688 Jun 25 21:19:26.577095 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2670/5797] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:25 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1723 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:27.127521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-118737852", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15adaf3c-53a3-47ee-a619-76a812ef788d"}], "security_groups": [{"name": "tempest-securitygroup--1588935344"}], "key_name": "tempest-keypair-1545305760", "user_data": "}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:27.275069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] validate_networks() for [('15adaf3c-53a3-47ee-a619-76a812ef788d', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:19:27.597257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:27.597834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:27.607135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:27.607903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:27.608867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:27.609458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:27.990698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:19:27.991322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:19:27.991853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:19:27.992417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:19:27.992867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:19:28.002996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:28.014923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:28.016584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.017061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.017876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.018437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.021122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:28.022418 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b8be84ea-bded-4e9d-9487-31f5a561aba9 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 200 len: 1656 microversion: 2.20 time: 0.431025 Jun 25 21:19:28.023466 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2671/5798] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:27 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 1656 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:28.036961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:28.042004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:28.056289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.060117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.061146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.063261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.068756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:19:28.081137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Getting quotas for user 3648405427d14f91a4bb44bd81f2195b and project d32f25e6afd2425db488a9387869da19. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:19:28.105841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:19:28.109241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:19:28.212555 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-334ed577-ed1d-4998-bb0e-8c208c03b090 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.090806 Jun 25 21:19:28.215177 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3128/5799] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:19:28.226685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fbfc52e3-4004-4a83-97d4-a9e22f243368 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:28.227667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fbfc52e3-4004-4a83-97d4-a9e22f243368 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:28.327449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fbfc52e3-4004-4a83-97d4-a9e22f243368 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:28.357382 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fbfc52e3-4004-4a83-97d4-a9e22f243368 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1241 microversion: 2.1 time: 0.134783 Jun 25 21:19:28.358244 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3129/5800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:28 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1241 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:28.372592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0010edd2-0ab3-4deb-a2ee-2b7aeacb22dc req-bf27dd3c-b296-4760-a614-fd6e40d5b1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0092220-c4b5-40be-a315-fabad4d12562", "name": "network-vif-deleted", "tag": "ee152cf2-99ea-4301-bcd4-f61a2ca11b02"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:28.405259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0010edd2-0ab3-4deb-a2ee-2b7aeacb22dc req-bf27dd3c-b296-4760-a614-fd6e40d5b1f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.406009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0010edd2-0ab3-4deb-a2ee-2b7aeacb22dc req-bf27dd3c-b296-4760-a614-fd6e40d5b1f2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.438564 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0010edd2-0ab3-4deb-a2ee-2b7aeacb22dc req-bf27dd3c-b296-4760-a614-fd6e40d5b1f2 service nova] Creating event network-vif-deleted:ee152cf2-99ea-4301-bcd4-f61a2ca11b02 for instance e0092220-c4b5-40be-a315-fabad4d12562 on nch1-master-1 Jun 25 21:19:28.452237 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0010edd2-0ab3-4deb-a2ee-2b7aeacb22dc req-bf27dd3c-b296-4760-a614-fd6e40d5b1f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092853 Jun 25 21:19:28.456154 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3130/5801] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:28.553996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:28.567841 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8789674-03ca-4b5d-b0ca-30e8c095af42 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1683 microversion: 2.1 time: 0.543154 Jun 25 21:19:28.571589 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2672/5802] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:28 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1683 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:28.687915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:28.689409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:28.697527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.697975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.698869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.699296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.765511 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db08d64b-dc97-494e-a165-d8e3012d9331 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action" status: 200 len: 32633 microversion: 2.1 time: 0.082412 Jun 25 21:19:28.768254 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3131/5803] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:19:28 2022] POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action => generated 32633 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:28.958461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:28.959304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:28.974790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.976479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:28.979251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:28.980075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.049054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:29.049789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:29.064803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.065740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.067308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.068188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.096716 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 HTTP/1.1 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e0092220-c4b5-40be-a315-fabad4d12562'} Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:29.099465 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:19:29.103106 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:29.106494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:19:29.108515 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d508ff08-a92c-49d3-b10f-1a59a7f1d377 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 404 len: 111 microversion: 2.20 time: 0.065099 Jun 25 21:19:29.109483 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3132/5804] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:29 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:19:29.133874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3891ecf4-9526-45ba-bde6-aa960d9caaca tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '.version_select at 0x7f984ef774c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:29.183288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3891ecf4-9526-45ba-bde6-aa960d9caaca tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869360770" status: 204 len: 0 microversion: 2.20 time: 0.069210 Jun 25 21:19:29.184325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3133/5805] 10.222.0.39 () {60 vars in 1261 bytes} [Sat Jun 25 21:19:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1869360770 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:19:29.334576 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85845552-31b0-4fcf-8ecd-59bc539c0e19 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1834 microversion: 2.1 time: 0.380334 Jun 25 21:19:29.336034 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2673/5806] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:28 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1834 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:29.363388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:29.366533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:29.373443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.374063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.375020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.376063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.380729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:29.383745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:29.399371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.401338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.404916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:29.406056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:29.425890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lazy-loading 'flavor' on Instance uuid 07bef245-ea2a-4401-9ce3-048636b36a28 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:19:29.453743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Going to try to live migrate instance to another host {{(pid=137461) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jun 25 21:19:29.480015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:29.627694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:29.642973 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02abe24e-b80f-4182-b68e-0b9872f6f751 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1293 microversion: 2.1 time: 0.268802 Jun 25 21:19:29.643674 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2674/5807] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:29 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1293 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:30.606395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82a86a8e-4d3f-49f7-b89b-b92a9fab4d12 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: .version_select at 0x7f984fd339d0>, body: {"keypair": {"name": "tempest-keypair-811875274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqFmFxvd5tBeTS30MvsBETfoK/nH3mPvMLmbhXPVTGyYt1NdllUC/2XzGCZBAvUTyS7VrvsbyBcPXtuebhGcR0JZYK+SpGBdWu857Jzbmiw2O1l66rhrOTtKnbQQqJNNA=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:30.636727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-82a86a8e-4d3f-49f7-b89b-b92a9fab4d12 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:19:30.649212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-82a86a8e-4d3f-49f7-b89b-b92a9fab4d12 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for user c845f86f1b6244f7a53996329294f2cd and project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:19:30.701028 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82a86a8e-4d3f-49f7-b89b-b92a9fab4d12 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.104851 Jun 25 21:19:30.702331 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2675/5808] 10.222.0.39 () {62 vars in 1199 bytes} [Sat Jun 25 21:19:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 21:19:30.709161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:30.710032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:30.719009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:30.719831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:30.721005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:30.721594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:30.885325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:30.897594 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b67b38a-e61e-4a92-bc69-05868f430bb0 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1299 microversion: 2.1 time: 0.192898 Jun 25 21:19:30.898931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2676/5809] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:30 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:31.922673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:31.923338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:31.932132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:31.932646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:31.933432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:31.933874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:32.267732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:32.292035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c553abb5-c3fb-4dac-b1ee-6018235f0689 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.380403 Jun 25 21:19:32.305342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2677/5810] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:31 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:32.398827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a3ce2a31-536d-48bd-b09e-88ba62c4bdd2 req-90a99031-041c-489d-bbc2-3b309876ecf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be347555-cec7-48c7-b4f7-8aabd1e61d84", "tag": "30227e07-6518-4a9d-b4db-803c750469e6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:32.457829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a3ce2a31-536d-48bd-b09e-88ba62c4bdd2 req-90a99031-041c-489d-bbc2-3b309876ecf5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:32.461225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a3ce2a31-536d-48bd-b09e-88ba62c4bdd2 req-90a99031-041c-489d-bbc2-3b309876ecf5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:32.466149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:32.476852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-60d164cd-d321-47f7-9b4a-fe3bfdd93860 tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action" status: 202 len: 0 microversion: 2.1 time: 3.118233 Jun 25 21:19:32.478706 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3134/5811] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:19:29 2022] POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action => generated 0 bytes in 3121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:19:32.487475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:32.490951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:32.506142 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a3ce2a31-536d-48bd-b09e-88ba62c4bdd2 req-90a99031-041c-489d-bbc2-3b309876ecf5 service nova] Creating event network-changed:30227e07-6518-4a9d-b4db-803c750469e6 for instance be347555-cec7-48c7-b4f7-8aabd1e61d84 on nch2-master-1 Jun 25 21:19:32.521650 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a3ce2a31-536d-48bd-b09e-88ba62c4bdd2 req-90a99031-041c-489d-bbc2-3b309876ecf5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129866 Jun 25 21:19:32.524877 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2678/5812] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:32.527669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:32.529288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:32.530615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:32.533045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:32.877723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:32.885875 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e896fd70-9af5-4757-87e5-7e3530b47acf tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.402432 Jun 25 21:19:32.886472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3135/5813] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:32 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:33.323041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:33.326731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:33.344755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.345737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.346851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.350066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.724395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:33.725546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:33.732907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.733371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.734144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.734812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.848036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lazy-loading 'services' on Instance uuid c10ea5c5-4e57-4c39-9c86-49e350cafb7a {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:19:33.929636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:33.930294 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f0ef9ac5-2e65-48f7-a8dd-3fc50e0b37cf tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a/os-volume_attachments/1b95a180-0d11-4045-88c2-16d087818925" status: 202 len: 0 microversion: 2.1 time: 0.209844 Jun 25 21:19:33.942132 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3136/5814] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:19:33 2022] DELETE /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a/os-volume_attachments/1b95a180-0d11-4045-88c2-16d087818925 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:19:33.949053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:33.950272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:33.958212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.958963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.959975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:33.960829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:33.991258 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7e0c41a-ca1b-4a95-9dce-02c37f1a055a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.666960 Jun 25 21:19:33.995614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2679/5815] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:33 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:34.390706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:34.401255 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5bf76c85-03ac-40ae-88ec-881542076dda tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.457243 Jun 25 21:19:34.402740 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3137/5816] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:33 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:34.959931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-811188519", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "086f218c-0564-4b53-bd70-7d37fb224369"}], "security_groups": [{"name": "tempest-securitygroup--1398298076"}], "key_name": "tempest-keypair-811875274", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:35.011360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:35.012876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:35.020109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.020910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.028450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.029163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.219049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:35.220996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] validate_networks() for [('086f218c-0564-4b53-bd70-7d37fb224369', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:19:35.229661 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-07636e5a-f851-40e4-bb89-b5a275fcd118 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.222413 Jun 25 21:19:35.230533 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3138/5817] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:35 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:35.419771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:35.420481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:35.428545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.429601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.430547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.434873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.728397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:35.738345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8c4f0b0-b40c-44a6-affb-aacaff89d7d8 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.322353 Jun 25 21:19:35.739629 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3139/5818] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:35 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:35.914778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:19:35.915408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:19:35.916606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:19:35.917064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:19:35.917555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:19:35.931966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.933783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.934862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:35.936720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:35.974628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:19:35.982913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Getting quotas for user c845f86f1b6244f7a53996329294f2cd and project 041615c7a84b47f88e21c6a4e19dd7ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:19:36.003149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:19:36.022888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:19:36.102998 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6a115c5d-6e3e-43f4-9862-7d09d0bcebee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.147885 Jun 25 21:19:36.110827 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2680/5819] 10.222.0.39 () {62 vars in 1187 bytes} [Sat Jun 25 21:19:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 21:19:36.114480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:36.115096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:36.230262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:36.242590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:36.244101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:36.245258 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36fb56de-d843-437c-970e-5b61d16d6de4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1280 microversion: 2.20 time: 0.135219 Jun 25 21:19:36.251129 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3140/5820] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:36 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1280 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:36.258532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:36.259168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:36.270552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:36.271432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:36.273976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:36.274713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:36.756702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:36.758084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:36.769728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:36.770683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:36.772516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:36.773149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:36.895344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:36.904232 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e010aad-4d7c-4744-92f6-376ef29db3bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.660486 Jun 25 21:19:36.906001 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2681/5821] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:36 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:37.126590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:37.139620 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1481e7ae-2d8f-43a1-95df-a9dc7574e437 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.388008 Jun 25 21:19:37.143464 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3141/5822] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:36 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:37.264223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:37.265468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:37.272417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.277338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.278298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.278752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.309009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:37.309702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:37.314539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:37.333213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.335566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.336390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.336858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.416329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:19:37.484762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:37.501109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:37.503119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:37.507550 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab146f2d-7868-4bbd-a2d4-e7d2959acc78 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1332 microversion: 2.20 time: 0.247326 Jun 25 21:19:37.524449 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2682/5823] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:37 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1332 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:37.559416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-03d5a762-61d6-44f7-be8b-142c14e6d800 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 204 len: 0 microversion: 2.1 time: 0.254726 Jun 25 21:19:37.563170 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3142/5824] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:19:37 2022] DELETE /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:19:37.572147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:37.572819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:37.584136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.589623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.590514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.590970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.927455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:37.927455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:37.934591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.935432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:37.936312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:37.936992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.011574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.025295 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b05bb248-8380-4be4-bab1-4f8a73ef6915 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1512 microversion: 2.1 time: 0.459988 Jun 25 21:19:38.027594 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2683/5825] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:37 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1512 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:38.045176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:38.125355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-90bb1bbd-91ed-432f-832b-b8a87c20e933 req-f730d182-d6b5-443f-adb2-0bfc0d3d1e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "name": "network-vif-unplugged", "status": "completed", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:38.140391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-90bb1bbd-91ed-432f-832b-b8a87c20e933 req-f730d182-d6b5-443f-adb2-0bfc0d3d1e95 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:38.141094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-90bb1bbd-91ed-432f-832b-b8a87c20e933 req-f730d182-d6b5-443f-adb2-0bfc0d3d1e95 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.166669 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-90bb1bbd-91ed-432f-832b-b8a87c20e933 req-f730d182-d6b5-443f-adb2-0bfc0d3d1e95 service nova] Creating event network-vif-unplugged:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:19:38.185352 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-90bb1bbd-91ed-432f-832b-b8a87c20e933 req-f730d182-d6b5-443f-adb2-0bfc0d3d1e95 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065881 Jun 25 21:19:38.187017 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2684/5826] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:38.190034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.196518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:38.197447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:38.201020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db2a47e2-b709-4bcb-b53f-af3565514742 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.281214 Jun 25 21:19:38.202055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3143/5827] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:37 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:38.212355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:38.212355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.212355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:38.212355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.536214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:38.537300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:38.554895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:38.557237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.560583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:38.561305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:38.645708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.656205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.657878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.658999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8e7208d5-c481-44a7-83b8-9f7f398bd0a0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1338 microversion: 2.20 time: 0.130337 Jun 25 21:19:38.660329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3144/5828] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:38 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1338 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:38.767418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:38.779188 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b4d8ce8-51bf-4f05-8741-68c951d0440a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.587552 Jun 25 21:19:38.779864 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2685/5829] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:38 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:39.046608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:39.047537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:39.059577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.060332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.065705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.066243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.219224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:39.219841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:39.229207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.230705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.240797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.241335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.360513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:39.368674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c334e769-c570-4d82-8f4a-542a1c582257 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1512 microversion: 2.1 time: 0.327812 Jun 25 21:19:39.373166 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3145/5830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:39 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1512 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:39.680043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:39.680976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:39.693900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.694361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.695165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.695604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.856160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:39.875869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:39.877932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:39.879811 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fccc7204-5f40-469e-9334-8255003c00ee tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1338 microversion: 2.20 time: 0.204665 Jun 25 21:19:39.880696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3146/5831] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:39 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:39.887481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:39.890366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:39.900480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.902333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:39.903628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:39.904845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.257268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:40.267978 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-681e03e7-da99-4920-8461-f18f69791379 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.385883 Jun 25 21:19:40.282408 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3147/5832] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:39 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:40.287267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:40.298858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e36ee7d0-73f4-4e33-850a-09c1fb825603 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 1.083433 Jun 25 21:19:40.313089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2686/5833] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:39 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:40.333161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ff34a7be-2857-4fb8-994f-50edece5a500 req-0e5a2bf0-54d6-4b2b-9950-853b474eb9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:40.358640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff34a7be-2857-4fb8-994f-50edece5a500 req-0e5a2bf0-54d6-4b2b-9950-853b474eb9c7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:40.359745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ff34a7be-2857-4fb8-994f-50edece5a500 req-0e5a2bf0-54d6-4b2b-9950-853b474eb9c7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.393158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:40.394853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:40.400074 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ff34a7be-2857-4fb8-994f-50edece5a500 req-0e5a2bf0-54d6-4b2b-9950-853b474eb9c7 service nova] Creating event network-changed:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:19:40.413823 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ff34a7be-2857-4fb8-994f-50edece5a500 req-0e5a2bf0-54d6-4b2b-9950-853b474eb9c7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083980 Jun 25 21:19:40.417118 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3148/5834] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:40.418022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:40.419248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.420290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:40.421043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.898802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:40.899864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:40.901366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:40.906884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:40.907630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.908657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:40.909316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:40.913518 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c107ee2-1d80-4d60-959a-278ed14b2955 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1512 microversion: 2.1 time: 0.528123 Jun 25 21:19:40.916819 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2687/5835] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:40 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1512 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:40.931432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:41.292113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:41.300459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:41.333864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.334867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.341248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.341963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.486253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:41.501114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:41.503648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:41.506120 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99d17007-1ec3-4c25-8c4d-a18529d0f97c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.611079 Jun 25 21:19:41.507251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3149/5836] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:40 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:41.513445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-52c50fbf-5374-4dea-abb4-ac8e9b6a1efe req-1d2f1f4e-af43-47db-a377-0fdaafd9b39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be347555-cec7-48c7-b4f7-8aabd1e61d84", "name": "network-vif-plugged", "status": "completed", "tag": "30227e07-6518-4a9d-b4db-803c750469e6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:41.525790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-52c50fbf-5374-4dea-abb4-ac8e9b6a1efe req-1d2f1f4e-af43-47db-a377-0fdaafd9b39b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.526957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-52c50fbf-5374-4dea-abb4-ac8e9b6a1efe req-1d2f1f4e-af43-47db-a377-0fdaafd9b39b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.542415 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-52c50fbf-5374-4dea-abb4-ac8e9b6a1efe req-1d2f1f4e-af43-47db-a377-0fdaafd9b39b service nova] Creating event network-vif-plugged:30227e07-6518-4a9d-b4db-803c750469e6 for instance be347555-cec7-48c7-b4f7-8aabd1e61d84 on nch2-master-1 Jun 25 21:19:41.550056 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-52c50fbf-5374-4dea-abb4-ac8e9b6a1efe req-1d2f1f4e-af43-47db-a377-0fdaafd9b39b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041269 Jun 25 21:19:41.558949 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3150/5837] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:41.566963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:41.568240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:41.582425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.583386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.584380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.585066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.755994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:41.771287 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52731f94-1c05-4495-bb9f-9df5e5537d83 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.486597 Jun 25 21:19:41.772578 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2688/5838] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:41 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:41.935119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:41.936175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:41.947330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.949062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:41.953070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:41.956640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.057161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.057712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.058479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lazy-loading 'fault' on Instance uuid c10ea5c5-4e57-4c39-9c86-49e350cafb7a {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:19:42.059538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:42.071137 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f5d9ea0-e302-49ab-899d-fa7120ca90b3 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.510002 Jun 25 21:19:42.072160 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3151/5839] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:41 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:42.195687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:42.204472 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fe66b083-9d98-4801-adfe-1d391fb5154d tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 200 len: 1308 microversion: 2.1 time: 0.274798 Jun 25 21:19:42.206646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2689/5840] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:41 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 1308 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:42.441190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c10ea5c5-4e57-4c39-9c86-49e350cafb7a", "name": "network-vif-deleted", "tag": "aa3fdfda-cc96-46fd-9f45-b05ac068217e"}, {"name": "network-changed", "server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:42.450629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.451153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.465013 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] Creating event network-vif-deleted:aa3fdfda-cc96-46fd-9f45-b05ac068217e for instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a on nch2-master-1 Jun 25 21:19:42.465925 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] Creating event network-changed:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch1-master-1 Jun 25 21:19:42.475912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e99b0cd4-62dd-4a9a-9ef5-e79af17a7ef2 req-38a4d795-8386-4e86-b5e3-d54fb23bcde4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.038985 Jun 25 21:19:42.476879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3152/5841] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:42.525799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:42.527031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:42.535220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:42.536976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.537609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.538586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.539222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.790775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:42.814295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:42.819354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:42.826083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:42.831798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:42.833029 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-888ead7c-aa70-4d0d-b736-aa77f1a9d456 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.311924 Jun 25 21:19:42.848801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.849049 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2690/5842] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:42 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:42.850297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:42.851512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:42.852135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.088465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:43.089333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:43.095717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.096171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.097054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.097496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.175187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:43.183535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-140c167f-4d59-430c-a3dc-1796952a63a0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.387916 Jun 25 21:19:43.184508 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3153/5843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:42 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:43.227821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:43.228963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: c10ea5c5-4e57-4c39-9c86-49e350cafb7a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:43.240459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.241127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.242091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.242911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.259611 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] HTTP exception thrown: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Request method failure captured: Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a HTTP/1.1 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3tW5P7NPMw1DRqyjcOc062RMxDjdfTNV3MOqKnqUjG7790-1FRR6AXeSSoGk9VEyLqbf7AMM2Gz75_832dKq_5IR24S5PB3i7bPdJtyAARKukUUsN8C6ox_MAhBI8Fzj9sWx2uB294gDHbf0IF-3Jpn582aWJIQwpUzyAeD4i8x2H8 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5a7efe5a3d7f4380b6e1ee40d4628ea8 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}] Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5a7efe5a3d7f4380b6e1ee40d4628ea8 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesSnapshotTestJSON-558272145-project Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 871c269a6b15425d8b79a6c653c56402 Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesSnapshotTestJSON-558272145-project Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c10ea5c5-4e57-4c39-9c86-49e350cafb7a'} Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:19:43.261633 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. Jun 25 21:19:43.265997 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:19:43.267379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Returning 404 to user: Instance c10ea5c5-4e57-4c39-9c86-49e350cafb7a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:19:43.268477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c041a351-1eac-4c88-96ac-d9aef9c1c945 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a" status: 404 len: 111 microversion: 2.1 time: 0.047510 Jun 25 21:19:43.273158 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3154/5844] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:43 2022] GET /compute/v2.1/servers/c10ea5c5-4e57-4c39-9c86-49e350cafb7a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:19:43.372211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:43.380417 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-436595a2-0bca-469c-93c5-47c9b4b46ceb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.296003 Jun 25 21:19:43.381314 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2691/5845] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:43 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:43.852392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:43.853087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:43.859773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.860229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:43.861023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:43.861459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:44.007352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:44.033003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:44.034584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:44.036477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be504154-5fb0-4d47-8642-e34328ce99c2 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.188728 Jun 25 21:19:44.037765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3155/5846] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:43 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:44.203155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:44.207012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:44.213476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:44.214080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:44.215109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:44.215759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:44.399559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:44.400648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:44.407734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:44.408938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:44.410021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:44.410652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:44.433433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:44.443566 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5e829d5-d935-41f1-ab39-2577751a6959 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.245615 Jun 25 21:19:44.445088 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2692/5847] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:44 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:45.030715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:45.039224 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0db38e5f-49ef-4195-b1b9-2273d3c5b364 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.644297 Jun 25 21:19:45.049655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3156/5848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:44 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:45.057607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:45.058360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:45.066819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:45.067342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:45.068451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:45.068949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:45.278320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:45.289679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:45.291708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:45.293060 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-08488df4-52b0-4524-b18e-cfcfee67ea62 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.240870 Jun 25 21:19:45.294159 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2693/5849] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:45 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:45.462939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:45.463732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:45.471243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:45.475051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:45.475924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:45.476468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:45.647560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:45.656518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0d5ddebd-c35b-4b77-8adc-7c395b15f451 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.197583 Jun 25 21:19:45.657442 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3157/5850] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:45 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:46.056795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:46.057646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:46.063770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:46.065176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:46.067245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.068057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:46.070400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.078652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:46.311737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:46.313375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:46.318007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=14 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:46.323099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.323918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:46.325317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.325993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:46.529555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:46.544480 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02e474cc-2182-4058-ac67-35289f88885e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1367 microversion: 2.1 time: 0.489501 Jun 25 21:19:46.547782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2694/5851] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:46 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:46.650672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:46.659011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:46.660709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:46.661889 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2c27a29-d2b5-4454-83ad-c3c2581f4690 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.354670 Jun 25 21:19:46.662988 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3158/5852] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:46 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:46.678222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:46.678838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:46.685064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.685517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:46.686278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:46.686831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.037605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:47.056771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b3a7894-4b49-46a0-ba14-fc37702d239b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.382693 Jun 25 21:19:47.074131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2695/5853] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:46 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:47.568786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:47.570258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:47.591830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.595538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.598017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.598723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.681925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:47.682718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:47.690200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.690808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.691659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.692168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.712170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=100 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:47.865859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:47.876262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5cb2fa20-1ba4-4441-9186-b4336162b34b tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1557 microversion: 2.1 time: 0.315607 Jun 25 21:19:47.880706 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3159/5854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:47 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1557 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:47.882488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:47.893195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:47.894933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:47.896219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc856eb1-7964-49da-9d6e-b7c71c9e3d1b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.218732 Jun 25 21:19:47.901353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:47.902152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:47.908023 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2696/5855] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:47 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:47.914732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.915224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:47.916009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:47.916463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:48.020078 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62c1758b-6a26-4c36-b50f-4a50d0a850bb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127493 Jun 25 21:19:48.021154 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3160/5856] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:19:47 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:48.082800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:48.083625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:48.090670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:48.091384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:48.092323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:48.092946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:48.309300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1578222755", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "358aad43-2693-4079-8b92-b34ee4b03afc"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:48.399873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] validate_networks() for [('358aad43-2693-4079-8b92-b34ee4b03afc', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:19:48.446514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:48.465018 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ef529ec-8153-4d41-bffc-e8fe4edf2861 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.385227 Jun 25 21:19:48.467109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2697/5857] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:48 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:48.481708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1eb97ab2-5c84-4661-8593-6d749f0fc27f req-010b9cdf-63d9-4d9d-9e1b-2a7e01490538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "name": "network-vif-plugged", "status": "completed", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:48.505063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1eb97ab2-5c84-4661-8593-6d749f0fc27f req-010b9cdf-63d9-4d9d-9e1b-2a7e01490538 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:48.505853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1eb97ab2-5c84-4661-8593-6d749f0fc27f req-010b9cdf-63d9-4d9d-9e1b-2a7e01490538 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:48.533011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1eb97ab2-5c84-4661-8593-6d749f0fc27f req-010b9cdf-63d9-4d9d-9e1b-2a7e01490538 service nova] Creating event network-vif-plugged:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch1-master-1 Jun 25 21:19:48.538577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1eb97ab2-5c84-4661-8593-6d749f0fc27f req-010b9cdf-63d9-4d9d-9e1b-2a7e01490538 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067736 Jun 25 21:19:48.539860 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2698/5858] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:48.928237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:48.931282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:48.939907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:48.942724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:48.943783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:48.944469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:49.212031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:49.225831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:49.229033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:49.232131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-343572c9-ba21-451f-8055-daa95164469c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1406 microversion: 2.20 time: 0.312842 Jun 25 21:19:49.244254 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2699/5859] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:48 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:19:49.483264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:49.483874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:49.500162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:49.500649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:49.501444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:49.501882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:49.892907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:19:49.893448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:19:49.893841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:19:49.894627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:19:49.895354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:19:49.906609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:49.907210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:49.915666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:49.916921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:49.917063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:49.932075 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1acbc3d7-3c1f-4083-a1ee-ae2fc8a45136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.452698 Jun 25 21:19:49.940264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2700/5860] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:49 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:49.973863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-da2fbf4f-92be-4baa-9b52-e328a8657c68 req-13265e5a-6b61-4c04-9979-be1069053f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "name": "network-vif-unplugged", "status": "completed", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:49.979293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Getting quotas for project 5a7efe5a3d7f4380b6e1ee40d4628ea8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:19:49.988855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Getting quotas for user 871c269a6b15425d8b79a6c653c56402 and project 5a7efe5a3d7f4380b6e1ee40d4628ea8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:19:50.004405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-da2fbf4f-92be-4baa-9b52-e328a8657c68 req-13265e5a-6b61-4c04-9979-be1069053f60 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.005240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-da2fbf4f-92be-4baa-9b52-e328a8657c68 req-13265e5a-6b61-4c04-9979-be1069053f60 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.007844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:19:50.010327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:19:50.021703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-da2fbf4f-92be-4baa-9b52-e328a8657c68 req-13265e5a-6b61-4c04-9979-be1069053f60 service nova] Creating event network-vif-unplugged:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch1-master-1 Jun 25 21:19:50.028386 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-da2fbf4f-92be-4baa-9b52-e328a8657c68 req-13265e5a-6b61-4c04-9979-be1069053f60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086524 Jun 25 21:19:50.031878 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2701/5861] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:50.071822 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db43cf96-97b3-46f1-967a-7c98627cd5f5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.767085 Jun 25 21:19:50.073271 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3161/5862] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:19:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:19:50.083943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa85465c-5fa3-4134-8d69-98b9517e4346 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:50.092296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa85465c-5fa3-4134-8d69-98b9517e4346 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:50.252593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:50.253600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:50.268236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.282019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.285120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.287529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.297902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa85465c-5fa3-4134-8d69-98b9517e4346 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:50.309656 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa85465c-5fa3-4134-8d69-98b9517e4346 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1219 microversion: 2.1 time: 0.228928 Jun 25 21:19:50.312638 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2702/5863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:50 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:50.520559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a26b4579-d427-42b6-a78c-67e7983d1789 req-e093249c-694c-49dc-979a-1ab834a24630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be347555-cec7-48c7-b4f7-8aabd1e61d84", "tag": "30227e07-6518-4a9d-b4db-803c750469e6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:50.543061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a26b4579-d427-42b6-a78c-67e7983d1789 req-e093249c-694c-49dc-979a-1ab834a24630 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.544919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a26b4579-d427-42b6-a78c-67e7983d1789 req-e093249c-694c-49dc-979a-1ab834a24630 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.563629 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a26b4579-d427-42b6-a78c-67e7983d1789 req-e093249c-694c-49dc-979a-1ab834a24630 service nova] Creating event network-changed:30227e07-6518-4a9d-b4db-803c750469e6 for instance be347555-cec7-48c7-b4f7-8aabd1e61d84 on nch2-master-1 Jun 25 21:19:50.600051 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a26b4579-d427-42b6-a78c-67e7983d1789 req-e093249c-694c-49dc-979a-1ab834a24630 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080947 Jun 25 21:19:50.602141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2703/5864] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:19:50.818372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:50.829657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:50.834773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:50.840847 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0bfc3aa3-af8a-45e0-bbc7-9cfe50e66bad tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1599 microversion: 2.20 time: 0.593796 Jun 25 21:19:50.843423 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3162/5865] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:19:50 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1599 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:19:50.863153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:50.864416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:50.881898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.882624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.883424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.884160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.957026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:50.957801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:50.969553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.970029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:50.970825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:50.971267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:51.254568 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3ac76ff-72de-4e0d-8a1d-05ac1a7d1abf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.397913 Jun 25 21:19:51.256077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2704/5866] 10.222.0.39 () {60 vars in 1315 bytes} [Sat Jun 25 21:19:50 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-interface => generated 285 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:51.331774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:51.332754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:51.347300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:51.348012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:51.349062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:51.349647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:51.360093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:51.380353 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7f48d33-fbd0-4c37-9f58-ba144ed937e9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.428219 Jun 25 21:19:51.381196 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3163/5867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:50 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:51.487829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:51.530250 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-959665f1-f62a-45ab-9b5e-4949ea29ec0e tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1215 microversion: 2.1 time: 0.204844 Jun 25 21:19:51.540544 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2705/5868] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:51 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:52.400466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:52.401696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:52.429522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:52.430265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:52.432986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:52.433594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:52.547976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:52.548792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:52.558349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:52.558801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:52.559616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:52.560050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:52.729682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:52.738001 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b0a2603-a3c8-4afe-b6bc-b64eb5dbe017 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1277 microversion: 2.1 time: 0.194029 Jun 25 21:19:52.752125 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2706/5869] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:52 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:52.866414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:52.879061 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-081c7e7d-b595-4c8a-8ccc-40a2d1997a75 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.484690 Jun 25 21:19:52.880106 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3164/5870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:52 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:53.161679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-623d6e53-190a-4f4f-ae96-5a9cd0b7c67f req-1e9392d2-1e22-4d2a-9edd-f7333ebc0a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:53.184627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-623d6e53-190a-4f4f-ae96-5a9cd0b7c67f req-1e9392d2-1e22-4d2a-9edd-f7333ebc0a08 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:53.186511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-623d6e53-190a-4f4f-ae96-5a9cd0b7c67f req-1e9392d2-1e22-4d2a-9edd-f7333ebc0a08 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:53.218958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-623d6e53-190a-4f4f-ae96-5a9cd0b7c67f req-1e9392d2-1e22-4d2a-9edd-f7333ebc0a08 service nova] Creating event network-changed:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch1-master-1 Jun 25 21:19:53.231650 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-623d6e53-190a-4f4f-ae96-5a9cd0b7c67f req-1e9392d2-1e22-4d2a-9edd-f7333ebc0a08 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076319 Jun 25 21:19:53.234746 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2707/5871] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:53.761158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:53.762687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:53.777097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:53.779275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:53.780942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:53.781800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:53.898098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:53.898704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:53.919974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:53.920818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:53.924536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:53.925297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:54.228552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:54.272144 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1080087c-d000-442e-b632-6c83f7d9cfaa tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.516627 Jun 25 21:19:54.274304 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3165/5872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:53 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:54.529410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:54.544016 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8728a215-5761-4315-8766-eb288c8a661a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1693 microversion: 2.1 time: 0.650231 Jun 25 21:19:54.556609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2708/5873] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:53 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1693 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:55.289520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:55.290917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:55.299992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.300875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.301961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.302646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.533453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c048939b-a564-4030-acef-cb273ac3d84f req-f4f969b7-3d37-4d6d-9d06-e09068b4afcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f2538f-a949-49ad-9d8f-e562025f77ba", "tag": "26c6acfc-b80c-4b10-8fd5-5abb66eff316"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:55.561049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c048939b-a564-4030-acef-cb273ac3d84f req-f4f969b7-3d37-4d6d-9d06-e09068b4afcd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.561509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c048939b-a564-4030-acef-cb273ac3d84f req-f4f969b7-3d37-4d6d-9d06-e09068b4afcd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.581862 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c048939b-a564-4030-acef-cb273ac3d84f req-f4f969b7-3d37-4d6d-9d06-e09068b4afcd service nova] Creating event network-changed:26c6acfc-b80c-4b10-8fd5-5abb66eff316 for instance 93f2538f-a949-49ad-9d8f-e562025f77ba on nch2-master-1 Jun 25 21:19:55.605789 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c048939b-a564-4030-acef-cb273ac3d84f req-f4f969b7-3d37-4d6d-9d06-e09068b4afcd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079812 Jun 25 21:19:55.606435 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2709/5874] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:19:55.620476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:55.621225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:55.629788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.630432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.631213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.631845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.705788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:55.714487 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6052c35c-b9c8-468a-9466-5c659e123e3a tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.428784 Jun 25 21:19:55.723296 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3166/5875] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:55 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:55.884890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:55.896290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd7eec7f-e041-4ae0-a4d7-e44d7a7d5f3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1683 microversion: 2.1 time: 0.286770 Jun 25 21:19:55.909583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2710/5876] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:55 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1683 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:55.919109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:55.919742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:55.929949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.930443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:55.931229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:55.931693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.354535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba1e01f5-1955-4da8-bd1b-50d38021286a tempest-TestNetworkAdvancedServerOps-148077325 tempest-TestNetworkAdvancedServerOps-148077325-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1834 microversion: 2.1 time: 0.440044 Jun 25 21:19:56.355201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3167/5877] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:55 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1834 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:56.372204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:56.372860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:56.379429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.379886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.380814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.381263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.524771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:56.532942 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c602cf5-a53c-40c6-9e6e-272babf4cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1683 microversion: 2.1 time: 0.164675 Jun 25 21:19:56.533878 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2711/5878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:56 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:56.629418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:19:56.630525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:56.637116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.637652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.638499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.639028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.731746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:56.732523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:56.739598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.740053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.740901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:56.741350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:56.881541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:56.890099 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bb592498-39b1-4f85-8a8d-7d56da42ebd5 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.162507 Jun 25 21:19:56.890689 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2712/5879] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:56 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:19:57.907296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:57.907889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:57.915624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:57.916340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:57.917104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:57.917502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:58.041186 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b7f6b40c-bd43-4116-b648-234552d2511c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action" status: 200 len: 38623 microversion: 2.1 time: 1.416032 Jun 25 21:19:58.042518 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3168/5880] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:19:56 2022] POST /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28/action => generated 38623 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:19:58.238737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:58.248240 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5fec60fc-99ac-4283-bad8-d78036c28df0 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.344988 Jun 25 21:19:58.249732 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2713/5881] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:57 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:19:59.291978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:19:59.297179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:19:59.312707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:59.314427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:59.315458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:19:59.316139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:19:59.339252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:19:59.684187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:19:59.692910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1edcf403-fb98-410d-9563-feda807dc130 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.424632 Jun 25 21:19:59.693507 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3169/5882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:19:59 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:00.461624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:00.462913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e41c3e0a-2eda-4805-bf2c-4f04789b5d4f req-2b218c14-48c0-42b2-bc75-e6e087e4fa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:00.464674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:00.480955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:00.486414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:00.487684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.488181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:00.490340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.493127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.495229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e41c3e0a-2eda-4805-bf2c-4f04789b5d4f req-2b218c14-48c0-42b2-bc75-e6e087e4fa20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.495723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.497731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e41c3e0a-2eda-4805-bf2c-4f04789b5d4f req-2b218c14-48c0-42b2-bc75-e6e087e4fa20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.538128 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e41c3e0a-2eda-4805-bf2c-4f04789b5d4f req-2b218c14-48c0-42b2-bc75-e6e087e4fa20 service nova] Creating event network-changed:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch2-master-1 Jun 25 21:20:00.543468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:20:00.554654 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e41c3e0a-2eda-4805-bf2c-4f04789b5d4f req-2b218c14-48c0-42b2-bc75-e6e087e4fa20 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102005 Jun 25 21:20:00.560090 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3170/5883] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:00.723076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:00.724051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:00.749153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.765616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.767209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.768631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.771580 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2735012f-aa46-4d4f-8b5b-95ec9d8e96fb tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 204 len: 0 microversion: 2.1 time: 0.323834 Jun 25 21:20:00.775648 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2714/5884] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:20:00 2022] DELETE /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:20:00.783424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:00.784664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:00.798128 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.798777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:00.799940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:00.800732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:01.087635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:01.098006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9eebf12f-774e-4dfa-9a19-b2aea3e6ce3c tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.391126 Jun 25 21:20:01.100786 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3171/5885] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:00 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:20:01.142122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:01.156973 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6123e10-965d-44a6-977f-deb1c14ecd3b tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1689 microversion: 2.1 time: 0.379306 Jun 25 21:20:01.158566 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2715/5886] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:00 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1689 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:02.120534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:02.121378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:02.139310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:02.143205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:02.145150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:02.147977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:02.176284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:02.177131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:02.195885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:02.196365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:02.203556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:02.204036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:02.279176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:02.483482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:02.509783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de85317f-1c99-4936-b478-6478ca11b4d8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.385187 Jun 25 21:20:02.519348 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3172/5887] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:02 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:02.520320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:02.530018 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5477e237-dcf4-4d52-b127-24b05779fe3a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 200 len: 1352 microversion: 2.1 time: 0.358663 Jun 25 21:20:02.530967 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2716/5888] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:02 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 1352 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:02.588935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d98e34f9-6213-4895-b8f7-ae025be5790d req-5f9245bd-5577-4c04-a7ad-6249013566b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07bef245-ea2a-4401-9ce3-048636b36a28", "name": "network-vif-deleted", "tag": "83142478-6b6c-4aba-beac-10fffa303318"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:02.604452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d98e34f9-6213-4895-b8f7-ae025be5790d req-5f9245bd-5577-4c04-a7ad-6249013566b4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:02.609704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d98e34f9-6213-4895-b8f7-ae025be5790d req-5f9245bd-5577-4c04-a7ad-6249013566b4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:02.653220 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d98e34f9-6213-4895-b8f7-ae025be5790d req-5f9245bd-5577-4c04-a7ad-6249013566b4 service nova] Creating event network-vif-deleted:83142478-6b6c-4aba-beac-10fffa303318 for instance 07bef245-ea2a-4401-9ce3-048636b36a28 on nch2-master-1 Jun 25 21:20:02.671829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d98e34f9-6213-4895-b8f7-ae025be5790d req-5f9245bd-5577-4c04-a7ad-6249013566b4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084403 Jun 25 21:20:02.672814 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3173/5889] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:03.527647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:03.528913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:03.536488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:03.537184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:03.537966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:03.538404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:03.548651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:03.550187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 07bef245-ea2a-4401-9ce3-048636b36a28] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:03.557083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:03.557822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:03.558678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:03.559312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:03.574147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] HTTP exception thrown: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Request method failure captured: Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 HTTP/1.1 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3oppHqyw4EeiDOlRZTssoyBnr4Fvha7OXgevHlVi_-Lo2Z8Iq2TjW5wdFnz53ddpd5IgdjOJUqfVFPdDF6ZhziXRhgRcBe3CuTOpGuDMlw8qliC1Zo9kBCF2HZU7ccN2avzoIa76kuxMJD3iDdl2bUmkbWRqsMNWpNI2_jlCuUlHsA Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}] Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: aa2aaa29e0dd479283202bd6575b4c25 Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '07bef245-ea2a-4401-9ce3-048636b36a28'} Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:20:03.576313 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. Jun 25 21:20:03.579925 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:20:03.582570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Returning 404 to user: Instance 07bef245-ea2a-4401-9ce3-048636b36a28 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:20:03.583474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-208f25c3-3dcb-4245-ab05-4280f9eaa649 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28" status: 404 len: 111 microversion: 2.1 time: 0.040024 Jun 25 21:20:03.584082 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3174/5890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:03 2022] GET /compute/v2.1/servers/07bef245-ea2a-4401-9ce3-048636b36a28 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:20:03.766650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:03.775422 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f31af60-b6db-4a9f-b58c-332a529aaa55 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.251954 Jun 25 21:20:03.776290 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2717/5891] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:03 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:04.793209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:04.793836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:04.806028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:04.806727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:04.810682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:04.811798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:05.031649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-544d13b3-9cb0-4c6a-b46c-a629a845c2fe req-3bea5702-9491-44ab-8fb0-2816d725bb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f2538f-a949-49ad-9d8f-e562025f77ba", "name": "network-vif-plugged", "status": "completed", "tag": "26c6acfc-b80c-4b10-8fd5-5abb66eff316"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:05.054050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-544d13b3-9cb0-4c6a-b46c-a629a845c2fe req-3bea5702-9491-44ab-8fb0-2816d725bb58 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:05.054683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-544d13b3-9cb0-4c6a-b46c-a629a845c2fe req-3bea5702-9491-44ab-8fb0-2816d725bb58 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:05.084327 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-544d13b3-9cb0-4c6a-b46c-a629a845c2fe req-3bea5702-9491-44ab-8fb0-2816d725bb58 service nova] Creating event network-vif-plugged:26c6acfc-b80c-4b10-8fd5-5abb66eff316 for instance 93f2538f-a949-49ad-9d8f-e562025f77ba on nch2-master-1 Jun 25 21:20:05.099251 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-544d13b3-9cb0-4c6a-b46c-a629a845c2fe req-3bea5702-9491-44ab-8fb0-2816d725bb58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073967 Jun 25 21:20:05.101823 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2718/5892] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:05.359145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:05.374721 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64e9b349-1589-4a3f-9fc1-ef281cb00ad7 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.585680 Jun 25 21:20:05.378896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3175/5893] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:04 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:06.403478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:06.404822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:06.417214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:06.418402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:06.419584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:06.421038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:06.668637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:06.693707 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dd49c7fd-e67a-4850-b896-e7c57ee8af0f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1319 microversion: 2.1 time: 0.301567 Jun 25 21:20:06.710852 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2719/5894] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:06 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:07.707908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3f6d71b-7a22-4c37-9e05-ade318b61e52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '.version_select at 0x7f984ef533a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:07.712305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:07.713022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:07.716108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:07.722135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:07.723012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:07.723493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:07.724026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:07.737950 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3f6d71b-7a22-4c37-9e05-ade318b61e52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1221555139" status: 202 len: 0 microversion: 2.1 time: 0.035783 Jun 25 21:20:07.743624 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3176/5895] 10.222.0.39 () {58 vars in 1283 bytes} [Sat Jun 25 21:20:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1221555139 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:20:07.780009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73d4f307-d526-460a-b858-fa97b41b5a29 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: .version_select at 0x7f984eb1d700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1045180870", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo64TqfJIoNNui8p3kOFOPgcX/gEk9QAB6XcnJSJxofLTT14FHL7maBSHm7c0PZZ7sptT0XBDJPdgTaMsm4t5W4ezr359KZN2W6tck5iM1wgmXCijWJxU5k4ZEI4QTy4A=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:07.824744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-73d4f307-d526-460a-b858-fa97b41b5a29 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:20:07.833043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-73d4f307-d526-460a-b858-fa97b41b5a29 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:20:07.866148 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73d4f307-d526-460a-b858-fa97b41b5a29 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.093454 Jun 25 21:20:07.872942 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3177/5896] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:20:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:07.970639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:07.983819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b1de1f9-9b89-4008-8edd-a859d3a43e93 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1507 microversion: 2.1 time: 0.274364 Jun 25 21:20:07.985486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2720/5897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:07 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:20:08.001790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c02e587f-1a09-4c9f-a6d5-e94a0b4adf15", "device": "/dev/sdb"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:08.002984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:08.009746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:08.010142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:08.011174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:08.011833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:08.371026 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86e2244a-db24-4dd7-8391-067b6b281ebe tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "POST /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372909 Jun 25 21:20:08.373768 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3178/5898] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:20:07 2022] POST /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:15.809765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-967187740", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "173741b9-567a-40eb-b3e5-26484d8daa04"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1045180870", "security_groups": [{"name": "tempest-secgroup-smoke-387536988"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:15.841713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:16.009605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] validate_networks() for [('173741b9-567a-40eb-b3e5-26484d8daa04', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:20:16.857533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:20:16.858953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:20:16.859672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:20:16.860104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:20:16.860681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:20:16.870158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:16.870621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:16.871414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:16.872038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:16.891078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:20:16.896586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Getting quotas for user aa2aaa29e0dd479283202bd6575b4c25 and project ac8403c64a48460ea9cbf383240fa2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:20:16.909484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:20:16.912057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:20:16.973587 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c2766a7-eb5f-4f0a-9998-885ab245e707 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.167712 Jun 25 21:20:16.975005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2721/5899] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:20:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:20:16.986509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2b663efe-bd58-4ec4-a9d3-381ab49969d9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:16.987616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b663efe-bd58-4ec4-a9d3-381ab49969d9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:17.072649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2b663efe-bd58-4ec4-a9d3-381ab49969d9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:17.087537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2b663efe-bd58-4ec4-a9d3-381ab49969d9 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1266 microversion: 2.1 time: 0.105858 Jun 25 21:20:17.100107 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3179/5900] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:16 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:18.105771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:18.107094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:18.115696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:18.116485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:18.117507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:18.118136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:18.219222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:18.231515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6decbff-93c4-4ef1-9c57-a98d04065069 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1326 microversion: 2.1 time: 0.130038 Jun 25 21:20:18.233554 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2722/5901] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:18 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:19.248912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:19.250332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:19.255602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:19.265803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:19.266738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:19.268055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:19.268626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:19.358952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:19.371938 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f40b96b-1587-407e-9507-2164f4c7f6b4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1324 microversion: 2.1 time: 0.127270 Jun 25 21:20:19.373115 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3180/5902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:19 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1324 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:20.401697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:20.404176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:20.424613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:20.425682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:20.427433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:20.428951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:20.729128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4cf66ed5-0d49-4b53-8228-852d0dda41ff req-12b047a2-407c-4f42-917b-ed4ee9f24437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:20.763885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4cf66ed5-0d49-4b53-8228-852d0dda41ff req-12b047a2-407c-4f42-917b-ed4ee9f24437 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:20.764334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4cf66ed5-0d49-4b53-8228-852d0dda41ff req-12b047a2-407c-4f42-917b-ed4ee9f24437 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:20.781219 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4cf66ed5-0d49-4b53-8228-852d0dda41ff req-12b047a2-407c-4f42-917b-ed4ee9f24437 service nova] Creating event network-changed:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:20:20.789756 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4cf66ed5-0d49-4b53-8228-852d0dda41ff req-12b047a2-407c-4f42-917b-ed4ee9f24437 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067041 Jun 25 21:20:20.790756 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3181/5903] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:20.869283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:20.883067 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-64715eb1-2045-436c-9a8d-b3b5c0a80d49 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.497205 Jun 25 21:20:20.887740 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2723/5904] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:20 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:21.904834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:21.905562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:21.912127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:21.912613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:21.913377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:21.913810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:22.087173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:22.095176 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67620325-399e-48af-9e16-d641f7a6e816 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.195578 Jun 25 21:20:22.097084 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3182/5905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:21 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:23.114177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:23.114893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:23.122598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:23.123060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:23.123828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:23.124259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:23.270174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:23.278927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ee6ced6-822e-4073-ae7b-caaf65d04921 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.168739 Jun 25 21:20:23.279872 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2724/5906] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:23 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:24.299859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:24.300753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:24.315025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:24.315958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:24.317345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:24.318174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:24.508126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:24.517058 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e897c493-e68a-4113-a941-8f4b884f7fc4 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.224835 Jun 25 21:20:24.517751 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3183/5907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:24 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:25.534439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:25.535058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:25.542276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:25.542726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:25.543494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:25.543898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:25.832751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:25.844646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aedeea83-64ed-4991-b174-9291924b6773 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.310346 Jun 25 21:20:25.844646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2725/5908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:25 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:26.405637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3268977c-0926-45e2-b81e-acdf2ea6d5c3 req-b4822c61-9e42-4fb1-9b14-16a13becc857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "name": "network-vif-plugged", "status": "completed", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:26.419875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3268977c-0926-45e2-b81e-acdf2ea6d5c3 req-b4822c61-9e42-4fb1-9b14-16a13becc857 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:26.420593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3268977c-0926-45e2-b81e-acdf2ea6d5c3 req-b4822c61-9e42-4fb1-9b14-16a13becc857 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:26.438430 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3268977c-0926-45e2-b81e-acdf2ea6d5c3 req-b4822c61-9e42-4fb1-9b14-16a13becc857 service nova] Creating event network-vif-plugged:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:20:26.444585 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3268977c-0926-45e2-b81e-acdf2ea6d5c3 req-b4822c61-9e42-4fb1-9b14-16a13becc857 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045170 Jun 25 21:20:26.445910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3184/5909] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:26.796701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:26.797306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:26.809648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:26.814997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:26.815841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:26.816290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:26.842207 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c34009d9-7d26-455f-a593-271654ff84fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/ips" status: 200 len: 153 microversion: 2.20 time: 0.049636 Jun 25 21:20:26.842828 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2726/5910] 10.222.0.39 () {60 vars in 1288 bytes} [Sat Jun 25 21:20:26 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/ips => generated 153 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:20:26.858448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:26.859589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:26.866893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:26.867555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:26.868552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:26.868992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:27.033098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:27.045493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dcc65326-5986-4ae1-b8b1-a331f7ff74d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1391 microversion: 2.1 time: 0.190587 Jun 25 21:20:27.047557 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3185/5911] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:26 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:28.062865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:28.063425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:28.066562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.068005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.073473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.073935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.074692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.075239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.272141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:28.281510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ecc8c783-404c-497e-b67f-7e0e86eb39d0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1564 microversion: 2.1 time: 0.222135 Jun 25 21:20:28.282847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2727/5912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:28 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1564 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:28.298399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:28.299132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:28.301248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:28.323713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.324176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.325814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.326421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.487004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:28.495225 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19422312-407e-4b53-b934-270fcc23b05c tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1564 microversion: 2.1 time: 0.200765 Jun 25 21:20:28.496325 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3186/5913] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:28 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1564 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:28.796923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:28.797670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:28.806036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.806861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.807901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:28.808521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:28.842004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lazy-loading 'flavor' on Instance uuid eec5c609-b7e5-4abe-b5b4-f3b066290a02 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:20:29.201478 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-216e7ea1-8f9e-4d79-94f5-d0e950072e69 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/action" status: 202 len: 0 microversion: 2.20 time: 0.408761 Jun 25 21:20:29.203212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2728/5914] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:20:28 2022] POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:20:29.214674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:29.215556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:29.222832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:29.223588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:29.225834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:29.227474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:29.504047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:29.527339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:29.530852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:29.533298 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfbbae63-3f9a-40d7-98c2-af17aa4ae66e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.324596 Jun 25 21:20:29.534567 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3187/5915] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:29 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:30.555584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:30.556358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:30.566813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:30.567595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:30.569518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:30.570130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:30.928211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:30.929688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:30.937954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:30.938704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:30.939837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:30.940482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:31.168884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:31.182218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5910503e-a53c-4997-af87-9955f21eb436 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1564 microversion: 2.1 time: 0.260482 Jun 25 21:20:31.184275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3188/5916] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:20:30 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1564 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:20:31.192988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8db753ab-2b79-48a5-8574-9852cfe0451d req-64f696b6-cca6-41a3-b8ba-2865d6a3486c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:31.215012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8db753ab-2b79-48a5-8574-9852cfe0451d req-64f696b6-cca6-41a3-b8ba-2865d6a3486c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:31.219513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8db753ab-2b79-48a5-8574-9852cfe0451d req-64f696b6-cca6-41a3-b8ba-2865d6a3486c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:31.247337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8db753ab-2b79-48a5-8574-9852cfe0451d req-64f696b6-cca6-41a3-b8ba-2865d6a3486c service nova] Creating event network-changed:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:20:31.273598 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8db753ab-2b79-48a5-8574-9852cfe0451d req-64f696b6-cca6-41a3-b8ba-2865d6a3486c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085862 Jun 25 21:20:31.274297 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3189/5917] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:31.426489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:31.440453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:31.443016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:31.444170 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e29237c-86ce-4f48-b999-870985b9b5b6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.894288 Jun 25 21:20:31.445318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2729/5918] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:30 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:32.474739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:32.481835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:32.503582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:32.504040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:32.509129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:32.509732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:32.764555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:32.777581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:32.779631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:32.781338 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24715138-86a4-4694-aab7-e1ec979ac938 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.318561 Jun 25 21:20:32.790704 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3190/5919] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:32 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:33.799166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:33.799769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:33.807117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:33.807562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:33.808578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:33.809016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:33.829010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:33.982401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:33.991184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:33.992733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:33.993919 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab176eab-983b-4e50-9284-4b9a655bfeba tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.198893 Jun 25 21:20:33.994499 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2730/5920] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:33 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:20:35.013274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:35.013932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:35.022732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:35.023081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:35.024068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:35.024723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:35.167916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:35.178151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:35.180042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:35.181395 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1307265-10cf-4900-92fe-9455545f304b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.172389 Jun 25 21:20:35.193588 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3191/5921] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:35 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:36.199795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:36.200475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:36.214924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:36.215388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:36.216164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:36.216722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:36.446059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:36.459842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:36.463072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:36.464845 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ed14088-e39f-4946-80ac-3051d1d11cb4 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.269549 Jun 25 21:20:36.466468 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2731/5922] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:36 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:37.483285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:37.485186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:37.492537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:37.492974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:37.493934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:37.494391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:37.755632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:37.764399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:37.766030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:37.767399 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d8f47f3-4671-4289-bcaa-9e6d6b6eeb50 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.288182 Jun 25 21:20:37.768074 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3192/5923] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:37 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:38.785775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:38.786471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:38.810482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:38.810931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:38.820462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:38.820462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:39.089690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:39.099195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:39.100775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:39.102010 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0e492b42-6dc5-4f45-81ef-539f49bde82d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.320645 Jun 25 21:20:39.102859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2732/5924] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:38 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:40.121230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:40.121855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:40.124827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:40.130746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:40.131173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:40.131942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:40.132592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:40.313768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:40.322289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:40.324223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:40.325486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4be71707-8f58-4c92-94d7-20ae84bbc262 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1745 microversion: 2.20 time: 0.208428 Jun 25 21:20:40.326239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3193/5925] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:40 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1745 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:41.351150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:41.351776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:41.359543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:41.361301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:41.362735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:41.363162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:41.552359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:41.561102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:41.562646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:41.564034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e7a82a5-6edb-444b-8a96-d9153126a701 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1745 microversion: 2.20 time: 0.216789 Jun 25 21:20:41.569101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2733/5926] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:41 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:42.583148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:42.584371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:42.603926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:42.604786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:42.607317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:42.609442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:43.379374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:43.402863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:43.404774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:43.406197 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6721c83c-0dd9-47d9-a9ce-1659764854e3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.827631 Jun 25 21:20:43.406924 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3194/5927] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:42 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:44.428458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:44.431077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:44.452225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:44.453143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:44.454357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:44.456699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:44.746910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7c9f3cd3-4d40-4f3f-ad0e-14e9b4afc530 req-eda0e302-a6e0-4d35-9f69-e374a146b84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "name": "network-vif-plugged", "status": "completed", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:44.783080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7c9f3cd3-4d40-4f3f-ad0e-14e9b4afc530 req-eda0e302-a6e0-4d35-9f69-e374a146b84b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:44.787253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7c9f3cd3-4d40-4f3f-ad0e-14e9b4afc530 req-eda0e302-a6e0-4d35-9f69-e374a146b84b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:44.823652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:44.837691 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7c9f3cd3-4d40-4f3f-ad0e-14e9b4afc530 req-eda0e302-a6e0-4d35-9f69-e374a146b84b service nova] Creating event network-vif-plugged:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch1-master-1 Jun 25 21:20:44.838248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:44.839965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:44.841691 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c975d9ea-3928-4e5a-a6c3-07f15af8ec94 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.419783 Jun 25 21:20:44.852796 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7c9f3cd3-4d40-4f3f-ad0e-14e9b4afc530 req-eda0e302-a6e0-4d35-9f69-e374a146b84b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108101 Jun 25 21:20:44.855046 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2734/5929] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:44 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:44.855260 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3195/5929] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:45.866199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:45.868198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:45.877600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:45.878450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:45.879501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:45.880273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:46.118275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:46.157309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:46.163150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:46.170233 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-78dc6c24-e31d-4a0d-8377-1d65bf13c3a3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.310556 Jun 25 21:20:46.172592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3196/5930] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:45 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:20:47.192697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:47.194749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:47.197036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:47.213813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:47.214264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:47.218413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:47.218871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:47.580058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:47.596339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:47.597968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:47.599242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d9c8ebde-f5be-476b-9f05-c03b8f19c131 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.413666 Jun 25 21:20:47.610732 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2735/5931] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:47 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:48.619715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:48.620530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:48.639741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:48.640774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:48.642219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:48.643917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:48.971061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:48.983458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:48.985541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:48.989846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5fd43835-3b15-41d5-b6f0-3f4632faaf04 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.374851 Jun 25 21:20:48.992829 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3197/5932] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:48 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:50.010024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:50.011317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:50.027158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:50.034204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:50.035287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:50.035886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:50.267871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:50.282342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:50.285656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:50.292554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5822ded-41fc-4981-ba5c-741a3fc76b5b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.286517 Jun 25 21:20:50.304143 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2736/5933] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:50 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:51.311441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:51.312102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:51.322809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:51.323534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:51.324650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:51.325301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:51.330694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=93 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:20:51.851899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:51.864474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:51.868939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:51.871880 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-806f11da-d012-4650-9fb1-21a419cf722a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.564621 Jun 25 21:20:51.890582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3198/5934] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:51 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:52.591098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:52.593122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:52.614237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:52.615264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:52.616385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:52.617109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:52.672448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ad908a7-bd45-4d73-8522-407243a37475 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action" status: 200 len: 24571 microversion: 2.1 time: 0.085031 Jun 25 21:20:52.679582 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2737/5935] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:20:52 2022] POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:20:52.890826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:52.892153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:52.910492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:52.911191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:52.912169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:52.912791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:53.225985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:53.239405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:53.243125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:53.245070 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6aa8ce8-3b76-445a-bb67-2939ef949b05 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.358279 Jun 25 21:20:53.256173 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3199/5936] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:52 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:54.277682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:54.278456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:54.314766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:54.340681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:54.347490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:54.348016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:54.632603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:54.646737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:54.648822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:54.657769 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-068160b2-2974-4876-8143-68b909add3be tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.397139 Jun 25 21:20:54.659106 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2738/5937] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:54 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:55.676655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:55.677791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:55.688793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:55.690018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:55.691409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:55.695189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:56.590897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:56.625697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:56.626873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:56.627734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:56.635567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:56.638548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c1cbfd1-3db9-4441-958b-f91e614e497c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.965942 Jun 25 21:20:56.642195 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3200/5938] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:55 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:56.645904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:56.647951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:56.649830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:56.654497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:56.741078 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-048641be-0bca-4f37-8acb-9ebae9fee3a5 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/ips" status: 200 len: 149 microversion: 2.1 time: 0.662242 Jun 25 21:20:56.743847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2739/5939] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:20:56 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/ips => generated 149 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:20:57.670475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:57.671114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:57.750638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:57.752706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:57.753537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:57.753984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:58.103256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6c89cbba-73be-4416-abd9-7ae454f8d32c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: .version_select at 0x7f984fcabf70>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2142713608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNx3mZMkTt0Hz7xRpwxouh2407nelyFxrm/TXl6wltn3dtP+1Fd87vyaZjeR8vcaEReeexBTyKvPA3l8CU36AI+SeCTd42MUEwByXHJR7ajchxlKWu7kB4v5ceZb5udgw=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:58.154935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6c89cbba-73be-4416-abd9-7ae454f8d32c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:20:58.176983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-6c89cbba-73be-4416-abd9-7ae454f8d32c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:20:58.250988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6c89cbba-73be-4416-abd9-7ae454f8d32c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.150162 Jun 25 21:20:58.252883 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2740/5940] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:20:58 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:20:58.351915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:58.375091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:58.380552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:20:58.383006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1990acd-edde-4d91-8c56-add3a5af5fe8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.726438 Jun 25 21:20:58.387505 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3201/5941] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:57 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:20:58.673500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "184c4f9a-38f6-4599-92b2-25ca10393308"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:20:58.674725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:58.693984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:58.694467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:58.697373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:58.703985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:59.376866 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f737147a-0725-4f46-bda6-a58c685e66fb tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "POST /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705941 Jun 25 21:20:59.379187 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2741/5942] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:20:58 2022] POST /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments => generated 194 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:20:59.411263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:20:59.411921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:20:59.430744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:59.431208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:20:59.436895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:20:59.437580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:00.211429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:00.232907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:00.242709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:00.247890 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88e93e0b-2acf-4e0b-8d36-1a571ccbe36d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.841420 Jun 25 21:21:00.255023 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3202/5943] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:20:59 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:00.753104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-446066909", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "2dba584b-76ef-4e6e-9d79-fc374da0d3b1"}], "key_name": "tempest-TestNetworkBasicOps-2142713608", "security_groups": [{"name": "tempest-secgroup-smoke-676865230"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:01.058537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] validate_networks() for [('2dba584b-76ef-4e6e-9d79-fc374da0d3b1', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:21:01.275225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:01.275850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:01.299647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:01.300157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:01.300999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:01.301444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:02.122725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:21:02.123845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:21:02.124527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:21:02.125313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:21:02.126585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:21:02.144173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:02.149043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:02.149548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:02.150626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:02.151076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:02.162881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:02.167061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:02.171015 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd2e95f0-9837-453b-bfae-ea2abba0283e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1740 microversion: 2.20 time: 0.899724 Jun 25 21:21:02.174016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3203/5944] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:01 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1740 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:02.208300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:21:02.218282 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:21:02.271204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:21:02.274618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:21:02.407427 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4573f0d-9e37-477d-bc8e-59ef0f0b0e8c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.660092 Jun 25 21:21:02.423101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1828cad-187a-4d7b-a01b-28776074b52f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:02.424448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1828cad-187a-4d7b-a01b-28776074b52f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:02.430826 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2742/5945] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:21:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:21:02.589376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1828cad-187a-4d7b-a01b-28776074b52f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:02.627643 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1828cad-187a-4d7b-a01b-28776074b52f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1248 microversion: 2.1 time: 0.209183 Jun 25 21:21:02.639655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3204/5946] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:02 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1248 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:03.193167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:03.193659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:03.213494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.213940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.214712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.215148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.571751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:03.584151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:03.586036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:03.587331 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48b72f52-d106-4fcd-9bcc-dbef218c4ef8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1722 microversion: 2.20 time: 0.398864 Jun 25 21:21:03.588114 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2743/5947] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:03 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:03.646609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:03.647236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:03.657719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.658213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.660789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.661263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.783490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:03.785121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:03.795226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.797653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.798636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:03.800982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:03.890039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:03.903689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:21:03.904853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:21:03.905339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:21:03.905750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:21:03.906169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:21:03.981987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:04.004353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.005223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.006219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.006884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.041230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-867bcc0c-b239-4730-89c9-9f8a4310c14a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action" status: 202 len: 1137 microversion: 2.1 time: 0.261804 Jun 25 21:21:04.042562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2744/5948] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:21:03 2022] POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action => generated 1137 bytes in 264 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jun 25 21:21:04.080324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:04.081044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:04.105884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.106922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.108037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.110846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.174245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:04.182460 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37cf9108-98cc-4fd4-9414-e9b18d4c8214 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1244 microversion: 2.1 time: 0.540323 Jun 25 21:21:04.183416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3205/5949] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:03 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1244 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:04.215455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:04.215967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:04.222245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.222803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.223502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.223926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.279762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:04.289901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfcba1d8-e61c-415e-92fc-ef815fe1da65 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.232108 Jun 25 21:21:04.291557 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2745/5950] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:04 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:04.313257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lazy-loading 'services' on Instance uuid be347555-cec7-48c7-b4f7-8aabd1e61d84 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:21:04.389792 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d82fc84e-e689-4bc3-abed-5ad528a3ef7e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments/184c4f9a-38f6-4599-92b2-25ca10393308" status: 202 len: 0 microversion: 2.1 time: 0.178140 Jun 25 21:21:04.390426 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3206/5951] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:21:04 2022] DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments/184c4f9a-38f6-4599-92b2-25ca10393308 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:21:04.407217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:04.410153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:04.421215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.421850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.423166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.424486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.495855 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-26dc89ed-94bc-4f84-aa95-d31d3c3dfd2e tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100614 Jun 25 21:21:04.497766 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2746/5952] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:21:04 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:21:04.609646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:04.610350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:04.622841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.624563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.627396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:04.628687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:04.992729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.004816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.006816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.008182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a171992b-e847-46a6-b5f0-e4f102f54be3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1722 microversion: 2.20 time: 0.404100 Jun 25 21:21:05.009306 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3207/5953] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:04 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:21:05.204486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:05.205404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:05.215513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.216203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.217123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.217657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.307631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:05.308254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:05.314909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.315582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.320577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.320873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.321762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.333247 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ab23ffac-e336-4412-a150-3a8bf5c7870a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1300 microversion: 2.1 time: 0.133415 Jun 25 21:21:05.336098 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2747/5954] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:05 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:05.513525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:05.515361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:05.524204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.527148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.528907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.534445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.572137 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f50c22b5-4592-4f64-9229-6f7e583b74ad tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065842 Jun 25 21:21:05.577418 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2748/5955] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:21:05 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:21:05.648841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:05.651690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:05.661579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.662469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.664263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.665113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.696392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:21:05.759425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.781124 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d08a611-c067-404d-a337-c4754db36829 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 204 len: 0 microversion: 2.1 time: 0.138045 Jun 25 21:21:05.784448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2603958a-38ac-4a3b-bc76-5610cc944aa1 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.479370 Jun 25 21:21:05.787019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2749/5956] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:05 2022] DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:21:05.792100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:05.792929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:05.800267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3208/5957] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:05 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:05.800592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.801350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.802354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:05.803232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:05.943372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:05.951426 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c32bf5f4-42c2-46f3-9aa8-a58719133eb1 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1681 microversion: 2.1 time: 0.163507 Jun 25 21:21:05.952012 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2750/5958] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:05 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:06.027539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:06.028156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:06.035067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.035773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.036622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.037066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.330849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:06.339949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:06.341315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:06.343041 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80841b8c-2027-4167-b499-a4446d1bf367 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1665 microversion: 2.20 time: 0.319724 Jun 25 21:21:06.343628 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3209/5959] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:06 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1665 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:06.352259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:06.353737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:06.361716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.362394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.363262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ea084b5-50f4-4ac2-a042-fe961b762368"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:06.363639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.364085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.365083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:06.372762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.373688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.374861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.375503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.453813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:06.465234 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3956fff-87f3-46d6-969e-e7eeee417420 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1306 microversion: 2.1 time: 0.116528 Jun 25 21:21:06.475578 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2751/5960] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:06 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:06.736293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-7d9905a9-2c84-4702-a4a3-1a65184cc716 req-1c69cc35-efa8-42e2-b767-6787e8c00bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "name": "network-vif-unplugged", "status": "completed", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:06.753586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7d9905a9-2c84-4702-a4a3-1a65184cc716 req-1c69cc35-efa8-42e2-b767-6787e8c00bb2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.756409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-7d9905a9-2c84-4702-a4a3-1a65184cc716 req-1c69cc35-efa8-42e2-b767-6787e8c00bb2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.775078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.compute.server_external_events [req-7d9905a9-2c84-4702-a4a3-1a65184cc716 req-1c69cc35-efa8-42e2-b767-6787e8c00bb2 service nova] Unable to find a host for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02. Dropping event network-vif-unplugged {{(pid=137462) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:21:06.776642 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-7d9905a9-2c84-4702-a4a3-1a65184cc716 req-1c69cc35-efa8-42e2-b767-6787e8c00bb2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044054 Jun 25 21:21:06.777584 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2752/5961] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 25 21:21:06.786912 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e4a61682-3865-400a-a3d9-fe93bd62f348 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.429566 Jun 25 21:21:06.787922 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3210/5962] 10.222.0.39 () {62 vars in 1363 bytes} [Sat Jun 25 21:21:06 2022] POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments => generated 188 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:21:06.801586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:06.802301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:06.809484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.809945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.813163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.813651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.969022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:06.969666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:06.984714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.985191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:06.986038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:06.986484 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.013345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:07.022097 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4fffcddf-b8db-45a8-8b6b-cec3172c603f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.224450 Jun 25 21:21:07.023952 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2753/5963] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:06 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:07.030173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:07.033551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:07.059342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.059806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.060641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.061087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.369267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:07.379127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16274369-77c5-4d4d-b590-bd8b42cf2180 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1681 microversion: 2.1 time: 0.414242 Jun 25 21:21:07.380291 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3211/5964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:06 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1681 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:07.425436 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-563bc5ab-5126-468c-9a86-2e1db2ce169f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments/6ea084b5-50f4-4ac2-a042-fe961b762368" status: 202 len: 0 microversion: 2.20 time: 0.399990 Jun 25 21:21:07.430118 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2754/5965] 10.222.0.39 () {60 vars in 1456 bytes} [Sat Jun 25 21:21:07 2022] DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments/6ea084b5-50f4-4ac2-a042-fe961b762368 => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:21:07.488339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:07.489042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:07.507926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.509643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.513622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.515924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.557057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:07.558074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:07.565328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.566312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.567325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.567969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.583144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:07.638561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:07.703635 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d3d91c1-3c0c-4bc6-978c-2f39f6aee11f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/action" status: 202 len: 0 microversion: 2.20 time: 0.150645 Jun 25 21:21:07.705050 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2755/5966] 10.222.0.39 () {62 vars in 1318 bytes} [Sat Jun 25 21:21:07 2022] POST /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:21:07.716172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:07.717030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:07.724900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.725447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:07.726333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:07.727485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:08.076624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.101931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.104782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.106279 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-76b91ad0-d67b-4809-a049-829d832f643f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1673 microversion: 2.20 time: 0.396335 Jun 25 21:21:08.117666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2756/5967] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:07 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1673 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:08.124495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:08.125543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:08.132819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:08.133621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:08.134619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:08.135241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:08.396731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.406731 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5dc374b4-fc77-4137-84cc-f7374acc6146 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.927307 Jun 25 21:21:08.407570 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3212/5968] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:07 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:08.414895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:08.415870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:08.423061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:08.425024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:08.426157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:08.427253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:08.451752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.466389 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8930394-bebe-45aa-a854-a93e1a676e58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.347254 Jun 25 21:21:08.468021 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2757/5969] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:08 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:08.895178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:08.911095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73cb4857-7962-46c3-b7d4-acc47f3d0a08 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1681 microversion: 2.1 time: 0.501432 Jun 25 21:21:08.912484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3213/5970] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:08 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1681 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:09.131133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:09.134749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:09.156836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.157813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:09.160516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.161297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:09.429777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:09.430406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:09.442621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.446873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:09.448736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.449357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:09.763814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:09.772845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:09.774425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:09.776131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e7f47c2-9d91-4816-8894-a435364f8e48 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1673 microversion: 2.20 time: 0.651214 Jun 25 21:21:09.797279 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2758/5971] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:09 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1673 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:21:09.813575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:09.814195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:09.840791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.842222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:09.843303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:09.845435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:10.010710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:10.021203 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f3bbcfb-75ae-4078-94da-a8f696d1b42c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.601078 Jun 25 21:21:10.030391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3214/5972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:09 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:10.047762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-57015478-3074-4cd6-9e79-1118091009b0 req-1d846c23-3d89-4e2a-b3e4-4242a110654c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19bec4d7-79fa-4d41-b851-29c4d183e351", "tag": "8c0d1de4-ef7c-4252-a737-3ff48c86a3a4"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:10.080861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-57015478-3074-4cd6-9e79-1118091009b0 req-1d846c23-3d89-4e2a-b3e4-4242a110654c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:10.081267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-57015478-3074-4cd6-9e79-1118091009b0 req-1d846c23-3d89-4e2a-b3e4-4242a110654c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:10.118126 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-57015478-3074-4cd6-9e79-1118091009b0 req-1d846c23-3d89-4e2a-b3e4-4242a110654c service nova] Creating event network-changed:8c0d1de4-ef7c-4252-a737-3ff48c86a3a4 for instance 19bec4d7-79fa-4d41-b851-29c4d183e351 on nch1-master-1 Jun 25 21:21:10.151156 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-57015478-3074-4cd6-9e79-1118091009b0 req-1d846c23-3d89-4e2a-b3e4-4242a110654c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118605 Jun 25 21:21:10.154577 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3215/5973] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:10.172668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:10.173863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:10.188511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=48 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:10.196980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:10.197624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:10.198489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:10.201234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:10.253811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:10.265277 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90a23ad4-181e-44a2-b4b0-a17ce2736a52 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.466801 Jun 25 21:21:10.266008 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2759/5974] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:09 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:10.334344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3648405427d14f91a4bb44bd81f2195b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd32f25e6afd2425db488a9387869da19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:10.351283 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7d0f2dc-6ff0-43d4-958d-099bde02bc77 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 200 len: 1613 microversion: 2.1 time: 0.194534 Jun 25 21:21:10.353475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3216/5975] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:10 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:10.815928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:10.817186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:10.826055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:10.826685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:10.827643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:10.828266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.038693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:11.039322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:11.046621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.047161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.047953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.048394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.270605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:11.271032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:11.282191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:11.284161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:11.285775 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45d4225b-77f3-4ce1-b35b-40cfc2379f91 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.474560 Jun 25 21:21:11.287119 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2760/5976] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:10 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:11.289560 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e67721f-3dbc-4dd6-b63a-b0bb7ed3afaf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.253542 Jun 25 21:21:11.290336 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3217/5977] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:11 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:11.302435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:11.303060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:11.309789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.310543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.311490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.312071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.371474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:11.372387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:11.408964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.413008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.415268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:11.416456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:11.437562 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 HTTP/1.1 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'be347555-cec7-48c7-b4f7-8aabd1e61d84'} Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:11.439736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:11.445917 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a0fe8bc-d368-4a3a-9062-0eb384e9f140 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 404 len: 111 microversion: 2.1 time: 0.074741 Jun 25 21:21:11.447776 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3218/5978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:11 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:11.455629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5689d519-b35b-4493-ac87-7c165b1536bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '.version_select at 0x7f984e7503a0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:11.502652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5689d519-b35b-4493-ac87-7c165b1536bf tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545305760" status: 202 len: 0 microversion: 2.1 time: 0.054224 Jun 25 21:21:11.504034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3219/5979] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545305760 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:21:11.793671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:11.802767 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-431dae33-ca7c-49f3-9472-7a11e2180a58 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.514147 Jun 25 21:21:11.803791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2761/5980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:11 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:12.233651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-acd44ed2-f139-40b1-997e-4c757e6174c4 req-109733dc-f1b9-4f3a-85bd-f74318728549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be347555-cec7-48c7-b4f7-8aabd1e61d84", "name": "network-vif-deleted", "tag": "30227e07-6518-4a9d-b4db-803c750469e6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:12.275104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-acd44ed2-f139-40b1-997e-4c757e6174c4 req-109733dc-f1b9-4f3a-85bd-f74318728549 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.276723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-acd44ed2-f139-40b1-997e-4c757e6174c4 req-109733dc-f1b9-4f3a-85bd-f74318728549 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.306640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:12.307253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:12.311957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:12.316226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:12.330678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-acd44ed2-f139-40b1-997e-4c757e6174c4 req-109733dc-f1b9-4f3a-85bd-f74318728549 service nova] Creating event network-vif-deleted:30227e07-6518-4a9d-b4db-803c750469e6 for instance be347555-cec7-48c7-b4f7-8aabd1e61d84 on nch2-master-1 Jun 25 21:21:12.341347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.341846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.347251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.348735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.349956 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-acd44ed2-f139-40b1-997e-4c757e6174c4 req-109733dc-f1b9-4f3a-85bd-f74318728549 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127534 Jun 25 21:21:12.354883 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3220/5981] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:12.362675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:12.363617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:12.388473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.388935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.389724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.390158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.624707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:12.707547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:12.717722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:12.719298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:12.720757 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c42f5777-7949-4d06-be6b-7fb0a0f28fd0 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.420280 Jun 25 21:21:12.721352 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2762/5982] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:12 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:12.736136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d5a46d86-64a0-40e6-a585-7256c37ca713 req-79e9f424-16fc-4972-a75e-1b0b13cd19a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:12.746069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d5a46d86-64a0-40e6-a585-7256c37ca713 req-79e9f424-16fc-4972-a75e-1b0b13cd19a3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.746798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d5a46d86-64a0-40e6-a585-7256c37ca713 req-79e9f424-16fc-4972-a75e-1b0b13cd19a3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.763717 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d5a46d86-64a0-40e6-a585-7256c37ca713 req-79e9f424-16fc-4972-a75e-1b0b13cd19a3 service nova] Creating event network-changed:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch2-master-1 Jun 25 21:21:12.769168 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d5a46d86-64a0-40e6-a585-7256c37ca713 req-79e9f424-16fc-4972-a75e-1b0b13cd19a3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039231 Jun 25 21:21:12.770164 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2763/5983] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:12.823142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:12.824178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:12.842323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.842790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.843630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:12.844088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:12.866635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:12.885340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41fb3dc8-c2b1-4ee9-b644-bc953b3ae5e2 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.528665 Jun 25 21:21:12.886805 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3221/5984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:12 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:13.106680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:13.121952 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-dbfa150d-c74f-4410-949b-076e6e11e16f tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.305312 Jun 25 21:21:13.123132 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2764/5985] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:12 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:13.739355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:13.739979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:13.753558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:13.754387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:13.755187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:13.755626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:13.909228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:13.910572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:13.927290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:13.928171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:13.929193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:13.929818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.434564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:14.447554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:14.449879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:14.451947 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1eab9039-680b-4de7-b32f-500bd284d4e8 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.717443 Jun 25 21:21:14.467353 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3222/5986] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:13 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:14.477636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:14.491092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:14.508866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.509716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.510765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.511430 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.817960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:14.831498 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-afa9bdf2-9b06-4615-bb08-46109c9dba25 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.362568 Jun 25 21:21:14.832824 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3223/5987] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:14 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:14.838568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:14.839269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:14.846785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.847457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.848600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.849198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.870852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 HTTP/1.1 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'be347555-cec7-48c7-b4f7-8aabd1e61d84'} Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:14.876668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.881099 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.883687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:14.885151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a6a700d-c2dd-464e-b4a3-01cda196b477 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 404 len: 111 microversion: 2.1 time: 0.050682 Jun 25 21:21:14.885931 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3224/5988] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:14 2022] DELETE /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:14.895695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:14.896598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: be347555-cec7-48c7-b4f7-8aabd1e61d84] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:14.903813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.904507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.905858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:14.906546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:14.924034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 HTTP/1.1 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'be347555-cec7-48c7-b4f7-8aabd1e61d84'} Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:14.926563 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. Jun 25 21:21:14.931116 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:14.932589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance be347555-cec7-48c7-b4f7-8aabd1e61d84 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:14.934001 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c3682d1e-c740-40e4-b4c8-324b5099dcea tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84" status: 404 len: 111 microversion: 2.1 time: 0.043644 Jun 25 21:21:14.934755 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3225/5989] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:14 2022] GET /compute/v2.1/servers/be347555-cec7-48c7-b4f7-8aabd1e61d84 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:14.945479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:14.962134 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbad1973-d041-4111-80ec-9c8a754f1d2d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 1.062596 Jun 25 21:21:14.963051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2765/5990] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:13 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:15.473498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:15.474873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:15.493346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:15.496596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:15.501344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:15.501916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:15.798642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:15.819053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:15.820802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:15.821990 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-018d413d-1006-4f22-a9da-a7c926dd5404 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.353791 Jun 25 21:21:15.829575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3226/5991] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:15 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:15.852910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:15.853671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:15.858016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:15.877708 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:15.878988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:15.880149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:15.882913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:15.979912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:15.980943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:15.995637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:15.996412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:15.997464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.000909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.258095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:16.259312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:16.267556 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7332a1f-6bc1-4026-a034-290bd633ba98 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.420956 Jun 25 21:21:16.268162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2766/5992] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:15 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:16.296339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:16.297396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:16.301437 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3fec107-4f99-452e-92be-f0a426aab867 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.325635 Jun 25 21:21:16.303716 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3227/5993] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:15 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:16.313599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.314067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.324775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.325657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.351759 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 HTTP/1.1 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '258dc019-3d6d-448a-819f-d7a79ad114e3'} Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:16.366591 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.370293 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.374433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:16.378312 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb66e058-782c-4349-948f-f7bdf36d0d9a tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 404 len: 111 microversion: 2.1 time: 0.096764 Jun 25 21:21:16.381440 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2767/5994] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:16 2022] DELETE /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:16.390698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:16.391531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 258dc019-3d6d-448a-819f-d7a79ad114e3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:16.402899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.403378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.407625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.408299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.434402 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 HTTP/1.1 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '258dc019-3d6d-448a-819f-d7a79ad114e3'} Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.436047 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 258dc019-3d6d-448a-819f-d7a79ad114e3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8096a4a1-706a-44e5-bd13-c905879d0c49 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3" status: 404 len: 111 microversion: 2.1 time: 0.051157 Jun 25 21:21:16.440066 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3228/5995] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:16 2022] GET /compute/v2.1/servers/258dc019-3d6d-448a-819f-d7a79ad114e3 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:16.455981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:16.457981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:16.468291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.469259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.470550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.471197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.521092 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 HTTP/1.1 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '28f89650-ba09-4528-a880-99c11aa84659'} Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:16.522997 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.526684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:16.531871 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da4abbd5-3d64-4596-ba70-f4f342d9d73f tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 404 len: 111 microversion: 2.1 time: 0.081213 Jun 25 21:21:16.536247 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2768/5996] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:16 2022] DELETE /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:16.552567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:16.553446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: 28f89650-ba09-4528-a880-99c11aa84659] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:16.575708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.577244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.580650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.582910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.631307 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 HTTP/1.1 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '28f89650-ba09-4528-a880-99c11aa84659'} Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:16.633899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:16.638782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance 28f89650-ba09-4528-a880-99c11aa84659 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:16.640217 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23eb26d1-7700-4afc-bfd4-0a9f0043fe56 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659" status: 404 len: 111 microversion: 2.1 time: 0.101245 Jun 25 21:21:16.644316 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3229/5997] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:16 2022] GET /compute/v2.1/servers/28f89650-ba09-4528-a880-99c11aa84659 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:16.847714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:16.848768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:16.875275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.893307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:16.895205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:16.916393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:17.286654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:17.288228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:17.310497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:17.311144 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:17.312282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:17.313069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:17.474789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:17.489111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:17.494997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:17.499081 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-178e9588-a599-4dff-ad61-5563bd338320 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.654665 Jun 25 21:21:17.500834 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2769/5998] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:16 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:17.510192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:17.521717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:17.542437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:17.545426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:17.546562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:17.548467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:17.706905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:17.727592 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22926aa3-fc34-49f3-90a5-ec1fb40e88fd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.445277 Jun 25 21:21:17.729613 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3230/5999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:17 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:17.983325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:18.017883 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44053788-183d-43e4-b91f-09ce24881856 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.497829 Jun 25 21:21:18.019138 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2770/6000] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:17 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:18.043473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:18.044414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:18.063060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.064759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.067425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.068345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.114375 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 HTTP/1.1 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'a3e6c722-541c-41aa-972a-83e1fe6fdc34'} Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:18.115969 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.120385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:18.123712 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c9d02ce-3202-41b1-a0f1-b252628ab0bc tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 404 len: 111 microversion: 2.1 time: 0.085025 Jun 25 21:21:18.124308 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3231/6001] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:18 2022] DELETE /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:18.135150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:18.138141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] [instance: a3e6c722-541c-41aa-972a-83e1fe6fdc34] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:18.144986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.145677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.155032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.155821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.184985 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] HTTP exception thrown: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Request method failure captured: Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 HTTP/1.1 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sCmZYK4XyM7sWaLtEhhN0bt1OoqaSlxzNnZUm_YVNMRR8PS3vsE6q7nOchIJNgmoHDomnebX7aLGBWpeT_Uj0GinqHNZWtid7R8lPLUCLx_QoqYlpnzFW7e8XfUgtBXieJZ5DRO_aFBT-bScvT69txm0uFOWhJKpl0PbNwemG9Rc8 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d32f25e6afd2425db488a9387869da19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d32f25e6afd2425db488a9387869da19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d32f25e6afd2425db488a9387869da19"}]}] Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d32f25e6afd2425db488a9387869da19 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2001135405 Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3648405427d14f91a4bb44bd81f2195b Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeNegativeTest-2001135405-project Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'a3e6c722-541c-41aa-972a-83e1fe6fdc34'} Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:18.191462 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. Jun 25 21:21:18.195379 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:21:18.198376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] Returning 404 to user: Instance a3e6c722-541c-41aa-972a-83e1fe6fdc34 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:18.199696 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8271c625-4810-4172-b82e-8d2c0f72d480 tempest-AttachVolumeNegativeTest-2001135405 tempest-AttachVolumeNegativeTest-2001135405-project] 10.222.0.39 "GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34" status: 404 len: 111 microversion: 2.1 time: 0.070465 Jun 25 21:21:18.201234 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2771/6002] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:18 2022] GET /compute/v2.1/servers/a3e6c722-541c-41aa-972a-83e1fe6fdc34 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:21:18.518829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:18.520142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:18.529376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.530257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.531534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.532203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.747909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:18.748722 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:18.759919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.763484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:18.764525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:18.766475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:19.024617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:19.039175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:19.057937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:19.059276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ab541f9-424a-4237-befb-11c6eeabbdc1 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.545484 Jun 25 21:21:19.061719 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3232/6003] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:18 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:19.094716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cec919fd-512d-4ecb-a071-6cd25ad438db req-36eee5d0-5b8b-4fa1-8b5e-ef519e4f5c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bec4d7-79fa-4d41-b851-29c4d183e351", "name": "network-vif-plugged", "status": "completed", "tag": "8c0d1de4-ef7c-4252-a737-3ff48c86a3a4"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:19.125971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cec919fd-512d-4ecb-a071-6cd25ad438db req-36eee5d0-5b8b-4fa1-8b5e-ef519e4f5c20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:19.126414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cec919fd-512d-4ecb-a071-6cd25ad438db req-36eee5d0-5b8b-4fa1-8b5e-ef519e4f5c20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:19.178221 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cec919fd-512d-4ecb-a071-6cd25ad438db req-36eee5d0-5b8b-4fa1-8b5e-ef519e4f5c20 service nova] Creating event network-vif-plugged:8c0d1de4-ef7c-4252-a737-3ff48c86a3a4 for instance 19bec4d7-79fa-4d41-b851-29c4d183e351 on nch1-master-1 Jun 25 21:21:19.196458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cec919fd-512d-4ecb-a071-6cd25ad438db req-36eee5d0-5b8b-4fa1-8b5e-ef519e4f5c20 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122168 Jun 25 21:21:19.198243 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3233/6004] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:19.250022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:19.256735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:19.268244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:19.270123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:19.271940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:19.272580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:19.430122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:19.440188 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a3f8205-5552-4feb-919e-dd0b387efbd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.696549 Jun 25 21:21:19.445143 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2772/6005] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:18 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:20.003251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:20.016685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe6c745f-8bd6-4b26-8b00-fd9b9d7ff292 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.815152 Jun 25 21:21:20.017606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3234/6006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:19 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:20.080954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:20.082455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:20.092091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:20.093193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:20.094465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:20.095250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:20.415089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:20.427665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:20.437247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:20.438954 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b04bfb1-e26c-4141-8bcc-dd53fab3d433 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.363722 Jun 25 21:21:20.440835 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2773/6007] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:20 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:20.463352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:20.464529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:20.472174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:20.473237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:20.475592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:20.476385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:20.668075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:20.678694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aaecb7a1-bf4d-4cf1-bbf8-4b571d8dd0ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.220197 Jun 25 21:21:20.688588 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3235/6008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:20 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:21.040206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:21.042986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:21.059997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.060746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:21.061917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.062604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:21.068852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:21.345424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:21.358495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0becd400-3696-411a-9205-4533f2c569ce tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1373 microversion: 2.1 time: 0.327278 Jun 25 21:21:21.373293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2774/6009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:21 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1373 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:21.458809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:21.459636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:21.479086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.482143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:21.483185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.491172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:21.507983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:21.698190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:21.698981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:21.706398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.707273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:21.708745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:21.709334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:22.186587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:22.195749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:22.202336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:22.205894 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c9f9bd69-7c5c-4b41-90a1-fe791d43358d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.751706 Jun 25 21:21:22.233295 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3236/6010] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:21 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:22.294286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:22.333848 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5a2749c-47c9-4efb-bd8a-146f6c9f0144 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1691 microversion: 2.1 time: 0.630061 Jun 25 21:21:22.335602 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2775/6011] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:21 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1691 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:22.380199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:22.380957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:22.400335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:22.400832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:22.401629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:22.402075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:22.722440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:22.733625 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f823ddc1-45b8-4995-9a2d-7e899404197a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1544 microversion: 2.1 time: 0.357274 Jun 25 21:21:22.734694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3237/6012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:22 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1544 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:22.754540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:22.755360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:22.762647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:22.763402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:22.764560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:22.765245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:23.010614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:23.018532 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-67dadf2d-7db8-46a5-8438-2f682eaaf9ee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1544 microversion: 2.1 time: 0.268154 Jun 25 21:21:23.024895 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2776/6013] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:22 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1544 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:23.232862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:23.233617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:23.252383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:23.252876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:23.253628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:23.254071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:23.354263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:23.354912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:23.377102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:23.377566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:23.378361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:23.378809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:23.829253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:23.855393 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-49f71d90-ba3c-4e8e-ba41-be113d4112ea tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1697 microversion: 2.1 time: 0.504922 Jun 25 21:21:23.855996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2777/6014] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:23 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1697 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:23.926113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:23.934714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:23.948056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:23.950153 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bca98a16-1b16-41e5-a25a-ac87ebbbbdbf tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.725857 Jun 25 21:21:23.951345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3238/6015] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:23 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:21:24.876568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:24.878741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:24.890259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:24.891016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:24.893004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:24.893671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:24.921402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d92632a8-74de-4659-a477-8e8f0fd8f5fd req-a0037b72-c069-4154-8aa6-adc77f6d1b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "name": "network-vif-unplugged", "status": "completed", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:24.955154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d92632a8-74de-4659-a477-8e8f0fd8f5fd req-a0037b72-c069-4154-8aa6-adc77f6d1b04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:24.955850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d92632a8-74de-4659-a477-8e8f0fd8f5fd req-a0037b72-c069-4154-8aa6-adc77f6d1b04 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:24.992392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d92632a8-74de-4659-a477-8e8f0fd8f5fd req-a0037b72-c069-4154-8aa6-adc77f6d1b04 service nova] Creating event network-vif-unplugged:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:21:25.012166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d92632a8-74de-4659-a477-8e8f0fd8f5fd req-a0037b72-c069-4154-8aa6-adc77f6d1b04 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095425 Jun 25 21:21:25.013442 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3239/6016] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:21:25.019291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:25.020363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:25.032067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:25.032976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:25.033932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:25.034516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:25.327764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:25.337819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e3970dcf-77fd-427a-aef3-2b673a787cd5 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1697 microversion: 2.1 time: 0.466403 Jun 25 21:21:25.338737 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2778/6017] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:24 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1697 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:25.960480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:25.975827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:25.977372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:25.978599 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-95311f95-25b5-4b38-a6fc-f748c00e8d37 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.963887 Jun 25 21:21:25.979184 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3240/6018] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:25 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:26.355631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:26.357063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:26.367976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:26.371004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:26.373392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:26.375007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:26.419457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b01a2369-2b0b-43a5-a292-ec11a47c3fff req-a46f5adf-c8d3-45d6-ab45-1b100104bc1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19bec4d7-79fa-4d41-b851-29c4d183e351", "tag": "8c0d1de4-ef7c-4252-a737-3ff48c86a3a4"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:26.435931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b01a2369-2b0b-43a5-a292-ec11a47c3fff req-a46f5adf-c8d3-45d6-ab45-1b100104bc1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:26.437481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b01a2369-2b0b-43a5-a292-ec11a47c3fff req-a46f5adf-c8d3-45d6-ab45-1b100104bc1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:26.471375 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b01a2369-2b0b-43a5-a292-ec11a47c3fff req-a46f5adf-c8d3-45d6-ab45-1b100104bc1e service nova] Creating event network-changed:8c0d1de4-ef7c-4252-a737-3ff48c86a3a4 for instance 19bec4d7-79fa-4d41-b851-29c4d183e351 on nch1-master-1 Jun 25 21:21:26.489902 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b01a2369-2b0b-43a5-a292-ec11a47c3fff req-a46f5adf-c8d3-45d6-ab45-1b100104bc1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073547 Jun 25 21:21:26.526358 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3241/6019] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:26.631609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:26.642771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cdc2bd97-0e53-4c62-bfe4-28974641fc36 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1682 microversion: 2.1 time: 0.291252 Jun 25 21:21:26.644282 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2779/6020] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:26 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1682 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:26.997720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:26.999210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:27.019303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:27.021338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:27.022819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:27.026495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:27.135318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d571ca72-e575-4e2e-a99a-fd9da5426c28 req-254cf5eb-668c-400e-91ef-b39204c9fe0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "name": "network-vif-plugged", "status": "completed", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:27.152740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d571ca72-e575-4e2e-a99a-fd9da5426c28 req-254cf5eb-668c-400e-91ef-b39204c9fe0b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:27.153893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d571ca72-e575-4e2e-a99a-fd9da5426c28 req-254cf5eb-668c-400e-91ef-b39204c9fe0b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:27.178170 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d571ca72-e575-4e2e-a99a-fd9da5426c28 req-254cf5eb-668c-400e-91ef-b39204c9fe0b service nova] Creating event network-vif-plugged:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:21:27.184082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d571ca72-e575-4e2e-a99a-fd9da5426c28 req-254cf5eb-668c-400e-91ef-b39204c9fe0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055600 Jun 25 21:21:27.187376 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2780/6021] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:21:27.416089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:27.433711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:27.435610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:27.436919 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb5690ef-6398-4053-a5a2-a4cfd5d15da6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.443470 Jun 25 21:21:27.450132 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3242/6022] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:26 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:28.471494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:28.472210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:28.481067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:28.481936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:28.483242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:28.484213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:28.774371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:28.785729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:28.788043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:28.789669 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba60b1f3-87dd-42cc-8536-b2563433779b tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.337018 Jun 25 21:21:28.794632 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2781/6023] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:28 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:29.816128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:29.817557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:29.835919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:29.840262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:29.841086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:29.841688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:30.088137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:30.099981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:30.105314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:30.107958 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ff5f485-3751-423b-8443-05dabc4229a6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.294334 Jun 25 21:21:30.124639 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3243/6024] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:29 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:31.129160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:31.129961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:31.141172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:31.142351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:31.144156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:31.144840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:31.389319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:31.398700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:31.400893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:31.402467 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b92c6a9b-5a00-4aba-bc57-6bfe80291158 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.280924 Jun 25 21:21:31.403554 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2782/6025] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:31 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:32.423243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:32.424002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:32.437838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:32.438320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:32.440520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:32.441312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:32.720280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:32.729960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:32.731613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:32.732883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d23dd08-fdcd-42e3-b978-92d0ecf05f40 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.315130 Jun 25 21:21:32.733769 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3244/6026] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:32 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:33.441863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-aa4aa866-ad7d-4f10-895e-ebdace0d336e req-49827ff2-376b-4d80-8530-699394f1741a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "name": "network-vif-plugged", "status": "completed", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:33.472505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-aa4aa866-ad7d-4f10-895e-ebdace0d336e req-49827ff2-376b-4d80-8530-699394f1741a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:33.477662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-aa4aa866-ad7d-4f10-895e-ebdace0d336e req-49827ff2-376b-4d80-8530-699394f1741a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:33.507178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-aa4aa866-ad7d-4f10-895e-ebdace0d336e req-49827ff2-376b-4d80-8530-699394f1741a service nova] Creating event network-vif-plugged:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch2-master-1 Jun 25 21:21:33.529945 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-aa4aa866-ad7d-4f10-895e-ebdace0d336e req-49827ff2-376b-4d80-8530-699394f1741a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093501 Jun 25 21:21:33.530979 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2783/6027] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:33.751628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:33.753126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:33.760860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:33.761469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:33.764477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:33.765159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:34.030870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:34.040767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:34.042740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:34.044869 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e43bab10-f26d-45a1-99ae-7f969085689d tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.297389 Jun 25 21:21:34.046068 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3245/6028] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:33 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:35.064011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:35.065116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:35.086182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:35.087926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:35.089976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:35.090444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:35.329367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:35.340304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:35.345428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:35.346671 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-385bf5e6-a780-4ade-89fc-23e3781ba10c tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1731 microversion: 2.20 time: 0.287015 Jun 25 21:21:35.362197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2784/6029] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:35 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1731 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:21:36.369752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:36.370501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:36.379758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:36.380221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:36.381060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:36.381501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:36.957122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:36.965849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:36.972216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:36.973712 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ddd70c4-1a6b-4103-99ad-3b944cc94e16 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1718 microversion: 2.20 time: 0.607939 Jun 25 21:21:36.974334 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3246/6030] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:21:36 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1718 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:21:46.942673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:46.943777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:46.946912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=37 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:46.947937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=56 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:46.955061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:46.955747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:46.956702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:46.957292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:47.014932 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f657645-a4d6-4072-8194-2ab157e70d3b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351/action" status: 200 len: 24561 microversion: 2.1 time: 0.075913 Jun 25 21:21:47.015712 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2785/6031] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:21:46 2022] POST /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351/action => generated 24561 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:21:47.330305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:47.331928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=57 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:21:47.339840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:47.340699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:47.348938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:47.349422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:47.350497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:47.351115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:47.460721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lazy-loading 'services' on Instance uuid 93f2538f-a949-49ad-9d8f-e562025f77ba {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:21:47.604129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3914f83e-cfbc-4dbd-ae25-d0df33b52ac8 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "DELETE /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba/os-volume_attachments/c02e587f-1a09-4c9f-a6d5-e94a0b4adf15" status: 202 len: 0 microversion: 2.1 time: 0.275860 Jun 25 21:21:47.605076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3247/6032] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:21:47 2022] DELETE /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba/os-volume_attachments/c02e587f-1a09-4c9f-a6d5-e94a0b4adf15 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:21:48.810653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:48.817266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:48.828307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:48.829424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:48.830222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:48.830661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:48.882021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:21:48.974493 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c17ebc00-d1a5-41a9-80b9-65d206f0a790 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "DELETE /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 204 len: 0 microversion: 2.1 time: 0.169620 Jun 25 21:21:48.975643 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2786/6033] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:21:48 2022] DELETE /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:21:48.985552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:48.986747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:49.005538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:49.006021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:49.008028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:49.008522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:49.235605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:49.245513 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7f58f179-e217-4371-9c14-90030b1e3875 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1513 microversion: 2.1 time: 0.264711 Jun 25 21:21:49.246202 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3248/6034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:48 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:21:50.272119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:50.273050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:50.280859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:50.281313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:50.282286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:50.282723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:50.524306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:50.535481 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae41cd4d-996f-446e-a95a-3cdf43546567 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1513 microversion: 2.1 time: 0.268356 Jun 25 21:21:50.536294 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2787/6035] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:50 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:50.903489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:50.904494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:50.919067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:50.920013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:50.921091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:50.922162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:50.987282 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9660305-1200-418b-bade-14e90a80cdcd tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action" status: 200 len: 24559 microversion: 2.1 time: 0.087875 Jun 25 21:21:50.988046 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3249/6036] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:21:50 2022] POST /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293/action => generated 24559 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:21:51.555117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:51.555752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:51.570080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:51.570836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:51.576338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:51.577076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:51.874260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6a5e969d-094c-48a3-8997-090dc89b561a req-1c40508a-540b-454f-bf86-12db1f014bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f2538f-a949-49ad-9d8f-e562025f77ba", "name": "network-vif-deleted", "tag": "26c6acfc-b80c-4b10-8fd5-5abb66eff316"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:21:51.895646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6a5e969d-094c-48a3-8997-090dc89b561a req-1c40508a-540b-454f-bf86-12db1f014bf0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:51.896387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6a5e969d-094c-48a3-8997-090dc89b561a req-1c40508a-540b-454f-bf86-12db1f014bf0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:51.926505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6a5e969d-094c-48a3-8997-090dc89b561a req-1c40508a-540b-454f-bf86-12db1f014bf0 service nova] Creating event network-vif-deleted:26c6acfc-b80c-4b10-8fd5-5abb66eff316 for instance 93f2538f-a949-49ad-9d8f-e562025f77ba on nch2-master-1 Jun 25 21:21:51.934312 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6a5e969d-094c-48a3-8997-090dc89b561a req-1c40508a-540b-454f-bf86-12db1f014bf0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066439 Jun 25 21:21:51.935656 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3250/6037] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:21:52.126936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '871c269a6b15425d8b79a6c653c56402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7efe5a3d7f4380b6e1ee40d4628ea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:21:52.135319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07048830-1c6f-4c22-abb0-10770a7e149f tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 200 len: 1513 microversion: 2.1 time: 0.585313 Jun 25 21:21:52.135927 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2788/6038] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:51 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 1513 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:21:53.154898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:21:53.155822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] [instance: 93f2538f-a949-49ad-9d8f-e562025f77ba] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:21:53.163004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:53.163584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:53.164877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:21:53.165544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:21:53.180494 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] HTTP exception thrown: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Request method failure captured: Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba HTTP/1.1 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3tW5P7NPMw1DRqyjcOc062RMxDjdfTNV3MOqKnqUjG7790-1FRR6AXeSSoGk9VEyLqbf7AMM2Gz75_832dKq_5IR24S5PB3i7bPdJtyAARKukUUsN8C6ox_MAhBI8Fzj9sWx2uB294gDHbf0IF-3Jpn582aWJIQwpUzyAeD4i8x2H8 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 5a7efe5a3d7f4380b6e1ee40d4628ea8 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5a7efe5a3d7f4380b6e1ee40d4628ea8"}]}] Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 5a7efe5a3d7f4380b6e1ee40d4628ea8 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-558272145 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesSnapshotTestJSON-558272145-project Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 871c269a6b15425d8b79a6c653c56402 Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesSnapshotTestJSON-558272145-project Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '93f2538f-a949-49ad-9d8f-e562025f77ba'} Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:21:53.182415 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. Jun 25 21:21:53.186498 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:21:53.188572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] Returning 404 to user: Instance 93f2538f-a949-49ad-9d8f-e562025f77ba could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:21:53.189710 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfcd5aa4-d150-47fb-a439-f931cca74429 tempest-VolumesSnapshotTestJSON-558272145 tempest-VolumesSnapshotTestJSON-558272145-project] 10.222.0.39 "GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba" status: 404 len: 111 microversion: 2.1 time: 0.040505 Jun 25 21:21:53.190527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3251/6039] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:21:53 2022] GET /compute/v2.1/servers/93f2538f-a949-49ad-9d8f-e562025f77ba => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:03.597460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:03.597993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:03.602992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:03.613137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a2aa6488-cc59-4cba-80df-78807e73d3c3 req-bca3ddbf-1d0d-4ba9-bdc2-e7a070b5c587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:03.619433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:03.624020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:03.629903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:03.640954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:03.641933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:03.645028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:03.651611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:03.658086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2aa6488-cc59-4cba-80df-78807e73d3c3 req-bca3ddbf-1d0d-4ba9-bdc2-e7a070b5c587 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:03.658762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2aa6488-cc59-4cba-80df-78807e73d3c3 req-bca3ddbf-1d0d-4ba9-bdc2-e7a070b5c587 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:03.690324 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a2aa6488-cc59-4cba-80df-78807e73d3c3 req-bca3ddbf-1d0d-4ba9-bdc2-e7a070b5c587 service nova] Creating event network-changed:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:22:03.704692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:22:03.713490 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a2aa6488-cc59-4cba-80df-78807e73d3c3 req-bca3ddbf-1d0d-4ba9-bdc2-e7a070b5c587 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104312 Jun 25 21:22:03.714866 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3252/6040] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:03.854910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-483c6025-4eb1-4075-b4a5-fe4e3ed59c0d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: .version_select at 0x7f984e8253a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1792383344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw6hVei23cAcpOQ79sr+Iq0sG7fJZvjbYls1nyxv9m3YFBveQcwKsfgGO90wvl1YML5iESs7qC21VylmIRWTjL6l5Gg3viJ3lRURVnMZmH8uhXgP8Nf+YgeSMdqaiRC+Q=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:03.875936 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a08ec30f-e656-43b0-83fa-d2de2875e2f0 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 204 len: 0 microversion: 2.1 time: 0.284027 Jun 25 21:22:03.878609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2789/6041] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:22:03 2022] DELETE /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:22:03.894820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:03.895769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-483c6025-4eb1-4075-b4a5-fe4e3ed59c0d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:22:03.898655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:03.912376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-483c6025-4eb1-4075-b4a5-fe4e3ed59c0d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:22:03.923113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:03.927614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:03.930509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:03.931501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:03.983231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-483c6025-4eb1-4075-b4a5-fe4e3ed59c0d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.134625 Jun 25 21:22:03.987003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3253/6042] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:22:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:04.353126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:04.365283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b7127eb-94ee-450f-952f-397d27869136 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1688 microversion: 2.1 time: 0.481023 Jun 25 21:22:04.366210 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2790/6043] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:03 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1688 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:05.386532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:05.388621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:05.422518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:05.436057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:05.441309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:05.442479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:06.265384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d3506cff-6827-46bf-a591-0dfc1d578443 req-96820580-47cb-401e-a8b0-b00a90cd720e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578c21c4-bafc-4095-b19b-b1e248ed1293", "name": "network-vif-deleted", "tag": "49510796-368f-47f2-9d2f-bdc1a5510f4a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:06.315964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d3506cff-6827-46bf-a591-0dfc1d578443 req-96820580-47cb-401e-a8b0-b00a90cd720e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:06.321477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d3506cff-6827-46bf-a591-0dfc1d578443 req-96820580-47cb-401e-a8b0-b00a90cd720e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:06.346790 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d3506cff-6827-46bf-a591-0dfc1d578443 req-96820580-47cb-401e-a8b0-b00a90cd720e service nova] Creating event network-vif-deleted:49510796-368f-47f2-9d2f-bdc1a5510f4a for instance 578c21c4-bafc-4095-b19b-b1e248ed1293 on nch1-master-1 Jun 25 21:22:06.360201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d3506cff-6827-46bf-a591-0dfc1d578443 req-96820580-47cb-401e-a8b0-b00a90cd720e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101550 Jun 25 21:22:06.361176 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2791/6044] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:22:06.447711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa2aaa29e0dd479283202bd6575b4c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8403c64a48460ea9cbf383240fa2a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:06.460056 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-303852f9-9c66-4b9b-b488-3e8f12476e37 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 200 len: 1621 microversion: 2.1 time: 1.079925 Jun 25 21:22:06.463492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3254/6045] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:05 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 1621 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:07.493774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:07.494514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] [instance: 578c21c4-bafc-4095-b19b-b1e248ed1293] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:07.517303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:07.518099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:07.525202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:07.525875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:07.550192 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] HTTP exception thrown: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Request method failure captured: Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 HTTP/1.1 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3oppHqyw4EeiDOlRZTssoyBnr4Fvha7OXgevHlVi_-Lo2Z8Iq2TjW5wdFnz53ddpd5IgdjOJUqfVFPdDF6ZhziXRhgRcBe3CuTOpGuDMlw8qliC1Zo9kBCF2HZU7ccN2avzoIa76kuxMJD3iDdl2bUmkbWRqsMNWpNI2_jlCuUlHsA Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ac8403c64a48460ea9cbf383240fa2a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ac8403c64a48460ea9cbf383240fa2a9"}]}] Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: ac8403c64a48460ea9cbf383240fa2a9 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-807565760 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: aa2aaa29e0dd479283202bd6575b4c25 Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-807565760-project Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '578c21c4-bafc-4095-b19b-b1e248ed1293'} Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:07.551785 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. Jun 25 21:22:07.555532 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:07.558352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Returning 404 to user: Instance 578c21c4-bafc-4095-b19b-b1e248ed1293 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:07.559497 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87a490d5-f17e-4a4d-a8d9-fdb0d6f74c4a tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293" status: 404 len: 111 microversion: 2.1 time: 0.079760 Jun 25 21:22:07.562956 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2792/6046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:07 2022] GET /compute/v2.1/servers/578c21c4-bafc-4095-b19b-b1e248ed1293 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:22:07.591585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-859862120", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "1edc3ba6-18f2-4a5c-b5c1-1bc0ece61be0"}], "key_name": "tempest-TestNetworkBasicOps-1792383344", "security_groups": [{"name": "tempest-secgroup-smoke-609890237"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:07.998148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] validate_networks() for [('1edc3ba6-18f2-4a5c-b5c1-1bc0ece61be0', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:22:09.487969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:22:09.489087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:22:09.489742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:22:09.490302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:22:09.490862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:22:09.516931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:09.517386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:09.518182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:09.518616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:09.627379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:22:09.654313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:22:09.710243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:22:09.710243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:22:09.898401 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c62e990-5164-4004-89da-0cf5843e62d8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.312930 Jun 25 21:22:09.913053 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3255/6047] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:22:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:22:09.914324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bdb0dd1b-4760-468d-ad0a-3ca2109e1620 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:09.915052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bdb0dd1b-4760-468d-ad0a-3ca2109e1620 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:10.084784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bdb0dd1b-4760-468d-ad0a-3ca2109e1620 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:10.094972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bdb0dd1b-4760-468d-ad0a-3ca2109e1620 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1248 microversion: 2.1 time: 0.184648 Jun 25 21:22:10.099647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2793/6048] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:09 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1248 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:11.114674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:11.115356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:11.138405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:11.139200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:11.140878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:11.141568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:11.398204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:11.410205 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c6a3bda-4ceb-43fe-b47d-992a16d23bc5 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1300 microversion: 2.1 time: 0.300331 Jun 25 21:22:11.410820 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3256/6049] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:11 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1300 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:22:12.432955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:12.433583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:12.450111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:12.450581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:12.451426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:12.451862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:12.581428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:12.616998 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8cb07e02-f805-4cd2-aafa-cff0c6a19f3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1306 microversion: 2.1 time: 0.191391 Jun 25 21:22:12.617618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2794/6050] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:12 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:13.637030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:13.638516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:13.674242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:13.674942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:13.676230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:13.676862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:13.762787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:13.772640 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1c19165b-c839-4774-b8d1-a0bb707d65b7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1306 microversion: 2.1 time: 0.141586 Jun 25 21:22:13.773806 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3257/6051] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:13 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1306 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:14.790539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:14.791137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:14.814381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:14.814845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:14.815652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:14.817004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:15.098496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:15.109728 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ad0a3b3-52d8-4ab7-99b3-894cc4b60e83 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.323455 Jun 25 21:22:15.114308 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2795/6052] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:14 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:15.698318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fa68ce89-73b7-485b-98c8-f16e13d796da req-3fe08469-160b-4ade-bd93-8268d350d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c", "tag": "65ab6ce2-95a3-4e7a-a334-a32f231a8c5d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:15.713357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa68ce89-73b7-485b-98c8-f16e13d796da req-3fe08469-160b-4ade-bd93-8268d350d4bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:15.714090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fa68ce89-73b7-485b-98c8-f16e13d796da req-3fe08469-160b-4ade-bd93-8268d350d4bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:15.743429 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fa68ce89-73b7-485b-98c8-f16e13d796da req-3fe08469-160b-4ade-bd93-8268d350d4bf service nova] Creating event network-changed:65ab6ce2-95a3-4e7a-a334-a32f231a8c5d for instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c on nch2-master-1 Jun 25 21:22:15.754560 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fa68ce89-73b7-485b-98c8-f16e13d796da req-3fe08469-160b-4ade-bd93-8268d350d4bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058351 Jun 25 21:22:15.757058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3258/6053] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:16.048843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3a96cf68-8b73-40f4-858d-7a7506eeef85 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] Calling method '.version_select at 0x7f984f4b2940>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:16.070467 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3a96cf68-8b73-40f4-858d-7a7506eeef85 tempest-TestNetworkAdvancedServerOps-807565760 tempest-TestNetworkAdvancedServerOps-807565760-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1045180870" status: 202 len: 0 microversion: 2.1 time: 0.025285 Jun 25 21:22:16.076562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2796/6054] 10.222.0.39 () {58 vars in 1283 bytes} [Sat Jun 25 21:22:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1045180870 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:22:16.132338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:16.133376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:16.145408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:16.145871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:16.146666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:16.147104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:16.748910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:16.762437 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8631e21-a4ee-47e5-b200-8d7f84613e76 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.635434 Jun 25 21:22:16.764250 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3259/6055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:16 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:17.779625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:17.780955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:17.804671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:17.805236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:17.806116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:17.806942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:18.096063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:18.108654 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16e67cd3-b127-430e-89a8-77a4650f9f32 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.332953 Jun 25 21:22:18.109964 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2797/6056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:17 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:19.126707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:19.128580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:19.144921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:19.145631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:19.148761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:19.149396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:19.458531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:19.471400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d5f9d09e-9f7f-4d43-9791-4bbcf2839c3a tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.348929 Jun 25 21:22:19.480328 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3260/6057] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:19 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:20.499770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:20.501340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:20.509344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:20.518749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:20.519528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:20.520793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:20.521475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:20.927618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:20.937645 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d983d74-6951-4522-aa3f-d3ba6606fed7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.442855 Jun 25 21:22:20.939202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2798/6058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:20 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:21.956244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:21.960814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:21.974196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:21.977487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:21.981345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:21.982549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:21.988600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:21.991500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:22.373052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:22.410759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37085ce9-fd1e-4383-a573-7dbbaf4996be tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.457188 Jun 25 21:22:22.413591 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3261/6059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:21 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:22.431315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-9d3d96a4-b926-46ab-aee6-21661e829f0f req-118f8ed5-9618-4961-a34f-fedc5515c769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c", "name": "network-vif-plugged", "status": "completed", "tag": "65ab6ce2-95a3-4e7a-a334-a32f231a8c5d"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:22.454792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9d3d96a4-b926-46ab-aee6-21661e829f0f req-118f8ed5-9618-4961-a34f-fedc5515c769 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:22.455180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-9d3d96a4-b926-46ab-aee6-21661e829f0f req-118f8ed5-9618-4961-a34f-fedc5515c769 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:22.477060 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-9d3d96a4-b926-46ab-aee6-21661e829f0f req-118f8ed5-9618-4961-a34f-fedc5515c769 service nova] Creating event network-vif-plugged:65ab6ce2-95a3-4e7a-a334-a32f231a8c5d for instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c on nch2-master-1 Jun 25 21:22:22.483790 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-9d3d96a4-b926-46ab-aee6-21661e829f0f req-118f8ed5-9618-4961-a34f-fedc5515c769 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055291 Jun 25 21:22:22.484990 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2799/6060] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:23.429955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:23.431244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:23.443549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:23.451719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:23.453341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:23.453942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:23.860967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:23.870256 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5c0f86a2-9ea0-4976-9062-3a6f3ca6e810 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1373 microversion: 2.1 time: 0.445407 Jun 25 21:22:23.871583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3262/6061] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:23 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1373 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:24.891069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:24.891778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:24.917716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:24.922600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:24.923872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:24.925647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:25.303829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:25.330309 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8a51a84-5037-4306-9c2f-5e3bbb2d7ca1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1545 microversion: 2.1 time: 0.442949 Jun 25 21:22:25.333109 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2800/6062] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:24 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1545 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:25.349034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:25.349772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:25.364230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:25.364740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:25.365527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:25.365965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:25.737634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:25.782217 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b84809d0-3ff9-4b31-b162-7abb50d82b4f tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1545 microversion: 2.1 time: 0.429243 Jun 25 21:22:25.793001 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3263/6063] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:22:25 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1545 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:37.700752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:37.701682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:37.867730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Calling method '.version_select at 0x7f984f4b2c10>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:37.869041 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:22:37.869041 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:22:37.870551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:37.871517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:37.891251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:37.892104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:37.906575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:37.907422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:37.915156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b109235-0405-44b0-b470-b91034ffdc58 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192 tempest-PortsAdminExtendedAttrsIpV6TestJSON-2019636192-project-admin] 10.222.0.39 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.216170 Jun 25 21:22:37.916656 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2801/6064] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:22:37 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:41.031953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:41.034005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:41.044405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:41.045628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=54 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:41.047495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.047946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.049476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.050422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.088369 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14647be3-92c0-4aec-93dc-a86d9664eb4f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060552 Jun 25 21:22:41.089017 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3264/6065] 10.222.0.39 () {60 vars in 1342 bytes} [Sat Jun 25 21:22:41 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:22:41.158983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:41.159524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:41.166829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.167288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.168293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.168954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.199462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:22:41.303491 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-03158707-bee3-4356-84b2-a2172ba43757 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 204 len: 0 microversion: 2.20 time: 0.148101 Jun 25 21:22:41.304342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2802/6066] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:22:41 2022] DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:22:41.313332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:41.314057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:41.320872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.321601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.322736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:41.323371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:41.568838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:41.580674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:41.582567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:41.583985 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca56b863-b681-4c59-933c-555b336a4dff tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.275288 Jun 25 21:22:41.600267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3265/6067] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:41 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 21:22:42.607253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:42.607950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:42.616338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:42.616875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:42.617636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:42.618306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:42.804778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:42.813957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:42.815739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:42.817386 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-469c03ad-9ba4-4a54-8825-c708fc6d61c3 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1724 microversion: 2.20 time: 0.214426 Jun 25 21:22:42.824215 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2803/6068] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:42 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:22:43.839407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:43.839407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:43.846132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:43.846720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:43.847592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:43.848721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:43.939078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:43.955018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:43.956179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4ff335b9-5ac4-4e21-b917-7a94f519cb1e req-0defe70b-d6dd-436a-bf55-eea06de32857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5c609-b7e5-4abe-b5b4-f3b066290a02", "name": "network-vif-deleted", "tag": "ca318a12-b889-4fbf-a965-fd8aa2f1cd64"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:43.962512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c845f86f1b6244f7a53996329294f2cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041615c7a84b47f88e21c6a4e19dd7ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:22:43.964276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d9a72b36-c78d-458b-ac28-dd1f452bba6f tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 200 len: 1656 microversion: 2.20 time: 0.131706 Jun 25 21:22:43.964955 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3266/6069] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:43 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 1656 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 21:22:43.969866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ff335b9-5ac4-4e21-b917-7a94f519cb1e req-0defe70b-d6dd-436a-bf55-eea06de32857 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:43.973497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ff335b9-5ac4-4e21-b917-7a94f519cb1e req-0defe70b-d6dd-436a-bf55-eea06de32857 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:44.006924 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4ff335b9-5ac4-4e21-b917-7a94f519cb1e req-0defe70b-d6dd-436a-bf55-eea06de32857 service nova] Creating event network-vif-deleted:ca318a12-b889-4fbf-a965-fd8aa2f1cd64 for instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 on nch2-master-1 Jun 25 21:22:44.024940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4ff335b9-5ac4-4e21-b917-7a94f519cb1e req-0defe70b-d6dd-436a-bf55-eea06de32857 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073053 Jun 25 21:22:44.025586 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2804/6070] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:44.985218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:44.986796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:44.995093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:44.995812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:44.996725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:44.997369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:45.014198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 HTTP/1.1 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'eec5c609-b7e5-4abe-b5b4-f3b066290a02'} Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:45.016237 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:45.021044 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:45.022489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:45.023418 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5aaefc17-e949-4b4a-96ee-801eaf63c47a tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 404 len: 111 microversion: 2.20 time: 0.042927 Jun 25 21:22:45.024126 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3267/6071] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:44 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:22:45.033939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8031f6b-8fb2-46d5-b52e-195058025a2e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '.version_select at 0x7f984f295af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:45.057826 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8031f6b-8fb2-46d5-b52e-195058025a2e tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-811875274" status: 204 len: 0 microversion: 2.20 time: 0.028738 Jun 25 21:22:45.063163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2805/6072] 10.222.0.39 () {60 vars in 1258 bytes} [Sat Jun 25 21:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-811875274 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 21:22:47.133361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:47.134058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:47.142654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:47.143218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:47.144087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:47.144684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:47.162624 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 HTTP/1.1 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'eec5c609-b7e5-4abe-b5b4-f3b066290a02'} Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:47.164389 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.168404 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.170823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:47.171980 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-20457c63-12f2-4778-8faa-bb094075fdd6 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 404 len: 111 microversion: 2.20 time: 0.042875 Jun 25 21:22:47.173238 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3268/6073] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:22:47 2022] DELETE /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:22:47.184685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:47.186393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: eec5c609-b7e5-4abe-b5b4-f3b066290a02] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:47.196727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:47.197521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:47.198548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:47.199149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:47.217893 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 HTTP/1.1 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'eec5c609-b7e5-4abe-b5b4-f3b066290a02'} Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.220945 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. Jun 25 21:22:47.225876 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:47.227429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance eec5c609-b7e5-4abe-b5b4-f3b066290a02 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:47.228624 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc5b51fa-ef3d-4632-aced-48d6c92015fa tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02" status: 404 len: 111 microversion: 2.20 time: 0.051041 Jun 25 21:22:47.229771 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2806/6074] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:47 2022] GET /compute/v2.1/servers/eec5c609-b7e5-4abe-b5b4-f3b066290a02 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:22:48.441033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:48.441518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:48.452280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:48.455811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:48.456740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:48.457193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:48.493455 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 HTTP/1.1 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e0092220-c4b5-40be-a315-fabad4d12562'} Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:48.501521 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.505818 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.508971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:48.512204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71b476db-e979-488e-9416-3f56f78e9d38 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 404 len: 111 microversion: 2.20 time: 0.075475 Jun 25 21:22:48.515732 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3269/6075] 10.222.0.39 () {60 vars in 1279 bytes} [Sat Jun 25 21:22:48 2022] DELETE /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:22:48.522711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:48.523334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] [instance: e0092220-c4b5-40be-a315-fabad4d12562] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:22:48.536412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:48.540907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:48.541733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:22:48.542583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:22:48.575950 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] HTTP exception thrown: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Request method failure captured: Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 HTTP/1.1 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3sFZ67Ej1IslGLspDwHZbwFlf4C58rZXIJ7k30OCReELMLQUAlnDNXNgq30V34LisINLiZOx9i9gA8D7gRwtngVn1vGI1MsNcWbEv3JjCQUiZI9wm1H8eTQX6vxtFDNiTmZgj2H5-YzyK53FDexUuNcn1l7W5acK5Z4rI0k7DLDfcc Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_041615c7a84b47f88e21c6a4e19dd7ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/041615c7a84b47f88e21c6a4e19dd7ec"}]}] Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 041615c7a84b47f88e21c6a4e19dd7ec Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-967589539 Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: c845f86f1b6244f7a53996329294f2cd Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-AttachVolumeShelveTestJSON-967589539-project Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e0092220-c4b5-40be-a315-fabad4d12562'} Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.577951 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. Jun 25 21:22:48.582601 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:22:48.589380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] Returning 404 to user: Instance e0092220-c4b5-40be-a315-fabad4d12562 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:48.590547 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-144fbbbc-d494-4d49-ba98-41361e409344 tempest-AttachVolumeShelveTestJSON-967589539 tempest-AttachVolumeShelveTestJSON-967589539-project] 10.222.0.39 "GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562" status: 404 len: 111 microversion: 2.20 time: 0.071923 Jun 25 21:22:48.593635 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2807/6076] 10.222.0.39 () {60 vars in 1276 bytes} [Sat Jun 25 21:22:48 2022] GET /compute/v2.1/servers/e0092220-c4b5-40be-a315-fabad4d12562 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:22:55.781207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Action: 'create', calling method: .version_select at 0x7f984e7f1430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1982344726", "metadata": {"Type": "work"}}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:22:56.146766 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-993ffd99-44b1-47f9-82ca-9ab5c4d0884a tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.689911 Jun 25 21:22:56.154009 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3270/6077] 10.222.0.39 () {60 vars in 1155 bytes} [Sat Jun 25 21:22:55 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 698 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 25 21:22:56.162221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f86e0ec-e8f3-43f0-aeec-5dbf212777df tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984fd0c430>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:56.231356 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f86e0ec-e8f3-43f0-aeec-5dbf212777df tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 200 len: 346 microversion: 2.1 time: 0.076232 Jun 25 21:22:56.232005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2808/6078] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:22:56 2022] GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:57.246684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8dd0ea5-244c-4a2f-a1df-c41e2ef0420b tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984e7f6b80>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:57.305725 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8dd0ea5-244c-4a2f-a1df-c41e2ef0420b tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 200 len: 347 microversion: 2.1 time: 0.064207 Jun 25 21:22:57.306343 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3271/6079] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:22:57 2022] GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 347 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:57.320089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e177243d-1499-4a7c-8300-bfbe78e26919 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984fce3d30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:57.381174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e177243d-1499-4a7c-8300-bfbe78e26919 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 200 len: 347 microversion: 2.1 time: 0.066459 Jun 25 21:22:57.383343 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2809/6080] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:22:57 2022] GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 347 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:57.398900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c5dbe232-57ed-4614-b4dc-61a8218031eb tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984e70d4c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:57.491467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c5dbe232-57ed-4614-b4dc-61a8218031eb tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 202 len: 0 microversion: 2.1 time: 0.095363 Jun 25 21:22:57.491929 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3272/6081] 10.222.0.39 () {58 vars in 1247 bytes} [Sat Jun 25 21:22:57 2022] DELETE /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:22:57.500851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f85cfd0-880c-444e-9373-ada9668f24b5 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984f5943a0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:57.577779 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f85cfd0-880c-444e-9373-ada9668f24b5 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 200 len: 346 microversion: 2.1 time: 0.081511 Jun 25 21:22:57.579545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2810/6082] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:22:57 2022] GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 346 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:22:58.589687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:58.590453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=24 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:22:58.595585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41651826-bcd7-45dc-ac80-e21170146b35 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Calling method '.version_select at 0x7f984e7f1040>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:22:58.631928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-41651826-bcd7-45dc-ac80-e21170146b35 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] HTTP exception thrown: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41651826-bcd7-45dc-ac80-e21170146b35 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Request method failure captured: Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec HTTP/1.1 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3yv9-sGSFPE6Ks_6Zx70JOOSlOh5J3DCZFm1rxoVAT6eA-w15HMaRT2X9Hc1MHgPY3fAbM4lhbrvKWJT7boAet5HR1n93ryKw0nUdFQ2DsVsnYaJo7ieHTvHUmV07H-aSOvn9NMA7dLVbRZLMi0GbZHymJbnRT7PkPTz3FTc2dnq1E Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 4aec2f850eac42b2ada24f111fcbcaff Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-VolumesGetTestJSON-1797936046 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4aec2f850eac42b2ada24f111fcbcaff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4aec2f850eac42b2ada24f111fcbcaff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4aec2f850eac42b2ada24f111fcbcaff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4aec2f850eac42b2ada24f111fcbcaff"}]}] Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-VolumesGetTestJSON-1797936046 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 4aec2f850eac42b2ada24f111fcbcaff Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-VolumesGetTestJSON-1797936046 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-VolumesGetTestJSON-1797936046-project Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 251e78d095684e13ac5404d0c1aed630 Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-VolumesGetTestJSON-1797936046-project Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: method: Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: exception: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '71df2ede-6494-4e66-a815-f8c07ea7cfec'} Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. (HTTP 404) (Request-ID: req-c23b5a60-6395-4a2e-acd2-89283fb16be3) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 21:22:58.634442 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41651826-bcd7-45dc-ac80-e21170146b35 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] Returning 404 to user: Volume 71df2ede-6494-4e66-a815-f8c07ea7cfec could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41651826-bcd7-45dc-ac80-e21170146b35 tempest-VolumesGetTestJSON-1797936046 tempest-VolumesGetTestJSON-1797936046-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec" status: 404 len: 109 microversion: 2.1 time: 0.047871 Jun 25 21:22:58.640200 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3273/6083] 10.222.0.39 () {58 vars in 1244 bytes} [Sat Jun 25 21:22:58 2022] GET /compute/v2.1/os-volumes/71df2ede-6494-4e66-a815-f8c07ea7cfec => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 21:23:05.987108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:05.988792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:05.997988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:05.999331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:06.008616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:06.009322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:06.010359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:06.010955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:06.045665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:23:06.185617 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a5e8a13-332b-4b29-ac9e-db330e97d4b1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 204 len: 0 microversion: 2.1 time: 0.202360 Jun 25 21:23:06.186338 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2811/6084] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:23:05 2022] DELETE /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:23:06.197255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:06.198850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:06.211505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:06.212342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:06.213357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:06.214402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:06.503054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:06.512796 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-be721cb2-7063-4c02-8e21-94d79a71ad10 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1551 microversion: 2.1 time: 0.321573 Jun 25 21:23:06.513637 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3274/6085] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:06 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1551 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:07.531202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:07.532185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:07.545554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:07.547964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:07.551105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:07.551892 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:07.791348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:07.823026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f8da9251-4a3a-4aeb-ac39-342e4a7255cf tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1551 microversion: 2.1 time: 0.296503 Jun 25 21:23:07.825940 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2812/6086] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:07 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1551 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:08.833278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ce4f5f0a-8c62-4e4e-bf8d-8220be707453 req-aa31be70-9aff-4d28-a59d-6a62c569d9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c", "name": "network-vif-deleted", "tag": "65ab6ce2-95a3-4e7a-a334-a32f231a8c5d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:08.845366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:08.846616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:08.878226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:08.878840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:08.880035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:08.881411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:08.889483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ce4f5f0a-8c62-4e4e-bf8d-8220be707453 req-aa31be70-9aff-4d28-a59d-6a62c569d9e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:08.889943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ce4f5f0a-8c62-4e4e-bf8d-8220be707453 req-aa31be70-9aff-4d28-a59d-6a62c569d9e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:08.939548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ce4f5f0a-8c62-4e4e-bf8d-8220be707453 req-aa31be70-9aff-4d28-a59d-6a62c569d9e6 service nova] Creating event network-vif-deleted:65ab6ce2-95a3-4e7a-a334-a32f231a8c5d for instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c on nch2-master-1 Jun 25 21:23:08.951939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ce4f5f0a-8c62-4e4e-bf8d-8220be707453 req-aa31be70-9aff-4d28-a59d-6a62c569d9e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149280 Jun 25 21:23:08.954499 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3275/6087] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:23:08.993761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:09.007163 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-727ace3d-e7b8-4b2b-aec3-35854366da4e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 200 len: 1333 microversion: 2.1 time: 0.163682 Jun 25 21:23:09.009326 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2813/6088] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:08 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:23:10.026508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:10.027472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:10.036292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:10.036988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:10.038056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:10.038622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:10.053528 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] HTTP exception thrown: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Request method failure captured: Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c HTTP/1.1 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3wsill46h9eK13YAsBE29lb9q4FjJT061mMcj61DM-3q8uD0jbzgts4pM74p3VHuupAp7TghDBCKz0iczAeCCwBKmG7jqZ8d5dNhVBtFcCiLX8yYX7gB9uVIItBqBGhYQ7uK6tEBvhsYmj07pMh1o1RboCVSzde6i_h7hlxK-aCSxw Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}] Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9ffe5cc15fe246e28cfff1fdb071dff5 Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c'} Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:23:10.055369 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Returning 404 to user: Instance 9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fc08bb53-5a59-4554-94df-ba90c2f4e3d6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c" status: 404 len: 111 microversion: 2.1 time: 0.035307 Jun 25 21:23:10.061893 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3276/6089] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:10 2022] GET /compute/v2.1/servers/9e77c3d0-e8f1-4b5a-8ddb-c2dae1e83b1c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:23:10.852049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da26717b-f2d6-46c8-bdb1-6cfc8efcdf04 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '.version_select at 0x7f984f660310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:10.898526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da26717b-f2d6-46c8-bdb1-6cfc8efcdf04 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1792383344" status: 202 len: 0 microversion: 2.1 time: 0.045955 Jun 25 21:23:10.899202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2814/6090] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1792383344 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:23:15.012323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:15.013098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:15.027735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:15.031084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:15.031905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:15.032354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:15.102793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:23:15.115917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-728e051c-5c31-42eb-9cab-ffaece712a7d req-fffd4efa-d3d6-4591-b2be-6040205219f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19bec4d7-79fa-4d41-b851-29c4d183e351", "tag": "8c0d1de4-ef7c-4252-a737-3ff48c86a3a4"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:15.153446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-728e051c-5c31-42eb-9cab-ffaece712a7d req-fffd4efa-d3d6-4591-b2be-6040205219f5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:15.162386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-728e051c-5c31-42eb-9cab-ffaece712a7d req-fffd4efa-d3d6-4591-b2be-6040205219f5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:15.178729 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-728e051c-5c31-42eb-9cab-ffaece712a7d req-fffd4efa-d3d6-4591-b2be-6040205219f5 service nova] Creating event network-changed:8c0d1de4-ef7c-4252-a737-3ff48c86a3a4 for instance 19bec4d7-79fa-4d41-b851-29c4d183e351 on nch1-master-1 Jun 25 21:23:15.193138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-728e051c-5c31-42eb-9cab-ffaece712a7d req-fffd4efa-d3d6-4591-b2be-6040205219f5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081261 Jun 25 21:23:15.198618 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2815/6091] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:23:15.350005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3181ce99-f6cc-49af-b737-ccd56f20b194 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 204 len: 0 microversion: 2.1 time: 0.341905 Jun 25 21:23:15.351024 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3277/6092] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:23:15 2022] DELETE /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:23:15.363953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:15.365518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:15.381560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:15.382441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:15.384484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:15.385151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:15.880577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:15.890812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c84865e6-ef03-4a43-9e1b-5453565ddd6c tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1669 microversion: 2.1 time: 0.533672 Jun 25 21:23:15.892416 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2816/6093] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:15 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1669 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:16.912060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:16.912784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:16.921503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:16.922129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:16.923932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:16.925528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:17.357802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:17.367758 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ab87050f-1401-444e-8577-5042fe3d45e8 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1669 microversion: 2.1 time: 0.460346 Jun 25 21:23:17.378148 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3278/6094] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:16 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1669 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:18.128085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c08247b8-b9d5-4113-8e06-dc076e364b67 req-5f890c92-7520-4b7f-9f27-4ba3fef95184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19bec4d7-79fa-4d41-b851-29c4d183e351", "name": "network-vif-deleted", "tag": "8c0d1de4-ef7c-4252-a737-3ff48c86a3a4"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:18.139885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c08247b8-b9d5-4113-8e06-dc076e364b67 req-5f890c92-7520-4b7f-9f27-4ba3fef95184 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:18.140028 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c08247b8-b9d5-4113-8e06-dc076e364b67 req-5f890c92-7520-4b7f-9f27-4ba3fef95184 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:18.163912 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c08247b8-b9d5-4113-8e06-dc076e364b67 req-5f890c92-7520-4b7f-9f27-4ba3fef95184 service nova] Creating event network-vif-deleted:8c0d1de4-ef7c-4252-a737-3ff48c86a3a4 for instance 19bec4d7-79fa-4d41-b851-29c4d183e351 on nch1-master-1 Jun 25 21:23:18.173735 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c08247b8-b9d5-4113-8e06-dc076e364b67 req-5f890c92-7520-4b7f-9f27-4ba3fef95184 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.396219 Jun 25 21:23:18.177072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2817/6095] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:23:18.389341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:18.390984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:18.402311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:18.406464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:18.407806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:18.408558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:18.510648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:18.516570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:18.517190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lazy-loading 'fault' on Instance uuid 19bec4d7-79fa-4d41-b851-29c4d183e351 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:23:18.596093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:18.604297 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb6669db-c71b-4d27-9ab8-e6dcdda657d1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 200 len: 1338 microversion: 2.1 time: 0.223160 Jun 25 21:23:18.615397 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3279/6096] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:18 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 1338 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:19.623640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:19.624461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 19bec4d7-79fa-4d41-b851-29c4d183e351] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:19.632833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:19.634462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:19.636281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:19.636897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:19.662138 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] HTTP exception thrown: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Request method failure captured: Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 HTTP/1.1 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3wsill46h9eK13YAsBE29lb9q4FjJT061mMcj61DM-3q8uD0jbzgts4pM74p3VHuupAp7TghDBCKz0iczAeCCwBKmG7jqZ8d5dNhVBtFcCiLX8yYX7gB9uVIItBqBGhYQ7uK6tEBvhsYmj07pMh1o1RboCVSzde6i_h7hlxK-aCSxw Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}] Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 9ffe5cc15fe246e28cfff1fdb071dff5 Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '19bec4d7-79fa-4d41-b851-29c4d183e351'} Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:23:19.665908 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. Jun 25 21:23:19.670075 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:23:19.673329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Returning 404 to user: Instance 19bec4d7-79fa-4d41-b851-29c4d183e351 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:23:19.674632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfc434d2-97ad-4629-b1f4-a68c7e3753ea tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351" status: 404 len: 111 microversion: 2.1 time: 0.055723 Jun 25 21:23:19.679247 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2818/6097] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:19 2022] GET /compute/v2.1/servers/19bec4d7-79fa-4d41-b851-29c4d183e351 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:23:19.973348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1567ce8e-c8e7-40d2-8172-84cb2adadb74 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '.version_select at 0x7f984ed54ca0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:20.023372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1567ce8e-c8e7-40d2-8172-84cb2adadb74 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2142713608" status: 202 len: 0 microversion: 2.1 time: 0.053811 Jun 25 21:23:20.029068 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3280/6098] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:23:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2142713608 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:23:35.404953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f9d4ec39-8df0-4637-b0f2-963f61ec0921 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: .version_select at 0x7f984f399310>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1808526179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJB4Whxhdnt33aiW+zgRzUpXU4ssuu13j38y08vNwMczKUBqz7S1SE5N5toLq50XFN71ZPq5SUrAw0eizRAv3I6OoEi3Wk9wyLQTiDO5XgVZcmz/TZ/gpcMb9dpwzGr5g=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:35.413998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:35.434246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:35.476992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f9d4ec39-8df0-4637-b0f2-963f61ec0921 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:23:35.500835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f9d4ec39-8df0-4637-b0f2-963f61ec0921 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:23:35.564217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f9d4ec39-8df0-4637-b0f2-963f61ec0921 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.161908 Jun 25 21:23:35.566057 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2819/6099] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:23:35 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:23:38.120861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:38.122108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:38.126347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1296401105", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "3fda2a1b-ceab-412b-b5cb-7638713f0714"}], "key_name": "tempest-TestNetworkBasicOps-1808526179", "security_groups": [{"name": "tempest-secgroup-smoke-1023907448"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:38.699835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] validate_networks() for [('3fda2a1b-ceab-412b-b5cb-7638713f0714', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:23:39.654131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:23:39.655870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:23:39.656769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:23:39.657313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:23:39.658024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:23:39.676578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:39.677129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:39.678197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:39.679719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:39.701077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:23:39.707157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Getting quotas for user 9ffe5cc15fe246e28cfff1fdb071dff5 and project 0293ee04883e4c2b95776200fa0b5862. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:23:39.721151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:23:39.723909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:23:39.799241 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58e210af-56dc-4404-af18-97b9d5a560fc tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.680269 Jun 25 21:23:39.801088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3281/6100] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:23:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:23:39.812582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca65ae2f-6fde-46ae-b5b6-b6df808b8f24 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:39.813851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca65ae2f-6fde-46ae-b5b6-b6df808b8f24 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:39.943145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca65ae2f-6fde-46ae-b5b6-b6df808b8f24 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:39.960687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca65ae2f-6fde-46ae-b5b6-b6df808b8f24 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1249 microversion: 2.1 time: 0.153331 Jun 25 21:23:39.962029 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2820/6101] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:39 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1249 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:40.982977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:40.984837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:41.007842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:41.008714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:41.010083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:41.011266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:41.140291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:41.152196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dc74bcf-81c7-489a-987b-1a970438d535 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1301 microversion: 2.1 time: 0.175208 Jun 25 21:23:41.153374 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3282/6102] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:40 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1301 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:42.173798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:42.176559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:42.185608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:42.186479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:42.187539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:42.188933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:42.278913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:42.291528 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59d241cc-c830-4ea3-8bb4-decd9b4db022 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1307 microversion: 2.1 time: 0.123947 Jun 25 21:23:42.292140 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2821/6103] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:42 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:43.309819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:43.310437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:43.324608 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:43.325071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:43.325866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:43.326395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:43.490182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:43.499844 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e09e688d-2a97-48b5-93af-bb2d1b6c50e1 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1307 microversion: 2.1 time: 0.194318 Jun 25 21:23:43.505313 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3283/6104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:43 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1307 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:44.522916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:44.523550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:44.536786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:44.538641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:44.541833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:44.543942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:45.156596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:45.165671 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc9faf28-93f9-4a74-b5ad-4b2b9a971a3e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.646715 Jun 25 21:23:45.166179 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2822/6105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:44 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:46.184149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:46.184824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:46.196129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:46.196620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:46.197426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:46.206513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:46.675657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:46.684319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-00a661e2-075e-4b81-afa3-b0534ad54b77 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.505623 Jun 25 21:23:46.695684 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3284/6106] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:46 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:46.961255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0535ee04-8654-4806-89ee-899df18712e5 req-a6697b7c-d652-4774-bbb3-9a8210ce1d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae", "tag": "f2daa8f5-3991-49f3-8d59-f29dbbc45603"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:46.987641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0535ee04-8654-4806-89ee-899df18712e5 req-a6697b7c-d652-4774-bbb3-9a8210ce1d56 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:46.987978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0535ee04-8654-4806-89ee-899df18712e5 req-a6697b7c-d652-4774-bbb3-9a8210ce1d56 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:47.029248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0535ee04-8654-4806-89ee-899df18712e5 req-a6697b7c-d652-4774-bbb3-9a8210ce1d56 service nova] Creating event network-changed:f2daa8f5-3991-49f3-8d59-f29dbbc45603 for instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae on nch1-master-1 Jun 25 21:23:47.040721 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0535ee04-8654-4806-89ee-899df18712e5 req-a6697b7c-d652-4774-bbb3-9a8210ce1d56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080879 Jun 25 21:23:47.040721 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2823/6107] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:23:47.703568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:47.705251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:47.719513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:47.719978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:47.723888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:47.724552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:47.937372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:47.947181 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3ac43929-f829-4072-8a8f-5b0b6564cc09 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.249179 Jun 25 21:23:47.948065 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3285/6108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:47 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:48.965877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:48.966582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:48.973279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:48.973739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:48.974501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:48.974929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:49.396204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:49.409626 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00b77f44-54e9-4d02-942f-978f98790eda tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.448928 Jun 25 21:23:49.410840 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2824/6109] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:48 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:50.427479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:50.428109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:50.432385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:50.443985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:50.449264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:50.449969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:50.451101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:50.452099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:51.042684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:51.057887 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35b85482-061c-4aa0-b712-43dc5ed287e6 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.634512 Jun 25 21:23:51.068967 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3286/6110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:50 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:52.084605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:52.087377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:52.105742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:23:52.108519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:52.109075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:52.112577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:52.115529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:52.517620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:52.527228 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c73f57d8-44b1-4616-a9f5-2ddd10386409 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.451919 Jun 25 21:23:52.537530 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2825/6111] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:52 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:53.545565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:53.546820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:53.559684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:53.561006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:53.564516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:53.565158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:54.502336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:54.523055 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-22c8b58a-3f1b-470d-89ff-1b4ca8c972a3 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.981529 Jun 25 21:23:54.524762 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3287/6112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:53 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:55.541620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:55.542979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:55.553868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:55.554698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:55.555688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:55.556411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:55.761114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:55.775618 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-00cf0701-c0f6-47c5-bb52-155b52b415de tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.238364 Jun 25 21:23:55.778264 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2826/6113] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:55 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:56.288997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e5cf6439-ef95-4ef2-9ab4-a873018a7675 req-d2bbe1e8-d672-451d-a26d-f2e6ae0f0b1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae", "name": "network-vif-plugged", "status": "completed", "tag": "f2daa8f5-3991-49f3-8d59-f29dbbc45603"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:23:56.303731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e5cf6439-ef95-4ef2-9ab4-a873018a7675 req-d2bbe1e8-d672-451d-a26d-f2e6ae0f0b1c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:56.304174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e5cf6439-ef95-4ef2-9ab4-a873018a7675 req-d2bbe1e8-d672-451d-a26d-f2e6ae0f0b1c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:56.332958 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e5cf6439-ef95-4ef2-9ab4-a873018a7675 req-d2bbe1e8-d672-451d-a26d-f2e6ae0f0b1c service nova] Creating event network-vif-plugged:f2daa8f5-3991-49f3-8d59-f29dbbc45603 for instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae on nch1-master-1 Jun 25 21:23:56.339942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e5cf6439-ef95-4ef2-9ab4-a873018a7675 req-d2bbe1e8-d672-451d-a26d-f2e6ae0f0b1c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380575 Jun 25 21:23:56.341582 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3288/6114] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:23:56.797257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:56.798104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:56.831100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:56.831567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:56.832370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:56.832845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:57.364885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:57.374347 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3ca0966f-2359-4c42-9f0c-6a24b9335b91 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1375 microversion: 2.1 time: 0.583683 Jun 25 21:23:57.375162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2827/6115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:56 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1375 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:58.393534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:58.394852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:58.410892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:58.411539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:58.412528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:58.413307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:58.997414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:59.009195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b059e9cb-7cba-4773-a45b-41d40f3a1f5d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1547 microversion: 2.1 time: 0.620959 Jun 25 21:23:59.025651 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3289/6116] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:58 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1547 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:23:59.028906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:23:59.029543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:23:59.037428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:59.037883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:59.038674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:23:59.039111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:23:59.336853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:23:59.348443 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbc77a78-a097-4262-973d-7cbff0d4644d tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1547 microversion: 2.1 time: 0.324548 Jun 25 21:23:59.349445 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2828/6117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:23:59 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1547 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:24:03.090450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a2a33d6b-6e72-4c44-a7a3-cebfb7f784d0 req-0096d260-6934-4955-bfe1-9ae8e0b2b791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae", "tag": "f2daa8f5-3991-49f3-8d59-f29dbbc45603"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:24:03.115182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2a33d6b-6e72-4c44-a7a3-cebfb7f784d0 req-0096d260-6934-4955-bfe1-9ae8e0b2b791 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:03.115912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a2a33d6b-6e72-4c44-a7a3-cebfb7f784d0 req-0096d260-6934-4955-bfe1-9ae8e0b2b791 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:03.143657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a2a33d6b-6e72-4c44-a7a3-cebfb7f784d0 req-0096d260-6934-4955-bfe1-9ae8e0b2b791 service nova] Creating event network-changed:f2daa8f5-3991-49f3-8d59-f29dbbc45603 for instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae on nch1-master-1 Jun 25 21:24:03.157948 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a2a33d6b-6e72-4c44-a7a3-cebfb7f784d0 req-0096d260-6934-4955-bfe1-9ae8e0b2b791 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178316 Jun 25 21:24:03.161745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3290/6118] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:24:23.481035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:24:23.481979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:23.484395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:23.485227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=44 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:23.491907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:23.492354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:23.493511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:23.494104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:23.566252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c7253db4-317b-4b3a-bf33-46b44e3d4008 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae/action" status: 200 len: 24566 microversion: 2.1 time: 0.089402 Jun 25 21:24:23.567336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2829/6119] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:24:23 2022] POST /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae/action => generated 24566 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:24:30.076585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:30.077369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=48 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:24:30.083795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:24:30.085238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:30.103384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:30.104194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:30.105327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:30.106980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:30.178392 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3aacfd6-68d4-4000-b8ad-ad7bb5ccaa2b tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "POST /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae/action" status: 200 len: 32633 microversion: 2.1 time: 0.104205 Jun 25 21:24:30.187937 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3291/6120] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:24:30 2022] POST /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae/action => generated 32633 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:24:32.379699 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:32.380299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:32.398483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:32.399200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:32.401055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:32.411089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9cf232f2-e1e5-488c-8a1b-6468da4c3fdc req-1d091e58-b470-43ac-9956-c0f9883e3fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae", "tag": "f2daa8f5-3991-49f3-8d59-f29dbbc45603"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:24:32.415442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:32.435329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9cf232f2-e1e5-488c-8a1b-6468da4c3fdc req-1d091e58-b470-43ac-9956-c0f9883e3fb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:32.435795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9cf232f2-e1e5-488c-8a1b-6468da4c3fdc req-1d091e58-b470-43ac-9956-c0f9883e3fb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:32.467605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:24:32.475018 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9cf232f2-e1e5-488c-8a1b-6468da4c3fdc req-1d091e58-b470-43ac-9956-c0f9883e3fb7 service nova] Creating event network-changed:f2daa8f5-3991-49f3-8d59-f29dbbc45603 for instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae on nch1-master-1 Jun 25 21:24:32.487962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9cf232f2-e1e5-488c-8a1b-6468da4c3fdc req-1d091e58-b470-43ac-9956-c0f9883e3fb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083318 Jun 25 21:24:32.490449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3292/6121] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:24:32.578738 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-84eb95f3-d204-410c-a3ee-72c84b6b2019 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 204 len: 0 microversion: 2.1 time: 0.203033 Jun 25 21:24:32.579778 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2830/6122] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:24:32 2022] DELETE /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:24:32.590545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:32.591648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:32.599447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:32.600275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:32.601682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:32.602362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:33.037177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:24:33.046196 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d2a46144-9820-4353-b165-e7382fb1485e tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1671 microversion: 2.1 time: 0.462022 Jun 25 21:24:33.061184 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3293/6123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:24:32 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1671 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:24:34.079533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:34.080245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:34.088562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:34.089314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:34.090290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:34.090897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:34.480980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:24:34.493988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59e7b9b0-cd89-4fba-a4e8-2fcb70b33ba7 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1671 microversion: 2.1 time: 0.418909 Jun 25 21:24:34.495286 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2831/6124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:24:34 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:24:35.393921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-451e2afa-52b0-40fc-bc82-0394b5a46d8f req-39123fab-03d3-490b-b9d7-edb893cd8458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae", "name": "network-vif-deleted", "tag": "f2daa8f5-3991-49f3-8d59-f29dbbc45603"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:24:35.422588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-451e2afa-52b0-40fc-bc82-0394b5a46d8f req-39123fab-03d3-490b-b9d7-edb893cd8458 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:35.423420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-451e2afa-52b0-40fc-bc82-0394b5a46d8f req-39123fab-03d3-490b-b9d7-edb893cd8458 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:35.452895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-451e2afa-52b0-40fc-bc82-0394b5a46d8f req-39123fab-03d3-490b-b9d7-edb893cd8458 service nova] Creating event network-vif-deleted:f2daa8f5-3991-49f3-8d59-f29dbbc45603 for instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae on nch1-master-1 Jun 25 21:24:35.458508 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-451e2afa-52b0-40fc-bc82-0394b5a46d8f req-39123fab-03d3-490b-b9d7-edb893cd8458 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068527 Jun 25 21:24:35.461713 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3294/6125] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:24:35.513878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:35.515162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:35.526771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:35.527205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:35.527995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:35.528510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:35.592022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:35.592590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:35.593062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lazy-loading 'fault' on Instance uuid 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:24:35.639489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ffe5cc15fe246e28cfff1fdb071dff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0293ee04883e4c2b95776200fa0b5862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:24:35.648596 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1843351-8f76-49d1-9ca6-f2b7da855fee tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 200 len: 1339 microversion: 2.1 time: 0.139293 Jun 25 21:24:35.649217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2832/6126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:24:35 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:24:36.666872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:36.668303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] [instance: 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:24:36.680266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:36.681106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:36.684705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:24:36.685399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:24:36.702409 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] HTTP exception thrown: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Request method failure captured: Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae HTTP/1.1 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3wsill46h9eK13YAsBE29lb9q4FjJT061mMcj61DM-3q8uD0jbzgts4pM74p3VHuupAp7TghDBCKz0iczAeCCwBKmG7jqZ8d5dNhVBtFcCiLX8yYX7gB9uVIItBqBGhYQ7uK6tEBvhsYmj07pMh1o1RboCVSzde6i_h7hlxK-aCSxw Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0293ee04883e4c2b95776200fa0b5862"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0293ee04883e4c2b95776200fa0b5862"}]}] Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 0293ee04883e4c2b95776200fa0b5862 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkBasicOps-1668062295 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 9ffe5cc15fe246e28cfff1fdb071dff5 Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkBasicOps-1668062295-project Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae'} Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:24:36.704308 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. Jun 25 21:24:36.710212 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:24:36.711943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Returning 404 to user: Instance 6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:24:36.712913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f92dafd-00fa-489b-8c62-bb935f582577 tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae" status: 404 len: 111 microversion: 2.1 time: 0.050624 Jun 25 21:24:36.716826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3295/6127] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:24:36 2022] GET /compute/v2.1/servers/6fb4e2a3-4ef2-4d96-9bef-2ed29f40b1ae => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:24:37.074237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b7fc2af9-0e48-4caa-8381-4584f426d5db tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] Calling method '.version_select at 0x7f984f4b65e0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:24:37.112795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b7fc2af9-0e48-4caa-8381-4584f426d5db tempest-TestNetworkBasicOps-1668062295 tempest-TestNetworkBasicOps-1668062295-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1808526179" status: 202 len: 0 microversion: 2.1 time: 0.042198 Jun 25 21:24:37.113559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2833/6128] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 21:24:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1808526179 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:25:18.354436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1761870963", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3890b137-875d-4c17-9e55-a1a15e418962", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:25:18.371752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:18.372877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=16 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:18.530582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:25:19.831075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:25:19.831716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:25:19.831971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:25:19.832380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:25:19.832862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:25:19.848417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:19.849289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:19.849694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:19.850269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:19.871630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:25:19.877120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:25:19.893929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:25:19.896353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3890b137-875d-4c17-9e55-a1a15e418962',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:25:19.987575 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-54e7edaf-7a5a-45e4-bc91-16dd6d3feb8e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.653559 Jun 25 21:25:19.989538 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3296/6129] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:25:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:25:20.006538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:20.007306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:20.014284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4aab2de3-1294-42e4-81b6-fca59f74b4e1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:20.018277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4aab2de3-1294-42e4-81b6-fca59f74b4e1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:20.105918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4aab2de3-1294-42e4-81b6-fca59f74b4e1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:20.117763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4aab2de3-1294-42e4-81b6-fca59f74b4e1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1057 microversion: 2.1 time: 0.121075 Jun 25 21:25:20.119077 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2834/6130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:19 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1057 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:21.138639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:21.140240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:21.155947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:21.156852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:21.158443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:21.159107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:21.364412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:21.379268 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eecec4cc-b8da-4a8e-ad84-8c5f77fca20e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1117 microversion: 2.1 time: 0.247744 Jun 25 21:25:21.381161 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3297/6131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:21 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1117 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:22.398492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:22.399200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:22.411849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:22.412390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:22.413310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:22.413749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:22.565039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:22.576628 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ecccf04-88f0-44fb-8ca4-568ed1e6a0eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1127 microversion: 2.1 time: 0.183043 Jun 25 21:25:22.577235 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2835/6132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:22 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1127 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:25:23.607772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:23.614935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:23.635446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:23.636571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:23.637692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:23.638991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:23.986289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:23.996159 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14e7cf7a-ab76-41a6-9e5e-c6682758db74 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1169 microversion: 2.1 time: 0.405589 Jun 25 21:25:24.000934 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3298/6133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:23 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1169 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:25.014966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-92a37f08-1f57-4701-9445-b9995880105b req-2b6affa0-c0e9-482a-a246-46bad8837be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db058622-3893-480e-afe9-04b716ba9d6b", "tag": "bca2ffbe-186e-4df9-9ccc-9a90c11673d3"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:25:25.017211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:25.018031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:25.036216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:25.038609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:25.039470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:25.039960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:25.073545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-92a37f08-1f57-4701-9445-b9995880105b req-2b6affa0-c0e9-482a-a246-46bad8837be0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:25.075318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-92a37f08-1f57-4701-9445-b9995880105b req-2b6affa0-c0e9-482a-a246-46bad8837be0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:25.092863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-92a37f08-1f57-4701-9445-b9995880105b req-2b6affa0-c0e9-482a-a246-46bad8837be0 service nova] Creating event network-changed:bca2ffbe-186e-4df9-9ccc-9a90c11673d3 for instance db058622-3893-480e-afe9-04b716ba9d6b on nch1-master-1 Jun 25 21:25:25.101262 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-92a37f08-1f57-4701-9445-b9995880105b req-2b6affa0-c0e9-482a-a246-46bad8837be0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093716 Jun 25 21:25:25.103544 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2836/6134] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:25:25.360747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:25.374927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dd35bf3-bb77-47f5-a917-dc5ed25d7fe2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1169 microversion: 2.1 time: 0.361943 Jun 25 21:25:25.382766 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3299/6135] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:25 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1169 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:25:26.410953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:26.415485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:26.434483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:26.436596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:26.437864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:26.438992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:27.053864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:27.066089 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-de7cfcce-7732-44af-a4be-4ae289aac147 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1215 microversion: 2.1 time: 0.671080 Jun 25 21:25:27.077832 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2837/6136] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:26 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1215 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:28.093872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:28.094638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:28.125738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:28.130837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:28.134525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:28.135009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:28.502121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:28.516559 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce7a9eab-9469-4e60-85eb-d39b99ee74eb tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1203 microversion: 2.1 time: 0.429649 Jun 25 21:25:28.519871 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3300/6137] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:28 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1203 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:29.537734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:29.540463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:29.550620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:29.550849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:29.552223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:29.552934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:30.117285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:30.314921 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:30.328558 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6acc2abd-1124-47a2-9e19-efa14df0550d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1203 microversion: 2.1 time: 0.794957 Jun 25 21:25:30.329500 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2838/6138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:29 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1203 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:31.347927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:31.348782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:31.361365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:31.365913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:31.371017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:31.374664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:31.376687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:31.377502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:31.595257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:31.603638 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4551bb55-06f9-493c-85c3-89bef8d824cf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1203 microversion: 2.1 time: 0.261564 Jun 25 21:25:31.607909 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3301/6139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:31 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1203 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:32.623463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:32.624069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:32.631350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:32.632080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:32.634430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:32.635057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:32.825509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:32.834955 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90cdd9ca-8ced-467d-936a-1925dcf61221 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1203 microversion: 2.1 time: 0.215337 Jun 25 21:25:32.844735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2839/6140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:32 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1203 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:33.189423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-715c5bda-4ca6-4ca0-a504-b850cb414bd8 req-f586bd6b-151f-406e-8511-8aa0e1969999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db058622-3893-480e-afe9-04b716ba9d6b", "name": "network-vif-plugged", "status": "completed", "tag": "bca2ffbe-186e-4df9-9ccc-9a90c11673d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:25:33.205172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-715c5bda-4ca6-4ca0-a504-b850cb414bd8 req-f586bd6b-151f-406e-8511-8aa0e1969999 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:33.207576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-715c5bda-4ca6-4ca0-a504-b850cb414bd8 req-f586bd6b-151f-406e-8511-8aa0e1969999 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:33.225837 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-715c5bda-4ca6-4ca0-a504-b850cb414bd8 req-f586bd6b-151f-406e-8511-8aa0e1969999 service nova] Creating event network-vif-plugged:bca2ffbe-186e-4df9-9ccc-9a90c11673d3 for instance db058622-3893-480e-afe9-04b716ba9d6b on nch1-master-1 Jun 25 21:25:33.238781 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-715c5bda-4ca6-4ca0-a504-b850cb414bd8 req-f586bd6b-151f-406e-8511-8aa0e1969999 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058684 Jun 25 21:25:33.239480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3302/6141] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:25:33.856094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:33.857467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:33.866075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:33.871153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:33.873798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:33.875337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:34.133449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:34.143430 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f98c038c-fca3-4eb4-9c83-3e7b12111a29 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1203 microversion: 2.1 time: 0.295830 Jun 25 21:25:34.145977 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2840/6142] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:33 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1203 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:35.164705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:35.165750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:35.181225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:35.183179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:35.186615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:35.188177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:35.872992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:35.883726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71e00bd6-07b9-4308-b835-45ff73baf73f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1389 microversion: 2.1 time: 0.725423 Jun 25 21:25:35.892660 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3303/6143] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:35 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1389 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:35.902353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:35.903784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:35.913253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:35.914496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:35.915799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:35.916786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:36.279503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:36.287753 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb90290b-b214-4b00-8b64-f1c1fa5a0e6e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1389 microversion: 2.1 time: 0.391494 Jun 25 21:25:36.291729 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2841/6144] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:35 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1389 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:36.306211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:36.307553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:36.321665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:36.322972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:36.323969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:36.324600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:36.632169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:36.659780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-335380b3-9c7c-40cf-a5fe-1b0bf27d1388 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1389 microversion: 2.1 time: 0.357581 Jun 25 21:25:36.670695 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3304/6145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:36 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1389 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:36.793369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:36.794001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:36.810469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:36.810933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:36.811740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:36.812189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:36.882563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:25:37.076625 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d8ce16c-6983-4c22-b762-6b266784ce47 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 204 len: 0 microversion: 2.1 time: 0.290082 Jun 25 21:25:37.084613 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2842/6146] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:25:36 2022] DELETE /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:25:37.089722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:37.090359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:37.100271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:37.100768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:37.101582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:37.102032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:37.430599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:37.442357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-61606b91-0125-46e5-84b6-d97e69f9d7f7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1395 microversion: 2.1 time: 0.354591 Jun 25 21:25:37.444150 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3305/6147] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:37 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1395 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:25:38.459727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:38.460466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:38.492710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:38.494142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:38.496680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:38.500200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:38.896796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:38.912527 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f21b849f-a02c-47ef-91e3-2b044f58b06b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1395 microversion: 2.1 time: 0.456512 Jun 25 21:25:38.920579 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2843/6148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:38 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1395 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:39.610392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-84900d49-0f00-420f-a9a9-4a5a0939f4bb req-48248600-825e-4c48-b837-7fdb0370d9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db058622-3893-480e-afe9-04b716ba9d6b", "name": "network-vif-deleted", "tag": "bca2ffbe-186e-4df9-9ccc-9a90c11673d3"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:25:39.625039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-84900d49-0f00-420f-a9a9-4a5a0939f4bb req-48248600-825e-4c48-b837-7fdb0370d9ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:39.625488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-84900d49-0f00-420f-a9a9-4a5a0939f4bb req-48248600-825e-4c48-b837-7fdb0370d9ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:39.652566 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-84900d49-0f00-420f-a9a9-4a5a0939f4bb req-48248600-825e-4c48-b837-7fdb0370d9ec service nova] Creating event network-vif-deleted:bca2ffbe-186e-4df9-9ccc-9a90c11673d3 for instance db058622-3893-480e-afe9-04b716ba9d6b on nch1-master-1 Jun 25 21:25:39.665319 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-84900d49-0f00-420f-a9a9-4a5a0939f4bb req-48248600-825e-4c48-b837-7fdb0370d9ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058458 Jun 25 21:25:39.666602 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3306/6149] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:25:39.937406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:39.937960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:39.950259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:39.953195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:39.954219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:39.956566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:40.128474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:40.198090 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-07726f8c-2b4e-4fee-9604-7dc2219790ae tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 200 len: 1188 microversion: 2.1 time: 0.262325 Jun 25 21:25:40.200870 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2844/6150] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:39 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 1188 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:41.223892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:41.224803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:41.237717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.238106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.238909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.239350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.279652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b HTTP/1.1 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'db058622-3893-480e-afe9-04b716ba9d6b'} Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.291029 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.298177 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.309824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:25:41.310927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-122fc7e2-19c4-4ef8-a214-51b65a29b795 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 404 len: 111 microversion: 2.1 time: 0.097388 Jun 25 21:25:41.315648 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3307/6151] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:41 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:25:41.415767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:41.419625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:41.431649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.434733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.435919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.439337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.491226 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b HTTP/1.1 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'db058622-3893-480e-afe9-04b716ba9d6b'} Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:25:41.496176 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:25:41.506108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2c9f001b-ef28-4217-bab1-c36603a3b121 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 404 len: 111 microversion: 2.1 time: 0.100158 Jun 25 21:25:41.509164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:41.509785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: db058622-3893-480e-afe9-04b716ba9d6b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:41.514586 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2845/6152] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:25:41 2022] DELETE /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:25:41.529913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.530877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.538561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:41.540633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:41.581224 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b HTTP/1.1 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'db058622-3893-480e-afe9-04b716ba9d6b'} Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:25:41.584921 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance db058622-3893-480e-afe9-04b716ba9d6b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:25:41.589605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-00521b3e-7e5f-4374-abf0-c1785e89d973 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b" status: 404 len: 111 microversion: 2.1 time: 0.080843 Jun 25 21:25:41.594364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3308/6153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:41 2022] GET /compute/v2.1/servers/db058622-3893-480e-afe9-04b716ba9d6b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:25:48.516896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-615561299", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "b1408ff2-4778-47fb-a800-57807e1be851", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:25:48.637528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:25:50.182095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:25:50.183263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:25:50.184100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:25:50.184884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:25:50.185646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:25:50.189188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:50.204607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:50.205383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:50.206419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:50.207092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:50.219940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:50.234416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:25:50.242083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:25:50.322697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:25:50.326080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b1408ff2-4778-47fb-a800-57807e1be851',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:25:50.548081 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [ff77ee03-829b-4f75-a380-1bbb3a6c3bff] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 21:25:51.561197 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [ff77ee03-829b-4f75-a380-1bbb3a6c3bff] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 59524. Jun 25 21:25:51.568534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f783555b-96d9-4def-b417-011629436648 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.057194 Jun 25 21:25:51.570581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2846/6154] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:25:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:25:51.582218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ee42f76-0ea1-4b67-9b97-0f6a3172f2b1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:51.583322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ee42f76-0ea1-4b67-9b97-0f6a3172f2b1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:51.585326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:51.585983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=58 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:25:51.734923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ee42f76-0ea1-4b67-9b97-0f6a3172f2b1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:51.751972 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ee42f76-0ea1-4b67-9b97-0f6a3172f2b1 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1070 microversion: 2.1 time: 0.175124 Jun 25 21:25:51.753054 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3309/6155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:51 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1070 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:52.769386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a24986c8-48d4-462d-ac52-6a2709f5782d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:52.770939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a24986c8-48d4-462d-ac52-6a2709f5782d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:52.943910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a24986c8-48d4-462d-ac52-6a2709f5782d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:52.953013 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a24986c8-48d4-462d-ac52-6a2709f5782d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1070 microversion: 2.1 time: 0.187552 Jun 25 21:25:52.953623 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2847/6156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:52 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1070 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:53.976624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa74eaaa-052b-4a8f-96db-c03720e8595a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:53.977208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa74eaaa-052b-4a8f-96db-c03720e8595a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:54.057910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fa74eaaa-052b-4a8f-96db-c03720e8595a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:54.067743 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa74eaaa-052b-4a8f-96db-c03720e8595a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1070 microversion: 2.1 time: 0.100016 Jun 25 21:25:54.070687 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3310/6157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:53 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1070 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:55.096189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0486a35-01cd-4db5-85c6-14dca1d89600 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:55.097406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0486a35-01cd-4db5-85c6-14dca1d89600 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:55.214825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0486a35-01cd-4db5-85c6-14dca1d89600 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:55.222887 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0486a35-01cd-4db5-85c6-14dca1d89600 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1070 microversion: 2.1 time: 0.140851 Jun 25 21:25:55.234072 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2848/6158] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:55 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1070 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:56.239357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:56.240805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:56.262330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:56.262786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:56.263587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:56.268508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:56.401468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:56.422695 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69c66bc8-2c70-4d97-acb7-70d6722ade3d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1120 microversion: 2.1 time: 0.186432 Jun 25 21:25:56.424010 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3311/6159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:56 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1120 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:57.439935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:57.440783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:57.448629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:57.458969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:57.461746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:57.462207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:57.690281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:57.708297 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cadfb388-98fc-4269-b250-ea6c34d6b78a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1186 microversion: 2.1 time: 0.267923 Jun 25 21:25:57.709778 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2849/6160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:57 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1186 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:58.727790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:58.729436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:58.743615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:58.744190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:58.745157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:58.747386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:58.889181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:25:58.899709 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-17408099-ad63-49b4-b0fa-16ef46bbfa9f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1186 microversion: 2.1 time: 0.176620 Jun 25 21:25:58.912165 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3312/6161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:58 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1186 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:25:59.924064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:25:59.924768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:25:59.942034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:59.943651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:25:59.945022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:25:59.946570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:00.220797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:00.287074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:00.313600 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-209f3806-a5b9-4587-813e-b52c0b615e09 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.394355 Jun 25 21:26:00.315262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2850/6162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:25:59 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:00.995719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6c55f272-c556-48bb-820b-3dff3d1db036 req-2483585f-3bcc-4755-be99-2acb87c05b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6582d227-5c6a-4da5-8465-df112e099058", "tag": "c20122e3-e332-4a1c-a496-e5426665e587"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:01.042442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c55f272-c556-48bb-820b-3dff3d1db036 req-2483585f-3bcc-4755-be99-2acb87c05b30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:01.044211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c55f272-c556-48bb-820b-3dff3d1db036 req-2483585f-3bcc-4755-be99-2acb87c05b30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:01.075867 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6c55f272-c556-48bb-820b-3dff3d1db036 req-2483585f-3bcc-4755-be99-2acb87c05b30 service nova] Creating event network-changed:c20122e3-e332-4a1c-a496-e5426665e587 for instance 6582d227-5c6a-4da5-8465-df112e099058 on nch1-master-1 Jun 25 21:26:01.097604 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6c55f272-c556-48bb-820b-3dff3d1db036 req-2483585f-3bcc-4755-be99-2acb87c05b30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106546 Jun 25 21:26:01.101323 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3313/6163] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:01.331500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:01.332861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:01.341330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:01.342059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:01.343018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:01.343610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:01.572180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:01.581118 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2daadf0a-0e99-4115-a5ca-d2630e728d14 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.253532 Jun 25 21:26:01.581694 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2851/6164] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:01 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:02.600042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:02.601568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:02.608478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:02.609267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:02.610981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:02.611715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:02.866262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:02.877457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ec293910-ae1c-4f12-9fb1-79862c7d7179 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.282679 Jun 25 21:26:02.887567 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3314/6165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:02 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:03.895307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:03.896824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:03.906910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:03.907823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:03.909057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:03.909863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:04.199099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:04.210774 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d8426f2e-8116-450a-b752-c8332947bd7b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.319707 Jun 25 21:26:04.213296 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2852/6166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:03 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:05.230209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:05.231361 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:05.235567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:05.249277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:05.254888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:05.256009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:05.256846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:05.607344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:05.617627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-28412950-da39-4a66-8cf1-d23ebbd64afd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.391563 Jun 25 21:26:05.619743 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3315/6167] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:05 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:05.979694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-608cfaae-34a7-4e8e-857c-18b2126ec898 req-ae451cc5-79bb-422b-899c-543eaf5a770e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6582d227-5c6a-4da5-8465-df112e099058", "name": "network-vif-plugged", "status": "completed", "tag": "c20122e3-e332-4a1c-a496-e5426665e587"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:05.991732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:05.995678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-608cfaae-34a7-4e8e-857c-18b2126ec898 req-ae451cc5-79bb-422b-899c-543eaf5a770e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:05.997454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-608cfaae-34a7-4e8e-857c-18b2126ec898 req-ae451cc5-79bb-422b-899c-543eaf5a770e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:06.032035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-608cfaae-34a7-4e8e-857c-18b2126ec898 req-ae451cc5-79bb-422b-899c-543eaf5a770e service nova] Creating event network-vif-plugged:c20122e3-e332-4a1c-a496-e5426665e587 for instance 6582d227-5c6a-4da5-8465-df112e099058 on nch1-master-1 Jun 25 21:26:06.038103 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-608cfaae-34a7-4e8e-857c-18b2126ec898 req-ae451cc5-79bb-422b-899c-543eaf5a770e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063077 Jun 25 21:26:06.039221 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2853/6168] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:06.636059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:06.636665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:06.644128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:06.644643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:06.645757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:06.646381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:06.942487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:06.954019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0253110-17c6-4b7e-b82c-b2074ce0e19f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1216 microversion: 2.1 time: 0.322054 Jun 25 21:26:06.965383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3316/6169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:06 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1216 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:07.972944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:07.975364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:07.983985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:07.987818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:07.988836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:07.989540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:08.493193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:08.502283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-051e00fc-84e9-41f9-9a57-9060d352a7d8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1402 microversion: 2.1 time: 0.534293 Jun 25 21:26:08.504509 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2854/6170] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:07 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1402 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:08.519734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:08.520706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:08.531283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:08.531849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:08.533775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:08.534534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:08.726871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:08.734778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a4a824ee-e890-450f-ac3d-26235b3b328e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1402 microversion: 2.1 time: 0.219472 Jun 25 21:26:08.735364 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3317/6171] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:08 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1402 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:08.751515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-144887476"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:08.752592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:08.758933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:08.759485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:08.760253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:08.761195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:08.912471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Attempting to quiesce instance before volume snapshot. Jun 25 21:26:08.975480 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jun 25 21:26:09.117752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Creating snapshot from volume b1408ff2-4778-47fb-a800-57807e1be851. {{(pid=137462) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jun 25 21:26:10.554159 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02277918-9710-403c-a01a-40fd8c0068e4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058/action" status: 202 len: 0 microversion: 2.1 time: 1.806017 Jun 25 21:26:10.555162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2855/6172] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:26:08 2022] POST /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058/action => generated 0 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 21:26:11.860013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1355578294", "imageRef": "6858fcc6-72b1-46cd-8cea-a0ae999c58ea", "flavorRef": "452", "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:11.919953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:26:12.662088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:26:12.662549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:26:12.663030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:26:12.663443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:26:12.664055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:26:12.677315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:12.678108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:12.679191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:12.679801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:12.708561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:26:12.715818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:26:12.735875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:26:12.740455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='eeaed976-f0d3-4e46-b596-c970e1db7981',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:26:12.856913 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23a05317-d2ce-4beb-8e89-4c784840aab2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.000750 Jun 25 21:26:12.858722 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3318/6173] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:26:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:26:12.872288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-34843ade-4728-43c7-8454-bbcecd7bbdc0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:12.873095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-34843ade-4728-43c7-8454-bbcecd7bbdc0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:12.999013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-34843ade-4728-43c7-8454-bbcecd7bbdc0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:13.007529 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-34843ade-4728-43c7-8454-bbcecd7bbdc0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1230 microversion: 2.1 time: 0.141815 Jun 25 21:26:13.011146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2856/6174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:12 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:14.028114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:14.028790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:14.036458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:14.036918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:14.037685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:14.038122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:14.108348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:14.132554 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a933dad7-ab62-4d04-b4fd-bcbe51d2cc36 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1282 microversion: 2.1 time: 0.096415 Jun 25 21:26:14.144638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3319/6175] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:14 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:15.154691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:15.155337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:15.180492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:15.184320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:15.185340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:15.185787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:15.721004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:15.735071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-da1ae2e7-17f8-4cdf-9d4a-7443123c85c8 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1342 microversion: 2.1 time: 0.587395 Jun 25 21:26:15.737989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2857/6176] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:15 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1342 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:16.581042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1559410c-bc67-4067-85f8-d6adc0fd942c req-7d48b5d6-9614-4e6f-8811-3ae3b0fb076b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8783077f-d905-4a1e-a8ca-a0dc143308bb", "tag": "9185fcaa-c028-40a1-897f-b2d134ee3d9f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:16.612034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1559410c-bc67-4067-85f8-d6adc0fd942c req-7d48b5d6-9614-4e6f-8811-3ae3b0fb076b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:16.612497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1559410c-bc67-4067-85f8-d6adc0fd942c req-7d48b5d6-9614-4e6f-8811-3ae3b0fb076b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:16.671064 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1559410c-bc67-4067-85f8-d6adc0fd942c req-7d48b5d6-9614-4e6f-8811-3ae3b0fb076b service nova] Creating event network-changed:9185fcaa-c028-40a1-897f-b2d134ee3d9f for instance 8783077f-d905-4a1e-a8ca-a0dc143308bb on nch2-master-1 Jun 25 21:26:16.678550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1559410c-bc67-4067-85f8-d6adc0fd942c req-7d48b5d6-9614-4e6f-8811-3ae3b0fb076b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101137 Jun 25 21:26:16.680270 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3320/6177] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:16.756336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:16.757005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:16.771296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:16.774424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:16.775302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:16.775763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:17.769787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:17.781526 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e9dbe051-289f-480c-928a-cd290cc7f953 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1342 microversion: 2.1 time: 1.030201 Jun 25 21:26:17.781955 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2858/6178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:16 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1342 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:18.801607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:18.803056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:18.814458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:18.815190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:18.816204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:18.816882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:19.020104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:19.035194 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-df67a133-0c63-4636-b8cf-f8d4911feddf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1342 microversion: 2.1 time: 0.239850 Jun 25 21:26:19.035922 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3321/6179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:18 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:20.052307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:20.052981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:20.066920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:20.067386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:20.068179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:20.068670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:20.383601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:20.387366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:20.394880 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5dbbe70e-8751-4c30-83b7-9811ab8814e9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.346684 Jun 25 21:26:20.395673 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2859/6180] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:20 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:21.416848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:21.418837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:21.427695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:21.428364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:21.433256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:21.433932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:21.636094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:21.638801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=59 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:21.647373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3e82babe-7067-4394-8c0f-6a4429457a58 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.237354 Jun 25 21:26:21.648540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3322/6181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:21 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:22.665300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:22.666050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:22.676487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:22.680882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:22.681404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:22.682796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:22.683682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:22.928870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:22.939290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-56afad8c-0e3a-4dfb-97e5-350ee14589b3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.278464 Jun 25 21:26:22.940471 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2860/6182] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:22 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:23.959910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:23.961967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:23.970568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.972113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.973309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:23.978398 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:23.979153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:23.980198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:23.980849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:24.235069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:24.252729 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f1896406-17bb-4704-9d54-46fb2468a5e0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.298339 Jun 25 21:26:24.254437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3323/6183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:23 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:26:25.274445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:25.275072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:25.284275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:25.291782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:25.295509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:25.296832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:25.299360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:25.695915 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:25.708077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f35ecec4-10ec-40fe-85a6-c2c6993830f5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.438062 Jun 25 21:26:25.709411 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2861/6184] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:25 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:26.725916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:26.726705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:26.741816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:26.742447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:26.744678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:26.746453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:27.109469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:27.124834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-256eeffa-639d-4e17-81ad-d04a77acc1a6 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.403421 Jun 25 21:26:27.126847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3324/6185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:26 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:27.193952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8618fc81-610d-4ede-96f5-99b7733ab41a req-6f5a7310-4e64-4625-a966-8a653a4f1534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8783077f-d905-4a1e-a8ca-a0dc143308bb", "name": "network-vif-plugged", "status": "completed", "tag": "9185fcaa-c028-40a1-897f-b2d134ee3d9f"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:27.210683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8618fc81-610d-4ede-96f5-99b7733ab41a req-6f5a7310-4e64-4625-a966-8a653a4f1534 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:27.211198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8618fc81-610d-4ede-96f5-99b7733ab41a req-6f5a7310-4e64-4625-a966-8a653a4f1534 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:27.243129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8618fc81-610d-4ede-96f5-99b7733ab41a req-6f5a7310-4e64-4625-a966-8a653a4f1534 service nova] Creating event network-vif-plugged:9185fcaa-c028-40a1-897f-b2d134ee3d9f for instance 8783077f-d905-4a1e-a8ca-a0dc143308bb on nch2-master-1 Jun 25 21:26:27.250560 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8618fc81-610d-4ede-96f5-99b7733ab41a req-6f5a7310-4e64-4625-a966-8a653a4f1534 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060470 Jun 25 21:26:27.251481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2862/6186] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:28.146918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:28.148518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:28.164908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:28.165970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:28.167383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:28.168119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:28.417321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:28.429192 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7eb1558a-76a4-4544-a979-846df8a75db5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1376 microversion: 2.1 time: 0.286056 Jun 25 21:26:28.430910 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3325/6187] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:28 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1376 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:29.448004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:29.448568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:29.457809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.458360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.459169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.459605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.631446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:29.640851 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a3948d0-4524-4009-900e-d1190080a40d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1562 microversion: 2.1 time: 0.197243 Jun 25 21:26:29.641798 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2863/6188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:29 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1562 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:29.659433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:29.660093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:29.668691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.669693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.670798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.671435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.836663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:29.844995 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ad2e6879-ff7c-4de4-be7b-308d4c3dadbc tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1562 microversion: 2.1 time: 0.190004 Jun 25 21:26:29.845753 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3326/6189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:29 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1562 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:29.927029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:29.928007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:29.935483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.936226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.937654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:29.938285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:29.985697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:26:30.118571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3cd1bd30-cff4-43de-9ff4-df6de9f8307d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 204 len: 0 microversion: 2.1 time: 0.196078 Jun 25 21:26:30.119540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2864/6190] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:26:29 2022] DELETE /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:26:30.131539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:30.132499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:30.158868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:30.159953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:30.161039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:30.164316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:30.372322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:30.380830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c461957c-17f0-4eaa-8265-2b093fb4162b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1568 microversion: 2.1 time: 0.255888 Jun 25 21:26:30.381763 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3327/6191] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:30 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:31.401507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:31.402330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:31.412560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:31.413025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:31.414041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:31.414813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:31.647151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:31.656793 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-20e5fb01-4220-44ea-b7e7-ddbdbb3068fd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1568 microversion: 2.1 time: 0.261239 Jun 25 21:26:31.657727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2865/6192] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:31 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:32.373824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-672c31ab-f60c-49af-bd91-56878618c723 req-2a512dae-09dd-4930-a396-4020adf30b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8783077f-d905-4a1e-a8ca-a0dc143308bb", "name": "network-vif-deleted", "tag": "9185fcaa-c028-40a1-897f-b2d134ee3d9f"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:32.410393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-672c31ab-f60c-49af-bd91-56878618c723 req-2a512dae-09dd-4930-a396-4020adf30b5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:32.410983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-672c31ab-f60c-49af-bd91-56878618c723 req-2a512dae-09dd-4930-a396-4020adf30b5a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:32.426037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-672c31ab-f60c-49af-bd91-56878618c723 req-2a512dae-09dd-4930-a396-4020adf30b5a service nova] Creating event network-vif-deleted:9185fcaa-c028-40a1-897f-b2d134ee3d9f for instance 8783077f-d905-4a1e-a8ca-a0dc143308bb on nch2-master-1 Jun 25 21:26:32.432884 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-672c31ab-f60c-49af-bd91-56878618c723 req-2a512dae-09dd-4930-a396-4020adf30b5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065323 Jun 25 21:26:32.433914 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3328/6193] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:32.683615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:32.686594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:32.705026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:32.712824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:32.714122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:32.714842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:32.891586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:26:32.903199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45ffce30-f303-4fb7-91f9-96fc8035b3ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 200 len: 1361 microversion: 2.1 time: 0.231068 Jun 25 21:26:32.906655 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2866/6194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:32 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:26:33.931379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:26:33.932913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:26:33.942207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:33.942763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:33.944032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:26:33.944663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:26:33.964032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb HTTP/1.1 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8783077f-d905-4a1e-a8ca-a0dc143308bb'} Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:26:33.966394 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:26:33.972668 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:26:33.974155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:26:33.975563 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6303576e-a02a-4c09-8b9e-f33a009db273 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 404 len: 111 microversion: 2.1 time: 0.054784 Jun 25 21:26:33.977045 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3329/6195] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:26:33 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:26:50.785651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:50.786431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:51.071975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f7e5596c-b76a-40bb-9e8f-c02c2fde69f9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Action: 'create', calling method: .version_select at 0x7f984f315af0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-744410256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJabHUqGWSorSjFfcjSUqzlZ/f8LHac/igbv9KAOuCmgbQ3U2uZDPbj+Tc8NwU/Av+e1OzuFvBw2RW2ZxaUzAwiQpyEzmqkDBeJKHob1liwKhKAETyyOtPxZ++51sMXWWg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:51.086801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f7e5596c-b76a-40bb-9e8f-c02c2fde69f9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for project 1578a50f2f074a0f8027d8376717a39c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:26:51.092280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f7e5596c-b76a-40bb-9e8f-c02c2fde69f9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for user 61f7e0c206e349a196bbd2c6562ee0e2 and project 1578a50f2f074a0f8027d8376717a39c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:26:51.119928 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f7e5596c-b76a-40bb-9e8f-c02c2fde69f9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.340206 Jun 25 21:26:51.120995 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2867/6196] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:26:50 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:26:58.244868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-456210428-access_point-1667796108", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "81e203c8-a7f0-4e17-adfa-7e0297bfa0dd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-744410256", "security_groups": [{"name": "tempest-secgroup_access--1209782820"}, {"name": "tempest-secgroup_general--682236023"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:26:58.276878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=13 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:58.280914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=35 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:26:58.504799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] validate_networks() for [('81e203c8-a7f0-4e17-adfa-7e0297bfa0dd', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:26:59.985770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:26:59.987052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:26:59.987736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:26:59.988309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:26:59.988948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:27:00.013605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:00.014285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:00.015431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:00.016907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:00.043887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for project 1578a50f2f074a0f8027d8376717a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:00.064252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for user 61f7e0c206e349a196bbd2c6562ee0e2 and project 1578a50f2f074a0f8027d8376717a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:00.084963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:27:00.087705 ncdv-master-1 devstack@n-api.service[137461]: WARNING nova.utils [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-456210428-access_point-1667796108 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-456210428-acc Jun 25 21:27:00.089558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:27:00.175384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-29e160bb-e7c3-4fbc-ae17-89ca90fcea73 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.935354 Jun 25 21:27:00.177633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3330/6197] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:26:58 2022] POST /compute/v2.1/servers => generated 457 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:27:00.190750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c780322-bb68-466f-8286-b59a14df363d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:00.191649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c780322-bb68-466f-8286-b59a14df363d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:00.767387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c780322-bb68-466f-8286-b59a14df363d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:00.775960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c780322-bb68-466f-8286-b59a14df363d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1293 microversion: 2.1 time: 0.591719 Jun 25 21:27:00.777735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2868/6198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:00 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1293 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:01.800405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:01.800405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:01.830782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:01.831729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:01.834337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:01.834995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:02.007374 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:02.022008 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ecc2006-5033-43af-998f-3b38c280a9b7 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1351 microversion: 2.1 time: 0.229908 Jun 25 21:27:02.033621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3331/6199] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:01 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1351 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:03.042654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:03.044288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:03.053449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:03.054539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:03.055604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:03.056491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:03.684096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:03.695811 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c899d6f1-6689-4996-86d1-e1b422df849b tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.657641 Jun 25 21:27:03.696682 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2869/6200] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:03 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:04.084044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-315a7d5b-9a92-4296-be65-62251c220576 req-6df98827-9d27-4a2a-b371-a6e9d635ab01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13d7be2-e727-4637-b045-3bab1e957c32", "tag": "c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:04.104329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-315a7d5b-9a92-4296-be65-62251c220576 req-6df98827-9d27-4a2a-b371-a6e9d635ab01 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.104810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-315a7d5b-9a92-4296-be65-62251c220576 req-6df98827-9d27-4a2a-b371-a6e9d635ab01 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.128457 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-315a7d5b-9a92-4296-be65-62251c220576 req-6df98827-9d27-4a2a-b371-a6e9d635ab01 service nova] Creating event network-changed:c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee for instance f13d7be2-e727-4637-b045-3bab1e957c32 on nch2-master-1 Jun 25 21:27:04.136592 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-315a7d5b-9a92-4296-be65-62251c220576 req-6df98827-9d27-4a2a-b371-a6e9d635ab01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065763 Jun 25 21:27:04.137795 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3332/6201] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:04.664894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:04.665558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:04.672894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.673495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.674442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.674967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.711102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:27:04.716787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:04.718018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:04.725818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.728008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.729203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.729885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.816771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e6c0c929-4c68-419a-aa6a-094939d10069 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 204 len: 0 microversion: 2.1 time: 0.155944 Jun 25 21:27:04.818624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2870/6202] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:27:04 2022] DELETE /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:27:04.829683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:04.830611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:04.838277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.838777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.839666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:04.840174 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:04.954574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:04.966652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73410ce4-a49c-4f8b-93de-5c3a27546a31 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.255994 Jun 25 21:27:04.973098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3333/6203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:04 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:05.057875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:05.067391 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3c9e395a-66ab-4724-a4a7-abcd44797641 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1408 microversion: 2.1 time: 0.243009 Jun 25 21:27:05.068547 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2871/6204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:04 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:05.987958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:05.989105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:06.002336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:06.003121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:06.004685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:06.005171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:06.086694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:06.087325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:06.094876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:06.095342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:06.096120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:06.096710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:06.232550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:06.240824 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-767ba4eb-f4b5-403c-ac37-36d6dd15313b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1408 microversion: 2.1 time: 0.158011 Jun 25 21:27:06.241646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2872/6205] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:06 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:06.328751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:06.339711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e27e0558-ddeb-45f2-9e63-087bb3762670 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.358532 Jun 25 21:27:06.350034 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3334/6206] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:05 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:07.083510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-000c7e39-efa9-43f4-a3bf-d667ef6a759a req-a31cd464-f953-45f0-b06c-a60ec4855afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6582d227-5c6a-4da5-8465-df112e099058", "name": "network-vif-deleted", "tag": "c20122e3-e332-4a1c-a496-e5426665e587"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:07.096664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-000c7e39-efa9-43f4-a3bf-d667ef6a759a req-a31cd464-f953-45f0-b06c-a60ec4855afe service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:07.097222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-000c7e39-efa9-43f4-a3bf-d667ef6a759a req-a31cd464-f953-45f0-b06c-a60ec4855afe service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:07.111702 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-000c7e39-efa9-43f4-a3bf-d667ef6a759a req-a31cd464-f953-45f0-b06c-a60ec4855afe service nova] Creating event network-vif-deleted:c20122e3-e332-4a1c-a496-e5426665e587 for instance 6582d227-5c6a-4da5-8465-df112e099058 on nch1-master-1 Jun 25 21:27:07.118725 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-000c7e39-efa9-43f4-a3bf-d667ef6a759a req-a31cd464-f953-45f0-b06c-a60ec4855afe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039197 Jun 25 21:27:07.120279 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2873/6207] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:07.258590 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:07.260119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:07.268354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:07.269121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:07.270040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:07.270740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:07.352823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:07.362636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:07.362958 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b755f99-cd46-4b8b-a4c7-96ae077efd01 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 200 len: 1201 microversion: 2.1 time: 0.108362 Jun 25 21:27:07.364242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3335/6208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:07 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:07.369445 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:07.382638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:07.383122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:07.388686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:07.389450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:07.601078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:07.620483 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3ec7361-3a15-42f6-88cc-0325ef84213f tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.265435 Jun 25 21:27:07.622677 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2874/6209] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:07 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:08.379782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:08.381498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:08.393495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:08.394487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:08.396163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:08.396636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:08.414604 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 HTTP/1.1 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6582d227-5c6a-4da5-8465-df112e099058'} Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:08.417252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:08.421211 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:08.423247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:08.424121 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fa113447-1eae-452c-a7e1-ccbaaa0ac5f3 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 404 len: 111 microversion: 2.1 time: 0.048620 Jun 25 21:27:08.425056 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3336/6210] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:08 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:08.638334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:08.639055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:08.646450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:08.646956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:08.647790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:08.648335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:08.798527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:08.806406 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3a804c7-6eb8-431b-9f11-7c23cb2f49e3 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.172060 Jun 25 21:27:08.806996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2875/6211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:08 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:09.825163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:09.826086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:09.839473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:09.839924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:09.840714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:09.841295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:09.994585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:10.003458 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb414609-ec49-4a36-8727-881a8f89bb5d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.182705 Jun 25 21:27:10.004592 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3337/6212] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:09 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:10.595648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:10.596164 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:10.603565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:10.604023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:10.605031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:10.605628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:10.619472 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb HTTP/1.1 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8783077f-d905-4a1e-a8ca-a0dc143308bb'} Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:10.621220 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6327fc21-9906-426d-b4fd-76b5681ffc9d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 404 len: 111 microversion: 2.1 time: 0.031009 Jun 25 21:27:10.624243 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2876/6213] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:27:10 2022] DELETE /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:10.632568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:10.633183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 8783077f-d905-4a1e-a8ca-a0dc143308bb] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:10.638488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:10.639169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:10.641587 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:10.642042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:10.642977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:10.643516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:10.659780 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb HTTP/1.1 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8783077f-d905-4a1e-a8ca-a0dc143308bb'} Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:10.661305 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 8783077f-d905-4a1e-a8ca-a0dc143308bb could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa3e2b62-8ed9-4ca3-bc66-ea49ced81b35 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb" status: 404 len: 111 microversion: 2.1 time: 0.035311 Jun 25 21:27:10.665335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3338/6214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:10 2022] GET /compute/v2.1/servers/8783077f-d905-4a1e-a8ca-a0dc143308bb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:11.020979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:11.021663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:11.028719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:11.031238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.031707 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.032855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.033327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.123806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fcc32710-d183-4b74-a5ec-22d5eee53790 req-6edda435-cda6-4256-9121-4bef995502ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13d7be2-e727-4637-b045-3bab1e957c32", "name": "network-vif-plugged", "status": "completed", "tag": "c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:11.151001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fcc32710-d183-4b74-a5ec-22d5eee53790 req-6edda435-cda6-4256-9121-4bef995502ce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.152763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fcc32710-d183-4b74-a5ec-22d5eee53790 req-6edda435-cda6-4256-9121-4bef995502ce service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.185600 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fcc32710-d183-4b74-a5ec-22d5eee53790 req-6edda435-cda6-4256-9121-4bef995502ce service nova] Creating event network-vif-plugged:c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee for instance f13d7be2-e727-4637-b045-3bab1e957c32 on nch2-master-1 Jun 25 21:27:11.196515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:11.202852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6086ef35-6c71-4085-bd17-efbcabacfdd2 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.186036 Jun 25 21:27:11.203749 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2877/6215] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:11 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:11.213545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fcc32710-d183-4b74-a5ec-22d5eee53790 req-6edda435-cda6-4256-9121-4bef995502ce service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095271 Jun 25 21:27:11.216705 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3339/6216] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:11.265333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:11.265865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:11.272268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.272766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.273552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.274003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.288106 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 HTTP/1.1 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '6582d227-5c6a-4da5-8465-df112e099058'} Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:11.290074 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.293774 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.295087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:11.296127 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f15c163b-ced0-4089-8ce8-d54e94ecb226 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 404 len: 111 microversion: 2.1 time: 0.034813 Jun 25 21:27:11.296742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2878/6217] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:27:11 2022] DELETE /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:11.305953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:11.307060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 6582d227-5c6a-4da5-8465-df112e099058] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:11.315156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.315812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.317429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.318076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.334264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 HTTP/1.1 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '6582d227-5c6a-4da5-8465-df112e099058'} Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:11.336028 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 6582d227-5c6a-4da5-8465-df112e099058 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0414563-ca86-43a8-91c0-8ce058243b87 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058" status: 404 len: 111 microversion: 2.1 time: 0.037557 Jun 25 21:27:11.339830 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3340/6218] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:11 2022] GET /compute/v2.1/servers/6582d227-5c6a-4da5-8465-df112e099058 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:11.415372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-97abe819-6342-4f8b-bc04-26aff0f507e5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: .version_select at 0x7f984f2e3790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-365734542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBnU3Fk42BYhF8pnAUfZX62fb5cKFJjeRRF+cwQ4TAi7srAozD49Dv4OBE5pDHAbm8LXzmohB/29EtCZn5/HC9090NZXvNjjnWuoJHwD6ukh4rpVP7JSC9QkTd+PDuAvg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:11.431734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-97abe819-6342-4f8b-bc04-26aff0f507e5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:11.436995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-97abe819-6342-4f8b-bc04-26aff0f507e5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:11.464131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-97abe819-6342-4f8b-bc04-26aff0f507e5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.053068 Jun 25 21:27:11.464865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2879/6219] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:27:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:11.601220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-291729064", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:11.665145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] validate_networks() for None {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:27:11.982187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:27:11.982963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:27:11.983593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:27:11.984006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:27:11.984626 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:27:11.994163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.994826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:11.995621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:11.996056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:12.014522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Getting quotas for project b43e0900925e4794b3be4da0a844654f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:12.020120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Getting quotas for user 15a1ef42555447b2b55b74917e926040 and project b43e0900925e4794b3be4da0a844654f. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:12.032876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:27:12.035296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:27:12.080951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf87e83f-005d-40de-851f-04fd5656800e tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483740 Jun 25 21:27:12.081981 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3341/6220] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:27:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:27:12.092823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3d5377e-a7e0-40e5-8ded-2180a02d2cd3 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:12.094237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3d5377e-a7e0-40e5-8ded-2180a02d2cd3 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:12.177562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d3d5377e-a7e0-40e5-8ded-2180a02d2cd3 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:12.184703 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3d5377e-a7e0-40e5-8ded-2180a02d2cd3 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1213 microversion: 2.1 time: 0.096875 Jun 25 21:27:12.185416 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2880/6221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:12 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1213 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:12.221892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:12.222747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:12.230851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:12.231406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:12.232788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:12.233227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:12.412145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:12.423046 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-98c59636-b3d0-4f95-a660-8f35ce402e5c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1470 microversion: 2.1 time: 0.206090 Jun 25 21:27:12.424360 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3342/6222] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:12 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:13.205805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:13.207356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:13.216007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.217149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.218025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.218691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.342816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:13.351799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd8ec732-e07d-47db-84bb-88311fa39b95 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1283 microversion: 2.1 time: 0.153549 Jun 25 21:27:13.352397 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2881/6223] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:13 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1283 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:13.440718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:13.441963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:13.449266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.449722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.450489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.450924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.600140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:13.608674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44d5dd5d-f3ae-4b81-9ca4-92409834c56d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1642 microversion: 2.1 time: 0.171908 Jun 25 21:27:13.609311 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3343/6224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:13 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1642 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:13.630235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:13.630878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:13.638299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.638934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.639723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.640173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.896302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:13.904539 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f45e2c6d-5cda-4384-acb0-8cda63891e82 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1642 microversion: 2.1 time: 0.280044 Jun 25 21:27:13.905150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2882/6225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:13 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1642 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:13.922337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:13.922984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:13.929732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.930410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:13.931160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:13.931625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:14.181075 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b0b035f9-b9e7-429f-ab66-a9945e7819db tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1793 microversion: 2.1 time: 0.263080 Jun 25 21:27:14.185317 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3344/6226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:13 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1793 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:14.369373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:14.370069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:14.381233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:14.381870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:14.382798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:14.383417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:14.642191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:14.657721 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a319da5-7c0b-48b1-a2c6-c9d854522cfc tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.292577 Jun 25 21:27:14.658646 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2883/6227] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:14 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:15.157782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-843103a6-c3a7-4014-b90d-887bdf23ba01 req-60615610-7096-4061-89ca-81f373669acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e449ef18-aadf-4a4f-be91-a14437349f01", "tag": "5b28d576-c022-4382-9b78-c3a071257e60"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:15.180955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-843103a6-c3a7-4014-b90d-887bdf23ba01 req-60615610-7096-4061-89ca-81f373669acb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:15.181728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-843103a6-c3a7-4014-b90d-887bdf23ba01 req-60615610-7096-4061-89ca-81f373669acb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:15.223454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-843103a6-c3a7-4014-b90d-887bdf23ba01 req-60615610-7096-4061-89ca-81f373669acb service nova] Creating event network-changed:5b28d576-c022-4382-9b78-c3a071257e60 for instance e449ef18-aadf-4a4f-be91-a14437349f01 on nch1-master-1 Jun 25 21:27:15.232808 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-843103a6-c3a7-4014-b90d-887bdf23ba01 req-60615610-7096-4061-89ca-81f373669acb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084419 Jun 25 21:27:15.234012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3345/6228] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:15.675737 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:15.676978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:15.684735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:15.685358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:15.686320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:15.687154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:15.822254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:15.830993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38ccc05e-d944-4369-bbb4-90596085ba84 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.159728 Jun 25 21:27:15.831600 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2884/6229] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:15 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:16.123857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5f588a87-65ea-4922-99ea-e41b39cb283d req-c78038cc-a110-4357-abc3-4dcc71731c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13d7be2-e727-4637-b045-3bab1e957c32", "tag": "c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:16.140274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5f588a87-65ea-4922-99ea-e41b39cb283d req-c78038cc-a110-4357-abc3-4dcc71731c01 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:16.141061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5f588a87-65ea-4922-99ea-e41b39cb283d req-c78038cc-a110-4357-abc3-4dcc71731c01 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:16.169300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5f588a87-65ea-4922-99ea-e41b39cb283d req-c78038cc-a110-4357-abc3-4dcc71731c01 service nova] Creating event network-changed:c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee for instance f13d7be2-e727-4637-b045-3bab1e957c32 on nch2-master-1 Jun 25 21:27:16.178453 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5f588a87-65ea-4922-99ea-e41b39cb283d req-c78038cc-a110-4357-abc3-4dcc71731c01 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058559 Jun 25 21:27:16.179609 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3346/6230] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:16.514888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-321255628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-365734542", "security_groups": [{"name": "tempest-secgroup-smoke-1105187054"}], "block_device_mapping_v2": [{"uuid": "45c469bc-53fa-489d-b96f-d0f49a47cac1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:16.847900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:16.848647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:16.856743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:16.857572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:16.858573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:16.870670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:16.890902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:27:17.442606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:17.454884 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3647fbe0-ead4-4607-80f7-ebcf6f76f086 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.610501 Jun 25 21:27:17.456038 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3347/6231] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:16 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:27:18.181588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:27:18.182052 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:27:18.182520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:27:18.182950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:27:18.183384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:27:18.193140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:18.193687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:18.194720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:18.195029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:18.214393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:18.220230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:18.292492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:27:18.294727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45c469bc-53fa-489d-b96f-d0f49a47cac1',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:27:18.451849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-05bac10c-179f-4749-8187-a6f99e2945db tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.946259 Jun 25 21:27:18.452880 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2885/6232] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:27:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:27:18.467147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80e6f3c7-0399-46ae-b74e-4b9354c26732 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:18.470671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-80e6f3c7-0399-46ae-b74e-4b9354c26732 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:18.477782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:18.479056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:18.492939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:18.493628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:18.494594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:18.496007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:18.574028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-80e6f3c7-0399-46ae-b74e-4b9354c26732 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:18.582890 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80e6f3c7-0399-46ae-b74e-4b9354c26732 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1093 microversion: 2.1 time: 0.122685 Jun 25 21:27:18.584264 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3348/6233] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:18 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1093 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:18.685864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:18.694117 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6f1cf8b6-a971-42b7-98b7-12c0d5c1f717 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.221801 Jun 25 21:27:18.695023 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2886/6234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:18 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:27:19.600930 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:19.601541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:19.611507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:19.611989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:19.613826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:19.614558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:19.697605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:19.705846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81e1af58-a41d-4464-b99c-c94604a4c6ce tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1209 microversion: 2.1 time: 0.108942 Jun 25 21:27:19.707174 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3349/6235] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:19 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:19.712507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:19.713133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:19.720457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:19.721023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:19.721757 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:19.722200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:19.964103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:19.976474 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16a2603a-d3e2-4c9f-bbd2-af6a402248b7 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.267713 Jun 25 21:27:19.977704 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2887/6236] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:19 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:27:20.203274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-937bd7d6-fa4b-47c3-b417-fe757bd026e8 req-df14b0e4-4de1-4a6f-8894-69e159d9fe24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e449ef18-aadf-4a4f-be91-a14437349f01", "name": "network-vif-plugged", "status": "completed", "tag": "5b28d576-c022-4382-9b78-c3a071257e60"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:20.218171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-937bd7d6-fa4b-47c3-b417-fe757bd026e8 req-df14b0e4-4de1-4a6f-8894-69e159d9fe24 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:20.220097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-937bd7d6-fa4b-47c3-b417-fe757bd026e8 req-df14b0e4-4de1-4a6f-8894-69e159d9fe24 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:20.241071 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-937bd7d6-fa4b-47c3-b417-fe757bd026e8 req-df14b0e4-4de1-4a6f-8894-69e159d9fe24 service nova] Creating event network-vif-plugged:5b28d576-c022-4382-9b78-c3a071257e60 for instance e449ef18-aadf-4a4f-be91-a14437349f01 on nch1-master-1 Jun 25 21:27:20.247351 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-937bd7d6-fa4b-47c3-b417-fe757bd026e8 req-df14b0e4-4de1-4a6f-8894-69e159d9fe24 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053252 Jun 25 21:27:20.249483 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3350/6237] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:20.724357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:20.725647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:20.736337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:20.737042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:20.738309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:20.739406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:20.761766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:20.980905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:20.995263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:20.995879 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29d4f9bc-c981-4fbb-843c-e64b0b7b2777 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1277 microversion: 2.1 time: 0.275840 Jun 25 21:27:20.996208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:20.998792 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2888/6238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:20 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:21.007120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:21.007662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:21.008701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:21.009349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:21.251909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:21.258103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8f0a01c3-75e0-428c-9973-8b1ff2994843 req-4e97f016-a525-4799-9889-d5eaa7435c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433bbb89-5296-4366-bf36-6e4eb85de73d", "tag": "3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:21.263643 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-31429808-8548-4d39-8f9b-38a99494f986 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1313 microversion: 2.1 time: 0.273465 Jun 25 21:27:21.265090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:21.283709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8f0a01c3-75e0-428c-9973-8b1ff2994843 req-4e97f016-a525-4799-9889-d5eaa7435c37 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:21.284176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8f0a01c3-75e0-428c-9973-8b1ff2994843 req-4e97f016-a525-4799-9889-d5eaa7435c37 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:21.289775 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3351/6239] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:20 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:27:21.297546 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8f0a01c3-75e0-428c-9973-8b1ff2994843 req-4e97f016-a525-4799-9889-d5eaa7435c37 service nova] Creating event network-changed:3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7 for instance 433bbb89-5296-4366-bf36-6e4eb85de73d on nch1-master-1 Jun 25 21:27:21.304511 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8f0a01c3-75e0-428c-9973-8b1ff2994843 req-4e97f016-a525-4799-9889-d5eaa7435c37 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052317 Jun 25 21:27:21.305695 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2889/6240] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:27:22.011151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:22.011773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:22.017216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:22.021431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.021888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:22.022668 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.023104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:22.171585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:22.181012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd24833b-2524-42c6-9fdb-cbec97444ad0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.173665 Jun 25 21:27:22.181787 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3352/6241] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:22 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:22.287977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:22.288883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:22.296322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.296819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:22.297639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.298085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:22.629406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:22.637692 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bec678fe-eea6-4c71-b18e-8a0ceabcde45 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1462 microversion: 2.1 time: 0.358499 Jun 25 21:27:22.638258 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2890/6242] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:22 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1462 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:22.655791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44fe462f-9405-4a4b-8ae6-cdb5db308015", "device": "/dev/sdb"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:22.657259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:22.663819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.664267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:22.665091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:22.665522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:23.132536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:23.199813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:23.200451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:23.207584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:23.208059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:23.208878 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:23.209399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:23.303468 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-667ee222-6841-46b3-9103-259f623d51a8 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "POST /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.651897 Jun 25 21:27:23.305016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3353/6243] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:27:22 2022] POST /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:23.412381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:23.425182 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-651c3572-13f7-411b-8efb-3e9c8c776bac tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.229623 Jun 25 21:27:23.426678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2891/6244] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:23 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:24.451154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:24.451872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:24.458941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:24.459605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:24.460581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:24.461027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:24.632502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:24.641174 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dac25e8-eb2e-4966-8680-68781d7c170c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.198499 Jun 25 21:27:24.641752 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3354/6245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:24 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:25.660097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:25.662425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:25.676457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:25.676951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:25.677763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:25.678807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:25.875329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:25.887267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8fb00c0a-f341-44e2-b379-8333c6185024 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.232958 Jun 25 21:27:25.903718 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2892/6246] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:25 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:26.908215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:26.908995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:26.927240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:26.928709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:26.929976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:26.932050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:27.137960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:27.157089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9f6fab49-719b-4ff7-9542-0c05706ac438 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.253543 Jun 25 21:27:27.166309 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3355/6247] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:26 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:28.179182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:28.180770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:28.197866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:28.198879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:28.199872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:28.200524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:28.207825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:28.233203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:28.391837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f7014a95-637a-42db-a02a-9bd444e8e791 req-c0edb7d0-4864-4276-a355-1074ed077ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433bbb89-5296-4366-bf36-6e4eb85de73d", "name": "network-vif-plugged", "status": "completed", "tag": "3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:28.405674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:28.440077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f7014a95-637a-42db-a02a-9bd444e8e791 req-c0edb7d0-4864-4276-a355-1074ed077ae2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:28.440793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f7014a95-637a-42db-a02a-9bd444e8e791 req-c0edb7d0-4864-4276-a355-1074ed077ae2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:28.455755 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f7014a95-637a-42db-a02a-9bd444e8e791 req-c0edb7d0-4864-4276-a355-1074ed077ae2 service nova] Creating event network-vif-plugged:3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7 for instance 433bbb89-5296-4366-bf36-6e4eb85de73d on nch1-master-1 Jun 25 21:27:28.461131 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f7014a95-637a-42db-a02a-9bd444e8e791 req-c0edb7d0-4864-4276-a355-1074ed077ae2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073014 Jun 25 21:27:28.462145 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3356/6248] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:28.513648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:28.522907 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f79cf57-54b8-4128-8e80-e30132b30eb7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.352362 Jun 25 21:27:28.524163 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2893/6249] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:28 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:29.537993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:29.547829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:29.549296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:29.558728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:29.559321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:29.560240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:29.561364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:29.725098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:29.734417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47679800-7be4-46ce-a179-a4a540999e90 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1265 microversion: 2.1 time: 0.197726 Jun 25 21:27:29.735789 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3357/6250] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:29 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:30.752412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:30.753344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:30.763313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:30.770242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:30.771271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:30.771830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:30.978228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:30.991834 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0419dfbc-5049-4b26-82cd-ed418a6d70a0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1451 microversion: 2.1 time: 0.240870 Jun 25 21:27:30.992658 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2894/6251] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:30 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1451 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:31.017709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:31.018664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:31.036538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:31.037057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:31.038012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:31.038598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:31.326439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:31.338571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee1ad773-5c4d-4f30-a966-930b4008ec77 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1451 microversion: 2.1 time: 0.324743 Jun 25 21:27:31.339472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3358/6252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:31 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1451 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:27:33.289395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:33.289967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:33.300709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:33.301181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:33.301979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:33.302427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:33.501918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lazy-loading 'services' on Instance uuid e449ef18-aadf-4a4f-be91-a14437349f01 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:27:33.656627 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f684bcd2-915e-4359-9236-0b59e217ee88 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01/os-volume_attachments/44fe462f-9405-4a4b-8ae6-cdb5db308015" status: 202 len: 0 microversion: 2.1 time: 0.371201 Jun 25 21:27:33.663351 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2895/6253] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:27:33 2022] DELETE /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01/os-volume_attachments/44fe462f-9405-4a4b-8ae6-cdb5db308015 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:27:34.766424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-fec747d4-f1c5-4b9d-81e4-eb470f5bfe28 req-6cc83cce-cf38-4902-becf-74571f40eb4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "433bbb89-5296-4366-bf36-6e4eb85de73d", "tag": "3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:34.815586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fec747d4-f1c5-4b9d-81e4-eb470f5bfe28 req-6cc83cce-cf38-4902-becf-74571f40eb4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:34.816049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-fec747d4-f1c5-4b9d-81e4-eb470f5bfe28 req-6cc83cce-cf38-4902-becf-74571f40eb4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:34.873675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:34.874278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:34.883131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:34.883759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:34.884859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:34.886156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:34.899712 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-fec747d4-f1c5-4b9d-81e4-eb470f5bfe28 req-6cc83cce-cf38-4902-becf-74571f40eb4f service nova] Creating event network-changed:3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7 for instance 433bbb89-5296-4366-bf36-6e4eb85de73d on nch1-master-1 Jun 25 21:27:34.919497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-fec747d4-f1c5-4b9d-81e4-eb470f5bfe28 req-6cc83cce-cf38-4902-becf-74571f40eb4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157628 Jun 25 21:27:34.920407 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3359/6254] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:34.963843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:27:35.148771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cef5bc53-44c7-4215-82d0-368ba4fe351f tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 204 len: 0 microversion: 2.1 time: 0.282879 Jun 25 21:27:35.150561 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2896/6255] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:27:34 2022] DELETE /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:27:35.161999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:35.163012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:35.173576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:35.176304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:35.177316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:35.181793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:35.408248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:35.419182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dbcc5c5e-7461-4939-9b55-ab55d0bcab6b tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1468 microversion: 2.1 time: 0.263835 Jun 25 21:27:35.433444 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3360/6256] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:35 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1468 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:36.459579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:36.476354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:36.494874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:36.495325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:36.500309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:36.501200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:37.033211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a1ef42555447b2b55b74917e926040', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b43e0900925e4794b3be4da0a844654f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:37.047407 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45421af1-9591-4323-86e3-428205a06674 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 200 len: 1468 microversion: 2.1 time: 0.614051 Jun 25 21:27:37.066957 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2897/6257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:36 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 1468 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:27:37.452810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-08d3adba-3653-4fa6-8c15-3f872ca5e7e8 req-12252b2a-5e16-425e-833a-fafa665d1db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e449ef18-aadf-4a4f-be91-a14437349f01", "name": "network-vif-deleted", "tag": "5b28d576-c022-4382-9b78-c3a071257e60"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:37.466568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-08d3adba-3653-4fa6-8c15-3f872ca5e7e8 req-12252b2a-5e16-425e-833a-fafa665d1db8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:37.467329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-08d3adba-3653-4fa6-8c15-3f872ca5e7e8 req-12252b2a-5e16-425e-833a-fafa665d1db8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:37.496217 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-08d3adba-3653-4fa6-8c15-3f872ca5e7e8 req-12252b2a-5e16-425e-833a-fafa665d1db8 service nova] Creating event network-vif-deleted:5b28d576-c022-4382-9b78-c3a071257e60 for instance e449ef18-aadf-4a4f-be91-a14437349f01 on nch1-master-1 Jun 25 21:27:37.510678 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-08d3adba-3653-4fa6-8c15-3f872ca5e7e8 req-12252b2a-5e16-425e-833a-fafa665d1db8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062318 Jun 25 21:27:37.511782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3361/6258] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:27:38.075079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:38.076606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] [instance: e449ef18-aadf-4a4f-be91-a14437349f01] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:38.085161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:38.086076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:38.087132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:38.087848 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:38.105160 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] HTTP exception thrown: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Request method failure captured: Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 HTTP/1.1 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit32t1jj39vpAJPvj-SyFOSVBNkhleHmgaKJlG0yF9a0qf2jZCptSNUKk_KPq0qq4cQyUoS3Imb43xOdXoofJhbf_zMM9vSE8QQyT-JuqyeOFWRCx2eXYq5aGk_FQP60yFAa76tKHqFklcoMtze5wUz8kKwngEKV9sbJEeZmElnPzMF4 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: b43e0900925e4794b3be4da0a844654f Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-VolumesBackupsTest-1925542344 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b43e0900925e4794b3be4da0a844654f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43e0900925e4794b3be4da0a844654f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b43e0900925e4794b3be4da0a844654f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b43e0900925e4794b3be4da0a844654f"}]}] Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-VolumesBackupsTest-1925542344 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: b43e0900925e4794b3be4da0a844654f Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-VolumesBackupsTest-1925542344 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-VolumesBackupsTest-1925542344-project Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 15a1ef42555447b2b55b74917e926040 Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-VolumesBackupsTest-1925542344-project Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e449ef18-aadf-4a4f-be91-a14437349f01'} Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:27:38.107216 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. Jun 25 21:27:38.111672 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:27:38.113420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] Returning 404 to user: Instance e449ef18-aadf-4a4f-be91-a14437349f01 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:27:38.114622 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0208d73f-c317-4ba0-8f86-3e56fd3af0c9 tempest-VolumesBackupsTest-1925542344 tempest-VolumesBackupsTest-1925542344-project] 10.222.0.39 "GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01" status: 404 len: 111 microversion: 2.1 time: 0.044187 Jun 25 21:27:38.120033 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2898/6259] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:38 2022] GET /compute/v2.1/servers/e449ef18-aadf-4a4f-be91-a14437349f01 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:27:56.333293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=11 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:56.334168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:56.338992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Action: 'create', calling method: .version_select at 0x7f984ed69820>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1147821589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIwlaEk46BDH5IO7OELU4e8mPswD8aMjzUivqX1tR8q9fBRlPO0alaNubNYHcxmRa34JxPtGCV6z6I9PJ1xO9ybbi20FdZW/ws8RUP1O6c9AAkLb9unbzyQTIrQDqEH/g=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:56.356669 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Getting quotas for project 039691ff93174f54aaaa13770a444aa2. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:56.362061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Getting quotas for user f7ea2397650748afa9edf0864829c434 and project 039691ff93174f54aaaa13770a444aa2. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:56.375594 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [7f05582b-9bb7-4516-bf59-f7aae26b3ba5] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 21:27:57.388516 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [7f05582b-9bb7-4516-bf59-f7aae26b3ba5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 35550. Jun 25 21:27:57.411637 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2f802c3-187b-4721-9e88-08881bd2db1c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.080440 Jun 25 21:27:57.412381 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3362/6260] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:27:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:27:58.606292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1187415553", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "f6251652-63b0-4878-98de-193b1d448e3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1147821589", "security_groups": [{"name": "tempest-secgroup-smoke-2020428160"}], "networks": [{"uuid": "0a4c46ca-2fc4-4145-967d-e0eb54e982fd"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:27:58.628416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:58.629195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:27:58.745606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] validate_networks() for [('0a4c46ca-2fc4-4145-967d-e0eb54e982fd', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:27:59.180194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:27:59.180619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:27:59.181113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:27:59.181534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:27:59.181959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:27:59.194562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:59.195840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:59.197134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:27:59.198133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:27:59.219953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Getting quotas for project 039691ff93174f54aaaa13770a444aa2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:27:59.227508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Getting quotas for user f7ea2397650748afa9edf0864829c434 and project 039691ff93174f54aaaa13770a444aa2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:27:59.294277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:27:59.296649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6251652-63b0-4878-98de-193b1d448e3b',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:27:59.427795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-134287a4-7d1e-4c82-b094-b7874915d9cc tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825726 Jun 25 21:27:59.432481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2899/6261] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:27:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:27:59.440183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-61035de3-832b-46d5-9d23-86c3304efb8c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:27:59.440960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-61035de3-832b-46d5-9d23-86c3304efb8c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:27:59.498496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-61035de3-832b-46d5-9d23-86c3304efb8c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:27:59.507125 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-61035de3-832b-46d5-9d23-86c3304efb8c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1099 microversion: 2.1 time: 0.070080 Jun 25 21:27:59.508246 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3363/6262] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:27:59 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1099 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:00.530377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:00.531255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:00.555809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:00.557355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:00.558216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:00.559029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:00.647224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:00.659218 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-76a93fd2-7be0-459f-b2e7-bbc76e5506a1 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1215 microversion: 2.1 time: 0.137607 Jun 25 21:28:00.660562 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2900/6263] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:00 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:01.678639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:01.678639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:01.688724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:01.689310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:01.694132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:01.695007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:02.277085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:02.285620 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6c8357e-9250-4d39-9c61-bf24f8b5868d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1283 microversion: 2.1 time: 0.612785 Jun 25 21:28:02.286488 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3364/6264] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:01 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1283 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:02.806355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-94cfb403-cb94-41ca-961d-eb8a2e4c5173 req-f4bfb880-9a25-4256-b44e-66bc59385238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:02.837434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-94cfb403-cb94-41ca-961d-eb8a2e4c5173 req-f4bfb880-9a25-4256-b44e-66bc59385238 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:02.848990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-94cfb403-cb94-41ca-961d-eb8a2e4c5173 req-f4bfb880-9a25-4256-b44e-66bc59385238 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:02.861905 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-94cfb403-cb94-41ca-961d-eb8a2e4c5173 req-f4bfb880-9a25-4256-b44e-66bc59385238 service nova] Creating event network-changed:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:02.868207 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-94cfb403-cb94-41ca-961d-eb8a2e4c5173 req-f4bfb880-9a25-4256-b44e-66bc59385238 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077797 Jun 25 21:28:02.869242 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2901/6265] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:03.303293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:03.303942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:03.311378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:03.311660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:03.312472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:03.312910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:03.466905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:03.474820 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9286883a-2f4f-4509-9e73-7563b6825cac tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.175710 Jun 25 21:28:03.475369 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3365/6266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:03 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:04.493126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:04.494510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:04.501291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:04.501762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:04.502550 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:04.503003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:04.647068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:04.655132 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c5a4091-dd75-4f48-acbb-dc9943608ab5 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.167349 Jun 25 21:28:04.655750 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2902/6267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:04 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:05.673859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:05.674485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:05.681991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:05.682386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:05.683215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:05.683704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:05.824864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:05.832726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b48b1aad-5d22-4d3c-8cc4-b1c38aaeef9f tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.163663 Jun 25 21:28:05.833311 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3366/6268] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:05 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:06.850107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:06.851079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:06.858363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:06.858884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:06.859683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:06.860125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:07.008147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:07.016719 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0d6ff36-45d5-42a4-9e19-0ed119664f3c tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.170638 Jun 25 21:28:07.017318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2903/6269] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:06 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:08.033402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:08.034085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:08.045711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:08.046169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:08.047023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:08.047496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:08.196190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:08.206664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4c1cdd61-25de-45c4-83c6-97465c1d3e48 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.177221 Jun 25 21:28:08.207472 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3367/6270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:08 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:08.370565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6d1d4f9b-09e8-455d-852f-91d2f5952280 req-4080fe83-de8a-4fa6-8ce8-8c08a07791d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "name": "network-vif-plugged", "status": "completed", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:08.381039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6d1d4f9b-09e8-455d-852f-91d2f5952280 req-4080fe83-de8a-4fa6-8ce8-8c08a07791d8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:08.382359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6d1d4f9b-09e8-455d-852f-91d2f5952280 req-4080fe83-de8a-4fa6-8ce8-8c08a07791d8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:08.396171 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6d1d4f9b-09e8-455d-852f-91d2f5952280 req-4080fe83-de8a-4fa6-8ce8-8c08a07791d8 service nova] Creating event network-vif-plugged:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:08.402438 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6d1d4f9b-09e8-455d-852f-91d2f5952280 req-4080fe83-de8a-4fa6-8ce8-8c08a07791d8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036061 Jun 25 21:28:08.403141 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2904/6271] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:09.223660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:09.224332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:09.231916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:09.232282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:09.234395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:09.234882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:09.377806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:09.387117 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-840aadb4-414b-47ac-8e0e-2a8cc2a4d3d2 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1271 microversion: 2.1 time: 0.166727 Jun 25 21:28:09.388006 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3368/6272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:09 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:10.402368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:10.403218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:10.408690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:10.409416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:10.416536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:10.417004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:10.417779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:10.418264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:10.562414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:10.574597 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82b181b8-31f5-41ba-8082-a6e78eedc84d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1459 microversion: 2.1 time: 0.172987 Jun 25 21:28:10.575303 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2905/6273] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:10 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:10.595240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:10.595860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:10.597830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:10.603966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:10.604444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:10.605221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:10.605663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:10.746014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:10.758448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4d28de33-3c3d-4357-9103-b1c5aafeb680 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1459 microversion: 2.1 time: 0.166952 Jun 25 21:28:10.759330 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3369/6274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:10 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1459 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:12.512356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-342dd8a4-125a-4df1-8be4-be27795283cc req-e3e4c148-268e-46ff-bc08-c234d75fbaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:12.522528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-342dd8a4-125a-4df1-8be4-be27795283cc req-e3e4c148-268e-46ff-bc08-c234d75fbaa3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:12.523065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-342dd8a4-125a-4df1-8be4-be27795283cc req-e3e4c148-268e-46ff-bc08-c234d75fbaa3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:12.536156 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-342dd8a4-125a-4df1-8be4-be27795283cc req-e3e4c148-268e-46ff-bc08-c234d75fbaa3 service nova] Creating event network-changed:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:12.541743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-342dd8a4-125a-4df1-8be4-be27795283cc req-e3e4c148-268e-46ff-bc08-c234d75fbaa3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033206 Jun 25 21:28:12.542684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2906/6275] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:13.705103 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b68eca47-aed1-4aeb-b7c1-d8d26006346e req-83d8acd2-ffce-435c-8135-ab2fcf646324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:13.726446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b68eca47-aed1-4aeb-b7c1-d8d26006346e req-83d8acd2-ffce-435c-8135-ab2fcf646324 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:13.726446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b68eca47-aed1-4aeb-b7c1-d8d26006346e req-83d8acd2-ffce-435c-8135-ab2fcf646324 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:13.742674 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b68eca47-aed1-4aeb-b7c1-d8d26006346e req-83d8acd2-ffce-435c-8135-ab2fcf646324 service nova] Creating event network-changed:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:13.748638 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b68eca47-aed1-4aeb-b7c1-d8d26006346e req-83d8acd2-ffce-435c-8135-ab2fcf646324 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048728 Jun 25 21:28:13.749711 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3370/6276] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:15.766084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-70c98d19-b808-4c0c-b2b8-1d6aadc4683d req-327dc48d-2bd4-43c1-8e88-e4f5ca5cc39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:15.776184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-70c98d19-b808-4c0c-b2b8-1d6aadc4683d req-327dc48d-2bd4-43c1-8e88-e4f5ca5cc39e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:15.776712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-70c98d19-b808-4c0c-b2b8-1d6aadc4683d req-327dc48d-2bd4-43c1-8e88-e4f5ca5cc39e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:15.789094 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-70c98d19-b808-4c0c-b2b8-1d6aadc4683d req-327dc48d-2bd4-43c1-8e88-e4f5ca5cc39e service nova] Creating event network-changed:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:15.794797 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-70c98d19-b808-4c0c-b2b8-1d6aadc4683d req-327dc48d-2bd4-43c1-8e88-e4f5ca5cc39e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034478 Jun 25 21:28:15.795601 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2907/6277] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:28:21.938240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1180458969", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "adc39125-5bfd-4afd-b2b8-907a2099b064"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:21.994463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] validate_networks() for [('adc39125-5bfd-4afd-b2b8-907a2099b064', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:28:22.382192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:28:22.382631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:28:22.383121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:28:22.383544 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:28:22.384158 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:28:22.394416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:22.394888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:22.395721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:22.396168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:22.415912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Getting quotas for project 0600178085744eb3925c615c9ee732c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:28:22.421814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Getting quotas for user 721e354ea8204dd7a77a6d01e9ca520b and project 0600178085744eb3925c615c9ee732c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:28:22.435878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:28:22.438437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:28:22.487480 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d487c8c7-57c8-4ea9-b740-951d7d0696e1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671946 Jun 25 21:28:22.493358 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3371/6278] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:28:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:28:22.500411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-acb1f380-24f1-4977-9ef2-e92a9cc4e744 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:22.501799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-acb1f380-24f1-4977-9ef2-e92a9cc4e744 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:22.579710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-acb1f380-24f1-4977-9ef2-e92a9cc4e744 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:22.588674 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-acb1f380-24f1-4977-9ef2-e92a9cc4e744 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1215 microversion: 2.1 time: 0.093233 Jun 25 21:28:22.589239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2908/6279] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:22 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:23.607189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:23.607992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:23.617435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:23.618038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:23.618967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:23.619503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:23.690357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:23.699023 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6339a47b-996a-4e23-99f4-1a9b8a9527de tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1273 microversion: 2.1 time: 0.095916 Jun 25 21:28:23.699628 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3372/6280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:23 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:24.718672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:24.720689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:24.730665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:24.732257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:24.733686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:24.734354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:24.949560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-98ed148b-de8b-45c0-955d-439adb118674 req-a588f813-f815-4a01-8947-3999ff797bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80b4cf9e-0dc9-466e-adca-196855a27eca", "tag": "3748c729-1f72-47bb-bfc5-ca2dd1e1c78e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:24.962868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-98ed148b-de8b-45c0-955d-439adb118674 req-a588f813-f815-4a01-8947-3999ff797bd2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:24.963989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-98ed148b-de8b-45c0-955d-439adb118674 req-a588f813-f815-4a01-8947-3999ff797bd2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:24.990586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:25.012289 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d5e5db3-2e4a-4f2e-aa22-4e7fc017afc1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.295330 Jun 25 21:28:25.014143 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-98ed148b-de8b-45c0-955d-439adb118674 req-a588f813-f815-4a01-8947-3999ff797bd2 service nova] Creating event network-changed:3748c729-1f72-47bb-bfc5-ca2dd1e1c78e for instance 80b4cf9e-0dc9-466e-adca-196855a27eca on nch2-master-1 Jun 25 21:28:25.028701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2909/6281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:24 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:25.039669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-98ed148b-de8b-45c0-955d-439adb118674 req-a588f813-f815-4a01-8947-3999ff797bd2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093770 Jun 25 21:28:25.041282 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3373/6282] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:28:26.036624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:26.038497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:26.049062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:26.049888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:26.050869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:26.051487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:26.241556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:26.251560 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ff80ffb7-0444-4d3a-8979-41c6ad9ac765 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.220394 Jun 25 21:28:26.262131 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2910/6283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:26 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:27.269652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:27.271047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:27.279266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:27.281159 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:27.282216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:27.283415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:27.284110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:27.297620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=49 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:27.522280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:27.530795 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-522cded0-2b2f-407c-a45a-2c2bebe559af tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.265728 Jun 25 21:28:27.532891 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3374/6284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:27 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:27.865966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-701294574", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "e4c0c52f-5076-46dc-b2e7-8fa1b6bc8240"}], "key_name": "tempest-TestSecurityGroupsBasicOps-744410256", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f13d7be2-e727-4637-b045-3bab1e957c32"]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:27.936129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] validate_networks() for [('e4c0c52f-5076-46dc-b2e7-8fa1b6bc8240', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:28:28.418219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:28:28.418934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:28:28.419581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:28:28.420069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:28:28.420654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:28:28.431463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:28.432342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:28.433680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:28.434273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:28.454491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for project 1578a50f2f074a0f8027d8376717a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:28:28.461546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Getting quotas for user 61f7e0c206e349a196bbd2c6562ee0e2 and project 1578a50f2f074a0f8027d8376717a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:28:28.475633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:28:28.478195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:28:28.550917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:28.553122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:28.555684 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92cdff1d-d9d9-4f54-ae2d-d5dbae423179 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.689865 Jun 25 21:28:28.561850 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2911/6285] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:28:27 2022] POST /compute/v2.1/servers => generated 361 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:28:28.571787 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8ec0eac-d58a-42ad-8258-d48dc3fb3185 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:28.574059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a8ec0eac-d58a-42ad-8258-d48dc3fb3185 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:28.575023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:28.577310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:28.578279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:28.578871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:28.644088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a8ec0eac-d58a-42ad-8258-d48dc3fb3185 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:28.652611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8ec0eac-d58a-42ad-8258-d48dc3fb3185 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1240 microversion: 2.1 time: 0.088609 Jun 25 21:28:28.653231 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2912/6286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:28 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1240 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:28.815628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:28.840766 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90290e7f-0ffa-4c38-b7aa-834860f2a0c0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.297233 Jun 25 21:28:28.842950 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3375/6287] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:28 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:29.670503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:29.671556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:29.675464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:29.684648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:29.685333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:29.686996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:29.687510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:29.693735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=49 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:29.763879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:29.780210 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-276da719-d0ee-4db2-92ac-e8c97779776c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1292 microversion: 2.1 time: 0.113211 Jun 25 21:28:29.791729 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2913/6288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:29 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1292 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:29.859343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:29.861445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:29.872650 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:29.873360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:29.874353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:29.875068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:30.151270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:30.165518 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ffd29ea0-1807-4ab6-ac57-a234d333a55e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.310431 Jun 25 21:28:30.166798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3376/6289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:29 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:30.801957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:30.803575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:30.816452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:30.817390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:30.818740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:30.819639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:30.970824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:30.981313 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bdd7b7e-f467-4d19-9c2c-f16de5853102 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.186329 Jun 25 21:28:30.989386 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2914/6290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:30 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:31.185280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:31.187255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:31.214065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:31.214783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:31.215889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:31.216543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:31.455853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:31.466424 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5650efb-6cc9-4932-b48e-c664472b417a tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.286255 Jun 25 21:28:31.467412 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3377/6291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:31 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:31.839890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6d8a456c-1fa6-4edd-b1a8-665c000ab912 req-c96a6610-f61d-4826-8dd4-03bc0ff7e7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2489a8f3-9d00-41e2-afe7-c2293bee876a", "tag": "7ef3a1fc-a082-40fb-8090-0ce4c79e4952"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:31.842535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-63414a73-7fb0-4781-ab6d-016780d8af5f req-ff163974-0be4-4033-8974-06f38e39adc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b4cf9e-0dc9-466e-adca-196855a27eca", "name": "network-vif-plugged", "status": "completed", "tag": "3748c729-1f72-47bb-bfc5-ca2dd1e1c78e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:31.853256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6d8a456c-1fa6-4edd-b1a8-665c000ab912 req-c96a6610-f61d-4826-8dd4-03bc0ff7e7ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:31.853712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6d8a456c-1fa6-4edd-b1a8-665c000ab912 req-c96a6610-f61d-4826-8dd4-03bc0ff7e7ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:31.855523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-63414a73-7fb0-4781-ab6d-016780d8af5f req-ff163974-0be4-4033-8974-06f38e39adc2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:31.858266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-63414a73-7fb0-4781-ab6d-016780d8af5f req-ff163974-0be4-4033-8974-06f38e39adc2 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:31.889605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-63414a73-7fb0-4781-ab6d-016780d8af5f req-ff163974-0be4-4033-8974-06f38e39adc2 service nova] Creating event network-vif-plugged:3748c729-1f72-47bb-bfc5-ca2dd1e1c78e for instance 80b4cf9e-0dc9-466e-adca-196855a27eca on nch2-master-1 Jun 25 21:28:31.895402 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6d8a456c-1fa6-4edd-b1a8-665c000ab912 req-c96a6610-f61d-4826-8dd4-03bc0ff7e7ee service nova] Creating event network-changed:7ef3a1fc-a082-40fb-8090-0ce4c79e4952 for instance 2489a8f3-9d00-41e2-afe7-c2293bee876a on nch1-master-1 Jun 25 21:28:31.901934 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6d8a456c-1fa6-4edd-b1a8-665c000ab912 req-c96a6610-f61d-4826-8dd4-03bc0ff7e7ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287009 Jun 25 21:28:31.903861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2915/6292] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:31.905274 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-63414a73-7fb0-4781-ab6d-016780d8af5f req-ff163974-0be4-4033-8974-06f38e39adc2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075126 Jun 25 21:28:31.906067 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3378/6293] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:31.999469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:32.001286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:32.013019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:32.018534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:32.023079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:32.023937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:32.199218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:32.209194 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1fa55c4-000e-4281-914d-e55e823c45bb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.214246 Jun 25 21:28:32.211851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3379/6294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:31 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:32.485746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:32.486393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:32.494332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:32.494869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:32.495682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:32.496163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:32.653189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:32.662421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb6dfa37-a5b6-45c5-8bcd-929c4baa20fd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1315 microversion: 2.1 time: 0.181170 Jun 25 21:28:32.663152 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2916/6295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:32 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:33.227630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:33.228235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:33.230263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:33.230927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:33.238049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.238495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:33.239255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.239686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:33.353682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:33.361744 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb02cd9d-910b-45b2-be88-cc7922675e3e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.138189 Jun 25 21:28:33.362449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3380/6296] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:33 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:33.679743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:33.680590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:33.688151 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.688754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:33.689525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.690009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:33.831898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:33.843930 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d7d5991-20ac-44c8-b9f8-2003dfa7ae3e tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1503 microversion: 2.1 time: 0.168071 Jun 25 21:28:33.844545 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2917/6297] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:33 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:33.860693 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:33.861318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:33.867784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.868238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:33.869041 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:33.869524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.070081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:34.078550 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69091b1b-ab3a-43ba-9263-f4bdd5e9d5a0 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1503 microversion: 2.1 time: 0.222006 Jun 25 21:28:34.079230 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3381/6298] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:33 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:34.095154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:34.095702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:34.102026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.102493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.103265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.103709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.127202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lazy-loading 'flavor' on Instance uuid 80b4cf9e-0dc9-466e-adca-196855a27eca {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:28:34.203097 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9861122-4bc4-4a6a-9188-94c38dbbb758 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action" status: 202 len: 0 microversion: 2.1 time: 0.111670 Jun 25 21:28:34.203767 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2918/6299] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:28:34 2022] POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:28:34.212517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:34.213141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:34.219639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.220141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.220988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.221458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.366833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:34.376718 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4bace40e-0831-4a0c-b8ae-09a218928727 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1511 microversion: 2.1 time: 0.168014 Jun 25 21:28:34.378750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3382/6300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:34 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1511 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:34.380239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:34.380979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:34.393043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.393559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.394431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:34.394884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:34.488512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:34.498195 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b01d4af-f87a-4866-97bb-ff3aa59120a0 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.122317 Jun 25 21:28:34.499177 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2919/6301] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:34 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:35.395250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:35.396025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:35.403596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.404050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.404869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.405310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.516288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:35.517046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:35.524586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.525058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.525854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.526307 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.540721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:35.548839 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f5520de-98f5-4e6f-a6aa-6fb45ee68855 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1494 microversion: 2.1 time: 0.157624 Jun 25 21:28:35.549444 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3383/6302] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:35 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1494 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:35.567154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:35.567694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:35.574294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.574746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.575594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.576056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.613107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:35.620870 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-643671ae-bc6a-45c2-ba78-5161216e0b0e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.108865 Jun 25 21:28:35.621457 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2920/6303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:35 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:35.647663 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86d62e44-9135-4d2b-82b1-24aa56b2cf83 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action" status: 202 len: 0 microversion: 2.1 time: 0.084147 Jun 25 21:28:35.649992 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3384/6304] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:28:35 2022] POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:28:35.657656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:35.658320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:35.665912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.666402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.667198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:35.667742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:35.880387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:35.889326 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c11eb71-c3e7-46bc-bdf3-e95c6a2cabca tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1500 microversion: 2.1 time: 0.235474 Jun 25 21:28:35.889585 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2921/6305] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:35 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:36.476910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-0c30d2f4-9187-4ecd-88fb-2c9a70298cee req-949aa43c-618b-4c97-8fe7-9bafd1830154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2489a8f3-9d00-41e2-afe7-c2293bee876a", "name": "network-vif-plugged", "status": "completed", "tag": "7ef3a1fc-a082-40fb-8090-0ce4c79e4952"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:36.486407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0c30d2f4-9187-4ecd-88fb-2c9a70298cee req-949aa43c-618b-4c97-8fe7-9bafd1830154 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:36.486862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-0c30d2f4-9187-4ecd-88fb-2c9a70298cee req-949aa43c-618b-4c97-8fe7-9bafd1830154 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:36.498496 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-0c30d2f4-9187-4ecd-88fb-2c9a70298cee req-949aa43c-618b-4c97-8fe7-9bafd1830154 service nova] Creating event network-vif-plugged:7ef3a1fc-a082-40fb-8090-0ce4c79e4952 for instance 2489a8f3-9d00-41e2-afe7-c2293bee876a on nch1-master-1 Jun 25 21:28:36.504620 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-0c30d2f4-9187-4ecd-88fb-2c9a70298cee req-949aa43c-618b-4c97-8fe7-9bafd1830154 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034011 Jun 25 21:28:36.505328 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3385/6306] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:36.638233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:36.639087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:36.647275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:36.647784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:36.648618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:36.649078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:36.741215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:36.749070 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-704510ff-bd48-4376-af53-e0b4cf859912 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1298 microversion: 2.1 time: 0.115331 Jun 25 21:28:36.749671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2922/6307] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:36 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:36.910265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:36.911290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:36.918757 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:36.919256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:36.920160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:36.920709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:37.066047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:37.075026 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-663bd55c-57ea-4547-8631-d53ec7c1d964 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1500 microversion: 2.1 time: 0.170610 Jun 25 21:28:37.075571 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3386/6308] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:36 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1500 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:37.766154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:37.766811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:37.774522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:37.775622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:37.775866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:37.776415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:37.872797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:37.881377 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-945789dc-ca68-4cbf-b885-229459e13291 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1470 microversion: 2.1 time: 0.119490 Jun 25 21:28:37.882042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2923/6309] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:37 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:37.901717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:37.902661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:37.913250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:37.913250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:37.913250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:37.913250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.012806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:38.021384 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e285e35b-918d-4b7e-a5e6-b68b14a89800 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1470 microversion: 2.1 time: 0.125711 Jun 25 21:28:38.022007 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3387/6310] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:37 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:38.038468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.039094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.046123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.046571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.047401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.047860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.093539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.094125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.101092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.101550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.102328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.102775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.137424 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f658abe4-7573-463b-a39b-706c6ae6cc9e tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1621 microversion: 2.1 time: 0.102842 Jun 25 21:28:38.138640 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2924/6311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:38 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1621 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:38.155874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.156521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.163630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.164023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.164900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.165341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.259842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:38.269492 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71188f2d-9103-4dcd-9281-373669f95eff tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1503 microversion: 2.1 time: 0.180615 Jun 25 21:28:38.270481 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3388/6312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:38 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:38.287802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:38.288651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.295179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.295709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.296769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.297226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.325874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lazy-loading 'flavor' on Instance uuid 80b4cf9e-0dc9-466e-adca-196855a27eca {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:28:38.326342 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cad7f6d3-c4b6-4e8d-b75a-eca75740b6d2 tempest-TestSecurityGroupsBasicOps-1115132142 tempest-TestSecurityGroupsBasicOps-1115132142-project-admin] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1911 microversion: 2.1 time: 0.174472 Jun 25 21:28:38.327096 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2925/6313] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:38 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1911 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:38.380790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:38.404001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.404615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.408267 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca413dc5-1c74-45b1-82f8-c6d08c99da29 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action" status: 202 len: 0 microversion: 2.1 time: 0.124766 Jun 25 21:28:38.409108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3389/6314] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:28:38 2022] POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:28:38.411570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.412448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.417586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.418146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.419488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.419488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.429809 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.431315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.432707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.433096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.443963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:38.450014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:28:38.539274 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e8cf5249-e965-4304-9d38-71ac1c519b1a tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 204 len: 0 microversion: 2.1 time: 0.139198 Jun 25 21:28:38.539982 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2926/6315] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:28:38 2022] DELETE /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:28:38.550742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:38.551480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:38.558159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.558652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.559462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:38.559918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:38.564633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:38.592853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:38.601505 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9371ae9-1dd5-4e43-a4a9-41c9bd4c9fd6 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1511 microversion: 2.1 time: 0.187861 Jun 25 21:28:38.602170 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3390/6316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:38 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:38.649327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:38.656300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:38.664653 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-02cfed44-8f0c-42ca-9a2e-c7eb0aac863e tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1476 microversion: 2.1 time: 0.118640 Jun 25 21:28:38.665252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2927/6317] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:38 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1476 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:39.619283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:39.619902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:39.627567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.628112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.628911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.629377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.683661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:39.684352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:39.692570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.693032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.693815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.694261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.787957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:39.788142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:39.796701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0f780330-407b-45cc-ac50-633300006ffb tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 200 len: 1476 microversion: 2.1 time: 0.117158 Jun 25 21:28:39.796899 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-152524e7-a3d1-423c-964b-3156f44b84d1 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1494 microversion: 2.1 time: 0.181342 Jun 25 21:28:39.797343 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3391/6318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:39 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1494 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:39.797451 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2928/6319] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:39 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 1476 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:39.815419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:39.816242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:39.824290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.824412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.825154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.825599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.894619 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64b3e011-e60a-4087-a018-ff3eeba242cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action" status: 202 len: 0 microversion: 2.1 time: 0.083174 Jun 25 21:28:39.898064 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3392/6320] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:28:39 2022] POST /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:28:39.903269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:39.903982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:39.910584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.911027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:39.911879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:39.912374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:40.152524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:40.163962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-75f14811-8bf0-4541-bb6a-9482921dd5cd tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1500 microversion: 2.1 time: 0.264472 Jun 25 21:28:40.173991 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2929/6321] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:39 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:40.353424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-43c24baa-283e-44c0-bf2c-1fec6637b58a req-5f9b9445-6c0c-45e3-9e9c-744aebe5c8f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2489a8f3-9d00-41e2-afe7-c2293bee876a", "name": "network-vif-deleted", "tag": "7ef3a1fc-a082-40fb-8090-0ce4c79e4952"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:40.363563 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43c24baa-283e-44c0-bf2c-1fec6637b58a req-5f9b9445-6c0c-45e3-9e9c-744aebe5c8f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:40.364392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43c24baa-283e-44c0-bf2c-1fec6637b58a req-5f9b9445-6c0c-45e3-9e9c-744aebe5c8f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:40.382238 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-43c24baa-283e-44c0-bf2c-1fec6637b58a req-5f9b9445-6c0c-45e3-9e9c-744aebe5c8f8 service nova] Creating event network-vif-deleted:7ef3a1fc-a082-40fb-8090-0ce4c79e4952 for instance 2489a8f3-9d00-41e2-afe7-c2293bee876a on nch1-master-1 Jun 25 21:28:40.389172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-43c24baa-283e-44c0-bf2c-1fec6637b58a req-5f9b9445-6c0c-45e3-9e9c-744aebe5c8f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040375 Jun 25 21:28:40.396659 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3393/6322] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:40.815216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:40.822249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: 2489a8f3-9d00-41e2-afe7-c2293bee876a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:40.824840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:40.825153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:40.826002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:40.826554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:40.843541 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] HTTP exception thrown: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Request method failure captured: Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a HTTP/1.1 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit32ZAfi3uFVQNdCvV8vA0izt4XYnGE-HheJPk2Kj8vhitoRmar7rOgrWSQYbjOAOhocm2qD8LgBptsTZ3IoHKUgOqWda44ZSxZnOgCJ6UvvXnkD17Xu3hjj8w6LV_6hYZP5lJiOjMK1cnYIELQmA93Llfr6CUEljKb3ZoN3_Qjfo0Cc Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1578a50f2f074a0f8027d8376717a39c Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1578a50f2f074a0f8027d8376717a39c"}]}] Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1578a50f2f074a0f8027d8376717a39c Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestSecurityGroupsBasicOps-456210428-project Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 61f7e0c206e349a196bbd2c6562ee0e2 Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestSecurityGroupsBasicOps-456210428-project Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '2489a8f3-9d00-41e2-afe7-c2293bee876a'} Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:40.845272 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Returning 404 to user: Instance 2489a8f3-9d00-41e2-afe7-c2293bee876a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ea790e2-3e31-4e14-8698-6f8eeab7146d tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a" status: 404 len: 111 microversion: 2.1 time: 0.035824 Jun 25 21:28:40.849414 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2930/6323] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:40 2022] GET /compute/v2.1/servers/2489a8f3-9d00-41e2-afe7-c2293bee876a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:28:41.183133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:41.183868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:41.191021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:41.191536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:41.192741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:41.193343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:41.440213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:41.451448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9a09ee5-1981-4c80-8a59-924ddfc0e028 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1500 microversion: 2.1 time: 0.273350 Jun 25 21:28:41.452354 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3394/6324] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:41 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1500 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:42.470785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:42.471421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:42.479885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:42.480618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:42.481420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:42.481877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:42.738392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:42.747979 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1597a311-c486-476c-88c6-c5928c9513d3 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1503 microversion: 2.1 time: 0.281962 Jun 25 21:28:42.759987 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2931/6325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:42 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:42.769227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:42.769734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:42.779702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:42.780390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:42.781572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:42.782341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:42.854115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:28:42.983231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c30f7904-176e-484b-aef8-7b9e9736a776 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "DELETE /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 204 len: 0 microversion: 2.1 time: 0.221076 Jun 25 21:28:42.984226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3395/6326] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:28:42 2022] DELETE /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:28:43.000731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:43.001447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:43.012405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:43.013369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:43.014509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:43.015329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:43.187380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:43.198785 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59a610ff-a6bc-4f98-b844-5785817bde4f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1509 microversion: 2.1 time: 0.204179 Jun 25 21:28:43.199736 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2932/6327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:42 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:44.218953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:44.219592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:44.229115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:44.229852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:44.231062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:44.231657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:44.402207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:44.412115 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e17953e9-e057-4ddd-871e-db4c2d586250 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1509 microversion: 2.1 time: 0.198692 Jun 25 21:28:44.413120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3396/6328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:44 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:45.431145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:45.431926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:45.440045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:45.440682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:45.441593 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:45.442131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:45.791602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:45.801859 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19316794-788a-483a-aec8-96b064d5311f tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1509 microversion: 2.1 time: 0.374892 Jun 25 21:28:45.811985 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2933/6329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:45 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:45.830711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-887761a5-ffe8-4d6d-a77e-8bab6200e94b req-eb6516b4-56a7-4d30-8e9e-ccec7247a162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80b4cf9e-0dc9-466e-adca-196855a27eca", "name": "network-vif-deleted", "tag": "3748c729-1f72-47bb-bfc5-ca2dd1e1c78e"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:45.840577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-887761a5-ffe8-4d6d-a77e-8bab6200e94b req-eb6516b4-56a7-4d30-8e9e-ccec7247a162 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:45.841038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-887761a5-ffe8-4d6d-a77e-8bab6200e94b req-eb6516b4-56a7-4d30-8e9e-ccec7247a162 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:45.855878 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-887761a5-ffe8-4d6d-a77e-8bab6200e94b req-eb6516b4-56a7-4d30-8e9e-ccec7247a162 service nova] Creating event network-vif-deleted:3748c729-1f72-47bb-bfc5-ca2dd1e1c78e for instance 80b4cf9e-0dc9-466e-adca-196855a27eca on nch2-master-1 Jun 25 21:28:45.861526 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-887761a5-ffe8-4d6d-a77e-8bab6200e94b req-eb6516b4-56a7-4d30-8e9e-ccec7247a162 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Jun 25 21:28:45.862219 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3397/6330] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:45.987153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:45.988216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:45.999243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.000053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.001755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.002585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.050805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:28:46.170274 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d796efa-b0f5-4921-855e-69ff5a54a7b6 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 204 len: 0 microversion: 2.1 time: 0.189624 Jun 25 21:28:46.170861 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2934/6331] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:28:45 2022] DELETE /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:28:46.181864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:46.183121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:46.190729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.191395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.192301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.192841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.343294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:46.353147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c90dd304-f315-4fa7-a9b8-7bc123768234 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1766 microversion: 2.1 time: 0.177191 Jun 25 21:28:46.353937 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3398/6332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:46 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1766 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:28:46.820604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:46.822960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:46.829897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.830352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.831333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.831927 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.872949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:46.873420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:46.874250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lazy-loading 'fault' on Instance uuid 80b4cf9e-0dc9-466e-adca-196855a27eca {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:28:46.920541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '721e354ea8204dd7a77a6d01e9ca520b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0600178085744eb3925c615c9ee732c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:46.932891 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61807a0d-dd0f-417f-8607-c12e76e95114 tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 200 len: 1305 microversion: 2.1 time: 0.117029 Jun 25 21:28:46.933688 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2935/6333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:46 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:47.372111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:47.372826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:47.382156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:47.382655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:47.383610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:47.384326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:47.839336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:47.858400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16065f15-974f-4019-aaca-521d2565a0c8 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1766 microversion: 2.1 time: 0.490619 Jun 25 21:28:47.859092 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3399/6334] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:47 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1766 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:47.879343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-02a11cfc-d2f0-47d0-90e4-a9db11b7133a req-375bd06d-bd73-48ca-84f8-05376c139102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13d7be2-e727-4637-b045-3bab1e957c32", "tag": "c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:47.889343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-02a11cfc-d2f0-47d0-90e4-a9db11b7133a req-375bd06d-bd73-48ca-84f8-05376c139102 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:47.889802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-02a11cfc-d2f0-47d0-90e4-a9db11b7133a req-375bd06d-bd73-48ca-84f8-05376c139102 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:47.903632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-02a11cfc-d2f0-47d0-90e4-a9db11b7133a req-375bd06d-bd73-48ca-84f8-05376c139102 service nova] Creating event network-changed:c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee for instance f13d7be2-e727-4637-b045-3bab1e957c32 on nch2-master-1 Jun 25 21:28:47.910338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-02a11cfc-d2f0-47d0-90e4-a9db11b7133a req-375bd06d-bd73-48ca-84f8-05376c139102 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035226 Jun 25 21:28:47.911689 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2936/6335] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:47.951740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:47.952781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] [instance: 80b4cf9e-0dc9-466e-adca-196855a27eca] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:47.960653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:47.961892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:47.962969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:47.963678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:47.981200 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] HTTP exception thrown: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Request method failure captured: Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca HTTP/1.1 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit330UvpbrKKswpOd-A4s8DGC7WqPmrNmX5KLgssrWLPyAccfhrQAYrumtuuz-1IHFtjt6AVG-O9krev5dpG17UOVSfPL6-LZ73HdhpCVIzdhnY3SoR-6odr7upeCa54Wcr-X6z5GNPRo7BU7szR8xG89PZbtjZEYolDglETO31f7vzE Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 0600178085744eb3925c615c9ee732c2 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestServerAdvancedOps-1320384657 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0600178085744eb3925c615c9ee732c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0600178085744eb3925c615c9ee732c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0600178085744eb3925c615c9ee732c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0600178085744eb3925c615c9ee732c2"}]}] Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestServerAdvancedOps-1320384657 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 0600178085744eb3925c615c9ee732c2 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestServerAdvancedOps-1320384657 Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestServerAdvancedOps-1320384657-project Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 721e354ea8204dd7a77a6d01e9ca520b Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestServerAdvancedOps-1320384657-project Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '80b4cf9e-0dc9-466e-adca-196855a27eca'} Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:47.983672 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. Jun 25 21:28:47.987146 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:28:47.989360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] Returning 404 to user: Instance 80b4cf9e-0dc9-466e-adca-196855a27eca could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:28:47.990639 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1ea7e6aa-7f5d-4315-a723-6b56014b5b5c tempest-TestServerAdvancedOps-1320384657 tempest-TestServerAdvancedOps-1320384657-project] 10.222.0.39 "GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca" status: 404 len: 111 microversion: 2.1 time: 0.044076 Jun 25 21:28:47.991797 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3400/6336] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:47 2022] GET /compute/v2.1/servers/80b4cf9e-0dc9-466e-adca-196855a27eca => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:28:48.877384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:48.878667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:48.888492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:48.889149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:48.890046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:48.890817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:48.984080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:48.985175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:48.986118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lazy-loading 'fault' on Instance uuid f13d7be2-e727-4637-b045-3bab1e957c32 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:28:49.070825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61f7e0c206e349a196bbd2c6562ee0e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1578a50f2f074a0f8027d8376717a39c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:49.084050 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0382b5d1-d360-42da-95df-62b5fc5a38e9 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 200 len: 1534 microversion: 2.1 time: 0.212013 Jun 25 21:28:49.084684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2937/6337] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:48 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 1534 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:28:49.932338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-850796eb-3a48-4df8-938f-171e256efd5c req-56735921-cb73-4ffe-904e-14be80b5058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13d7be2-e727-4637-b045-3bab1e957c32", "name": "network-vif-deleted", "tag": "c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:49.942823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-850796eb-3a48-4df8-938f-171e256efd5c req-56735921-cb73-4ffe-904e-14be80b5058a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:49.943306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-850796eb-3a48-4df8-938f-171e256efd5c req-56735921-cb73-4ffe-904e-14be80b5058a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:49.956306 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-850796eb-3a48-4df8-938f-171e256efd5c req-56735921-cb73-4ffe-904e-14be80b5058a service nova] Creating event network-vif-deleted:c98d46ee-9571-4bd6-b3b5-5cbf4ee5ebee for instance f13d7be2-e727-4637-b045-3bab1e957c32 on nch2-master-1 Jun 25 21:28:49.961369 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-850796eb-3a48-4df8-938f-171e256efd5c req-56735921-cb73-4ffe-904e-14be80b5058a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036416 Jun 25 21:28:49.965111 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3401/6338] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:28:50.102548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:50.103096 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] [instance: f13d7be2-e727-4637-b045-3bab1e957c32] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:50.110416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:50.110816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:50.111706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:50.112168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:50.403611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] HTTP exception thrown: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Request method failure captured: Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 HTTP/1.1 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit32ZAfi3uFVQNdCvV8vA0izt4XYnGE-HheJPk2Kj8vhitoRmar7rOgrWSQYbjOAOhocm2qD8LgBptsTZ3IoHKUgOqWda44ZSxZnOgCJ6UvvXnkD17Xu3hjj8w6LV_6hYZP5lJiOjMK1cnYIELQmA93Llfr6CUEljKb3ZoN3_Qjfo0Cc Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 1578a50f2f074a0f8027d8376717a39c Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1578a50f2f074a0f8027d8376717a39c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1578a50f2f074a0f8027d8376717a39c"}]}] Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 1578a50f2f074a0f8027d8376717a39c Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-456210428 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestSecurityGroupsBasicOps-456210428-project Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 61f7e0c206e349a196bbd2c6562ee0e2 Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestSecurityGroupsBasicOps-456210428-project Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'f13d7be2-e727-4637-b045-3bab1e957c32'} Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:28:50.405332 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Returning 404 to user: Instance f13d7be2-e727-4637-b045-3bab1e957c32 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6de758dd-14a2-4f8d-9480-ea15af8c66a1 tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32" status: 404 len: 111 microversion: 2.1 time: 0.308533 Jun 25 21:28:50.413841 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2938/6339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:50 2022] GET /compute/v2.1/servers/f13d7be2-e727-4637-b045-3bab1e957c32 => generated 111 bytes in 310 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:28:54.489910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ba82ae5-5d7b-4f59-b9ff-680c7bf2079c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] Calling method '.version_select at 0x7f984ef23f70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:54.529531 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ba82ae5-5d7b-4f59-b9ff-680c7bf2079c tempest-TestSecurityGroupsBasicOps-456210428 tempest-TestSecurityGroupsBasicOps-456210428-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-744410256" status: 202 len: 0 microversion: 2.1 time: 0.050121 Jun 25 21:28:54.530527 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3402/6340] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:28:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-744410256 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:28:59.350738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:59.352687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:59.369055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:59.369775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:59.370766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:59.371297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:59.373293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-50d81ffb-4d1d-4676-b0fa-26dbccd234e3 req-c6e0107c-0539-4ac4-879a-bf42358a12b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:28:59.379039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:28:59.401295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50d81ffb-4d1d-4676-b0fa-26dbccd234e3 req-c6e0107c-0539-4ac4-879a-bf42358a12b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:59.402517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50d81ffb-4d1d-4676-b0fa-26dbccd234e3 req-c6e0107c-0539-4ac4-879a-bf42358a12b1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:59.420371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:28:59.424480 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-50d81ffb-4d1d-4676-b0fa-26dbccd234e3 req-c6e0107c-0539-4ac4-879a-bf42358a12b1 service nova] Creating event network-changed:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:28:59.435824 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-50d81ffb-4d1d-4676-b0fa-26dbccd234e3 req-c6e0107c-0539-4ac4-879a-bf42358a12b1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067105 Jun 25 21:28:59.437652 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3403/6341] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:28:59.553242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88b8d286-a03a-4074-ba8c-ec1b8d33a969 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "DELETE /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 204 len: 0 microversion: 2.1 time: 0.206424 Jun 25 21:28:59.555116 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2939/6342] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:28:59 2022] DELETE /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:28:59.588133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:28:59.595297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:28:59.624335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:59.626705 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:59.634755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:28:59.636837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:28:59.926559 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:28:59.945807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6ee5c73d-ca57-403b-a9e5-2bc60f66e67d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1584 microversion: 2.1 time: 0.384367 Jun 25 21:28:59.947568 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3404/6343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:28:59 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1584 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:00.967816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:00.969084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:00.977364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:00.988934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:00.989570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:00.990517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:00.991518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:01.264501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:01.274610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55de29c3-8286-4107-a9e2-dd846576aa62 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1584 microversion: 2.1 time: 0.313420 Jun 25 21:29:01.280514 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2940/6344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:00 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1584 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:02.008246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-032ed73a-f59a-47b0-b77c-b69f24b0360c req-be0c4fa8-789e-4db0-ae7b-55f58fdcff12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16c351c3-e093-42e1-870d-0f522cb40138", "name": "network-vif-deleted", "tag": "098fb37a-03c3-4095-8cd1-eb117ea9cc38"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:02.019859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-032ed73a-f59a-47b0-b77c-b69f24b0360c req-be0c4fa8-789e-4db0-ae7b-55f58fdcff12 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:02.020963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-032ed73a-f59a-47b0-b77c-b69f24b0360c req-be0c4fa8-789e-4db0-ae7b-55f58fdcff12 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:02.036504 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-032ed73a-f59a-47b0-b77c-b69f24b0360c req-be0c4fa8-789e-4db0-ae7b-55f58fdcff12 service nova] Creating event network-vif-deleted:098fb37a-03c3-4095-8cd1-eb117ea9cc38 for instance 16c351c3-e093-42e1-870d-0f522cb40138 on nch1-master-1 Jun 25 21:29:02.044174 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-032ed73a-f59a-47b0-b77c-b69f24b0360c req-be0c4fa8-789e-4db0-ae7b-55f58fdcff12 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039000 Jun 25 21:29:02.049846 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3405/6345] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:02.292587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:02.293268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:02.307537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:02.308186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:02.309930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:02.312276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:02.379274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:02.379961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:02.381217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lazy-loading 'fault' on Instance uuid 16c351c3-e093-42e1-870d-0f522cb40138 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:29:02.390260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:02.476278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7ea2397650748afa9edf0864829c434', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '039691ff93174f54aaaa13770a444aa2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:02.486358 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f02cc456-1598-40fc-a265-fc8bd6c1e55d tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 200 len: 1402 microversion: 2.1 time: 0.198664 Jun 25 21:29:02.488412 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2941/6346] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:02 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 1402 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:03.510112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:03.510888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] [instance: 16c351c3-e093-42e1-870d-0f522cb40138] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:03.523751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:03.524455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:03.526123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:03.531539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:03.554537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] HTTP exception thrown: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Request method failure captured: Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 HTTP/1.1 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit32-2PK76I99GDyfIjsv_Gtftl8S63znjA6BsFsDPqhvtlq6LJegZ7Yuw5tDfQ1OLoVa8WeQBVORjiGFafvCWW3ONMrR4gwzGMBHSZMhjXFyUF6AZ_iL93AGr851b5-GSqVudpikTXeanhBWU2pnHjVhh_clYivRLkGdu20H3KxLVFs Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 039691ff93174f54aaaa13770a444aa2 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBackupRestore-224445072 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/039691ff93174f54aaaa13770a444aa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/039691ff93174f54aaaa13770a444aa2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_039691ff93174f54aaaa13770a444aa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/039691ff93174f54aaaa13770a444aa2"}]}] Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBackupRestore-224445072 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 039691ff93174f54aaaa13770a444aa2 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBackupRestore-224445072 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBackupRestore-224445072-project Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: f7ea2397650748afa9edf0864829c434 Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBackupRestore-224445072-project Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '16c351c3-e093-42e1-870d-0f522cb40138'} Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:29:03.556477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. Jun 25 21:29:03.561252 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:29:03.562952 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Returning 404 to user: Instance 16c351c3-e093-42e1-870d-0f522cb40138 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:29:03.564865 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fb705e5-3614-48b8-9011-6257f85848e3 tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138" status: 404 len: 111 microversion: 2.1 time: 0.061691 Jun 25 21:29:03.565994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3406/6347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:03 2022] GET /compute/v2.1/servers/16c351c3-e093-42e1-870d-0f522cb40138 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:29:03.789834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ea45968-b0a1-4883-b163-575980ab97ee tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] Calling method '.version_select at 0x7f984e66e820>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:03.836960 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ea45968-b0a1-4883-b163-575980ab97ee tempest-TestVolumeBackupRestore-224445072 tempest-TestVolumeBackupRestore-224445072-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1147821589" status: 202 len: 0 microversion: 2.1 time: 0.068174 Jun 25 21:29:03.839390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3407/6348] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1147821589 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:29:03.973833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1c8af3c-da3b-4efb-96a2-75053fb89cbe tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Action: 'create', calling method: .version_select at 0x7f9861f0c3a0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1789145652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKzOSFzqwhvgTmrNvtninxlomm3cwajYFr48alYuNomTe6FgRZ57Xt2G3bx4Y1mHMuIq/nsFtmHzrv5+0Xuigt3vbvEn2EvRtcyEY8HZrYJlLnCN76A6L3jSz0GlcUuzQ=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:03.993402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f1c8af3c-da3b-4efb-96a2-75053fb89cbe tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:29:04.000826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-f1c8af3c-da3b-4efb-96a2-75053fb89cbe tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for user d83e6898693c4e39a3959609c266f550 and project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:29:04.033965 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f1c8af3c-da3b-4efb-96a2-75053fb89cbe tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.353602 Jun 25 21:29:04.040326 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2942/6349] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:29:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:05.189508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-104924169", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1789145652", "security_groups": [{"name": "tempest-secgroup-smoke-479406556"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a80f3a40-21f8-4e19-acc0-79958778e37e"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:05.369538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] validate_networks() for [('a80f3a40-21f8-4e19-acc0-79958778e37e', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:29:05.827543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:29:05.832995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for user d83e6898693c4e39a3959609c266f550 and project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: dict_keys(['metadata_items']) {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:29:05.846384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:29:05.846818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:29:05.847306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:29:05.847721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:29:05.848143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:29:05.856325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:05.856840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:05.857646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:05.858084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:05.874934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:29:05.880238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Getting quotas for user d83e6898693c4e39a3959609c266f550 and project 47f83fd0806d415bbe911f1d51ad3c2c. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:29:05.893578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:29:05.896012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:29:05.944380 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16e91491-9aea-42b4-9d46-fc35daa57ed1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759678 Jun 25 21:29:05.945415 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3408/6350] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:29:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:29:05.957015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0cbd4cf-7826-41dd-81ed-aeefca5315ba tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:05.957653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0cbd4cf-7826-41dd-81ed-aeefca5315ba tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:06.017255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0cbd4cf-7826-41dd-81ed-aeefca5315ba tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:06.024921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0cbd4cf-7826-41dd-81ed-aeefca5315ba tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1302 microversion: 2.1 time: 0.072885 Jun 25 21:29:06.025495 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2943/6351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:05 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1302 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:07.042637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:07.043436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:07.051191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:07.051745 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:07.052646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:07.053197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:07.121749 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:07.131285 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d85dd044-aeb5-4681-99dc-73c438d150a9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1354 microversion: 2.1 time: 0.093664 Jun 25 21:29:07.131943 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3409/6352] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:07 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:08.150745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:08.151442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:08.162367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:08.163444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:08.164266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:08.164756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:08.344335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:08.352487 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3fe5dc03-c2ff-44e5-a869-ac13c8424a01 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.207369 Jun 25 21:29:08.362462 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2944/6353] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:08 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:09.034773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-7392479d-ac45-44d5-94ed-a4bae68b9c8d req-4c8b1451-2944-4eba-aafd-11375594b0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e34839-e8ce-44b1-9215-1b4d8d9e28d2", "tag": "0333e13f-88c6-48db-bdc5-81a8d5b95dcd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:09.047817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7392479d-ac45-44d5-94ed-a4bae68b9c8d req-4c8b1451-2944-4eba-aafd-11375594b0ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:09.048353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-7392479d-ac45-44d5-94ed-a4bae68b9c8d req-4c8b1451-2944-4eba-aafd-11375594b0ee service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:09.053993 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:09.065407 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-7392479d-ac45-44d5-94ed-a4bae68b9c8d req-4c8b1451-2944-4eba-aafd-11375594b0ee service nova] Creating event network-changed:0333e13f-88c6-48db-bdc5-81a8d5b95dcd for instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 on nch2-master-1 Jun 25 21:29:09.073506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-7392479d-ac45-44d5-94ed-a4bae68b9c8d req-4c8b1451-2944-4eba-aafd-11375594b0ee service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044330 Jun 25 21:29:09.074735 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3410/6354] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:09.370176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:09.370926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:09.378967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:09.379471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:09.380273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:09.380761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:09.522350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:09.530640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6c561b3-aaa2-4ed7-a882-96b2c3b31e16 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.164441 Jun 25 21:29:09.531248 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2945/6355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:09 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:10.548088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:10.548818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:10.557759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:10.558333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:10.559124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:10.559614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:10.814147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:10.828385 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-789c448d-5357-4eaa-93bc-97d87475a668 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.284624 Jun 25 21:29:10.829016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3411/6356] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:10 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:11.845761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:11.846616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:11.853988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:11.854561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:11.855470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:11.856016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:12.020340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:12.028253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16d32ebc-505c-481e-816f-1d9bb2c9e92f tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.186692 Jun 25 21:29:12.028881 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2946/6357] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:11 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:13.046959 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:13.047816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:13.060486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:13.061122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:13.062077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:13.062655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:13.212923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:13.221627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ea241cd7-9042-4ebb-b841-15e66922e71d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.178907 Jun 25 21:29:13.222242 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3412/6358] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:13 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:14.241935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:14.242581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:14.252508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:14.253152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:14.257181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:14.258110 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:14.488099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:14.495930 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e60cf3b8-9b62-4bc4-8cbc-c6829f6da706 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.261440 Jun 25 21:29:14.496560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2947/6359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:14 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:15.514356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:15.515286 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:15.522913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:15.523394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:15.524163 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:15.524642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:15.762554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:15.774565 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3278caf7-737b-46be-9cb3-f94dd898c2b7 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.264831 Jun 25 21:29:15.776367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3413/6360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:15 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:15.886800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cd68ce00-0d95-4177-8a1d-933048c8ed04 req-94475969-639f-41f8-9a32-621cd654d564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e34839-e8ce-44b1-9215-1b4d8d9e28d2", "name": "network-vif-plugged", "status": "completed", "tag": "0333e13f-88c6-48db-bdc5-81a8d5b95dcd"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:15.897137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cd68ce00-0d95-4177-8a1d-933048c8ed04 req-94475969-639f-41f8-9a32-621cd654d564 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:15.897599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cd68ce00-0d95-4177-8a1d-933048c8ed04 req-94475969-639f-41f8-9a32-621cd654d564 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:15.910095 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cd68ce00-0d95-4177-8a1d-933048c8ed04 req-94475969-639f-41f8-9a32-621cd654d564 service nova] Creating event network-vif-plugged:0333e13f-88c6-48db-bdc5-81a8d5b95dcd for instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 on nch2-master-1 Jun 25 21:29:15.917045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cd68ce00-0d95-4177-8a1d-933048c8ed04 req-94475969-639f-41f8-9a32-621cd654d564 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106486 Jun 25 21:29:15.917045 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2948/6361] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:16.793220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:16.795035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:16.797634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:16.798827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:16.807429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:16.808142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:16.811787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:16.812335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:16.983622 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:16.991481 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90ca9132-7e00-4dc2-a0e7-083fdf10624b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1427 microversion: 2.1 time: 0.202653 Jun 25 21:29:16.992067 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3414/6362] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:16 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1427 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:18.006238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:18.013629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:18.014375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:18.022223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.022691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.023673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.024120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.180898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:18.192715 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50104b56-95ed-4fe8-85fc-e121b1fe8e9b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1608 microversion: 2.1 time: 0.187409 Jun 25 21:29:18.193415 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2949/6363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:18 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1608 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:18.212855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:18.213480 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:18.220778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.221242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.222136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.222577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.380099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:18.388288 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9524d797-6db9-46c1-b349-3280094badd9 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1608 microversion: 2.1 time: 0.179524 Jun 25 21:29:18.388944 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3415/6364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:18 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1608 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:18.406943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:18.407579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:18.414142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.414617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.415431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:18.415885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:18.560459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:18.568444 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ea74bd0-3a59-4f3f-b09f-cf88ef4f3b78 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1608 microversion: 2.1 time: 0.165604 Jun 25 21:29:18.569057 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2950/6365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:18 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1608 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:20.567386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-51c3b4f9-14f2-4335-ac67-c685b3b701c9 req-6cf04cee-c0e8-49d7-a672-1f6bb652f539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e34839-e8ce-44b1-9215-1b4d8d9e28d2", "tag": "0333e13f-88c6-48db-bdc5-81a8d5b95dcd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:20.576702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-51c3b4f9-14f2-4335-ac67-c685b3b701c9 req-6cf04cee-c0e8-49d7-a672-1f6bb652f539 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:20.577380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-51c3b4f9-14f2-4335-ac67-c685b3b701c9 req-6cf04cee-c0e8-49d7-a672-1f6bb652f539 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:20.590191 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-51c3b4f9-14f2-4335-ac67-c685b3b701c9 req-6cf04cee-c0e8-49d7-a672-1f6bb652f539 service nova] Creating event network-changed:0333e13f-88c6-48db-bdc5-81a8d5b95dcd for instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 on nch2-master-1 Jun 25 21:29:20.596234 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-51c3b4f9-14f2-4335-ac67-c685b3b701c9 req-6cf04cee-c0e8-49d7-a672-1f6bb652f539 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185623 Jun 25 21:29:20.600960 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3416/6366] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:52.515137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:52.516093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:52.519267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:52.519968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=41 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:52.526038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:52.526523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:52.527311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:52.527764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:52.558132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:29:52.644128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d09cc58-60fb-4a62-b123-2db9d078c085 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 204 len: 0 microversion: 2.1 time: 0.135604 Jun 25 21:29:52.644855 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2951/6367] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:29:52 2022] DELETE /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:29:52.652167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:52.652967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=33 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:29:52.657483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:52.658190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:52.665900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:52.666385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:52.667259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:52.667706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:52.807620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:52.816108 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee60d59a-dcca-457f-8ae7-c1bb28df1f8d tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1576 microversion: 2.1 time: 0.166579 Jun 25 21:29:52.816975 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3417/6368] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:52 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:53.834459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:53.835188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:53.843050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:53.843528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:53.844314 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:53.844817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:53.993399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:54.001553 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3b65fec-f1ea-4ae4-a245-99a8015d3373 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1576 microversion: 2.1 time: 0.171485 Jun 25 21:29:54.002127 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2952/6369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:53 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:55.019009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:55.019633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:55.026846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:55.027267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:55.028352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:55.028825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:55.062929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-189f0c3c-cb37-49e6-b58b-345a8a79f849 req-ad104795-a98c-41d6-ab9a-0fd76b4e929f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "433bbb89-5296-4366-bf36-6e4eb85de73d", "name": "network-vif-deleted", "tag": "3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:55.076519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-189f0c3c-cb37-49e6-b58b-345a8a79f849 req-ad104795-a98c-41d6-ab9a-0fd76b4e929f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:55.076983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-189f0c3c-cb37-49e6-b58b-345a8a79f849 req-ad104795-a98c-41d6-ab9a-0fd76b4e929f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:55.089254 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-189f0c3c-cb37-49e6-b58b-345a8a79f849 req-ad104795-a98c-41d6-ab9a-0fd76b4e929f service nova] Creating event network-vif-deleted:3ef56e8f-0cbb-420a-b082-7a3ca21ebcf7 for instance 433bbb89-5296-4366-bf36-6e4eb85de73d on nch1-master-1 Jun 25 21:29:55.098909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-189f0c3c-cb37-49e6-b58b-345a8a79f849 req-ad104795-a98c-41d6-ab9a-0fd76b4e929f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036448 Jun 25 21:29:55.098909 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2953/6370] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:29:55.108995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:55.119734 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ce17c8bf-dc93-427e-a342-1bf52d6373d0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 200 len: 1508 microversion: 2.1 time: 0.104719 Jun 25 21:29:55.120335 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3418/6371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:55 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 1508 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:56.138739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:56.139454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:56.146397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:56.146903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:56.147695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:56.148148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:56.163337 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d HTTP/1.1 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '433bbb89-5296-4366-bf36-6e4eb85de73d'} Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:29:56.165266 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:29:56.170795 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94f742c0-1488-4377-8dd9-02759265a753 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 404 len: 111 microversion: 2.1 time: 0.033179 Jun 25 21:29:56.175485 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2954/6372] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:56 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:29:56.267610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-935106552", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-365734542", "security_groups": [{"name": "tempest-secgroup-smoke-1105187054"}], "block_device_mapping_v2": [{"uuid": "45c469bc-53fa-489d-b96f-d0f49a47cac1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:56.395644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:29:56.808787 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:29:56.809219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:29:56.809702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:29:56.810115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:29:56.810538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:29:56.820201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:56.821052 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:56.821843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:56.822295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:56.840088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:29:56.845459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:29:56.904719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:29:56.906864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45c469bc-53fa-489d-b96f-d0f49a47cac1',volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:29:57.056215 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2fc33086-c92b-4709-831c-8ca720a630b0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.792741 Jun 25 21:29:57.056947 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3419/6373] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:29:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:29:57.066960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4100e936-939a-4a59-9b1d-f65b36ff45b4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:57.067588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4100e936-939a-4a59-9b1d-f65b36ff45b4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:57.124488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4100e936-939a-4a59-9b1d-f65b36ff45b4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:57.131482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4100e936-939a-4a59-9b1d-f65b36ff45b4 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1093 microversion: 2.1 time: 0.068466 Jun 25 21:29:57.132042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2955/6374] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:57 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:29:58.149729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:58.150333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:58.157424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:58.157883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:58.158648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:58.159092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:58.242717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:58.251502 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a45e9ce9-2258-48db-9a36-c3aecd553312 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1191 microversion: 2.1 time: 0.106774 Jun 25 21:29:58.252084 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3420/6375] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:58 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1191 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:59.272853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:29:59.273827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:29:59.283801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:59.284806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:59.286427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:59.287262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:59.448592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:29:59.461032 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0253e72-2e41-473b-9709-18b145110407 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1277 microversion: 2.1 time: 0.194034 Jun 25 21:29:59.471089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2956/6376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:29:59 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:29:59.941198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f3c1c84e-c4c2-4197-a786-2d3e0a36ba88 req-3612784e-af23-4198-9b9c-d927e1bb27e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7be5e1-ad01-4caf-82a6-4214c6f2b27d", "tag": "317add1f-3bde-4939-a5f4-e670a66c4249"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:29:59.956263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f3c1c84e-c4c2-4197-a786-2d3e0a36ba88 req-3612784e-af23-4198-9b9c-d927e1bb27e0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:29:59.957200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f3c1c84e-c4c2-4197-a786-2d3e0a36ba88 req-3612784e-af23-4198-9b9c-d927e1bb27e0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:29:59.972584 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f3c1c84e-c4c2-4197-a786-2d3e0a36ba88 req-3612784e-af23-4198-9b9c-d927e1bb27e0 service nova] Creating event network-changed:317add1f-3bde-4939-a5f4-e670a66c4249 for instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d on nch1-master-1 Jun 25 21:29:59.979881 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f3c1c84e-c4c2-4197-a786-2d3e0a36ba88 req-3612784e-af23-4198-9b9c-d927e1bb27e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043768 Jun 25 21:29:59.981144 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3421/6377] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:30:00.483468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:00.484507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:00.496400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:00.497255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:00.498549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:00.499318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:00.638549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:00.646837 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a71d4d89-1eb5-47b1-929e-315cd88d9021 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1265 microversion: 2.1 time: 0.170241 Jun 25 21:30:00.647419 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2957/6378] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:00 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:01.669910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:01.670644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:01.678270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:01.678754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:01.679566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:01.680009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:01.821920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:01.830168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6931a1e8-ca6f-4efc-b99c-6b7e0b76d17a tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1265 microversion: 2.1 time: 0.164557 Jun 25 21:30:01.830762 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3422/6379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:01 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:02.847410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:02.848124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:02.855656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:02.856134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:02.857044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:02.857508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:02.992935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:03.000804 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14c1cbc4-5c75-4d3b-94a9-1d48f159d942 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1265 microversion: 2.1 time: 0.157344 Jun 25 21:30:03.001394 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2958/6380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:02 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:04.017524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:04.018136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:04.025772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:04.026224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:04.026981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:04.027413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:04.178865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:04.187039 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5be61054-d40b-401e-96cb-deed825684da tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1265 microversion: 2.1 time: 0.173524 Jun 25 21:30:04.187621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3423/6381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:04 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:04.860300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1aed64b8-08f4-4251-a9a5-c5874f31596c req-971c9ca3-c5e2-4a94-8509-cf089a4b6712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7be5e1-ad01-4caf-82a6-4214c6f2b27d", "name": "network-vif-plugged", "status": "completed", "tag": "317add1f-3bde-4939-a5f4-e670a66c4249"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:30:04.870660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1aed64b8-08f4-4251-a9a5-c5874f31596c req-971c9ca3-c5e2-4a94-8509-cf089a4b6712 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:04.871127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1aed64b8-08f4-4251-a9a5-c5874f31596c req-971c9ca3-c5e2-4a94-8509-cf089a4b6712 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:04.885938 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1aed64b8-08f4-4251-a9a5-c5874f31596c req-971c9ca3-c5e2-4a94-8509-cf089a4b6712 service nova] Creating event network-vif-plugged:317add1f-3bde-4939-a5f4-e670a66c4249 for instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d on nch1-master-1 Jun 25 21:30:04.891052 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1aed64b8-08f4-4251-a9a5-c5874f31596c req-971c9ca3-c5e2-4a94-8509-cf089a4b6712 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Jun 25 21:30:04.891674 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2959/6382] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:30:05.205404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:05.206039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:05.213528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:05.213988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:05.214761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:05.215205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:05.348214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:05.359608 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91031731-0c9b-4a83-a059-486be65e2386 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1265 microversion: 2.1 time: 0.158055 Jun 25 21:30:05.360400 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3424/6383] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:05 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:06.377485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:06.378079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:06.385823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:06.386293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:06.387080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:06.387532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:06.524452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:06.532677 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2e8b0388-b8dc-4a57-a284-2dc415ce86ea tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1452 microversion: 2.1 time: 0.159654 Jun 25 21:30:06.533331 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2960/6384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:06 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:06.549033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:06.549759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:06.558974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:06.559521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:06.560380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:06.560897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:06.776642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:30:06.786863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d8b090c7-a850-44bd-b990-fe524f708587 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1452 microversion: 2.1 time: 0.241562 Jun 25 21:30:06.787621 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3425/6385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:30:06 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:30:08.729661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4d98e26f-efa4-43cf-a324-5d052c7f0d1c req-686d4125-1359-4ec2-a92d-d1785ffd5fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7be5e1-ad01-4caf-82a6-4214c6f2b27d", "tag": "317add1f-3bde-4939-a5f4-e670a66c4249"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:30:08.733313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:08.741084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4d98e26f-efa4-43cf-a324-5d052c7f0d1c req-686d4125-1359-4ec2-a92d-d1785ffd5fe7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:08.741542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4d98e26f-efa4-43cf-a324-5d052c7f0d1c req-686d4125-1359-4ec2-a92d-d1785ffd5fe7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:08.753087 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4d98e26f-efa4-43cf-a324-5d052c7f0d1c req-686d4125-1359-4ec2-a92d-d1785ffd5fe7 service nova] Creating event network-changed:317add1f-3bde-4939-a5f4-e670a66c4249 for instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d on nch1-master-1 Jun 25 21:30:08.758246 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4d98e26f-efa4-43cf-a324-5d052c7f0d1c req-686d4125-1359-4ec2-a92d-d1785ffd5fe7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032416 Jun 25 21:30:08.758876 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2961/6386] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:30:27.362214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:30:27.362735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:30:27.366213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:27.367211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:27.367950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:27.368792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=46 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:30:27.375872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:27.376397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:27.377193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:30:27.377631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:30:27.404345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8884b497-f31d-4321-a60b-302742e6057d tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.047542 Jun 25 21:30:27.405000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3426/6387] 10.222.0.39 () {58 vars in 1292 bytes} [Sat Jun 25 21:30:27 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2/os-server-password => generated 116 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:31:47.803160 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 21:31:47.804352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:47.805209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:47.809954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1404524633", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-365734542", "security_groups": [{"name": "tempest-secgroup-smoke-1105187054"}], "block_device_mapping_v2": [{"uuid": "020f313c-d48f-42f6-9ac9-70ef9031c609", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fddb5e29-3df8-4cba-afa6-45f52c35089a"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:31:47.933059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] validate_networks() for [('fddb5e29-3df8-4cba-afa6-45f52c35089a', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:31:48.323538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:31:48.324168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:31:48.324749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:31:48.325185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:31:48.326219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:31:48.337725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:48.338198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:48.339021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:48.339483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:48.357613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:31:48.363256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Getting quotas for user 8d162afa6d9b48ef9fac1bf23c0c41e9 and project d1a396ec47a346dc97426df498e54ab2. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:31:48.422448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:31:48.424746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='020f313c-d48f-42f6-9ac9-70ef9031c609',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:31:48.557721 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d6dbcea0-229f-4db9-a780-1600d11d9799 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.757169 Jun 25 21:31:48.558405 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2962/6388] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:31:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:31:48.566760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:48.567960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:48.572204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fd16596-5010-464f-8fcb-cf1f8bc32667 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:48.572863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fd16596-5010-464f-8fcb-cf1f8bc32667 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:48.628555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fd16596-5010-464f-8fcb-cf1f8bc32667 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:48.636077 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fd16596-5010-464f-8fcb-cf1f8bc32667 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1094 microversion: 2.1 time: 0.071285 Jun 25 21:31:48.636686 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3427/6389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:48 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:49.656514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:49.657141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:49.666500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:49.667226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:49.668784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:49.669389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:49.677782 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 36834. Jun 25 21:31:49.741624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:49.750937 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8f814b77-66dc-4073-92ae-36079917584b tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1210 microversion: 2.1 time: 0.100960 Jun 25 21:31:49.751661 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2963/6390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:49 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:50.769298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:50.770092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:50.783012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:50.784207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:50.785690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:50.786143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:50.989538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1a3c057e-c300-417a-bc13-ef28139e2d60 req-01e2ed65-62f8-444f-9e16-329ee9e45fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e470cc7e-3fc9-4e57-bf25-37410e958e7f", "tag": "3155991d-9e3b-427c-9dbb-8961ff7ceaab"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:31:51.012906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1a3c057e-c300-417a-bc13-ef28139e2d60 req-01e2ed65-62f8-444f-9e16-329ee9e45fc6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:51.013726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1a3c057e-c300-417a-bc13-ef28139e2d60 req-01e2ed65-62f8-444f-9e16-329ee9e45fc6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:51.024069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:51.028457 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1a3c057e-c300-417a-bc13-ef28139e2d60 req-01e2ed65-62f8-444f-9e16-329ee9e45fc6 service nova] Creating event network-changed:3155991d-9e3b-427c-9dbb-8961ff7ceaab for instance e470cc7e-3fc9-4e57-bf25-37410e958e7f on nch1-master-1 Jun 25 21:31:51.035902 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1a3c057e-c300-417a-bc13-ef28139e2d60 req-01e2ed65-62f8-444f-9e16-329ee9e45fc6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051990 Jun 25 21:31:51.037019 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2964/6391] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:31:51.042276 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16c8cf98-362a-48b0-b8b5-526b72d79e2c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.278066 Jun 25 21:31:51.053776 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3428/6392] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:50 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:52.061300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:52.062149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:52.068635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:52.069116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:52.069909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:52.070356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:52.244561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:52.252573 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-88e0d8ef-9950-4dd3-9cc8-c4e1d4cfe66e tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.196491 Jun 25 21:31:52.253351 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2965/6393] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:52 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:53.274308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:53.275603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:53.286904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:53.287762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:53.288572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:53.289012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:53.424990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:53.432711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2232cb93-dc42-4e98-a160-1b6060f17a89 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.165349 Jun 25 21:31:53.433279 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3429/6394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:53 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:54.453431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:54.454046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:54.463790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:54.464288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:54.465121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:54.465572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:54.612764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:54.620870 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b5f5cdd-898c-48c4-89e0-b9dfbe29f086 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.174292 Jun 25 21:31:54.621479 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2966/6395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:54 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:55.638089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:55.638670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:55.646124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:55.646576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:55.647352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:55.647827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:55.784183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:55.793680 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5321f26f-e84e-4e7b-8384-07ead5abaeaf tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.159804 Jun 25 21:31:55.794276 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3430/6396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:55 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:56.814279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:56.816043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:56.825491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:56.826328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:56.827122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:56.827575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:56.959124 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:56.968254 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b5e7b57e-97c5-4de1-9868-1a8d925bc2c0 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.160632 Jun 25 21:31:56.968913 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2967/6397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:56 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:57.294254 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-66e67d12-64b7-4173-a26c-c96315538097 req-5a078f58-4afc-42cd-8286-28f76d6455cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e470cc7e-3fc9-4e57-bf25-37410e958e7f", "name": "network-vif-plugged", "status": "completed", "tag": "3155991d-9e3b-427c-9dbb-8961ff7ceaab"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:31:57.306442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-66e67d12-64b7-4173-a26c-c96315538097 req-5a078f58-4afc-42cd-8286-28f76d6455cd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:57.306918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-66e67d12-64b7-4173-a26c-c96315538097 req-5a078f58-4afc-42cd-8286-28f76d6455cd service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:57.318536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-66e67d12-64b7-4173-a26c-c96315538097 req-5a078f58-4afc-42cd-8286-28f76d6455cd service nova] Creating event network-vif-plugged:3155991d-9e3b-427c-9dbb-8961ff7ceaab for instance e470cc7e-3fc9-4e57-bf25-37410e958e7f on nch1-master-1 Jun 25 21:31:57.323741 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-66e67d12-64b7-4173-a26c-c96315538097 req-5a078f58-4afc-42cd-8286-28f76d6455cd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033379 Jun 25 21:31:57.324564 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3431/6398] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:31:57.986656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:57.987322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:57.995776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:57.996252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:57.997081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:57.997568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:58.142608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:58.150993 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b014a9d1-4de3-4326-a017-9e85e4b55ffd tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1266 microversion: 2.1 time: 0.169163 Jun 25 21:31:58.151570 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2968/6399] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:57 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:59.170389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:59.176888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:59.177607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:59.186636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:59.187083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:59.187854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:59.188297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:59.348794 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:59.356875 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2bb9e6ce-7ab2-4e6b-b077-10d16cddf51f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1452 microversion: 2.1 time: 0.189718 Jun 25 21:31:59.357454 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3432/6400] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:59 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:31:59.375744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:31:59.376491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:31:59.379053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:59.379821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:31:59.388951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:59.389592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:59.390704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:31:59.391248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:31:59.533891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:31:59.546248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-397c05aa-6abc-4d1d-b9c1-cc0659374c04 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1452 microversion: 2.1 time: 0.176550 Jun 25 21:31:59.547194 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2969/6401] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:31:59 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:32:01.171929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9fc0975c-1449-4d93-8624-baf61b8c6e04 req-4e7599a1-19ca-4c0a-9edc-0417e161617e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e470cc7e-3fc9-4e57-bf25-37410e958e7f", "tag": "3155991d-9e3b-427c-9dbb-8961ff7ceaab"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:32:01.181048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9fc0975c-1449-4d93-8624-baf61b8c6e04 req-4e7599a1-19ca-4c0a-9edc-0417e161617e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:32:01.181500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9fc0975c-1449-4d93-8624-baf61b8c6e04 req-4e7599a1-19ca-4c0a-9edc-0417e161617e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:32:01.193842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-9fc0975c-1449-4d93-8624-baf61b8c6e04 req-4e7599a1-19ca-4c0a-9edc-0417e161617e service nova] Creating event network-changed:3155991d-9e3b-427c-9dbb-8961ff7ceaab for instance e470cc7e-3fc9-4e57-bf25-37410e958e7f on nch1-master-1 Jun 25 21:32:01.199422 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9fc0975c-1449-4d93-8624-baf61b8c6e04 req-4e7599a1-19ca-4c0a-9edc-0417e161617e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031067 Jun 25 21:32:01.200092 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3433/6402] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:32:17.861327 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:32:17.861840 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:32:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:33:38.090306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=16 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:38.091207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=28 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:38.092776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:33:38.094022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:33:38.096643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:38.097186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-55ddf984-9be2-499a-83f6-7a998a22d3f7 req-f08db405-0345-4186-bf44-d540493d0b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e470cc7e-3fc9-4e57-bf25-37410e958e7f", "tag": "3155991d-9e3b-427c-9dbb-8961ff7ceaab"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:33:38.097543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=40 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:33:38.103759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:38.104239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:38.105080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:38.105532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:38.108380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-55ddf984-9be2-499a-83f6-7a998a22d3f7 req-f08db405-0345-4186-bf44-d540493d0b6d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:38.108863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-55ddf984-9be2-499a-83f6-7a998a22d3f7 req-f08db405-0345-4186-bf44-d540493d0b6d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:38.121557 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-55ddf984-9be2-499a-83f6-7a998a22d3f7 req-f08db405-0345-4186-bf44-d540493d0b6d service nova] Creating event network-changed:3155991d-9e3b-427c-9dbb-8961ff7ceaab for instance e470cc7e-3fc9-4e57-bf25-37410e958e7f on nch1-master-1 Jun 25 21:33:38.127139 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-55ddf984-9be2-499a-83f6-7a998a22d3f7 req-f08db405-0345-4186-bf44-d540493d0b6d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038933 Jun 25 21:33:38.128110 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3434/6403] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:33:38.136600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:33:38.229046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-476540a5-b7e9-4745-a3d4-039eadecbcf9 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 204 len: 0 microversion: 2.1 time: 0.143020 Jun 25 21:33:38.233766 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2970/6404] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:33:38 2022] DELETE /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:33:38.239795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:33:38.240704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:33:38.250027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:38.250638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:38.251420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:38.251857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:38.495312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:33:38.503694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4ecfda6b-5972-43d8-a619-6fe57d24aac5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1577 microversion: 2.1 time: 0.268175 Jun 25 21:33:38.504303 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3435/6405] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:33:38 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1577 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:33:39.525293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:33:39.526294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:33:39.533752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:39.534223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:39.534974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:39.535475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:39.763747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:33:39.772588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ff24f86-27fa-400f-a620-12a0abe763b5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 200 len: 1577 microversion: 2.1 time: 0.253779 Jun 25 21:33:39.773170 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2971/6406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:33:39 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:33:40.229766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c82e4452-7fed-4c25-968e-86ebe068f7a4 req-2f8e16ad-b08e-45de-ba0b-bf536b92df5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e470cc7e-3fc9-4e57-bf25-37410e958e7f", "name": "network-vif-deleted", "tag": "3155991d-9e3b-427c-9dbb-8961ff7ceaab"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:33:40.241287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c82e4452-7fed-4c25-968e-86ebe068f7a4 req-2f8e16ad-b08e-45de-ba0b-bf536b92df5d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:40.241731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c82e4452-7fed-4c25-968e-86ebe068f7a4 req-2f8e16ad-b08e-45de-ba0b-bf536b92df5d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:40.254036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c82e4452-7fed-4c25-968e-86ebe068f7a4 req-2f8e16ad-b08e-45de-ba0b-bf536b92df5d service nova] Creating event network-vif-deleted:3155991d-9e3b-427c-9dbb-8961ff7ceaab for instance e470cc7e-3fc9-4e57-bf25-37410e958e7f on nch1-master-1 Jun 25 21:33:40.259795 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c82e4452-7fed-4c25-968e-86ebe068f7a4 req-2f8e16ad-b08e-45de-ba0b-bf536b92df5d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Jun 25 21:33:40.261236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3436/6407] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:33:40.791821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:33:40.792449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: e470cc7e-3fc9-4e57-bf25-37410e958e7f] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:33:40.799774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:40.800245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:40.801058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:33:40.801508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:33:40.819482 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f HTTP/1.1 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e470cc7e-3fc9-4e57-bf25-37410e958e7f'} Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:33:40.821263 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance e470cc7e-3fc9-4e57-bf25-37410e958e7f could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c7ad33cf-54cc-4e35-86d9-16e49ce4eb96 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f" status: 404 len: 111 microversion: 2.1 time: 0.035278 Jun 25 21:33:40.829111 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2972/6408] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:33:40 2022] GET /compute/v2.1/servers/e470cc7e-3fc9-4e57-bf25-37410e958e7f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:14.228640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:14.229239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:14.231360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-2616a7fc-ebbb-414e-b2ba-33a7210bf4b0 req-96a87293-4629-433e-8b62-240516a91e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e7be5e1-ad01-4caf-82a6-4214c6f2b27d", "tag": "317add1f-3bde-4939-a5f4-e670a66c4249"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:34:14.231878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:14.232765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:14.237378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:14.238166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:14.239112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:14.239531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:14.240652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:14.241085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:14.245539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2616a7fc-ebbb-414e-b2ba-33a7210bf4b0 req-96a87293-4629-433e-8b62-240516a91e1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:14.246475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-2616a7fc-ebbb-414e-b2ba-33a7210bf4b0 req-96a87293-4629-433e-8b62-240516a91e1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:14.259479 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-2616a7fc-ebbb-414e-b2ba-33a7210bf4b0 req-96a87293-4629-433e-8b62-240516a91e1b service nova] Creating event network-changed:317add1f-3bde-4939-a5f4-e670a66c4249 for instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d on nch1-master-1 Jun 25 21:34:14.265180 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-2616a7fc-ebbb-414e-b2ba-33a7210bf4b0 req-96a87293-4629-433e-8b62-240516a91e1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038192 Jun 25 21:34:14.265882 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2973/6409] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:34:14.270942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:34:14.358099 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b6461ff4-76e3-4fd6-a091-53ad7cdd8ec7 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 204 len: 0 microversion: 2.1 time: 0.133656 Jun 25 21:34:14.360068 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3437/6410] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:34:14 2022] DELETE /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:34:14.371327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:14.373050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:14.383401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:14.383867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:14.384828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:14.385287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:14.546055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:14.554754 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1054984e-0535-4fff-9b4d-b262bec41b38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1577 microversion: 2.1 time: 0.190012 Jun 25 21:34:14.555323 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2974/6411] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:14 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1577 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:34:15.573599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:15.574307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:15.582093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:15.582556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:15.583323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:15.583850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:15.718428 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:15.727080 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16c4ccfb-cfdf-441a-95c5-54cadad38c38 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1577 microversion: 2.1 time: 0.157846 Jun 25 21:34:15.736937 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3438/6412] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:15 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:16.315171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e50b77e6-40a7-43b7-9ad1-7a464c74bd27 req-b0fa190d-604f-4050-902b-0bcb32cfcfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e7be5e1-ad01-4caf-82a6-4214c6f2b27d", "name": "network-vif-deleted", "tag": "317add1f-3bde-4939-a5f4-e670a66c4249"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:34:16.327503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e50b77e6-40a7-43b7-9ad1-7a464c74bd27 req-b0fa190d-604f-4050-902b-0bcb32cfcfd7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:16.327956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e50b77e6-40a7-43b7-9ad1-7a464c74bd27 req-b0fa190d-604f-4050-902b-0bcb32cfcfd7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:16.341211 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e50b77e6-40a7-43b7-9ad1-7a464c74bd27 req-b0fa190d-604f-4050-902b-0bcb32cfcfd7 service nova] Creating event network-vif-deleted:317add1f-3bde-4939-a5f4-e670a66c4249 for instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d on nch1-master-1 Jun 25 21:34:16.346569 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e50b77e6-40a7-43b7-9ad1-7a464c74bd27 req-b0fa190d-604f-4050-902b-0bcb32cfcfd7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035903 Jun 25 21:34:16.347192 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2975/6413] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:34:16.744837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:16.745411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:16.752795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:16.753255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:16.754010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:16.754446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:16.787318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:16.787791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:16.788233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lazy-loading 'fault' on Instance uuid 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:34:16.831564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d162afa6d9b48ef9fac1bf23c0c41e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a396ec47a346dc97426df498e54ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:16.840067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c49ffcd0-7518-432e-b9ad-015340a1446c tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 200 len: 1229 microversion: 2.1 time: 0.099330 Jun 25 21:34:16.840882 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3439/6414] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:16 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:17.859605 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:17.860315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:17.867438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:17.867907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:17.868804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:17.869240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:17.885891 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d HTTP/1.1 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '7e7be5e1-ad01-4caf-82a6-4214c6f2b27d'} Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:17.887579 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 7e7be5e1-ad01-4caf-82a6-4214c6f2b27d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-69575cd4-529f-4f19-ab5f-a53f1347539f tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d" status: 404 len: 111 microversion: 2.1 time: 0.034744 Jun 25 21:34:17.891347 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2976/6415] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:17 2022] GET /compute/v2.1/servers/7e7be5e1-ad01-4caf-82a6-4214c6f2b27d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:18.356949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:18.357442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:18.364678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:18.365176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:18.365910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:18.366427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:18.380333 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d HTTP/1.1 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '433bbb89-5296-4366-bf36-6e4eb85de73d'} Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:18.382198 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-90749189-d87b-49f2-b741-228b04a37eb2 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 404 len: 111 microversion: 2.1 time: 0.030796 Jun 25 21:34:18.386514 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3440/6416] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:34:18 2022] DELETE /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:18.392410 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:18.393149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [instance: 433bbb89-5296-4366-bf36-6e4eb85de73d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:18.399587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:18.400060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:18.400877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:18.401329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:18.415646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] HTTP exception thrown: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Request method failure captured: Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d HTTP/1.1 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit30uLOFduI7uXv0TU4F8qqOTJLzXXkCMkEtFoc60lYMvyRHKJUkJiQM9rS0zV17tZCO7GqQIgMl_3dfS9e-gIFdOiavfBWHQVAqVve2f1wnNpmVUBL1tNmb_KCPgjP9sV-349XDZH_FHtk6xMWDF93y3ja23J74BVsHuutNJFbRFG44 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d1a396ec47a346dc97426df498e54ab2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d1a396ec47a346dc97426df498e54ab2"}]}] Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d1a396ec47a346dc97426df498e54ab2 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestVolumeBootPattern-148826616 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 8d162afa6d9b48ef9fac1bf23c0c41e9 Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestVolumeBootPattern-148826616-project Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '433bbb89-5296-4366-bf36-6e4eb85de73d'} Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:18.417257 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Returning 404 to user: Instance 433bbb89-5296-4366-bf36-6e4eb85de73d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bed0d8b1-8bda-4fc4-99a6-85bf0b743855 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d" status: 404 len: 111 microversion: 2.1 time: 0.030265 Jun 25 21:34:18.421615 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2977/6417] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:18 2022] GET /compute/v2.1/servers/433bbb89-5296-4366-bf36-6e4eb85de73d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:19.744296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69325f60-76b7-4c8e-b05a-b050b07997c5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] Calling method '.version_select at 0x7f984ef8bf70>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:19.747629 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69325f60-76b7-4c8e-b05a-b050b07997c5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [7f05582b-9bb7-4516-bf59-f7aae26b3ba5] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 21:34:20.762334 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [None req-69325f60-76b7-4c8e-b05a-b050b07997c5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] [7f05582b-9bb7-4516-bf59-f7aae26b3ba5] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 37150. Jun 25 21:34:20.789134 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69325f60-76b7-4c8e-b05a-b050b07997c5 tempest-TestVolumeBootPattern-148826616 tempest-TestVolumeBootPattern-148826616-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-365734542" status: 202 len: 0 microversion: 2.1 time: 1.048853 Jun 25 21:34:20.789743 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3441/6418] 10.222.0.39 () {58 vars in 1259 bytes} [Sat Jun 25 21:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-365734542 => generated 0 bytes in 1050 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:34:30.821267 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:30.822459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=14 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:31.083191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:31.083710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:31.090175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:31.090648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:31.092089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:31.092587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:31.118890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:34:31.201048 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c568be40-d3dd-4462-b0a2-c15f0ff49793 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 204 len: 0 microversion: 2.1 time: 0.388354 Jun 25 21:34:31.201833 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2978/6419] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:34:30 2022] DELETE /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:34:31.208807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:31.209602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:31.213924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:31.214554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:31.222601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:31.223054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:31.223818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:31.224257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:31.360657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:31.368962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb929b0c-1a86-45f9-9857-f60d04620494 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1732 microversion: 2.1 time: 0.162544 Jun 25 21:34:31.369568 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3442/6420] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:31 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:32.388016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:32.388913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:32.397643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:32.398113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:32.398897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:32.399352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:32.539389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd83e6898693c4e39a3959609c266f550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47f83fd0806d415bbe911f1d51ad3c2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:32.548025 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-92371585-3cab-4062-85d5-25b920bb283b tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 200 len: 1732 microversion: 2.1 time: 0.164950 Jun 25 21:34:32.556729 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2979/6421] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:32 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:32.935493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-a64b4500-872c-45d5-8215-1e0ffc28512f req-82c88788-53c2-4b73-8523-72faae615617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e34839-e8ce-44b1-9215-1b4d8d9e28d2", "name": "network-vif-deleted", "tag": "0333e13f-88c6-48db-bdc5-81a8d5b95dcd"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:34:32.947704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a64b4500-872c-45d5-8215-1e0ffc28512f req-82c88788-53c2-4b73-8523-72faae615617 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:32.948403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-a64b4500-872c-45d5-8215-1e0ffc28512f req-82c88788-53c2-4b73-8523-72faae615617 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:32.973842 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-a64b4500-872c-45d5-8215-1e0ffc28512f req-82c88788-53c2-4b73-8523-72faae615617 service nova] Creating event network-vif-deleted:0333e13f-88c6-48db-bdc5-81a8d5b95dcd for instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 on nch2-master-1 Jun 25 21:34:32.983126 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-a64b4500-872c-45d5-8215-1e0ffc28512f req-82c88788-53c2-4b73-8523-72faae615617 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143762 Jun 25 21:34:32.984474 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3443/6422] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:34:33.567333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:33.568133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:33.578808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:33.579400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:33.580406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:33.580956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:33.597141 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] HTTP exception thrown: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Request method failure captured: Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 HTTP/1.1 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit34Yko_oObnXIX7edOiv4elH2-lHuYzJYyPoUDa80V6B6VVovkiRlEdnqYvCGsGt6adV4_RH5JoGPmyLliz9ir5o0JS2zlPls51g55be6COp_whD87SFZq-d2Z_T3vaRGG3Ov-iijJbpv5LE4rFRgpnDI0zuNPn8dCkMphD6zSbssCM Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}] Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d83e6898693c4e39a3959609c266f550 Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c8e34839-e8ce-44b1-9215-1b4d8d9e28d2'} Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:33.598864 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Returning 404 to user: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:33.602940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7eec94f5-5834-48f3-a03c-055f36316caa tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 404 len: 111 microversion: 2.1 time: 0.040579 Jun 25 21:34:33.603701 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2980/6423] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:33 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:34.062150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:34.062761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:34.069252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:34.069701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:34.070452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:34.070908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:34.084559 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] HTTP exception thrown: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Request method failure captured: Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 HTTP/1.1 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit34Yko_oObnXIX7edOiv4elH2-lHuYzJYyPoUDa80V6B6VVovkiRlEdnqYvCGsGt6adV4_RH5JoGPmyLliz9ir5o0JS2zlPls51g55be6COp_whD87SFZq-d2Z_T3vaRGG3Ov-iijJbpv5LE4rFRgpnDI0zuNPn8dCkMphD6zSbssCM Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}] Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: d83e6898693c4e39a3959609c266f550 Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'c8e34839-e8ce-44b1-9215-1b4d8d9e28d2'} Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:34.086194 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Returning 404 to user: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7436dab-cf29-43f5-8755-f3744ac030c1 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 404 len: 111 microversion: 2.1 time: 0.031138 Jun 25 21:34:34.090417 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3444/6424] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:34:34 2022] DELETE /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:34.096380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:34.097031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] [instance: c8e34839-e8ce-44b1-9215-1b4d8d9e28d2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:34.103453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:34.104030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:34.104839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:34.105290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:34.121762 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] HTTP exception thrown: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Request method failure captured: Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 HTTP/1.1 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit34Yko_oObnXIX7edOiv4elH2-lHuYzJYyPoUDa80V6B6VVovkiRlEdnqYvCGsGt6adV4_RH5JoGPmyLliz9ir5o0JS2zlPls51g55be6COp_whD87SFZq-d2Z_T3vaRGG3Ov-iijJbpv5LE4rFRgpnDI0zuNPn8dCkMphD6zSbssCM Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_47f83fd0806d415bbe911f1d51ad3c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/47f83fd0806d415bbe911f1d51ad3c2c"}]}] Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 47f83fd0806d415bbe911f1d51ad3c2c Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestServerBasicOps-1738166267 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: d83e6898693c4e39a3959609c266f550 Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestServerBasicOps-1738166267-project Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'c8e34839-e8ce-44b1-9215-1b4d8d9e28d2'} Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:34:34.123311 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Returning 404 to user: Instance c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b9fa92ed-f911-407a-bdd0-bbf0c680aa2a tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2" status: 404 len: 111 microversion: 2.1 time: 0.032335 Jun 25 21:34:34.127521 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2981/6425] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:34 2022] GET /compute/v2.1/servers/c8e34839-e8ce-44b1-9215-1b4d8d9e28d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:34:34.294328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f4a80f5-4bf5-49d1-bbcc-a1fee9250a32 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] Calling method '.version_select at 0x7f984ef8b280>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:34.315500 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f4a80f5-4bf5-49d1-bbcc-a1fee9250a32 tempest-TestServerBasicOps-1738166267 tempest-TestServerBasicOps-1738166267-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1789145652" status: 202 len: 0 microversion: 2.1 time: 0.025120 Jun 25 21:34:34.316094 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3445/6426] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 21:34:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1789145652 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:34:53.481640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:53.482426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:53.598769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-465301770", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:34:53.652966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] validate_networks() for None {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:34:53.847367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:34:53.848051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:34:53.849043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:34:53.849511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:34:53.850075 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:34:53.860494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:53.860970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:53.861793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:53.862251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:53.880281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Getting quotas for project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:34:53.886005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Getting quotas for user 81d3c5433f55474f90eab8bb607d48ae and project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:34:53.899221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:34:53.901592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:34:53.951909 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2cb99368-4af0-41ea-8a8a-5b5c998c5e00 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478468 Jun 25 21:34:53.952715 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2982/6427] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:34:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:34:53.961732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=10 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:53.962874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:34:53.966928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0da8d79c-667f-456c-b3ea-0765567d3d08 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:53.967806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0da8d79c-667f-456c-b3ea-0765567d3d08 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:54.023712 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0da8d79c-667f-456c-b3ea-0765567d3d08 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:54.031067 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0da8d79c-667f-456c-b3ea-0765567d3d08 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1221 microversion: 2.1 time: 0.071427 Jun 25 21:34:54.031627 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3446/6428] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:53 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:55.050036 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78d99207-d770-4132-bf40-54c6eea74953 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:55.050649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-78d99207-d770-4132-bf40-54c6eea74953 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:55.105134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-78d99207-d770-4132-bf40-54c6eea74953 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:55.114814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78d99207-d770-4132-bf40-54c6eea74953 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1221 microversion: 2.1 time: 0.070139 Jun 25 21:34:55.115399 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2983/6429] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:55 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:56.135417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ff9d358-1428-4356-b114-a89b0abdca92 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:56.136109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9ff9d358-1428-4356-b114-a89b0abdca92 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:56.198518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9ff9d358-1428-4356-b114-a89b0abdca92 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:56.206508 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ff9d358-1428-4356-b114-a89b0abdca92 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1221 microversion: 2.1 time: 0.077662 Jun 25 21:34:56.207450 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3447/6430] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:56 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:57.227491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1396fb2-59a1-4445-b2f2-ce620e85e5c7 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:57.229011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1396fb2-59a1-4445-b2f2-ce620e85e5c7 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:57.291529 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1396fb2-59a1-4445-b2f2-ce620e85e5c7 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:57.298751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1396fb2-59a1-4445-b2f2-ce620e85e5c7 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1221 microversion: 2.1 time: 0.077984 Jun 25 21:34:57.299328 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2984/6431] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:57 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1221 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:58.322309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:58.323179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:58.331285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:58.332084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:58.332904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:58.333343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:58.396793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:58.404582 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a5e1324-b204-4eb8-acac-7524e7607706 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1225 microversion: 2.1 time: 0.088602 Jun 25 21:34:58.405162 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3448/6432] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:58 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:34:59.420999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:34:59.421542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:34:59.429382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:59.429850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:59.430630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:34:59.431080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:34:59.499138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:34:59.506927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4735e7b8-d573-4810-89fb-0cee88d84697 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1279 microversion: 2.1 time: 0.090036 Jun 25 21:34:59.507472 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2985/6433] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:34:59 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1279 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:00.524694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:00.525424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:00.532711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:00.533172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:00.533941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:00.534383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:00.686162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:00.695988 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca1451a7-beff-43af-b59d-b9a7fbb7c655 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.175422 Jun 25 21:35:00.697896 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3449/6434] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:00 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:00.921268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3e97d336-3c2a-47b7-aab7-d6ae1b60532b req-0d6f8553-40e0-4bee-9ee9-69a3f449ef1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bee362d-1a12-422d-896a-6b6decaa1b72", "tag": "4488978e-bc5f-47de-afe2-c12c6718bb81"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:00.937755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3e97d336-3c2a-47b7-aab7-d6ae1b60532b req-0d6f8553-40e0-4bee-9ee9-69a3f449ef1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:00.938426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3e97d336-3c2a-47b7-aab7-d6ae1b60532b req-0d6f8553-40e0-4bee-9ee9-69a3f449ef1e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:00.951354 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3e97d336-3c2a-47b7-aab7-d6ae1b60532b req-0d6f8553-40e0-4bee-9ee9-69a3f449ef1e service nova] Creating event network-changed:4488978e-bc5f-47de-afe2-c12c6718bb81 for instance 3bee362d-1a12-422d-896a-6b6decaa1b72 on nch1-master-1 Jun 25 21:35:00.957412 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3e97d336-3c2a-47b7-aab7-d6ae1b60532b req-0d6f8553-40e0-4bee-9ee9-69a3f449ef1e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134238 Jun 25 21:35:00.958038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2986/6435] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:01.718529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:01.719469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:01.731366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:01.732121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:01.733424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:01.734149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:01.872977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:01.881243 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-71ce069b-51d4-46cf-b2e3-7dad9bc9264a tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.169564 Jun 25 21:35:01.881822 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3450/6436] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:01 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:02.905252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:02.906434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:02.917347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:02.917818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:02.918600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:02.919053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:03.058043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:03.066554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-593a9744-a893-4eb2-b887-91ce75ae127d tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.169979 Jun 25 21:35:03.067144 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2987/6437] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:02 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:04.088150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:04.089412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:04.097049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:04.097498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:04.098268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:04.098699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:04.243505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:04.252081 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3df4e530-33ea-46fa-bd42-fc5b818d8f29 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.171237 Jun 25 21:35:04.252798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3451/6438] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:04 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:05.268799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:05.269451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:05.271530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:05.278402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:05.278855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:05.279637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:05.280088 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:05.414607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:05.422870 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29f21247-a416-4892-9b17-61b7748d84f6 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.158081 Jun 25 21:35:05.423388 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2988/6439] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:05 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:06.368707 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:06.440487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:06.441795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:06.444388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-983909cb-3adc-48c9-8ff9-b54446dd17c0 req-bcfe6022-df41-499c-8bd7-917463be77fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bee362d-1a12-422d-896a-6b6decaa1b72", "name": "network-vif-plugged", "status": "completed", "tag": "4488978e-bc5f-47de-afe2-c12c6718bb81"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:06.450553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:06.451026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:06.451852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:06.452308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:06.452856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-983909cb-3adc-48c9-8ff9-b54446dd17c0 req-bcfe6022-df41-499c-8bd7-917463be77fc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:06.453298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-983909cb-3adc-48c9-8ff9-b54446dd17c0 req-bcfe6022-df41-499c-8bd7-917463be77fc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:06.472838 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-983909cb-3adc-48c9-8ff9-b54446dd17c0 req-bcfe6022-df41-499c-8bd7-917463be77fc service nova] Creating event network-vif-plugged:4488978e-bc5f-47de-afe2-c12c6718bb81 for instance 3bee362d-1a12-422d-896a-6b6decaa1b72 on nch1-master-1 Jun 25 21:35:06.478049 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-983909cb-3adc-48c9-8ff9-b54446dd17c0 req-bcfe6022-df41-499c-8bd7-917463be77fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114379 Jun 25 21:35:06.478663 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3452/6440] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:06.640472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:06.648402 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a455f4ba-654c-4495-94e2-f24fd0863f20 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.212600 Jun 25 21:35:06.649055 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2989/6441] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:06 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:07.672351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:07.673833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:07.684858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:07.685642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:07.686515 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:07.686980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:07.824948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:07.833331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8588f34-1d87-4751-bf91-8c849aa9bb6f tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1321 microversion: 2.1 time: 0.169717 Jun 25 21:35:07.833902 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3453/6442] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:07 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:08.851436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:08.852071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:08.854131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:08.860964 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:08.861436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:08.862224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:08.862682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.000294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:09.008386 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e21f14f2-0b58-4747-82e4-05d3a16ca2d2 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1470 microversion: 2.1 time: 0.161079 Jun 25 21:35:09.009017 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2990/6443] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:08 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:09.073431 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:35:09.073959 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-quota-sets/a3bc66f185a74931bdf355a34805bc8f (ip 10.222.0.39) !!! Jun 25 21:35:09.088445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80d97cfd-0d91-49b9-b701-a34aca29198b tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '.version_select at 0x7f984efa34c0>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.161813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80d97cfd-0d91-49b9-b701-a34aca29198b tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a3bc66f185a74931bdf355a34805bc8f" status: 200 len: 371 microversion: 2.1 time: 0.138612 Jun 25 21:35:09.162490 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3454/6444] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:35:09 2022] GET /compute/v2.1/os-quota-sets/a3bc66f185a74931bdf355a34805bc8f => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:09.178340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-91564444-2bf9-4af3-9133-a1eff076d9a0 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-639198829", "id": 1372954341, "os-flavor-access:is_public": "True"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:09.181153 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:35:09.181153 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:35:09.204135 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-91564444-2bf9-4af3-9133-a1eff076d9a0 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.033656 Jun 25 21:35:09.204818 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2991/6445] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:35:09 2022] POST /compute/v2.1/flavors => generated 437 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:09.216384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1372954341"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:09.217966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:09.226737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.227393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.229048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.229647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.425044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '66848b4c3e5440c8a2ef62627bdcee2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bc66f185a74931bdf355a34805bc8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:09.431991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-639198829 {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:35:09.438915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.439372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.440174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.440677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.462327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Getting quotas for project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:35:09.468846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Getting quotas for user 81d3c5433f55474f90eab8bb607d48ae and project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:35:09.481783 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.compute.api [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] ram quota exceeded for a3bc66f185a74931bdf355a34805bc8f, tried to resize instance. Jun 25 21:35:09.482373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Request method failure captured: Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action HTTP/1.1 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 39 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3999eok6GViITIAQd-h9gabYwRucpmXUD17Ldi3lZp_kiK78Qax_sNz9Z3NjmWzjYrwGhMvQk9mDxP2kxpK3QQ7fk36sa6PoUurLRnvKyXvx8RXgspJpS0OltHEueCaTXlgiZ7y1Mke5qRbTZdxaKLdbZI0_oXz0Xj0kO_IwrMrd8I Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: a3bc66f185a74931bdf355a34805bc8f Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,admin,reader Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,admin,reader Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3bc66f185a74931bdf355a34805bc8f"}]}] Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: a3bc66f185a74931bdf355a34805bc8f Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersAdminNegativeTestJSON-598529908-project-admin Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 66848b4c3e5440c8a2ef62627bdcee2c Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersAdminNegativeTestJSON-598529908-project-admin Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: {"resize": {"flavorRef": "1372954341"}} Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3bee362d-1a12-422d-896a-6b6decaa1b72', 'body': {'resize': {'flavorRef': '1372954341'}}} Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.484505 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2ee2a71d-3325-49a6-b0dd-d3e3020fda7d tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action" status: 403 len: 118 microversion: 2.1 time: 0.273638 Jun 25 21:35:09.488966 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3455/6446] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:35:09 2022] POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action => generated 118 bytes in 275 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:35:09.496304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a4331b03-f8e0-4daa-a308-be044e28ef2c tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.497111 ncdv-master-1 devstack@n-api.service[137462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:35:09.497111 ncdv-master-1 devstack@n-api.service[137462]: warnings.warn(msg) Jun 25 21:35:09.518702 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a4331b03-f8e0-4daa-a308-be044e28ef2c tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1372954341" status: 202 len: 0 microversion: 2.1 time: 0.026322 Jun 25 21:35:09.519295 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2992/6447] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 21:35:09 2022] DELETE /compute/v2.1/flavors/1372954341 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:35:09.527635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c91c4004-50a4-483a-9fcd-eedbe7fe6a7e tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.547044 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c91c4004-50a4-483a-9fcd-eedbe7fe6a7e tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023203 Jun 25 21:35:09.547604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3456/6448] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:35:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:09.564853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-656ebaec-f92a-428a-a0bd-1a45fdaea5b1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '.version_select at 0x7f984f584790>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.636293 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-656ebaec-f92a-428a-a0bd-1a45fdaea5b1 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "GET /compute/v2.1/os-quota-sets/a3bc66f185a74931bdf355a34805bc8f" status: 200 len: 371 microversion: 2.1 time: 0.075667 Jun 25 21:35:09.636927 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2993/6449] 10.222.0.39 () {58 vars in 1241 bytes} [Sat Jun 25 21:35:09 2022] GET /compute/v2.1/os-quota-sets/a3bc66f185a74931bdf355a34805bc8f => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:09.647370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d21d1bd6-ed58-480c-a3c3-535b694eb426 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-565745936", "id": 1759486937, "os-flavor-access:is_public": "True"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:09.649061 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:35:09.649061 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:35:09.665975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d21d1bd6-ed58-480c-a3c3-535b694eb426 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022477 Jun 25 21:35:09.666560 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3457/6450] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:35:09 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:09.677433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1759486937"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:09.678493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:09.685201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.685662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.686440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.686893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.840345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '66848b4c3e5440c8a2ef62627bdcee2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3bc66f185a74931bdf355a34805bc8f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:09.847514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-565745936 {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:35:09.854262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.854838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.855556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:09.856007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:09.884403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Getting quotas for project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:35:09.889776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Getting quotas for user 81d3c5433f55474f90eab8bb607d48ae and project 5909b19117bd4a978ebda418febc91f8. Resources: {'cores', 'ram'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:35:09.903679 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] cores quota exceeded for a3bc66f185a74931bdf355a34805bc8f, tried to resize instance. Jun 25 21:35:09.904602 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Request method failure captured: Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action HTTP/1.1 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 39 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3999eok6GViITIAQd-h9gabYwRucpmXUD17Ldi3lZp_kiK78Qax_sNz9Z3NjmWzjYrwGhMvQk9mDxP2kxpK3QQ7fk36sa6PoUurLRnvKyXvx8RXgspJpS0OltHEueCaTXlgiZ7y1Mke5qRbTZdxaKLdbZI0_oXz0Xj0kO_IwrMrd8I Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: a3bc66f185a74931bdf355a34805bc8f Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,admin,reader Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,admin,reader Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a3bc66f185a74931bdf355a34805bc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a3bc66f185a74931bdf355a34805bc8f"}]}] Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: a3bc66f185a74931bdf355a34805bc8f Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-598529908 Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-598529908-project-admin Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 66848b4c3e5440c8a2ef62627bdcee2c Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-598529908-project-admin Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: {"resize": {"flavorRef": "1759486937"}} Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '3bee362d-1a12-422d-896a-6b6decaa1b72', 'body': {'resize': {'flavorRef': '1759486937'}}} Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.924089 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a2109563-7408-4a49-9f49-090293ae05ea tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action" status: 403 len: 113 microversion: 2.1 time: 0.252257 Jun 25 21:35:09.928305 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2994/6451] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:35:09 2022] POST /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72/action => generated 113 bytes in 253 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:35:09.934621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c1ba0b93-b016-4908-972c-9f4ffb01239b tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.935458 ncdv-master-1 devstack@n-api.service[137461]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 21:35:09.935458 ncdv-master-1 devstack@n-api.service[137461]: warnings.warn(msg) Jun 25 21:35:09.954588 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c1ba0b93-b016-4908-972c-9f4ffb01239b tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "DELETE /compute/v2.1/flavors/1759486937" status: 202 len: 0 microversion: 2.1 time: 0.023883 Jun 25 21:35:09.955156 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3458/6452] 10.222.0.39 () {58 vars in 1160 bytes} [Sat Jun 25 21:35:09 2022] DELETE /compute/v2.1/flavors/1759486937 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:35:09.963506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90011148-b233-4a9d-8eb4-cd3758456636 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:09.983107 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90011148-b233-4a9d-8eb4-cd3758456636 tempest-ServersAdminNegativeTestJSON-598529908 tempest-ServersAdminNegativeTestJSON-598529908-project-admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023346 Jun 25 21:35:09.983679 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2995/6453] 10.222.0.39 () {58 vars in 1145 bytes} [Sat Jun 25 21:35:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:10.000448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:10.000968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:10.007208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:10.007643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:10.008450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:10.008885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:10.035331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:35:10.120416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dc0d1e1-3f82-4d5c-ab42-7d5d8a28eb13 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 204 len: 0 microversion: 2.1 time: 0.123667 Jun 25 21:35:10.122055 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3459/6454] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:35:09 2022] DELETE /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:35:10.133092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:10.134014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:10.141876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:10.142291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:10.143062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:10.143513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:10.278959 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:10.287006 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d3494fa-2212-4833-b19c-bc25b30db5c4 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1476 microversion: 2.1 time: 0.159279 Jun 25 21:35:10.287590 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2996/6455] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:10 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:11.309666 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:11.310928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:11.318241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:11.318698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:11.319459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:11.319871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:11.463109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:11.471716 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a909f91e-85db-4abf-aa82-80318f1330c1 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1476 microversion: 2.1 time: 0.169252 Jun 25 21:35:11.472318 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3460/6456] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:11 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:12.157665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-772fe219-993a-40d9-9817-ffc6a61faf88 req-f27030ad-7180-4996-9e43-7905a09b8f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bee362d-1a12-422d-896a-6b6decaa1b72", "name": "network-vif-deleted", "tag": "4488978e-bc5f-47de-afe2-c12c6718bb81"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:12.168301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-772fe219-993a-40d9-9817-ffc6a61faf88 req-f27030ad-7180-4996-9e43-7905a09b8f81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:12.168983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-772fe219-993a-40d9-9817-ffc6a61faf88 req-f27030ad-7180-4996-9e43-7905a09b8f81 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:12.181514 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-772fe219-993a-40d9-9817-ffc6a61faf88 req-f27030ad-7180-4996-9e43-7905a09b8f81 service nova] Creating event network-vif-deleted:4488978e-bc5f-47de-afe2-c12c6718bb81 for instance 3bee362d-1a12-422d-896a-6b6decaa1b72 on nch1-master-1 Jun 25 21:35:12.191387 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-772fe219-993a-40d9-9817-ffc6a61faf88 req-f27030ad-7180-4996-9e43-7905a09b8f81 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037216 Jun 25 21:35:12.192712 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2997/6457] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:12.494213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:12.495427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:12.506833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:12.507607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:12.510148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:12.510148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:12.544451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:12.544901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:12.545465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lazy-loading 'fault' on Instance uuid 3bee362d-1a12-422d-896a-6b6decaa1b72 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:35:12.587728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81d3c5433f55474f90eab8bb607d48ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5909b19117bd4a978ebda418febc91f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:12.597105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-881dc76d-1b4a-46f3-b9f4-d2af83755234 tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 200 len: 1311 microversion: 2.1 time: 0.110213 Jun 25 21:35:12.597857 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3461/6458] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:12 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:13.619736 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:13.620784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] [instance: 3bee362d-1a12-422d-896a-6b6decaa1b72] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:13.631213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:13.631884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:13.633235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:13.633996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:13.658754 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] HTTP exception thrown: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Request method failure captured: Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 HTTP/1.1 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit398S9AzJ_-yyLbtJOlDUejdaNs1MHon8M3PJ84nOH5lH6PCYT5O2WAx3kPNd0pEMMsqOsgrUjx3ScBQsxBsJr9GUJAKPaxOyRX85q1hYX5cY4ABsb5YgXBt0k6jTmihma-vlmIZX9K5zWCv03JFRQFWsfMA5kl1cF3GTwiLJ2ttQTk Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 5909b19117bd4a978ebda418febc91f8 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1422063266 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5909b19117bd4a978ebda418febc91f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5909b19117bd4a978ebda418febc91f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5909b19117bd4a978ebda418febc91f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5909b19117bd4a978ebda418febc91f8"}]}] Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1422063266 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 5909b19117bd4a978ebda418febc91f8 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1422063266 Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersAdminNegativeTestJSON-1422063266-project Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 81d3c5433f55474f90eab8bb607d48ae Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1422063266-project Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '3bee362d-1a12-422d-896a-6b6decaa1b72'} Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:13.660457 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] Returning 404 to user: Instance 3bee362d-1a12-422d-896a-6b6decaa1b72 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca9e6ab8-3891-4e16-b391-d64821f04dac tempest-ServersAdminNegativeTestJSON-1422063266 tempest-ServersAdminNegativeTestJSON-1422063266-project] 10.222.0.39 "GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72" status: 404 len: 111 microversion: 2.1 time: 0.049641 Jun 25 21:35:13.664610 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2998/6459] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:13 2022] GET /compute/v2.1/servers/3bee362d-1a12-422d-896a-6b6decaa1b72 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:35:19.603648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:19.604467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:19.725893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1735920109", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "da0103f2-6c89-47c5-aca7-9d6bfdd3b0b8"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:19.779086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] validate_networks() for [('da0103f2-6c89-47c5-aca7-9d6bfdd3b0b8', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:35:20.174403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:35:20.174851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:35:20.175342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:35:20.175762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:35:20.176156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:35:20.186069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:20.186530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:20.187364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:20.187813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:20.205529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Getting quotas for project 27deb4968d0749dfb6501f5cf2d3f403. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:35:20.211564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Getting quotas for user 6ded64c384e144c69c160f7f5568ac27 and project 27deb4968d0749dfb6501f5cf2d3f403. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:35:20.224653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:35:20.226984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:35:20.282605 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-638eb2b3-f072-4d34-bf6d-7de37036782d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684628 Jun 25 21:35:20.283268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3462/6460] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:35:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:35:20.293634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9b940c3-75f3-4480-8d56-12c999d09ae3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:20.294261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9b940c3-75f3-4480-8d56-12c999d09ae3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:20.299238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:20.300354 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:20.696455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9b940c3-75f3-4480-8d56-12c999d09ae3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:20.705995 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9b940c3-75f3-4480-8d56-12c999d09ae3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1215 microversion: 2.1 time: 0.416046 Jun 25 21:35:20.706614 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 2999/6461] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:20 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1215 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:21.727945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:21.728624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:21.736055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:21.736461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:21.737222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:21.737900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:21.827596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:21.837686 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2842461a-8d0b-4b7a-92c3-db3abcb250c8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1273 microversion: 2.1 time: 0.114857 Jun 25 21:35:21.838760 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3463/6462] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:21 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:22.791955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-77fc49e1-c18b-4642-8caa-055a7edc7f34 req-62a0fb4e-0bda-4353-b5e5-f76b5bbfb4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:22.811681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-77fc49e1-c18b-4642-8caa-055a7edc7f34 req-62a0fb4e-0bda-4353-b5e5-f76b5bbfb4e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:22.814345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-77fc49e1-c18b-4642-8caa-055a7edc7f34 req-62a0fb4e-0bda-4353-b5e5-f76b5bbfb4e9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:22.837519 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-77fc49e1-c18b-4642-8caa-055a7edc7f34 req-62a0fb4e-0bda-4353-b5e5-f76b5bbfb4e9 service nova] Creating event network-changed:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch1-master-1 Jun 25 21:35:22.844371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-77fc49e1-c18b-4642-8caa-055a7edc7f34 req-62a0fb4e-0bda-4353-b5e5-f76b5bbfb4e9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056414 Jun 25 21:35:22.845609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3000/6463] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:22.863375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:22.864080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:22.871718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:22.872501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:22.873524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:22.874969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:23.028652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:23.039058 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d435f61d-a722-4998-8965-400c4eeea9ab tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.186810 Jun 25 21:35:23.040283 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3464/6464] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:22 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:24.057735 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:24.058371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:24.061535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:24.068331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:24.069221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:24.070035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:24.070493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:24.075861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=60 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:24.306469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:24.314925 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-223bb5f3-68c4-4fbc-91d8-a91ab626e6d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.261688 Jun 25 21:35:24.315444 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3001/6465] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:24 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:25.336814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:25.337721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:25.342724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:25.355841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:25.356966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:25.358151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:25.358598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:25.362038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:25.508801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:25.517133 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f638376-b16d-4cb0-b028-eef5b933bc34 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.187653 Jun 25 21:35:25.517764 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3465/6466] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:25 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:26.534324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:26.535072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:26.541756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:26.542225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:26.543012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:26.543485 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:26.688328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:26.696377 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14d20efa-d94f-4f67-9192-126f7e16b6e9 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.166072 Jun 25 21:35:26.697251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3002/6467] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:26 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:35:27.714499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:27.715084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:27.722648 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:27.723101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:27.723869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:27.724303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:27.857958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:27.866807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06c4a45d-b301-4319-b147-590796ab57c1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.156400 Jun 25 21:35:27.867391 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3466/6468] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:27 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:28.439945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d12056c2-5e0e-4c5a-b18f-42de60ee40be req-ece5439e-91d7-4551-b272-becf5bcb6691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "name": "network-vif-plugged", "status": "completed", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:28.449731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d12056c2-5e0e-4c5a-b18f-42de60ee40be req-ece5439e-91d7-4551-b272-becf5bcb6691 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:28.450192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d12056c2-5e0e-4c5a-b18f-42de60ee40be req-ece5439e-91d7-4551-b272-becf5bcb6691 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:28.461844 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d12056c2-5e0e-4c5a-b18f-42de60ee40be req-ece5439e-91d7-4551-b272-becf5bcb6691 service nova] Creating event network-vif-plugged:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch1-master-1 Jun 25 21:35:28.466760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d12056c2-5e0e-4c5a-b18f-42de60ee40be req-ece5439e-91d7-4551-b272-becf5bcb6691 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Jun 25 21:35:28.467581 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3003/6469] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:35:28.884265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:28.884857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:28.892671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:28.893148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:28.893899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:28.894317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:29.035012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:29.042997 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e072567-2a30-4fd7-be05-56d142a15b08 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1315 microversion: 2.1 time: 0.162816 Jun 25 21:35:29.043562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3467/6470] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:28 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:30.066030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:30.066879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:30.075417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.076001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.077015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.077578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.215531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:30.223763 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb0aa72f-1b84-4fd2-8c06-ca6e13cfbc00 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1503 microversion: 2.1 time: 0.165514 Jun 25 21:35:30.224359 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3004/6471] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:30 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:30.240312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:30.241400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:30.244188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:30.244890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:30.250839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.251294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.252053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.252506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.281391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:30.287673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Old instance type m1.heat2, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:35:30.294270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:35:30.294694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:35:30.295203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:35:30.295619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:35:30.296034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:35:30.364278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a15207a9-2a6e-4d0d-8695-cd0f63d055d3 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "POST /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c/action" status: 202 len: 0 microversion: 2.1 time: 0.127927 Jun 25 21:35:30.364865 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3468/6472] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:35:30 2022] POST /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:35:30.373383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:30.374011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:30.380749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.381319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.382094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:30.382542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:30.518841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:30.526904 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-902b8521-bb2d-481a-af22-837eabd546e1 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1512 microversion: 2.1 time: 0.157501 Jun 25 21:35:30.527864 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3005/6473] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:30 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:31.545342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:31.545953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:31.552237 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:31.553058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:31.554396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:31.555278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:31.701975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:31.714151 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6743b29e-f1dd-40a4-a211-fdc57ae386be tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1512 microversion: 2.1 time: 0.173398 Jun 25 21:35:31.714941 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3469/6474] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:31 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:32.737778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:32.738551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:32.740991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:32.749187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:32.749765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:32.750733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:32.751291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:32.892212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:32.900296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8e5a78eb-1bc4-4631-9110-89217c4679bc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.169147 Jun 25 21:35:32.900923 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3006/6475] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:32 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:33.922871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:33.923886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:33.935819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:33.936641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:33.937958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:33.938691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:34.088200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:34.095939 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e2c11215-7502-4cd3-9e67-e37d7868a7c2 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.179817 Jun 25 21:35:34.096540 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3470/6476] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:33 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:35.116383 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:35.117009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:35.127872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:35.128518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:35.130099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:35.130742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:35.277948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:35.285746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1a5d4d59-7f6a-41d7-887b-cd90637836de tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.174821 Jun 25 21:35:35.286322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3007/6477] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:35 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:36.307166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:36.308258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:36.319992 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:36.320790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:36.322040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:36.322759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:36.468125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:36.479725 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cbb90cbb-62ed-4a0d-a21f-e68406533f1d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.179186 Jun 25 21:35:36.480530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3471/6478] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:36 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:37.503286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:37.504062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:37.512745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:37.513300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:37.514223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:37.514758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:37.655479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:37.663741 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c4ea36b-f3b0-4494-b5f1-bb8de5cf688e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.167248 Jun 25 21:35:37.664289 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3008/6479] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:37 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:37.872119 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:35:37.872450 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:35:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:35:38.685185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:38.686198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:38.697940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:38.698684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:38.699947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:38.700714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:38.851048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:38.859098 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a69a41ae-331f-4903-938f-b507e65d02df tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.180661 Jun 25 21:35:38.859659 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3472/6480] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:38 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:39.878465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:39.879093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:39.886555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:39.887019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:39.887795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:39.888243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:40.023864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:40.032279 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b35eaa3b-2d6c-478c-920a-8ca45e75f489 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.159608 Jun 25 21:35:40.032893 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3009/6481] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:39 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:41.053056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:41.053926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:41.066446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:41.067207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:41.068461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:41.069261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:41.205801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:41.213975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ac6c07d-88d3-4308-8078-8281f0847693 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.167853 Jun 25 21:35:41.214566 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3473/6482] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:41 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:42.236211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:42.237372 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:42.244939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:42.245405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:42.246189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:42.246640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:42.384883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:42.393227 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a983406b-c5e1-41c8-8817-5c8f7a3a1ab4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.163802 Jun 25 21:35:42.393828 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3010/6483] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:42 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:43.412557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:43.413084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:43.420441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:43.420906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:43.421662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:43.422096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:43.560900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:43.568704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64302849-50d1-411d-9bbe-cefdc4084cdd tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.161228 Jun 25 21:35:43.569282 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3474/6484] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:43 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:44.593345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:44.594034 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:44.602160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:44.602663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:44.603447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:44.603888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:44.743380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:44.751424 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8110c6ac-f617-4662-a51b-21f74415c5f4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.162948 Jun 25 21:35:44.752051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3011/6485] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:44 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:45.773000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:45.773964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:45.785018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:45.785477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:45.786236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:45.786663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:45.925182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:45.933203 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7a87447a-982d-46f3-b599-7b93e53b1a78 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.166834 Jun 25 21:35:45.933759 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3475/6486] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:45 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:46.951115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:46.951768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:46.959975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:46.960454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:46.961237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:46.961682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:47.094733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:47.103180 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7a7b4634-f7de-4efa-b160-cfbec33c3ae0 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.156292 Jun 25 21:35:47.103775 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3012/6487] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:46 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:48.124721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:48.125603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:48.134188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:48.134643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:48.135408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:48.135845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:48.270215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:48.281168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-410d891c-9c30-4ce0-b5bf-8883f6a79c8c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.163039 Jun 25 21:35:48.282070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3476/6488] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:48 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:49.308835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:49.309865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:49.320374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:49.320854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:49.321662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:49.322114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:49.472232 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:49.480408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be4d256b-7d12-45fe-b1e8-490bad7d691e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.178629 Jun 25 21:35:49.481013 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3013/6489] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:49 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:50.501115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:50.502126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:50.513879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:50.514628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:50.515881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:50.516660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:50.948951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:50.961167 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d0da0ac-a39b-4491-809a-0720a40f6d92 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.466387 Jun 25 21:35:50.962021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3477/6490] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:50 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:51.983983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:51.985033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:51.993475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:51.993947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:51.994751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:51.995207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:52.136816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:52.145149 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4261b418-06ac-4096-869d-57f5c3668abf tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.168447 Jun 25 21:35:52.145855 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3014/6491] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:51 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:53.165098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:53.165644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:53.173049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:53.173518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:53.174282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:53.174719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:53.307661 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:53.315854 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d2b6533d-b564-4e84-9f40-d71df61eefcc tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.155842 Jun 25 21:35:53.316452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3478/6492] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:53 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:54.342733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:54.343774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:54.348246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=28 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:54.357403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:54.358173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:54.359412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:54.360207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:54.364855 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=80 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:54.509178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:54.517071 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c41262cc-e344-49ad-95ae-1e6dd27b7c3c tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.181282 Jun 25 21:35:54.517692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3015/6493] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:54 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:55.538923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:55.539716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:55.543050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=32 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:55.550571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:55.551179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:55.552118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:55.552710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:55.556090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:35:55.700385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:55.708889 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3d48a6f8-63b5-4e99-8899-45969cd792b8 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.176422 Jun 25 21:35:55.709535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3479/6494] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:55 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:56.726754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:56.727395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:56.734790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:56.735261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:56.736027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:56.736516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:56.877283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:56.885498 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-57211133-eaab-4c2d-9c38-772f6172e520 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.162836 Jun 25 21:35:56.886092 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3016/6495] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:56 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:57.905342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:57.906233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:57.915574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:57.916046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:57.916850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:57.917288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:58.059533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:58.067611 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-06df0129-1d69-44eb-a787-681a0529cb6e tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.167228 Jun 25 21:35:58.068201 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3480/6496] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:57 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:59.089662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:35:59.090624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:35:59.102917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:59.103747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:59.104586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:59.105045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:59.251142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:35:59.259110 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3de5d65-35b9-4748-9449-6cb667eac413 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1517 microversion: 2.1 time: 0.176607 Jun 25 21:35:59.259772 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3017/6497] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:35:59 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1517 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:35:59.790561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "name": "network-vif-unplugged", "status": "completed", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:35:59.800229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:35:59.800702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:35:59.814411 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] Creating event network-vif-unplugged:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch2-master-1 Jun 25 21:35:59.820242 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] Instance 8e577437-8f44-419b-9fed-dd120363815c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:35:59.831976 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-50ef7c40-5ecd-43fc-865e-f92a56c9eacc req-bf32a62d-77c9-480c-92e1-cfd80ee4381b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045515 Jun 25 21:35:59.833732 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3481/6498] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:36:00.277331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:00.278026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:00.285210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:00.285686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:00.286477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:00.286963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:00.426404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:00.434254 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ccfccda-dc96-4396-be45-08a5841912ed tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1516 microversion: 2.1 time: 0.161078 Jun 25 21:36:00.434837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3018/6499] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:00 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:01.457969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:01.459523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:01.470339 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:01.471090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:01.472341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:01.473101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:01.612387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:01.620999 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-173a746e-f050-4af7-97b1-e5f0b45cef10 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1514 microversion: 2.1 time: 0.171264 Jun 25 21:36:01.621983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3482/6500] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:01 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:01.855665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:01.868343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:01.868950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:01.883852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] Creating event network-changed:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch2-master-1 Jun 25 21:36:01.889460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] Instance 8e577437-8f44-419b-9fed-dd120363815c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:36:01.900858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d438fa2e-90ef-4fb8-ba83-47789f58569a req-8d8fba5d-d50f-4163-98ed-ad188ecebbb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050144 Jun 25 21:36:01.901480 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3019/6501] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:36:02.644476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:02.645370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:02.654801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:02.655258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:02.656024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:02.656464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:02.795306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:02.805485 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0533a1c2-8130-4f6c-b9e3-f986c259f27d tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1514 microversion: 2.1 time: 0.167897 Jun 25 21:36:02.806101 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3483/6502] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:02 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:03.824321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:03.825068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:03.831692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:03.832154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:03.832989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:03.833803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:03.966205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:03.974508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4cbc62b3-84c8-4296-8cbe-e5042380d597 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1511 microversion: 2.1 time: 0.155359 Jun 25 21:36:03.975540 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3020/6503] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:03 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:03.991004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:03.991500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:03.999879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:04.000331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:04.001138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:04.001570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:04.028950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:36:04.082007 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.compute.api [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Found an unconfirmed migration during delete, id: 16, status: finished Jun 25 21:36:05.426047 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3492aed1-6c30-42c2-b3b9-5b80286d1cca tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 204 len: 0 microversion: 2.1 time: 1.438632 Jun 25 21:36:05.430322 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3484/6504] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:36:03 2022] DELETE /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 0 bytes in 1440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:36:05.435897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:05.436566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:05.444120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:05.444623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:05.445411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:05.445852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:05.582796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:05.591116 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e5d4fdef-a41b-4eda-88ab-9479f1e230e4 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1503 microversion: 2.1 time: 0.159515 Jun 25 21:36:05.591702 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3021/6505] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:05 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:05.765635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1a05d45a-b26b-4fe1-9cdf-d89dca7aed7e req-f228a517-6687-46b7-aae1-0e155d68548d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "name": "network-vif-plugged", "status": "completed", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:05.774691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1a05d45a-b26b-4fe1-9cdf-d89dca7aed7e req-f228a517-6687-46b7-aae1-0e155d68548d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:05.775192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1a05d45a-b26b-4fe1-9cdf-d89dca7aed7e req-f228a517-6687-46b7-aae1-0e155d68548d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:05.787670 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1a05d45a-b26b-4fe1-9cdf-d89dca7aed7e req-f228a517-6687-46b7-aae1-0e155d68548d service nova] Creating event network-vif-plugged:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch2-master-1 Jun 25 21:36:05.792848 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1a05d45a-b26b-4fe1-9cdf-d89dca7aed7e req-f228a517-6687-46b7-aae1-0e155d68548d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Jun 25 21:36:05.793448 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3485/6506] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:36:06.609054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:06.609687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:06.617203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:06.617663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:06.618440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:06.618888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:06.752154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ded64c384e144c69c160f7f5568ac27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27deb4968d0749dfb6501f5cf2d3f403', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:06.760176 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ec642f7-aab1-48df-8945-4d6da9f1d255 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 200 len: 1503 microversion: 2.1 time: 0.155122 Jun 25 21:36:06.760849 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3022/6507] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:06 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:07.293198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-93b0c8a5-042b-47b6-bdb1-54998dee4802 req-6748ad89-a081-4700-9f48-905ee492beb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e577437-8f44-419b-9fed-dd120363815c", "name": "network-vif-deleted", "tag": "49e4e1bb-014a-428c-8e07-e04d119f09a6"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:07.305331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-93b0c8a5-042b-47b6-bdb1-54998dee4802 req-6748ad89-a081-4700-9f48-905ee492beb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.305769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-93b0c8a5-042b-47b6-bdb1-54998dee4802 req-6748ad89-a081-4700-9f48-905ee492beb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.317499 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-93b0c8a5-042b-47b6-bdb1-54998dee4802 req-6748ad89-a081-4700-9f48-905ee492beb7 service nova] Creating event network-vif-deleted:49e4e1bb-014a-428c-8e07-e04d119f09a6 for instance 8e577437-8f44-419b-9fed-dd120363815c on nch2-master-1 Jun 25 21:36:07.323792 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-93b0c8a5-042b-47b6-bdb1-54998dee4802 req-6748ad89-a081-4700-9f48-905ee492beb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034913 Jun 25 21:36:07.324402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3486/6508] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:36:07.778687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:07.779327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:07.786898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.787367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.788175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.788641 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.802663 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] HTTP exception thrown: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Request method failure captured: Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c HTTP/1.1 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3-Xx1ew_ut0JR8QzMItdO8q227bjkUgsvHFHL03kQlt_ThCBnml0gOVE3gGrbD-jYcN_-5eS9WqVPgC9YJusLXZXAJaVE_Pe4EEabpmghw4P7uwXVNXvTF6v8Zj9dj0OnkpqDu3nTCxKZgPat7mfs6Klowp49ZQLp0JyAu1G419Y_Y Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}] Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6ded64c384e144c69c160f7f5568ac27 Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8e577437-8f44-419b-9fed-dd120363815c'} Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.804492 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Returning 404 to user: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-28ac3e7a-efae-4ae4-9128-0bfff85e39cb tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 404 len: 111 microversion: 2.1 time: 0.032003 Jun 25 21:36:07.809413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3023/6509] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:07 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:36:07.820219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:07.820806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:07.828062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.828539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.829303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.829739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.843651 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] HTTP exception thrown: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Request method failure captured: Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c HTTP/1.1 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3-Xx1ew_ut0JR8QzMItdO8q227bjkUgsvHFHL03kQlt_ThCBnml0gOVE3gGrbD-jYcN_-5eS9WqVPgC9YJusLXZXAJaVE_Pe4EEabpmghw4P7uwXVNXvTF6v8Zj9dj0OnkpqDu3nTCxKZgPat7mfs6Klowp49ZQLp0JyAu1G419Y_Y Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}] Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6ded64c384e144c69c160f7f5568ac27 Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8e577437-8f44-419b-9fed-dd120363815c'} Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:36:07.845327 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Returning 404 to user: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-21fce339-07db-4408-8813-6ac649caaa7a tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 404 len: 111 microversion: 2.1 time: 0.031027 Jun 25 21:36:07.849197 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3487/6510] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:36:07 2022] DELETE /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:36:07.855561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:07.856210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] [instance: 8e577437-8f44-419b-9fed-dd120363815c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:07.863063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.863541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.864365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:07.864850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:07.879157 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] HTTP exception thrown: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Request method failure captured: Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c HTTP/1.1 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3-Xx1ew_ut0JR8QzMItdO8q227bjkUgsvHFHL03kQlt_ThCBnml0gOVE3gGrbD-jYcN_-5eS9WqVPgC9YJusLXZXAJaVE_Pe4EEabpmghw4P7uwXVNXvTF6v8Zj9dj0OnkpqDu3nTCxKZgPat7mfs6Klowp49ZQLp0JyAu1G419Y_Y Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_27deb4968d0749dfb6501f5cf2d3f403"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/27deb4968d0749dfb6501f5cf2d3f403"}]}] Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 27deb4968d0749dfb6501f5cf2d3f403 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-DeleteServersTestJSON-1164274593 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6ded64c384e144c69c160f7f5568ac27 Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-DeleteServersTestJSON-1164274593-project Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8e577437-8f44-419b-9fed-dd120363815c'} Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:36:07.880764 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] Returning 404 to user: Instance 8e577437-8f44-419b-9fed-dd120363815c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55ea72b8-a77f-4216-b4ff-f4b13b15dc04 tempest-DeleteServersTestJSON-1164274593 tempest-DeleteServersTestJSON-1164274593-project] 10.222.0.39 "GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c" status: 404 len: 111 microversion: 2.1 time: 0.030725 Jun 25 21:36:07.884751 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3024/6511] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:07 2022] GET /compute/v2.1/servers/8e577437-8f44-419b-9fed-dd120363815c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:36:16.630487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1350528539", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "81771b46-5b2e-4708-822b-3205e233fab6"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:16.683149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] validate_networks() for [('81771b46-5b2e-4708-822b-3205e233fab6', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:36:17.070985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:36:17.071557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:36:17.072048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:36:17.072557 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:36:17.073008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:36:17.083382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:17.084324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:17.085174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:17.085620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:17.104561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:36:17.110061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for user 581e969a68fc439f8021e3c106a1b58b and project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:36:17.130512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:36:17.133022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:36:17.180364 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ac67f711-8b84-4dad-ae5b-b75155ac1cd3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677356 Jun 25 21:36:17.181253 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3488/6512] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:36:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:36:17.191652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca9a1990-a8f0-42bb-89dc-3721ff402c84 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:17.192209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca9a1990-a8f0-42bb-89dc-3721ff402c84 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:17.258115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca9a1990-a8f0-42bb-89dc-3721ff402c84 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:17.268209 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca9a1990-a8f0-42bb-89dc-3721ff402c84 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1218 microversion: 2.1 time: 0.080590 Jun 25 21:36:17.268847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3025/6513] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:17 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:18.288892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:18.289599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:18.297943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:18.298407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:18.299188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:18.299632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:18.365043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:18.373194 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-626eec5f-a64e-4a48-9760-741b861d6750 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1276 microversion: 2.1 time: 0.090410 Jun 25 21:36:18.373792 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3489/6514] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:18 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:19.391805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:19.393118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:19.404156 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=49 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:19.412859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:19.413331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:19.414940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:19.415618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:19.679385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:19.693009 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a4442cae-0f0a-4caf-a344-6a2d99b9384f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.305806 Jun 25 21:36:19.708101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3026/6515] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:19 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:19.745764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1af6f52d-4b27-4f36-bf80-bb73e5f0ec8a req-34266494-4333-4351-833a-094b9288532d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:19.762762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1af6f52d-4b27-4f36-bf80-bb73e5f0ec8a req-34266494-4333-4351-833a-094b9288532d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:19.763732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1af6f52d-4b27-4f36-bf80-bb73e5f0ec8a req-34266494-4333-4351-833a-094b9288532d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:19.790918 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1af6f52d-4b27-4f36-bf80-bb73e5f0ec8a req-34266494-4333-4351-833a-094b9288532d service nova] Creating event network-changed:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch1-master-1 Jun 25 21:36:19.798474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1af6f52d-4b27-4f36-bf80-bb73e5f0ec8a req-34266494-4333-4351-833a-094b9288532d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058444 Jun 25 21:36:19.800471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3490/6516] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:36:20.712860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:20.713508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:20.720604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:20.721101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:20.721879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:20.722325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:20.860666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:20.868464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa5631d4-86d2-413a-a8d7-f0d28a684131 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.160406 Jun 25 21:36:20.869080 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3027/6517] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:20 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:21.887473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:21.888194 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:21.896342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:21.897157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:21.898507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:21.899229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:22.041114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:22.048878 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-84ee0402-b8b8-4c00-b6fc-f6388d8cbca1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.166703 Jun 25 21:36:22.049475 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3491/6518] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:21 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:23.066047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:23.066683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:23.073896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:23.074402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:23.075191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:23.075649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:23.214401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:23.222338 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bd4ccca0-55b7-4cf9-ac90-67d44ab5234f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.160290 Jun 25 21:36:23.222946 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3028/6519] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:23 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:24.243441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:24.244497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:24.251970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:24.252440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:24.253228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:24.253643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:24.393385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:24.401567 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-383a06b0-05e8-4bf0-a7d0-560d2ce8e648 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.164820 Jun 25 21:36:24.402161 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3492/6520] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:24 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:24.725127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3196d6d2-bf49-41da-ba88-43aa7c7be586 req-49589d61-1410-47fa-a6be-9ea0bf9037e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "name": "network-vif-plugged", "status": "completed", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:24.729730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=30 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:24.736538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3196d6d2-bf49-41da-ba88-43aa7c7be586 req-49589d61-1410-47fa-a6be-9ea0bf9037e0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:24.737263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3196d6d2-bf49-41da-ba88-43aa7c7be586 req-49589d61-1410-47fa-a6be-9ea0bf9037e0 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:24.748921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3196d6d2-bf49-41da-ba88-43aa7c7be586 req-49589d61-1410-47fa-a6be-9ea0bf9037e0 service nova] Creating event network-vif-plugged:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch1-master-1 Jun 25 21:36:24.754127 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3196d6d2-bf49-41da-ba88-43aa7c7be586 req-49589d61-1410-47fa-a6be-9ea0bf9037e0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032865 Jun 25 21:36:24.754781 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3029/6521] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:36:25.421345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:25.422249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:25.432654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:25.433458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:25.434728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:25.435346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:25.581279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:25.583649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:25.590927 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d1ae7870-20b4-469f-b524-04a2904843d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1318 microversion: 2.1 time: 0.175416 Jun 25 21:36:25.591515 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3493/6522] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:25 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:26.609888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:26.610595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:26.617909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:26.618369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:26.619191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:26.619742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:26.786627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:26.794690 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-61db3185-9ba4-40e0-ad65-aa966fa7c667 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1508 microversion: 2.1 time: 0.190195 Jun 25 21:36:26.795282 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3030/6523] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:26 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:26.814446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:26.815020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:26.818184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:26.824724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:26.825211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:26.826022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:26.826457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:26.982134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:26.993749 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f85e1b15-428a-4c90-a3f0-6e44b56962c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1508 microversion: 2.1 time: 0.184252 Jun 25 21:36:26.994539 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3494/6524] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:26 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:27.010234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:27.011576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:27.018265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.018746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.019533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.019990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.097590 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bc65ad5d-19b1-495b-bc89-7039463bb2bc tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "PUT /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1080 microversion: 2.1 time: 0.091428 Jun 25 21:36:27.098276 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3031/6525] 10.222.0.39 () {60 vars in 1255 bytes} [Sat Jun 25 21:36:27 2022] PUT /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1080 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:27.112807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:27.113424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:27.115421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:27.121438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.121878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.122632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.123065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.123500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:27.275313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:27.285483 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-becd5b12-6866-4c3a-82b4-a180465b706b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1506 microversion: 2.1 time: 0.176768 Jun 25 21:36:27.286073 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3495/6526] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:27 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1506 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:27.301739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:27.302381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:27.304570 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:27.310654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.311125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.311935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.312381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.449657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:27.458710 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f38c8684-9a9c-4ebf-88c6-fc8a044e6309 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1506 microversion: 2.1 time: 0.160898 Jun 25 21:36:27.459661 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3032/6527] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:27 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:27.475494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:36:27.476671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:27.483088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.483551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.484321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.484791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.513273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:27.519360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Old instance type m1.heat2, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:36:27.526287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:36:27.526678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:36:27.527164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:36:27.527582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:36:27.528001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:36:27.594819 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e3089b77-8db4-4486-9a8e-c89fbfcb43d9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b/action" status: 202 len: 0 microversion: 2.1 time: 0.123399 Jun 25 21:36:27.595432 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3496/6528] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:36:27 2022] POST /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:36:27.604140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:27.604982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:27.612792 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.613364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.614039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:27.614493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:27.752494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:27.761043 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-507bcbbc-4f31-426c-b4c9-b5d38400008e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1517 microversion: 2.1 time: 0.161091 Jun 25 21:36:27.761639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3033/6529] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:27 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:28.783170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:28.783879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:28.791984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:28.792592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:28.793535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:28.794074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:28.934984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:28.942827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d9c4cc9-513c-4fff-b17b-408d06b128d1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1517 microversion: 2.1 time: 0.166045 Jun 25 21:36:28.943657 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3497/6530] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:28 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:29.964068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:29.965014 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:29.977145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:29.978013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:29.979183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:29.979636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:30.124636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:30.132415 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-761f8c36-b732-4afc-84c6-0329e86ff17f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.175541 Jun 25 21:36:30.133230 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3034/6531] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:29 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:31.153132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:31.153673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:31.161120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:31.161573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:31.162337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:31.162772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:31.304742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:31.312705 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-636f23bc-0b0e-4f2e-9d41-a5bb43108ac5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.165026 Jun 25 21:36:31.313280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3498/6532] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:31 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:32.333527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:32.334884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:32.343526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:32.343988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:32.344863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:32.345311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:32.487611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:32.498328 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35e2bd64-1470-4efe-8e8f-e5b8ad053514 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.171157 Jun 25 21:36:32.498931 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3035/6533] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:32 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:33.520190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:33.521166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:33.532625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:33.533378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:33.534634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:33.535358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:33.680799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:33.693237 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb5f5cbf-a819-4118-bc53-29893570d9e9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.179421 Jun 25 21:36:33.694069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3499/6534] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:33 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:34.715072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:34.715709 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:34.722969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:34.723438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:34.724219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:34.724705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:34.871503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:34.879753 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-72a548df-2800-4c21-879b-d27c99d7a017 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.171062 Jun 25 21:36:34.880337 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3036/6535] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:34 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:35.901227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:35.902232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:35.913703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:35.914454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:35.915711 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:35.916500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:36.060556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:36.068571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfd26aca-3616-46e9-83a9-86664c7f555a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.174066 Jun 25 21:36:36.069160 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3500/6536] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:35 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:37.086647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:37.087202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:37.094817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:37.095285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:37.096062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:37.096563 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:37.242391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:37.250543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e34d283b-a1f8-4aa4-81ff-d9f1000fd629 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.168396 Jun 25 21:36:37.251100 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3037/6537] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:37 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:38.271318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:38.272312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:38.284837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:38.285752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:38.287030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:38.287747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:38.422372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:38.430223 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c7c99df4-c4c9-431a-a27b-f7bf0509e1ae tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.165521 Jun 25 21:36:38.430807 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3501/6538] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:38 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:39.448521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:39.449214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:39.456939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:39.457408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:39.458185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:39.458633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:39.591438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:39.603204 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-788132b3-932d-4fee-abb2-80c38d311895 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.158488 Jun 25 21:36:39.603987 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3038/6539] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:39 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:40.624235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:40.625079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:40.634375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:40.634948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:40.635962 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:40.636554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:40.783433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:40.795520 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4e61ef29-1494-4d31-a493-7d269a5322f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.176867 Jun 25 21:36:40.796367 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3502/6540] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:40 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:41.813568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:41.814204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:41.822049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:41.822541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:41.823342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:41.823786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:41.973960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:41.982224 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0bc73112-0456-4d36-939a-b48867455e71 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.172857 Jun 25 21:36:41.982823 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3039/6541] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:41 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:43.002422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:43.003055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:43.010862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:43.011369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:43.012220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:43.012746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:43.149860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:43.158211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b9a2a224-5c44-465b-bc16-abba4244a6b6 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.160846 Jun 25 21:36:43.158989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3503/6542] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:42 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:44.179658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:44.180614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:44.192264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:44.193101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:44.194369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:44.195123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:44.331833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:44.340080 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5543e63-535b-40fe-9b64-aa38df014881 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.167461 Jun 25 21:36:44.340684 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3040/6543] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:44 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:45.360969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:45.362035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:45.373596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:45.374053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:45.374820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:45.375252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:45.515118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:45.523032 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c6306ac1-2886-44f8-8def-f1facbbd18de tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.168788 Jun 25 21:36:45.523653 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3504/6544] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:45 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:46.543667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:46.544290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:46.555755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:46.556399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:46.557635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:46.558312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:46.699015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:46.707499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-809d0109-aacd-4b5e-8771-7e043234de41 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.170309 Jun 25 21:36:46.708121 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3041/6545] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:46 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:47.729578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:47.730612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:47.739193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:47.739633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:47.740395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:47.740857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:47.884285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:47.894554 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-500deb8b-3193-488a-b764-c87d6bbcf5eb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.171617 Jun 25 21:36:47.895147 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3505/6546] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:47 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:48.916322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:48.917418 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:48.929468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:48.930146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:48.931475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:48.932271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:48.953749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:49.071302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:49.079273 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f6f0b9b5-5c78-4b57-844c-0c091fae6388 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.169667 Jun 25 21:36:49.079865 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3042/6547] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:48 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:50.100401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:50.101366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:50.112259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:50.112741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:50.113514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:50.113954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:50.244774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:50.252982 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abf81be5-e812-4918-8ab7-ad29c7794534 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.159260 Jun 25 21:36:50.253575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3506/6548] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:50 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:51.270527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:51.271159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:51.277983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:51.278450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:51.279221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:51.279669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:51.419701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:51.427932 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14ca77d6-cb98-421b-824c-9a2f8037c025 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.161710 Jun 25 21:36:51.428548 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3043/6549] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:51 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:52.449642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:52.450507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:52.462316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:52.463076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:52.464341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:52.465122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:52.915147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:52.923646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f1bce58-1538-4a52-9c9d-c4cf6846f484 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.481199 Jun 25 21:36:52.924221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3507/6550] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:52 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:53.951252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:53.952237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:53.964860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:53.965631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:53.966906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:53.967650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:54.104903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:54.114575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5360288b-7787-4949-9449-e97bff48acc3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.170268 Jun 25 21:36:54.115355 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3044/6551] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:53 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:55.136124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:55.137327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:55.146375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:55.146822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:55.147583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:55.148019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:55.287008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:55.294725 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4633a43d-efaf-4171-8b9e-78550aa87696 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.165360 Jun 25 21:36:55.295307 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3508/6552] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:55 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:56.311545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:56.312209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:56.315279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:56.321207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:56.321678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:56.322475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:56.322926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:56.539879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:56.548305 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c491cba-3c24-4def-a20a-82aacd6a07c9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.240891 Jun 25 21:36:56.549628 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3045/6553] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:56 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:57.570751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:57.571613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:57.575932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=34 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:57.583049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:57.583497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:57.584261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:57.585084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:57.587821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:36:57.719827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:57.727949 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c570aa31-7e4e-48ff-b320-8a723e70d42c tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.164018 Jun 25 21:36:57.728603 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3509/6554] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:57 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:58.749685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:58.750838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:58.758716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:58.759209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:58.760029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:58.760532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:58.902157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:36:58.910266 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31ed29d4-5297-44e3-a733-674c7522b3f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.167465 Jun 25 21:36:58.910847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3046/6555] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:58 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:36:59.930748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:36:59.931783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:36:59.941743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:59.942199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:36:59.942966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:36:59.943402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:00.084102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:00.092454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-661c9588-1733-4437-8745-bbd2cba7472e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.168476 Jun 25 21:37:00.093051 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3510/6556] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:36:59 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:01.113579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:01.114429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:01.126540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:01.127352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:01.128697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:01.129455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:01.285754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:01.293674 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbe8e41f-5ed0-46d5-a218-5aa8d87aee44 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1522 microversion: 2.1 time: 0.187062 Jun 25 21:37:01.294443 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3047/6557] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:01 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:01.788385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "name": "network-vif-unplugged", "status": "completed", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:01.798213 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:01.798811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:01.811584 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] Creating event network-vif-unplugged:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch2-master-1 Jun 25 21:37:01.818311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:37:01.829511 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2cda37f3-ac32-43a9-9043-e10380adaa33 req-4e26b64e-9bcf-4754-bdf2-e782fb3bb55f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045237 Jun 25 21:37:01.830332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3511/6558] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:02.311304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:02.311938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:02.319414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:02.319884 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:02.320672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:02.321296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:02.457524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:02.465926 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6102e437-ae62-47fc-9379-00c060e56338 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1521 microversion: 2.1 time: 0.158721 Jun 25 21:37:02.466621 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3048/6559] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:02 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:03.489275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:03.489918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:03.497049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:03.497502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:03.498284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:03.498730 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:03.639866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:03.648883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14e70f5f-84d3-4de1-bdc1-73d68084ceee tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1519 microversion: 2.1 time: 0.167347 Jun 25 21:37:03.649453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3512/6560] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:03 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:03.849104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:03.858494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:03.858961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:03.873000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] Creating event network-changed:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch2-master-1 Jun 25 21:37:03.883073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:37:03.895527 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3f7525b9-87a6-4eb3-8161-d9fdf619a0a6 req-d898b930-43c0-4cbf-9b07-3d15ccf77150 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050940 Jun 25 21:37:03.896134 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3049/6561] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:04.670873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:04.671706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:04.680457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:04.680938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:04.681701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:04.682136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:04.814241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:04.822849 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9aa9b1a4-d7fc-4604-ba5e-611aaf61de96 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1519 microversion: 2.1 time: 0.158377 Jun 25 21:37:04.823009 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3513/6562] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:04 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:05.845042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:05.845760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:05.852891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:05.853290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:05.854130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:05.854680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:05.991054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:05.999000 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ed6e81a9-1b64-4cd6-aa8b-8a5ecc8c219d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1516 microversion: 2.1 time: 0.159231 Jun 25 21:37:05.999560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3050/6563] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:05 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:06.018222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:06.019231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:06.026799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:06.027373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:06.028229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:06.028816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:06.090209 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-86555d18-f8d1-4574-aac2-d9ccbfc2da02 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b/action" status: 204 len: 0 microversion: 2.1 time: 0.075697 Jun 25 21:37:06.091076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3514/6564] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:37:06 2022] POST /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:37:06.099469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:06.100109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:06.106540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:06.107015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:06.108409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:06.108930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:06.317638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:06.327534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e9becf5a-8acc-483c-87b3-ae0b25af9389 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1516 microversion: 2.1 time: 0.232194 Jun 25 21:37:06.328146 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3051/6565] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:06 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:07.351069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:07.352243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:07.363766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:07.364228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:07.365035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:07.365482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:07.504319 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:07.512471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a36bb632-e180-4ba5-8d9c-bc001446728b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1516 microversion: 2.1 time: 0.168653 Jun 25 21:37:07.513125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3515/6566] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:07 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1516 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:08.030446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8b2f9cde-33df-4610-8ac8-b7da95aacf4d req-eac97edd-cf43-499d-ad21-7a3fc0cc0957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "name": "network-vif-plugged", "status": "completed", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:08.041249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8b2f9cde-33df-4610-8ac8-b7da95aacf4d req-eac97edd-cf43-499d-ad21-7a3fc0cc0957 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:08.041829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8b2f9cde-33df-4610-8ac8-b7da95aacf4d req-eac97edd-cf43-499d-ad21-7a3fc0cc0957 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:08.056826 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8b2f9cde-33df-4610-8ac8-b7da95aacf4d req-eac97edd-cf43-499d-ad21-7a3fc0cc0957 service nova] Creating event network-vif-plugged:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch2-master-1 Jun 25 21:37:08.061904 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8b2f9cde-33df-4610-8ac8-b7da95aacf4d req-eac97edd-cf43-499d-ad21-7a3fc0cc0957 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037830 Jun 25 21:37:08.062534 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3052/6567] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:08.530831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:08.531454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:08.543086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:08.543688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:08.544616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:08.545210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:08.685437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:08.694683 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b4ed238-98fd-48bb-be2b-c554add8d0d3 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1508 microversion: 2.1 time: 0.168745 Jun 25 21:37:08.695252 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3516/6568] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:08 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:08.712238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:08.712945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:08.719491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:08.719951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:08.720762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:08.721216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:08.858658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:08.866927 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a801cd74-8a71-4d53-965f-abaf9c3874c7 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1508 microversion: 2.1 time: 0.159503 Jun 25 21:37:08.867516 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3053/6569] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:08 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:08.886465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a7ba45e4-0031-4e3f-b1f4-39c5ce93b777 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'create', calling method: .version_select at 0x7f984fe444c0>, body: {"keypair": {"name": "tempest-keypair-1420584076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1gDiM69BbYFo8ViNmWKfJ96a5p/e4/++zbZoTMml3z/K+dGYeBCApMlVHakCBdP7cL6dTLwUdYZnx6sn7YHDPA5B+9KtI8cpq2kwu5P0Jsv0/kHauLzT7nPcLFPK8eMw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:08.902393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a7ba45e4-0031-4e3f-b1f4-39c5ce93b777 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:37:08.909164 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-a7ba45e4-0031-4e3f-b1f4-39c5ce93b777 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for user 581e969a68fc439f8021e3c106a1b58b and project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:37:08.941154 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a7ba45e4-0031-4e3f-b1f4-39c5ce93b777 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058692 Jun 25 21:37:08.941772 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3517/6570] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:37:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:10.163766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:10.164417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:10.171509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.172016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:10.172817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.173270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:10.316572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:10.324806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4c3cfa2-85a7-4233-a152-36c0a93a2720 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 200 len: 1508 microversion: 2.1 time: 0.165131 Jun 25 21:37:10.325391 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3054/6571] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:10 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:10.342839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:10.343396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:10.353762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.354223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:10.355006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.355449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:10.380635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:37:10.458662 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f9a1735-78d1-4bb4-bc09-65036509a5f1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 204 len: 0 microversion: 2.1 time: 0.120415 Jun 25 21:37:10.459400 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3518/6572] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:37:10 2022] DELETE /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:37:10.516449 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-120257305", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "81771b46-5b2e-4708-822b-3205e233fab6"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:10.569698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] validate_networks() for [('81771b46-5b2e-4708-822b-3205e233fab6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:37:10.970201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:37:10.970677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:37:10.971157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:37:10.971716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:37:10.972152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:37:10.982836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.983698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:10.985079 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:10.985532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:11.004502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:37:11.010090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Getting quotas for user 581e969a68fc439f8021e3c106a1b58b and project 31f1f1e662e94d4899d83dcdc61cb9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:37:11.022969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:37:11.025349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:37:11.073394 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a456f431-7a40-4c62-a3f2-2047025b6050 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560893 Jun 25 21:37:11.074075 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3055/6573] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:37:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:37:11.085110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fae6c7c0-e89e-4648-a589-2d1aaee6d303 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:11.085804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fae6c7c0-e89e-4648-a589-2d1aaee6d303 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:11.139615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fae6c7c0-e89e-4648-a589-2d1aaee6d303 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:11.146846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fae6c7c0-e89e-4648-a589-2d1aaee6d303 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1217 microversion: 2.1 time: 0.066460 Jun 25 21:37:11.147407 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3519/6574] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:11 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:12.164604 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:12.165247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:12.171779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:12.172256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:12.173070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:12.173530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:12.236987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:12.245159 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ab05cbf-3e23-4cc5-8efa-b84afde47328 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1277 microversion: 2.1 time: 0.085670 Jun 25 21:37:12.245723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3056/6575] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:12 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:12.750633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f573278d-457e-4b92-87a4-041716bf33c1 req-c1d7a66c-a9bd-4522-bfe1-94dccb38bd83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "719dc77d-fc31-4c17-8dbe-d67115cab05b", "name": "network-vif-deleted", "tag": "a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:12.769219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f573278d-457e-4b92-87a4-041716bf33c1 req-c1d7a66c-a9bd-4522-bfe1-94dccb38bd83 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:12.770497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f573278d-457e-4b92-87a4-041716bf33c1 req-c1d7a66c-a9bd-4522-bfe1-94dccb38bd83 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:12.787955 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f573278d-457e-4b92-87a4-041716bf33c1 req-c1d7a66c-a9bd-4522-bfe1-94dccb38bd83 service nova] Creating event network-vif-deleted:a3198aff-fa52-4ee8-a2c0-a9f8b2dc6442 for instance 719dc77d-fc31-4c17-8dbe-d67115cab05b on nch2-master-1 Jun 25 21:37:12.807807 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f573278d-457e-4b92-87a4-041716bf33c1 req-c1d7a66c-a9bd-4522-bfe1-94dccb38bd83 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058946 Jun 25 21:37:12.807807 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3520/6576] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:13.263851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:13.265594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:13.274784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:13.276135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:13.277425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:13.278200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:13.535642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:13.544242 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aa788f0b-e3cf-4e1f-854d-da1b1bbbe704 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.285576 Jun 25 21:37:13.544916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3057/6577] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:13 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:13.948573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c2961006-1356-4d41-8e80-e9be247a7d4d req-babe9514-8482-454e-bbfb-cf13f19944b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:13.962442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c2961006-1356-4d41-8e80-e9be247a7d4d req-babe9514-8482-454e-bbfb-cf13f19944b6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:13.963003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c2961006-1356-4d41-8e80-e9be247a7d4d req-babe9514-8482-454e-bbfb-cf13f19944b6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:13.978346 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c2961006-1356-4d41-8e80-e9be247a7d4d req-babe9514-8482-454e-bbfb-cf13f19944b6 service nova] Creating event network-changed:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch2-master-1 Jun 25 21:37:13.985759 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c2961006-1356-4d41-8e80-e9be247a7d4d req-babe9514-8482-454e-bbfb-cf13f19944b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045160 Jun 25 21:37:13.986789 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3521/6578] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:14.565766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:14.566626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:14.577830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:14.578405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:14.579510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:14.580091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:14.729857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:14.737844 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22702eb5-5063-422b-915a-e4794435f24d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.178911 Jun 25 21:37:14.738427 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3058/6579] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:14 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:15.761803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:15.762960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:15.774146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:15.774898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:15.776151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:15.776873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:15.916552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:15.924753 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c61f2c2-8ea9-4f8c-835d-bf54c830f8e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.171554 Jun 25 21:37:15.925345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3522/6580] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:15 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:16.942890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:16.943591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:16.951883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:16.952402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:16.953292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:16.953821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:17.094711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:17.103868 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59c18b81-dc01-4060-958c-df696450a084 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.165378 Jun 25 21:37:17.104525 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3059/6581] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:16 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:18.124083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:18.124798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:18.133417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:18.133870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:18.134644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:18.135077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:18.270810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:18.278743 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3635687-90b9-4e9d-b471-b2a2f6198189 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.160626 Jun 25 21:37:18.279302 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3523/6582] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:18 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:19.301512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:19.302152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:19.309872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:19.310341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:19.311123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:19.311574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:19.314337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=95 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:19.458514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:19.471286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6259247d-d336-450c-b79f-ee9a2447f68f tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.175863 Jun 25 21:37:19.472021 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3060/6583] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:19 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:20.083459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f1d1e17d-835d-4652-a4bb-c7fce96a2e88 req-2f509f2b-c8f7-43a6-90bd-a84dc6296f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "name": "network-vif-plugged", "status": "completed", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:20.093152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f1d1e17d-835d-4652-a4bb-c7fce96a2e88 req-2f509f2b-c8f7-43a6-90bd-a84dc6296f2a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:20.093760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f1d1e17d-835d-4652-a4bb-c7fce96a2e88 req-2f509f2b-c8f7-43a6-90bd-a84dc6296f2a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:20.107683 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f1d1e17d-835d-4652-a4bb-c7fce96a2e88 req-2f509f2b-c8f7-43a6-90bd-a84dc6296f2a service nova] Creating event network-vif-plugged:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch2-master-1 Jun 25 21:37:20.112890 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f1d1e17d-835d-4652-a4bb-c7fce96a2e88 req-2f509f2b-c8f7-43a6-90bd-a84dc6296f2a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033289 Jun 25 21:37:20.113504 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3524/6584] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:20.493085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:20.493580 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:20.500631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:20.501108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:20.501906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:20.502364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:20.641003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:20.649019 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd8f9f74-363f-407c-8248-6980b3f720a9 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1317 microversion: 2.1 time: 0.161857 Jun 25 21:37:20.649601 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3061/6585] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:20 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:21.667802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:21.674760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:21.675916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:21.683877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:21.684316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:21.685109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:21.685547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:21.816960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:21.826359 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9a0a5264-6b6b-4b4e-8b43-f52c806c7d7b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1507 microversion: 2.1 time: 0.161636 Jun 25 21:37:21.827102 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3525/6586] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:21 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:21.843419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:21.844053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:21.846021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:21.846720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:21.853581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:21.854049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:21.854809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:21.855278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:21.992832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:22.005274 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e62defe-3019-428f-a98a-1787a0e3f4c0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1507 microversion: 2.1 time: 0.165426 Jun 25 21:37:22.006100 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3062/6587] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:21 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:22.022132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:22.023053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:22.029657 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:22.030117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:22.030892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:22.031338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:22.062903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:22.069482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Old instance type m1.heat2, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:37:22.076376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:37:22.076831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:37:22.077306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:37:22.077710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:37:22.078121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:37:22.094751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:22.149180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8465cd49-b1e1-40c8-bd53-e447d9dafb94 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff/action" status: 202 len: 0 microversion: 2.1 time: 0.130844 Jun 25 21:37:22.150395 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3526/6588] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:37:22 2022] POST /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:37:22.158727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:22.159356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:22.166001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:22.166467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:22.167253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:22.167754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:22.304391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:22.312499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ccdf0890-9c27-4c8b-917a-cd87d4782198 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1514 microversion: 2.1 time: 0.158183 Jun 25 21:37:22.313092 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3063/6589] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:22 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:37:23.330844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:23.332115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:23.340350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:23.340948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:23.341759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:23.342240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:23.479104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:23.487147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3f10b24-15bb-46a2-bd27-6caf0bb5ff83 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1514 microversion: 2.1 time: 0.160379 Jun 25 21:37:23.487738 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3527/6590] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:23 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:24.508260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:24.508900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:24.516762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:24.517238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:24.518017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:24.518469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:24.650340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:24.658469 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d616250e-3817-473f-bad7-67402f1adc59 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.156433 Jun 25 21:37:24.659056 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3064/6591] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:24 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:25.680613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:25.681411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:25.690262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:25.690797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:25.691691 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:25.692208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:25.832006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:25.843152 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-048c23fe-b959-4a26-a4dd-44e554d3a288 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.169236 Jun 25 21:37:25.843874 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3528/6592] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:25 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:26.861094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:26.861748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:26.864572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:26.870246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:26.870701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:26.871479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:26.871940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:27.015794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:27.024092 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d989db32-7119-4027-bf80-a80fc32dcf49 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.167086 Jun 25 21:37:27.024762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3065/6593] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:26 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:28.042370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:28.043024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:28.045877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:28.052963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:28.053410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:28.054206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:28.054630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:28.202923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:28.215069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf22f23a-6087-4b1f-822b-2be206f2aba1 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.176820 Jun 25 21:37:28.215771 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3529/6594] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:28 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:29.240777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:29.241807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:29.249898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:29.250366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:29.251143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:29.251597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:29.384976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:29.393018 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cbe4d04-0067-4802-9a60-5ae699311fca tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.158936 Jun 25 21:37:29.393571 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3066/6595] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:29 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:30.416482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:30.417265 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:30.426525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:30.427093 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:30.428055 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:30.428656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:30.580754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:30.590987 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-002682ba-5f71-404d-a211-7f08929d8eb2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.180998 Jun 25 21:37:30.591544 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3530/6596] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:30 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:31.612595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:31.613523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:31.622908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:31.623382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:31.624168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:31.624660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:31.768248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:31.780416 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d4d2397-3412-4bb7-affc-4fe398f19df4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.174335 Jun 25 21:37:31.781255 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3067/6597] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:31 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:32.801982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:32.803114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:32.812373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:32.812947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:32.813763 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:32.814229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:32.957586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:32.966204 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc7de24b-0c75-4949-ab2e-ef09d64edc2a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.171099 Jun 25 21:37:32.966794 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3531/6598] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:32 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:33.988814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:33.989944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:34.001703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:34.002477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:34.003749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:34.004494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:34.150638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:34.158860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c5cacf4-5930-4be7-be5c-63a4489154fe tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.177765 Jun 25 21:37:34.159426 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3068/6599] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:33 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:35.180280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:35.181160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:35.188877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:35.189320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:35.190092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:35.190527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:35.322338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:35.330218 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-878f8ac1-a8c2-4503-92de-fcab089d806a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.156717 Jun 25 21:37:35.330798 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3532/6600] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:35 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:36.351478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:36.352811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:36.361932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:36.362390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:36.363166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:36.363614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:36.494650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:36.502411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba4a76d9-fb7c-4b34-9863-78bea6026cf4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.157660 Jun 25 21:37:36.502997 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3069/6601] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:36 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:37.524068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:37.524980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:37.533053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:37.533511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:37.534269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:37.534698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:37.673937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:37.686074 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e7fbdec6-631f-4ebb-8e5a-341ce480e3c2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.168453 Jun 25 21:37:37.686835 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3533/6602] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:37 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:38.707945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:38.709065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:38.719691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:38.720158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:38.720969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:38.721416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:38.869587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:38.878871 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f42fc14-5ec3-44c8-b7cb-62ba66fb25f5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.177578 Jun 25 21:37:38.879471 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3070/6603] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:38 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:39.896461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:39.897089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:39.904233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:39.904721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:39.905491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:39.905920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:40.058545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:40.066474 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6741dda9-2f96-4617-81e4-ea71523fd7b4 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.174083 Jun 25 21:37:40.067062 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3534/6604] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:39 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:41.084395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:41.085074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:41.093899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:41.094359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:41.095138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:41.095584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:41.227143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:41.235464 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4dfcc741-d7fd-45b5-b1fe-ff7eba61f6d2 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.155935 Jun 25 21:37:41.236016 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3071/6605] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:41 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:42.254412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:42.255273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:42.264754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:42.265212 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:42.265991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:42.266431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:42.416392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:42.425571 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebe4d37e-2828-4d47-965a-bb50623f37e5 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.176631 Jun 25 21:37:42.426159 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3535/6606] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:42 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:43.447629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:43.448561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:43.460816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:43.461632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:43.462926 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:43.463685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:43.605209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:43.613239 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d17208a-95b7-49fd-91ba-1fe38d9c5c1d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.172421 Jun 25 21:37:43.613833 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3072/6607] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:43 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:44.635013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:44.636048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:44.644889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:44.645347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:44.646120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:44.646561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:44.792852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:44.800861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ff51e62c-0161-4764-85eb-bf75e8bee6a0 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.172763 Jun 25 21:37:44.801485 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3536/6608] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:44 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:45.822344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:45.823514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:45.833055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:45.833527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:45.834313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:45.834769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:45.976804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:45.985611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae3a8c00-224f-4c92-afe8-bf38c8c43194 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.170066 Jun 25 21:37:45.986243 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3073/6609] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:45 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:47.002832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:47.003446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:47.011328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:47.011804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:47.012647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:47.013106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:47.152342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:47.160277 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d160ebb-79d0-4ddd-9170-151ef877d032 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.161711 Jun 25 21:37:47.160892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3537/6610] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:46 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:48.183189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:48.184146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:48.196278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:48.197318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:48.198623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:48.199378 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:48.333561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:48.342333 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0de8e89a-5cec-4a28-a8a2-d64330133b04 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.167256 Jun 25 21:37:48.342918 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3074/6611] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:48 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:49.366048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:49.366983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:49.376859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:49.377312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:49.378075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:49.378509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:49.512997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:49.520796 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cbd9a9a7-d3da-4cab-9771-f88976b8608b tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.161319 Jun 25 21:37:49.521383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3538/6612] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:49 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:50.542682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:50.543609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:50.551491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:50.551961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:50.552775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:50.553234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:50.555841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=90 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:50.692279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:50.704296 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-39213010-a29a-4195-8f3d-453054e0cc6a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1519 microversion: 2.1 time: 0.168223 Jun 25 21:37:50.705089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3075/6613] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:50 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:51.403891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "name": "network-vif-unplugged", "status": "completed", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:51.413527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:51.413937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:51.426369 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] Creating event network-vif-unplugged:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch1-master-1 Jun 25 21:37:51.431944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:37:51.442933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-e91b17e6-9f51-4f53-928f-ed936047f941 req-f17ee455-c06c-4374-863f-91ed432a811e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042816 Jun 25 21:37:51.443516 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3539/6614] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:51.725998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:51.726656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:51.734223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:51.734704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:51.735515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:51.735981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:51.965437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:51.973600 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d2dc376-0c4f-4d4b-93d9-24968a973676 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1518 microversion: 2.1 time: 0.251604 Jun 25 21:37:51.974197 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3076/6615] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:51 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1518 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:52.999376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:53.000074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:53.006808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:53.007259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:53.008024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:53.008448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:53.011134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:53.142146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:53.150408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16b6d898-f6e7-4813-878b-405e5054c70e tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1516 microversion: 2.1 time: 0.159823 Jun 25 21:37:53.150998 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3540/6616] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:52 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:53.464504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:53.479619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:53.480760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:53.498556 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] Creating event network-changed:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch1-master-1 Jun 25 21:37:53.504460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:37:53.515644 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-fd241e01-8e3e-4486-b354-459b7af12fa6 req-d9d671f0-3b80-4b3e-9841-25e84a662008 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057875 Jun 25 21:37:53.516235 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3077/6617] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:54.168083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:54.168853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:54.176070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.176569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.177355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.177798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.314184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:54.322167 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65102733-f065-4c67-9838-f964d14b3c43 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1513 microversion: 2.1 time: 0.158212 Jun 25 21:37:54.322762 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3541/6618] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:54 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:54.340147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:54.340833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:54.347690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.348391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.349211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.349668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.418129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9193a0b0-cf7c-4977-a759-d731d9b03908 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "POST /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff/action" status: 204 len: 0 microversion: 2.1 time: 0.082662 Jun 25 21:37:54.418788 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3078/6619] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:37:54 2022] POST /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:37:54.427373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:54.428132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:54.434724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.435302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.436233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:54.436884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:54.578482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:54.586915 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8739af2b-69b4-442a-8f15-38487741deed tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1513 microversion: 2.1 time: 0.163651 Jun 25 21:37:54.587535 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3542/6620] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:54 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:55.605650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:55.606525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:55.614292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.614850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:55.615833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.616297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:55.761476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:55.769598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-990eafd9-b922-4048-a65b-f1c1c62afe5d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1505 microversion: 2.1 time: 0.168417 Jun 25 21:37:55.770201 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3079/6621] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:55 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:55.785865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:55.786478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:55.793719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.794147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:55.794908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.795346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:55.929453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:55.946612 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e5bec945-9ac6-4031-b797-dd7dc5769c25 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1505 microversion: 2.1 time: 0.164603 Jun 25 21:37:55.947221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3543/6622] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:55 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:55.965982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:55.966564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:55.973269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.973744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:55.974532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:55.974981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.162179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:56.170114 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9f3e7085-29aa-4adb-8384-78f44b5c664a tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1505 microversion: 2.1 time: 0.210611 Jun 25 21:37:56.170791 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3080/6623] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:55 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:56.186774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:56.187560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:56.194110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.194863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.195742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.196178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.225101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:37:56.307812 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7476538e-aa4a-4dac-b574-2834234af74d tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 204 len: 0 microversion: 2.1 time: 0.124691 Jun 25 21:37:56.309221 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3544/6624] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:37:56 2022] DELETE /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:37:56.324394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:56.324919 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:56.332060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.332636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.333479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.333924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.359710 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:37:56.406252 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.compute.api [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Instance is already in deleting state, ignoring this request Jun 25 21:37:56.407125 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd457cec-462a-4dc4-aa4f-0eb86fa027cb tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 204 len: 0 microversion: 2.1 time: 0.086879 Jun 25 21:37:56.407678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3081/6625] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:37:56 2022] DELETE /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:37:56.416773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:56.417475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:56.423897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.424799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.425895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:56.426336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:56.565935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:56.574123 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e6a1c47-4386-41c7-825c-14bf0777a102 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1511 microversion: 2.1 time: 0.161713 Jun 25 21:37:56.574700 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3545/6626] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:56 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:57.333653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-436d2e34-f953-4b35-ab8d-2356d59ee83a req-9b3c7926-c7d6-4c4a-a469-b39ce34a2317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "name": "network-vif-plugged", "status": "completed", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:57.343611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=34 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:57.346749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-436d2e34-f953-4b35-ab8d-2356d59ee83a req-9b3c7926-c7d6-4c4a-a469-b39ce34a2317 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:57.347466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-436d2e34-f953-4b35-ab8d-2356d59ee83a req-9b3c7926-c7d6-4c4a-a469-b39ce34a2317 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:57.361124 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-436d2e34-f953-4b35-ab8d-2356d59ee83a req-9b3c7926-c7d6-4c4a-a469-b39ce34a2317 service nova] Creating event network-vif-plugged:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch1-master-1 Jun 25 21:37:57.366419 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-436d2e34-f953-4b35-ab8d-2356d59ee83a req-9b3c7926-c7d6-4c4a-a469-b39ce34a2317 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036974 Jun 25 21:37:57.367040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3082/6627] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:57.594463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:57.595071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:57.604206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:57.604696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:57.605470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:57.606113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:57.842203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '581e969a68fc439f8021e3c106a1b58b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f1f1e662e94d4899d83dcdc61cb9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:37:57.850216 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2768deb0-a0a1-4160-8536-7b77a2169685 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 200 len: 1511 microversion: 2.1 time: 0.261387 Jun 25 21:37:57.850851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3546/6628] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:57 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:37:58.161940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3f763623-7f21-4363-87e5-8cdbe249aee4 req-213f300f-9e26-4505-bfda-77d5abced79d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3036ca1e-60ff-4832-80db-e8b5d8b74eff", "name": "network-vif-deleted", "tag": "255f6bcb-01e3-4076-896e-67bc62f51eb7"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:37:58.171077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f763623-7f21-4363-87e5-8cdbe249aee4 req-213f300f-9e26-4505-bfda-77d5abced79d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:58.171595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f763623-7f21-4363-87e5-8cdbe249aee4 req-213f300f-9e26-4505-bfda-77d5abced79d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:58.186460 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3f763623-7f21-4363-87e5-8cdbe249aee4 req-213f300f-9e26-4505-bfda-77d5abced79d service nova] Creating event network-vif-deleted:255f6bcb-01e3-4076-896e-67bc62f51eb7 for instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff on nch1-master-1 Jun 25 21:37:58.193521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3f763623-7f21-4363-87e5-8cdbe249aee4 req-213f300f-9e26-4505-bfda-77d5abced79d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037610 Jun 25 21:37:58.194776 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3083/6629] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:37:58.871467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:58.872576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 3036ca1e-60ff-4832-80db-e8b5d8b74eff] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:58.877028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:37:58.886043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:58.886798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:58.888080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:58.888842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:58.904155 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] HTTP exception thrown: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Request method failure captured: Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff HTTP/1.1 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3_QSJ84him8sCq-4KItj6kepT5jdZHhBNDblS78bdJBQ1SjtQgFFgsIUSVPrZYQQ7HwvS9st_C8vIf_oCOJmzurC82-sJMpbRio-78eD0g5aja-2O4LmhUFRR3kXuFFcxuoI0IeiNdFUfSLsQlpWRhmGo2-pCw3ghCzzZIc4IAGimE Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}] Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 581e969a68fc439f8021e3c106a1b58b Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '3036ca1e-60ff-4832-80db-e8b5d8b74eff'} Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:58.905966 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Returning 404 to user: Instance 3036ca1e-60ff-4832-80db-e8b5d8b74eff could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:37:58.910628 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-26527c47-dc76-4f1a-9cb3-a901cd7bcf06 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff" status: 404 len: 111 microversion: 2.1 time: 0.042558 Jun 25 21:37:58.911265 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3547/6630] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:58 2022] GET /compute/v2.1/servers/3036ca1e-60ff-4832-80db-e8b5d8b74eff => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:37:58.917828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4012d3f7-962f-4fb6-b100-a8d03fc958cd tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '.version_select at 0x7f984fd9c160>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:58.944621 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4012d3f7-962f-4fb6-b100-a8d03fc958cd tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420584076" status: 202 len: 0 microversion: 2.1 time: 0.031346 Jun 25 21:37:58.945202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3084/6631] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:37:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1420584076 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:37:59.553583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:59.554129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:59.560467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:59.560928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:59.561689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:59.562122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:59.576033 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] HTTP exception thrown: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Request method failure captured: Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: request: DELETE /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b HTTP/1.1 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit3_QSJ84him8sCq-4KItj6kepT5jdZHhBNDblS78bdJBQ1SjtQgFFgsIUSVPrZYQQ7HwvS9st_C8vIf_oCOJmzurC82-sJMpbRio-78eD0g5aja-2O4LmhUFRR3kXuFFcxuoI0IeiNdFUfSLsQlpWRhmGo2-pCw3ghCzzZIc4IAGimE Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}] Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 581e969a68fc439f8021e3c106a1b58b Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '719dc77d-fc31-4c17-8dbe-d67115cab05b'} Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:37:59.578423 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Returning 404 to user: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3719c794-2809-4f1f-89bd-eac711ff2c35 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "DELETE /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 404 len: 111 microversion: 2.1 time: 0.031128 Jun 25 21:37:59.582245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3548/6632] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:37:59 2022] DELETE /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:37:59.592251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:37:59.593053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] [instance: 719dc77d-fc31-4c17-8dbe-d67115cab05b] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:37:59.602183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:59.602652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:59.603712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:37:59.604162 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:37:59.618988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] HTTP exception thrown: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Request method failure captured: Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b HTTP/1.1 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit3_QSJ84him8sCq-4KItj6kepT5jdZHhBNDblS78bdJBQ1SjtQgFFgsIUSVPrZYQQ7HwvS9st_C8vIf_oCOJmzurC82-sJMpbRio-78eD0g5aja-2O4LmhUFRR3kXuFFcxuoI0IeiNdFUfSLsQlpWRhmGo2-pCw3ghCzzZIc4IAGimE Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_31f1f1e662e94d4899d83dcdc61cb9c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/31f1f1e662e94d4899d83dcdc61cb9c8"}]}] Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 31f1f1e662e94d4899d83dcdc61cb9c8 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1599994554 Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 581e969a68fc439f8021e3c106a1b58b Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerDiskConfigTestJSON-1599994554-project Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '719dc77d-fc31-4c17-8dbe-d67115cab05b'} Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:37:59.620704 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] Returning 404 to user: Instance 719dc77d-fc31-4c17-8dbe-d67115cab05b could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ed8eda61-b07a-4a9c-8fac-c5f3664b5579 tempest-ServerDiskConfigTestJSON-1599994554 tempest-ServerDiskConfigTestJSON-1599994554-project] 10.222.0.39 "GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b" status: 404 len: 111 microversion: 2.1 time: 0.035214 Jun 25 21:37:59.625716 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3085/6633] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:37:59 2022] GET /compute/v2.1/servers/719dc77d-fc31-4c17-8dbe-d67115cab05b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:38:08.316546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f35b7f42-9d9a-4424-8e3d-638d45958fc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: .version_select at 0x7f984ef8baf0>, body: {"keypair": {"name": "tempest-keypair-1929333221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK42jUkpGj3pzqQXsqrt37KOfd9B53rHVUSNWL9FKUNDi1/edzXM7iQdhrCnZ2ArL/POEGY0qozWG/04CbQ/uh5k+NnAMm2A7U8orxOic0n84fjnHnqtSEv2UQPbFILeoA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:08.332468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f35b7f42-9d9a-4424-8e3d-638d45958fc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:38:08.338315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f35b7f42-9d9a-4424-8e3d-638d45958fc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:38:08.364225 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f35b7f42-9d9a-4424-8e3d-638d45958fc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.170727 Jun 25 21:38:08.364890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3549/6634] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:38:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:38:09.631353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-223955495", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "568f79cb-7fa4-475a-97f8-00e0980c23b6"}], "security_groups": [{"name": "tempest-securitygroup--699415506"}], "key_name": "tempest-keypair-1929333221", "user_data": "}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:09.639587 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:09.640573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:09.744992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] validate_networks() for [('568f79cb-7fa4-475a-97f8-00e0980c23b6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:38:10.122844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:38:10.123296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:38:10.123796 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:38:10.124265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:38:10.124745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:38:10.134565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:10.135041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:10.135870 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:10.136355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:10.154790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:38:10.160304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:38:10.177625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:38:10.180078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:38:10.233777 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-68dfa46c-f7f0-41e4-991b-15404411310f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.606736 Jun 25 21:38:10.235446 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3086/6635] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:38:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:38:10.245800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e53dda19-86e7-41f0-b96d-b5488a83ed3f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:10.247225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e53dda19-86e7-41f0-b96d-b5488a83ed3f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:10.251976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:10.337261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e53dda19-86e7-41f0-b96d-b5488a83ed3f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:10.347193 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e53dda19-86e7-41f0-b96d-b5488a83ed3f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1238 microversion: 2.1 time: 0.106243 Jun 25 21:38:10.348456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3550/6636] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:10 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1238 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:11.365983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:11.366626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:11.374772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:11.375628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:11.376502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:11.376969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:11.467053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:11.481723 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0600ca80-32c7-4a00-9dbc-2ca6b09c9474 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1298 microversion: 2.1 time: 0.120819 Jun 25 21:38:11.487450 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3087/6637] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:11 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:12.501708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:12.502327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:12.510708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:12.511442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:12.512224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:12.512686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:12.795388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:12.803379 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d1f34f0-efdf-40db-b217-d0a048607846 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.305863 Jun 25 21:38:12.803908 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3551/6638] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:12 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:13.182229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-225561f7-9aa0-4c02-8046-7bdb4cf49ed0 req-2daf5a4b-a032-444c-b67b-2e54bcea706a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:13.193016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-225561f7-9aa0-4c02-8046-7bdb4cf49ed0 req-2daf5a4b-a032-444c-b67b-2e54bcea706a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:13.193479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-225561f7-9aa0-4c02-8046-7bdb4cf49ed0 req-2daf5a4b-a032-444c-b67b-2e54bcea706a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:13.216770 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-225561f7-9aa0-4c02-8046-7bdb4cf49ed0 req-2daf5a4b-a032-444c-b67b-2e54bcea706a service nova] Creating event network-changed:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch1-master-1 Jun 25 21:38:13.224543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-225561f7-9aa0-4c02-8046-7bdb4cf49ed0 req-2daf5a4b-a032-444c-b67b-2e54bcea706a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050968 Jun 25 21:38:13.229889 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3088/6639] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:38:13.824551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:13.825829 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:13.834063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:13.834512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:13.836114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:13.836944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:13.981555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:13.992166 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35de6ba8-8427-412a-9edb-4c89ded89f74 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.174027 Jun 25 21:38:13.993036 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3552/6640] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:13 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:15.012887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:15.013607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:15.022643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:15.023194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:15.024120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:15.024696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:15.163463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:15.171864 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db8d8875-676c-4b57-9366-789180d2f6ab tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.165209 Jun 25 21:38:15.172468 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3089/6641] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:15 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:16.193632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:16.194485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:16.206287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:16.207058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:16.208342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:16.209130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:16.343514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:16.351493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f89da16a-9e3e-42df-98c7-36ad2ee0a29d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.164946 Jun 25 21:38:16.352064 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3553/6642] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:16 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:17.368780 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:17.369393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:17.376523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:17.377080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:17.377776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:17.378259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:17.520917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:17.528858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e3e27db-f9d9-4cc1-90e1-fa802e959e69 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.164153 Jun 25 21:38:17.529837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3090/6643] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:17 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:18.545331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:18.545966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:18.554437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:18.555104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:18.556185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:18.556795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:18.707905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:18.716274 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-11b89760-f4da-48a4-9565-b0a7d5c2ee94 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.174952 Jun 25 21:38:18.716924 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3554/6644] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:18 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:19.318229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-617fdd13-0db9-4dda-a01e-aaed401989e6 req-62c4d37e-70ba-426a-8828-d21ddd5bc4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "name": "network-vif-plugged", "status": "completed", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:19.328191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-617fdd13-0db9-4dda-a01e-aaed401989e6 req-62c4d37e-70ba-426a-8828-d21ddd5bc4b6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:19.328755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-617fdd13-0db9-4dda-a01e-aaed401989e6 req-62c4d37e-70ba-426a-8828-d21ddd5bc4b6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:19.342682 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-617fdd13-0db9-4dda-a01e-aaed401989e6 req-62c4d37e-70ba-426a-8828-d21ddd5bc4b6 service nova] Creating event network-vif-plugged:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch1-master-1 Jun 25 21:38:19.349646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-617fdd13-0db9-4dda-a01e-aaed401989e6 req-62c4d37e-70ba-426a-8828-d21ddd5bc4b6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034760 Jun 25 21:38:19.350356 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3091/6645] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:38:19.733402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:19.734007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:19.741295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:19.741742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:19.742575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:19.742970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:19.887188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:19.895408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7ff7bbc3-2faa-4970-bed2-70807bba10f8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1363 microversion: 2.1 time: 0.166061 Jun 25 21:38:19.895989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3555/6646] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:19 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:20.917812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:20.918967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:20.922434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:20.923695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:20.934428 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:20.935223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:20.936584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:20.937159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:21.077298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:21.085315 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e15ce510-9bf0-4f91-b694-cce942ea7c31 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1550 microversion: 2.1 time: 0.175063 Jun 25 21:38:21.086239 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3092/6647] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:20 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1550 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:21.104761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:21.105268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:21.107941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:21.114824 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:21.115293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:21.116063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:21.116493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:21.195085 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eecad6e3-c383-4f44-8045-4a1e711f2661 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096527 Jun 25 21:38:21.195705 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3556/6648] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:38:21 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:38:22.459317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3668384c-116c-4bf7-964a-5679778fb073 req-d80b9bc3-c33f-4d64-8f52-bdb46744eae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:22.469026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3668384c-116c-4bf7-964a-5679778fb073 req-d80b9bc3-c33f-4d64-8f52-bdb46744eae6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:22.469488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3668384c-116c-4bf7-964a-5679778fb073 req-d80b9bc3-c33f-4d64-8f52-bdb46744eae6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:22.480969 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3668384c-116c-4bf7-964a-5679778fb073 req-d80b9bc3-c33f-4d64-8f52-bdb46744eae6 service nova] Creating event network-changed:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch1-master-1 Jun 25 21:38:22.485896 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3668384c-116c-4bf7-964a-5679778fb073 req-d80b9bc3-c33f-4d64-8f52-bdb46744eae6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030371 Jun 25 21:38:22.486568 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3093/6649] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:38:52.109647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.110818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=34 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.117180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:52.118178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:52.129182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.129909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.131148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.131888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.332941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:52.341659 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f46ee4c1-a1e2-4d29-b103-3e27e93ca66f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.235633 Jun 25 21:38:52.342251 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3557/6650] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:52 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:52.356296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.357107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:38:52.361511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:52.362222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:52.369833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.370295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.371090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.371597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.574929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:52.583208 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a43c59e3-3628-45ce-89b7-b847b61e1009 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.228950 Jun 25 21:38:52.583793 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3094/6651] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:52 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:52.600170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:52.600821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:52.607204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.607662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.608417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.608891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.747353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:52.758885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f9d8bbd4-3e80-479f-90bf-63db984bcc90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.162494 Jun 25 21:38:52.759668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3558/6652] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:52 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:38:52.775797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:38:52.776823 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:52.785214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.785691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.787021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:52.787610 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:52.866868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:52.873600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:38:52.880148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:38:52.880617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:38:52.881099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:38:52.881515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:38:52.881931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:38:52.995753 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa59076b-6950-40fe-bb40-0396eebc7559 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/action" status: 202 len: 0 microversion: 2.1 time: 0.223658 Jun 25 21:38:52.996566 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3095/6653] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:38:52 2022] POST /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:38:53.011110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:53.011963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:53.018071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:53.018704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:53.019399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:53.019781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:53.179758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:53.188172 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb93cdd7-c909-487b-83b5-ebdfc46eb489 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1677 microversion: 2.1 time: 0.181125 Jun 25 21:38:53.188826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3559/6654] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:53 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:54.210623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:54.212112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:54.225322 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:54.226108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:54.227394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:54.228153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:54.363849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:54.372061 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d8ef171-1a5f-4953-93bb-f55148f1e31b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1677 microversion: 2.1 time: 0.168279 Jun 25 21:38:54.372735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3096/6655] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:54 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:55.395877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:55.396741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:55.405569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:55.406022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:55.406773 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:55.407202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:55.557155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:55.565588 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4d29aff-3c5f-4037-a356-6f7b904aa356 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.178424 Jun 25 21:38:55.566140 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3560/6656] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:55 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:56.589748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:56.590731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:56.602549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:56.603334 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:56.604666 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:56.605473 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:56.741091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:56.749515 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9365f266-4db8-4d77-8ef1-a2745ff6d380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.166894 Jun 25 21:38:56.750139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3097/6657] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:56 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:57.771129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:57.772161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:57.782230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:57.782683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:57.783443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:57.783878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:57.919152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:57.927235 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e08c7dee-8994-4fce-8950-2df601b8ffb2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.162724 Jun 25 21:38:57.927807 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3561/6658] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:57 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:38:58.948588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:38:58.949682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:38:58.961955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:58.962777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:58.964033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:38:58.964829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:38:59.110505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:38:59.123947 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fd3a8878-df1a-4a1a-b489-e9f97ec9e8a0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.181915 Jun 25 21:38:59.124535 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3098/6659] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:38:58 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:00.144649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:00.145517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:00.154651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:00.155249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:00.156417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:00.157023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:00.305804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:00.318833 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0b282a0a-b68e-44ac-ad84-5948d06af780 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.178870 Jun 25 21:39:00.319739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3562/6660] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:00 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:01.341020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:01.341906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:01.349705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:01.350198 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:01.351019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:01.351493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:01.489671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:01.497465 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8405fb0-c9a1-4780-9453-dcbef14dd601 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.162280 Jun 25 21:39:01.498087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3099/6661] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:01 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:02.519140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:02.520116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:02.532080 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:02.532882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:02.534300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:02.535027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:02.681504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:02.689362 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3815d522-13aa-47b7-9ebf-b2947508037e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.176954 Jun 25 21:39:02.689950 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3563/6662] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:02 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:03.709286 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:03.710116 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:03.719548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:03.720018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:03.720831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:03.721283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:03.865830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:03.873987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-78433cac-eae4-4854-a6c3-f120abbf67f6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.170135 Jun 25 21:39:03.874541 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3100/6663] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:03 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:04.893134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:04.893725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:04.901337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:04.901804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:04.902573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:04.903016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:05.057462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:05.065971 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a17848a2-e435-4284-8827-3204c2ef589d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.176917 Jun 25 21:39:05.066562 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3564/6664] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:04 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:06.088085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:06.089017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:06.100953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:06.101725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:06.103007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:06.103749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:06.238597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:06.246356 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-85a72275-66f9-4462-a477-eb9d98e8439d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1682 microversion: 2.1 time: 0.165526 Jun 25 21:39:06.246934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3101/6665] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:06 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:07.255972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "name": "network-vif-unplugged", "status": "completed", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:07.263807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:07.264458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:07.266506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:07.266975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:07.272200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:07.272691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:07.273476 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:07.274118 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:07.280279 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] Creating event network-vif-unplugged:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch2-master-1 Jun 25 21:39:07.287634 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:39:07.299659 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-007e485b-1c9f-4b96-a6ef-bec413cb6fb5 req-b0494f48-bd6e-4364-9dcd-e5da2699a85a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047074 Jun 25 21:39:07.301440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3565/6666] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:07.581714 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:07.590421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1952b0ff-43be-4bd1-aafd-0f6fe1946af2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1681 microversion: 2.1 time: 0.331038 Jun 25 21:39:07.591051 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3102/6667] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:07 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:08.610744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:08.611337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:08.619031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:08.619464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:08.620231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:08.620704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:08.757619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:08.769254 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2694ad7f-826f-4bf4-8055-581b7cdb2289 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1679 microversion: 2.1 time: 0.164632 Jun 25 21:39:08.770066 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3566/6668] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:08 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:09.322092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:09.333711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:09.334167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:09.346572 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] Creating event network-changed:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch2-master-1 Jun 25 21:39:09.352215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:39:09.363154 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a9e60804-0118-4b35-ab6b-29ec6f80a7c8 req-5eebef79-e283-4e99-8df2-c02f55eed093 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048267 Jun 25 21:39:09.363754 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3103/6669] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:09.792697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:09.793312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:09.800879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:09.801328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:09.802095 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:09.802528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:09.969835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:09.977686 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d49802db-5cd3-4b34-a891-3c768a5a7141 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1679 microversion: 2.1 time: 0.190077 Jun 25 21:39:09.978245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3567/6670] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:09 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:10.996221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:10.997089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:11.003839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:11.004468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:11.005297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:11.005746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:11.200208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:11.208392 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d2df222-9612-4225-ad0b-851653f2d694 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1679 microversion: 2.1 time: 0.217637 Jun 25 21:39:11.208989 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3104/6671] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:10 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1679 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:12.228104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:12.228741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:12.236720 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.237190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.237956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.238370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.379084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:12.387111 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-43b5813c-3bce-4bd5-900d-311cfdd2b8d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1676 microversion: 2.1 time: 0.163947 Jun 25 21:39:12.387710 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3568/6672] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:12 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:12.403901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:12.404478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:12.411944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.412411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.413226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.413679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.478160 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f3fd91d-6afc-49b9-a33e-7e41623ee20e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/action" status: 204 len: 0 microversion: 2.1 time: 0.078037 Jun 25 21:39:12.478811 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3105/6673] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:39:12 2022] POST /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:39:12.490288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:12.491283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:12.500731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.501539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.502299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:12.502738 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:12.707107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:12.715815 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-accd5730-4069-4803-b272-16a9b0e1d7e6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1676 microversion: 2.1 time: 0.232087 Jun 25 21:39:12.716413 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3569/6674] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:12 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1676 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:39:13.056634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "name": "network-vif-plugged", "status": "completed", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:13.065779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:13.066292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:13.079153 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] Creating event network-vif-plugged:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch2-master-1 Jun 25 21:39:13.085783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:39:13.099003 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-c35e9144-d49f-40c5-a6d9-c32e6a3a8648 req-f31e31ed-4fea-401b-aa2f-16e9089cc77c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046401 Jun 25 21:39:13.099781 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3106/6675] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:13.736475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:13.737463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:13.744470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:13.744916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:13.745680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:13.746109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:13.883532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:13.891464 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-aa5a0ad4-7900-4cda-aed5-424ba34d31ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.161524 Jun 25 21:39:13.892048 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3570/6676] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:13 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:13.911204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:13.911914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:13.918685 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:13.919150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:13.919930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:13.920375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.060961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:14.069233 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b920786-1690-4519-97e7-7ca4f90f7d0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.163925 Jun 25 21:39:14.069819 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3107/6677] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:13 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:14.085565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:14.086182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:14.093239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.093694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.094441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.094908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.227938 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:14.235936 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fc46b622-e600-4377-9347-23b46c2b4cc2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1668 microversion: 2.1 time: 0.154332 Jun 25 21:39:14.236619 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3571/6678] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:14 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:14.252123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:14.252665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:14.258881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.259277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.260053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.260524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.285724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:39:14.288752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:14.374983 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3800599-4082-486e-9ea4-f9003bcb5f3a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 204 len: 0 microversion: 2.1 time: 0.126496 Jun 25 21:39:14.375598 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3108/6679] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:39:14 2022] DELETE /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:39:14.384336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:14.385146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:14.391885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.392054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.392859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:14.393304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:14.524723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:14.535829 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99bd35fb-84f4-48fc-89cb-c5fba6bb34a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1674 microversion: 2.1 time: 0.155428 Jun 25 21:39:14.536607 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3572/6680] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:14 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:15.558420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:15.559966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:15.567998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:15.568483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:15.569382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:15.569894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:15.926518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:15.934836 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5e94addc-eb57-41b7-ac92-625b18bdbbb5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1674 microversion: 2.1 time: 0.380749 Jun 25 21:39:15.935638 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3109/6681] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:15 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1674 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:16.941956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1fe10d79-d0b1-4d4f-818a-ef9669f968d9 req-d0fbda8e-f123-4178-bbe9-1ae409f46385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2", "name": "network-vif-deleted", "tag": "650e581b-44b2-48a0-837a-dfa1d862c858"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:16.953123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:16.953767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:16.962491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:16.963408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:16.964520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:16.965039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:16.965401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1fe10d79-d0b1-4d4f-818a-ef9669f968d9 req-d0fbda8e-f123-4178-bbe9-1ae409f46385 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:16.966001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1fe10d79-d0b1-4d4f-818a-ef9669f968d9 req-d0fbda8e-f123-4178-bbe9-1ae409f46385 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:16.984877 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1fe10d79-d0b1-4d4f-818a-ef9669f968d9 req-d0fbda8e-f123-4178-bbe9-1ae409f46385 service nova] Creating event network-vif-deleted:650e581b-44b2-48a0-837a-dfa1d862c858 for instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 on nch2-master-1 Jun 25 21:39:16.990300 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1fe10d79-d0b1-4d4f-818a-ef9669f968d9 req-d0fbda8e-f123-4178-bbe9-1ae409f46385 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053368 Jun 25 21:39:16.991245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3573/6682] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:17.038902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:17.047292 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c3879969-c3fd-4476-9a73-cf164f3611e7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 200 len: 1323 microversion: 2.1 time: 0.098180 Jun 25 21:39:17.048205 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3110/6683] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:16 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:18.067687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:18.068986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:18.079582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.080290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.081190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.081631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.095883 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 HTTP/1.1 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2'} Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:39:18.097605 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f003d704-7710-46db-8e44-7d2410ed3eec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 404 len: 111 microversion: 2.1 time: 0.037493 Jun 25 21:39:18.102333 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3574/6684] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:18 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:39:18.112939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:18.113568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:18.121358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.121827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.122984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.123435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.136964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 HTTP/1.1 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2'} Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:39:18.138632 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d11de4b-ed70-4393-b83e-3518498ea928 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 404 len: 111 microversion: 2.1 time: 0.031254 Jun 25 21:39:18.143435 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3111/6685] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:18 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:39:18.188801 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-762415349", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "568f79cb-7fa4-475a-97f8-00e0980c23b6"}], "security_groups": [{"name": "tempest-securitygroup--699415506"}], "key_name": "tempest-keypair-1929333221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:18.294868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] validate_networks() for [('568f79cb-7fa4-475a-97f8-00e0980c23b6', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:39:18.666984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:39:18.667412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:39:18.667886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:39:18.668292 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:39:18.668748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:39:18.678271 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.678734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.679511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:18.679941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:18.686913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=100 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:18.698537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:39:18.703911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:39:18.717010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:39:18.719318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:39:18.768051 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5720a2db-74d8-4618-bcf3-2d31b099694d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.583175 Jun 25 21:39:18.768766 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3575/6686] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:39:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:39:18.779233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5b73f67d-05c1-4725-b8b7-3e3e56aeed11 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:18.779867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5b73f67d-05c1-4725-b8b7-3e3e56aeed11 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:18.834401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5b73f67d-05c1-4725-b8b7-3e3e56aeed11 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:18.841834 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5b73f67d-05c1-4725-b8b7-3e3e56aeed11 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1238 microversion: 2.1 time: 0.066744 Jun 25 21:39:18.842438 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3112/6687] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:18 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:19.859908 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:19.861035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:19.868182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:19.868769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:19.869601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:19.870341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:19.969021 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:19.977340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b3cc89d3-86d1-4e35-b194-1b88c888d194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1296 microversion: 2.1 time: 0.122305 Jun 25 21:39:19.986972 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3576/6688] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:19 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1296 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:20.995994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:20.997525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:21.009843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:21.010842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:21.012048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:21.013098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:21.108638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-247dfb8e-f708-413b-a178-54c338e66dc5 req-495a89d4-acca-4720-a60f-9e2b8c2bb182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:21.143770 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-247dfb8e-f708-413b-a178-54c338e66dc5 req-495a89d4-acca-4720-a60f-9e2b8c2bb182 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:21.146758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-247dfb8e-f708-413b-a178-54c338e66dc5 req-495a89d4-acca-4720-a60f-9e2b8c2bb182 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:21.160461 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-247dfb8e-f708-413b-a178-54c338e66dc5 req-495a89d4-acca-4720-a60f-9e2b8c2bb182 service nova] Creating event network-changed:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch1-master-1 Jun 25 21:39:21.164011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:21.173334 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-247dfb8e-f708-413b-a178-54c338e66dc5 req-495a89d4-acca-4720-a60f-9e2b8c2bb182 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067917 Jun 25 21:39:21.174143 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3577/6689] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:39:21.175088 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-472d02a1-6240-4448-8197-4ebcc3c35030 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.183519 Jun 25 21:39:21.175672 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3113/6690] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:20 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:22.194788 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:22.195360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:22.197386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:22.203866 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:22.204410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:22.205190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:22.205615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:22.393586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:22.401792 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-67de2f99-8111-488f-84d6-fc4cc0a22d9f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.212406 Jun 25 21:39:22.402392 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3578/6691] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:22 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:23.419648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:23.420226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:23.423255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:23.428987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:23.429451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:23.430231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:23.430681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:23.564557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:23.572406 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9be610aa-118b-44e9-ba21-90812c9d984c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.156842 Jun 25 21:39:23.572977 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3114/6692] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:23 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:24.594417 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:24.595476 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:24.603516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:24.603966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:24.604748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:24.605178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:24.739223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:24.746916 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4541de1e-0181-4c55-9b26-db2700bfe93d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.159267 Jun 25 21:39:24.747495 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3579/6693] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:24 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:25.768308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:25.769070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:25.776455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:25.776905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:25.777683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:25.778127 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:25.910766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:25.918949 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-21a1f51a-9eb0-4e28-bd7c-6f27e8d62c92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.154669 Jun 25 21:39:25.919605 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3115/6694] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:25 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:26.940681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:26.941643 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:26.953980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:26.954753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:26.956157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:26.956639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:27.091577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:27.099456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bee172c9-98ef-4fd5-be9a-1fd713517384 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.165439 Jun 25 21:39:27.100028 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3580/6695] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:26 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:27.821718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4e85a66e-e99a-40a6-8187-3f9fa42c4a33 req-e6c6e484-aa3b-4227-afbc-73207cae715b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "name": "network-vif-plugged", "status": "completed", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:27.831679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4e85a66e-e99a-40a6-8187-3f9fa42c4a33 req-e6c6e484-aa3b-4227-afbc-73207cae715b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:27.832148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4e85a66e-e99a-40a6-8187-3f9fa42c4a33 req-e6c6e484-aa3b-4227-afbc-73207cae715b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:27.845585 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4e85a66e-e99a-40a6-8187-3f9fa42c4a33 req-e6c6e484-aa3b-4227-afbc-73207cae715b service nova] Creating event network-vif-plugged:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch1-master-1 Jun 25 21:39:27.850665 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4e85a66e-e99a-40a6-8187-3f9fa42c4a33 req-e6c6e484-aa3b-4227-afbc-73207cae715b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033244 Jun 25 21:39:27.851270 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3116/6696] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:28.124083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:28.125008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:28.133517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:28.133963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:28.134744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:28.135177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:28.276335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:28.284372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a5067631-e043-4b26-b412-260e9bf722a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1363 microversion: 2.1 time: 0.166647 Jun 25 21:39:28.284989 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3581/6697] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:28 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:29.306545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:29.307585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:29.313211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:29.320217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:29.320882 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:29.322270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:29.322989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:29.483509 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:39:29.492220 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f833afb-e12f-431c-8bef-946df9134194 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1550 microversion: 2.1 time: 0.192621 Jun 25 21:39:29.492874 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3117/6698] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:39:29 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1550 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:39:29.509293 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:39:29.509841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:39:29.511681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:29.512356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:39:29.519502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:29.519944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:29.520731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:29.521269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:29.611323 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-980b605b-5819-477c-92ce-64975f9c8d93 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105608 Jun 25 21:39:29.612294 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3582/6699] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:39:29 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:39:30.624616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-a886f48e-63ad-4c0c-9098-f7811793aee8 req-9a8ad018-e8cb-4306-a9dc-11484cb0657b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:39:30.634012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a886f48e-63ad-4c0c-9098-f7811793aee8 req-9a8ad018-e8cb-4306-a9dc-11484cb0657b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:39:30.634472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-a886f48e-63ad-4c0c-9098-f7811793aee8 req-9a8ad018-e8cb-4306-a9dc-11484cb0657b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:39:30.646054 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-a886f48e-63ad-4c0c-9098-f7811793aee8 req-9a8ad018-e8cb-4306-a9dc-11484cb0657b service nova] Creating event network-changed:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch1-master-1 Jun 25 21:39:30.651290 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-a886f48e-63ad-4c0c-9098-f7811793aee8 req-9a8ad018-e8cb-4306-a9dc-11484cb0657b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Jun 25 21:39:30.652091 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3118/6700] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:00.997081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=9 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:00.999200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=36 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:01.005625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a51811f5-23d0-48a3-b69e-7f3e55d4d2a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:01.012677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a51811f5-23d0-48a3-b69e-7f3e55d4d2a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:01.013128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a51811f5-23d0-48a3-b69e-7f3e55d4d2a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:01.035722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a51811f5-23d0-48a3-b69e-7f3e55d4d2a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 21:40:01.082283 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a51811f5-23d0-48a3-b69e-7f3e55d4d2a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.088113 Jun 25 21:40:01.082828 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3583/6701] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:40:00 2022] POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:40:01.090817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=9 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:01.091740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:01.096231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:01.096994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:01.105392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:01.105859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:01.106644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:01.107092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:01.241454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:01.249575 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d62dc3c-fead-4283-b703-7e3164f2cdb3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.160912 Jun 25 21:40:01.250138 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3119/6702] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:01 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:02.272461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:02.273185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:02.280433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:02.280901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:02.281673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:02.282112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:02.417929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:02.426215 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6e2a2660-23c5-4d3b-91ff-9001102fb409 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.161741 Jun 25 21:40:02.426892 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3584/6703] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:02 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:03.447674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:03.448729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:03.460578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:03.461347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:03.463025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:03.463773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:03.609435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:03.620840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eb283fb1-3654-4d8d-ad84-ee541438ef0b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.179940 Jun 25 21:40:03.621471 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3120/6704] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:03 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:04.642411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:04.643387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:04.652395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:04.652879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:04.653647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:04.654083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:04.786461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:04.794802 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f1002d9-4890-4c33-83ac-f821032a4765 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.159253 Jun 25 21:40:04.795390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3585/6705] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:04 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:05.815935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:05.816980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:05.825515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:05.825984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:05.826779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:05.827230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:05.963718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:05.971849 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-afa9e81f-2c70-44de-87ae-a97b36874dd7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.162560 Jun 25 21:40:05.972439 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3121/6706] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:05 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:06.992152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:06.992827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:07.002681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:07.003117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:07.004309 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:07.004785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:07.149431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:07.157366 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-048a4c63-581b-440e-bd80-ad6a0d3b6f43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.171322 Jun 25 21:40:07.157945 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3586/6707] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:06 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:08.179180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:08.179746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:08.188798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:08.189520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:08.190399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:08.190941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:08.331631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:08.340398 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7f8c6b39-e10a-48da-bd8d-02c2f7f96a8b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.168038 Jun 25 21:40:08.341026 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3122/6708] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:08 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:09.358508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:09.359156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:09.366595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:09.367059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:09.367822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:09.368261 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:09.515019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:09.527014 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e70af3f1-888b-4a88-8d33-a5b0ae62b2ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.172285 Jun 25 21:40:09.527775 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3587/6709] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:09 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:10.553049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:10.554730 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:10.562380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:10.562844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:10.563649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:10.564093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:10.708208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:10.719990 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-277d8ab5-84e9-41ff-9277-7c8b97e42727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.173391 Jun 25 21:40:10.720845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3123/6710] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:10 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:11.742014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:11.743148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:11.755259 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:11.756020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:11.757351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:11.758234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:11.892887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:11.901014 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e5950319-7e2f-4b3e-876d-31b469e50bb1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1655 microversion: 2.1 time: 0.165732 Jun 25 21:40:11.901844 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3588/6711] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:11 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:11.917683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:11.918688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:11.926113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:11.926579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:11.927365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:11.927834 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:11.955756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:11.962657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Old instance type m1.heat2, new instance type m1.heat {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:40:11.969461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:40:11.969897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:40:11.970406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:40:11.970812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:40:11.971237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:40:12.038377 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7fad6878-297f-448a-afb2-a3baca0e6b92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.124752 Jun 25 21:40:12.042101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3124/6712] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:40:11 2022] POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 21:40:12.047490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:12.048122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:12.054437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:12.054970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:12.055748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:12.056160 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:12.218620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:12.226560 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d618a007-b864-4c9f-8ac7-3f4a8759bb1c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.183117 Jun 25 21:40:12.227284 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3589/6713] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:12 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:13.244108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:13.245287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:13.252344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:13.252842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:13.253612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:13.254182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:13.388534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:13.396521 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-509885f9-1558-4a50-b3ad-93da3649114a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1678 microversion: 2.1 time: 0.157228 Jun 25 21:40:13.397105 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3125/6714] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:13 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:14.417039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:14.417717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:14.426407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:14.426884 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:14.427671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:14.428125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:14.563358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:14.571248 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-abb21eee-e8e1-4cf6-8786-5b90e5179757 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1683 microversion: 2.1 time: 0.159665 Jun 25 21:40:14.571827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3590/6715] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:14 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:15.592290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:15.592945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:15.604983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:15.605522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:15.606825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:15.607386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:15.744004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:15.752143 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bcf980b7-effb-4ad4-a845-8e74e06ed602 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1683 microversion: 2.1 time: 0.165975 Jun 25 21:40:15.752758 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3126/6716] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:15 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:16.556102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:16.565226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:16.565767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:16.578719 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] Creating event network-vif-unplugged:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch2-master-1 Jun 25 21:40:16.585131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:40:16.597671 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-bcde7e09-8b37-4d26-b173-2e83488ae440 req-ecbcb221-68d0-430d-8c18-1ceb1a5fe7bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111521 Jun 25 21:40:16.598677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3591/6717] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:16.771894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:16.772461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:16.779727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:16.780561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:16.781510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:16.781965 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:16.917316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:16.926040 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6d4fea7c-7218-4261-a38d-eeca7c8060a4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1682 microversion: 2.1 time: 0.159705 Jun 25 21:40:16.926638 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3127/6718] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:16 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:17.944970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:17.945816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:17.952344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:17.952873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:17.953645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:17.954090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:18.095273 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:18.103140 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c79af799-c64a-44bb-9ca2-19f962ad1737 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1680 microversion: 2.1 time: 0.163505 Jun 25 21:40:18.103694 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3592/6719] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:17 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:18.624626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:18.636149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:18.636770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:18.652812 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] Creating event network-changed:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch2-master-1 Jun 25 21:40:18.659448 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:40:18.670060 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-bef979f0-fae9-4333-ba60-17c131b11dc6 req-83a02a65-7c97-409b-bad5-1b6035281e3e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050182 Jun 25 21:40:18.670678 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3128/6720] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:19.120577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:19.121172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:19.128394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:19.128923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:19.129694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:19.130131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:19.273345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:19.281460 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b153e19-ea59-4cbd-ac7f-8c808ce22834 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1680 microversion: 2.1 time: 0.165039 Jun 25 21:40:19.282035 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3593/6721] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:19 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:20.302478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:20.303194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:20.310039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.310500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.311273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.311721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.442688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:20.450971 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b288c3b9-3d2a-44a0-b6d3-2da517f9195f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1676 microversion: 2.1 time: 0.153730 Jun 25 21:40:20.451559 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3129/6722] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:20 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:20.468143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:20.468740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:20.475762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.476193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.477102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.477509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.537549 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9380819e-3367-4ce6-a484-b7eedeaa084d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action" status: 204 len: 0 microversion: 2.1 time: 0.073160 Jun 25 21:40:20.538211 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3594/6723] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:40:20 2022] POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:40:20.546633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:20.547264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:20.553914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.554387 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.555201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:20.555868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:20.697032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:20.705213 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f2cacb74-9351-469d-b2fc-78a0c4c8c0a5 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1676 microversion: 2.1 time: 0.162619 Jun 25 21:40:20.705824 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3130/6724] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:20 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:40:21.727454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:21.728245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:21.736699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:21.737106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:21.737980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:21.738521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:21.881725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:21.889609 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2e8cd0a-1370-4dad-98d7-e02bfd425c60 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1655 microversion: 2.1 time: 0.169108 Jun 25 21:40:21.890188 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3595/6725] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:21 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1655 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:21.909141 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:21.909729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:21.918231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:21.918694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:21.919463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:21.919907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:22.053981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:22.061866 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5fa9752a-a786-44a6-9102-a0560fdc9841 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1655 microversion: 2.1 time: 0.159146 Jun 25 21:40:22.062453 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3131/6726] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:21 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:22.078540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4a3395ad-a94a-448a-9a9f-86b2f3cb6423 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:22.085075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a3395ad-a94a-448a-9a9f-86b2f3cb6423 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:22.085531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4a3395ad-a94a-448a-9a9f-86b2f3cb6423 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:22.109162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4a3395ad-a94a-448a-9a9f-86b2f3cb6423 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Going to try to start instance {{(pid=137461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 21:40:22.145528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:22.156165 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4a3395ad-a94a-448a-9a9f-86b2f3cb6423 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action" status: 202 len: 0 microversion: 2.1 time: 0.081598 Jun 25 21:40:22.156833 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3596/6727] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:40:22 2022] POST /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:40:22.166309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:22.166936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:22.173398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:22.173940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:22.174788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:22.175325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:22.315477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:22.323371 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5cf5981a-1bf0-4aec-aea4-e8baa3b3e49e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1664 microversion: 2.1 time: 0.161087 Jun 25 21:40:22.323957 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3132/6728] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:22 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:23.342007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:23.343839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:23.353450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:23.354155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:23.355272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:23.356004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:23.420631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5785674a-05b9-4e5d-9619-9738cc2d7c70 req-c0b85874-71ca-4779-b31f-198a44971053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "name": "network-vif-plugged", "status": "completed", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:23.429125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5785674a-05b9-4e5d-9619-9738cc2d7c70 req-c0b85874-71ca-4779-b31f-198a44971053 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:23.429658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5785674a-05b9-4e5d-9619-9738cc2d7c70 req-c0b85874-71ca-4779-b31f-198a44971053 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:23.442404 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5785674a-05b9-4e5d-9619-9738cc2d7c70 req-c0b85874-71ca-4779-b31f-198a44971053 service nova] Creating event network-vif-plugged:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch2-master-1 Jun 25 21:40:23.447609 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5785674a-05b9-4e5d-9619-9738cc2d7c70 req-c0b85874-71ca-4779-b31f-198a44971053 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109299 Jun 25 21:40:23.448689 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3133/6729] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:23.502786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:23.514680 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bf47e0e8-6b8c-48a7-94b5-19fe55b21f81 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1664 microversion: 2.1 time: 0.177225 Jun 25 21:40:23.515268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3597/6730] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:23 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:24.536263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:24.537117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:24.544528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.545158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.546022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.546522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.682367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:24.690339 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-841461e0-ddd5-4a9e-b9fa-4967b82d3c45 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1668 microversion: 2.1 time: 0.159831 Jun 25 21:40:24.690916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3134/6731] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:24 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1668 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:24.706937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:24.707474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:24.715288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.715753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.716597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.717050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.746944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:40:24.828537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e11ce2b4-44be-477a-b454-b74b378d3a5e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 204 len: 0 microversion: 2.1 time: 0.125275 Jun 25 21:40:24.829491 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3598/6732] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:40:24 2022] DELETE /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:40:24.838635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:24.839260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:24.845677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.846152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.846930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:24.847381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:24.851596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:24.991397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:25.002786 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b3313073-7683-47f0-9f49-83c9f2927c43 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1674 microversion: 2.1 time: 0.168347 Jun 25 21:40:25.003503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3135/6733] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:24 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:26.025464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:26.026836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:26.039820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:26.040281 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:26.041129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:26.041576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:26.175843 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:26.184034 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6d62095-dcd4-4bea-9117-f736ee2ffcc0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1674 microversion: 2.1 time: 0.166189 Jun 25 21:40:26.184680 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3599/6734] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:26 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:27.054555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f98da8a0-a67c-45bf-b7e9-350e2994a476 req-1c9ed547-1219-4cf5-9923-7ee425713ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f898ec4-18d7-4d49-999e-5b54f6ca9c9a", "name": "network-vif-deleted", "tag": "356e2168-183d-4f6b-91ad-9b6709737e45"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:27.066943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f98da8a0-a67c-45bf-b7e9-350e2994a476 req-1c9ed547-1219-4cf5-9923-7ee425713ddc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:27.067464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f98da8a0-a67c-45bf-b7e9-350e2994a476 req-1c9ed547-1219-4cf5-9923-7ee425713ddc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:27.080374 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f98da8a0-a67c-45bf-b7e9-350e2994a476 req-1c9ed547-1219-4cf5-9923-7ee425713ddc service nova] Creating event network-vif-deleted:356e2168-183d-4f6b-91ad-9b6709737e45 for instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a on nch2-master-1 Jun 25 21:40:27.086724 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f98da8a0-a67c-45bf-b7e9-350e2994a476 req-1c9ed547-1219-4cf5-9923-7ee425713ddc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035979 Jun 25 21:40:27.088021 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3136/6735] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:27.202010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:27.202721 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:27.211726 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:27.212830 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:27.213653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:27.214083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:27.250911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:27.251280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:27.251922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lazy-loading 'fault' on Instance uuid 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:40:27.302346 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:27.309438 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a0dfcfb0-887b-42d6-a6b9-54f1c097d0d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 200 len: 1328 microversion: 2.1 time: 0.111734 Jun 25 21:40:27.310022 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3600/6736] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:27 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:28.332399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:28.333534 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:28.345300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:28.345776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:28.346596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:28.347048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:28.360906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a HTTP/1.1 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4f898ec4-18d7-4d49-999e-5b54f6ca9c9a'} Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:40:28.362571 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d4d51b44-2bba-4048-9b24-ba47cfa990e1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 404 len: 111 microversion: 2.1 time: 0.039163 Jun 25 21:40:28.366647 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3137/6737] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:28 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:40:28.388440 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:28.389079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:28.396354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:28.396847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:28.397616 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:28.398057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:28.411826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a HTTP/1.1 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '4f898ec4-18d7-4d49-999e-5b54f6ca9c9a'} Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:40:28.413519 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-32608f6e-cfdd-46d2-a304-c88199c8d65b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 404 len: 111 microversion: 2.1 time: 0.030507 Jun 25 21:40:28.417631 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3601/6738] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:28 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:40:28.465844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1267368479", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "568f79cb-7fa4-475a-97f8-00e0980c23b6"}], "security_groups": [{"name": "tempest-securitygroup--699415506"}], "key_name": "tempest-keypair-1929333221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:28.572682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] validate_networks() for [('568f79cb-7fa4-475a-97f8-00e0980c23b6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:40:29.077194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:40:29.077657 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:40:29.078229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:40:29.078643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:40:29.079093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:40:29.095242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:29.095711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:29.096558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:29.097010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:29.115238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:40:29.120774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:40:29.134807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:40:29.137220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:40:29.185983 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3cb0d897-3a59-4a67-8ed0-8ca24e5f28cd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.724502 Jun 25 21:40:29.186667 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3138/6739] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:40:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:40:29.196927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0fa2f8df-5a34-451d-8b6e-5707a382b577 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:29.197578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0fa2f8df-5a34-451d-8b6e-5707a382b577 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:29.257284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0fa2f8df-5a34-451d-8b6e-5707a382b577 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:29.264377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0fa2f8df-5a34-451d-8b6e-5707a382b577 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1239 microversion: 2.1 time: 0.071398 Jun 25 21:40:29.265088 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3602/6740] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:29 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:30.282293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:30.283522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:30.290777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:30.291294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:30.292145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:30.292623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:30.363371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:30.374715 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d3e9f05e-6040-43c0-87b5-3f5236e4edf3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1299 microversion: 2.1 time: 0.097054 Jun 25 21:40:30.375375 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3139/6741] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:30 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:31.393445 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:31.394177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:31.397867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:31.406387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:31.407199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:31.408283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:31.408739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:31.649120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:31.658775 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-232019fb-77fe-47a1-a671-01e9caf0dc92 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.270140 Jun 25 21:40:31.659491 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3603/6742] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:31 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:31.782161 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-576d3f8d-1810-405a-aade-a0ff6b0429f7 req-1992f151-cdad-4494-b6ca-085b60d595d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:31.795627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:31.808811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-576d3f8d-1810-405a-aade-a0ff6b0429f7 req-1992f151-cdad-4494-b6ca-085b60d595d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:31.809455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-576d3f8d-1810-405a-aade-a0ff6b0429f7 req-1992f151-cdad-4494-b6ca-085b60d595d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:31.833776 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-576d3f8d-1810-405a-aade-a0ff6b0429f7 req-1992f151-cdad-4494-b6ca-085b60d595d7 service nova] Creating event network-changed:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:40:31.839483 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-576d3f8d-1810-405a-aade-a0ff6b0429f7 req-1992f151-cdad-4494-b6ca-085b60d595d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063675 Jun 25 21:40:31.840278 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3140/6743] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:32.680148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:32.681137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:32.691583 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:32.692045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:32.692887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:32.693323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:32.844994 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:32.852928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-381e983f-a054-4bdf-93dd-bea9eb70d3ad tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.179521 Jun 25 21:40:32.853511 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3604/6744] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:32 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:33.872506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:33.873243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:33.880508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:33.880970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:33.881747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:33.882201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:34.029457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:34.037533 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-41ff45b9-e7f7-429f-9bf2-0aefa05d93fa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.170344 Jun 25 21:40:34.038123 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3141/6745] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:33 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:35.057321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:35.058099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:35.066538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:35.066989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:35.067752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:35.068191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:35.206764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:35.215041 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fdc4cfac-cc4b-42e8-85fb-273ac4136315 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.162702 Jun 25 21:40:35.215633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3605/6746] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:35 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:36.235489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:36.236091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:36.243729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:36.244194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:36.245013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:36.245462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:36.382805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:36.394380 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0a2caae-af9a-479f-9c4e-435145adc50b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.164069 Jun 25 21:40:36.395186 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3142/6747] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:36 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:37.411602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:37.412409 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:37.419762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:37.420223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:37.421000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:37.421438 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:37.490199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0bda28b0-164b-4c3f-9855-9da9b96c377f req-d26d4385-b887-4ec9-9f55-9348ba00d765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "name": "network-vif-plugged", "status": "completed", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:37.500750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0bda28b0-164b-4c3f-9855-9da9b96c377f req-d26d4385-b887-4ec9-9f55-9348ba00d765 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:37.501215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0bda28b0-164b-4c3f-9855-9da9b96c377f req-d26d4385-b887-4ec9-9f55-9348ba00d765 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:37.514692 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0bda28b0-164b-4c3f-9855-9da9b96c377f req-d26d4385-b887-4ec9-9f55-9348ba00d765 service nova] Creating event network-vif-plugged:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:40:37.519883 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0bda28b0-164b-4c3f-9855-9da9b96c377f req-d26d4385-b887-4ec9-9f55-9348ba00d765 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034333 Jun 25 21:40:37.520735 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3143/6748] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:37.564765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:37.575046 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ee0b9a1-e038-49eb-be37-7e110e88468f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.167517 Jun 25 21:40:37.575565 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3606/6749] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:37 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:37.888615 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:40:37.888955 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:40:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:40:38.598021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:38.599203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:38.610506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:38.610966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:38.611742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:38.612187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:38.756037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:38.765611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-87adc91e-aac2-4232-a6e1-c02ebc1779b8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1364 microversion: 2.1 time: 0.174893 Jun 25 21:40:38.766193 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3144/6750] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:38 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:39.783522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:39.784112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:39.786928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:39.792739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:39.793192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:39.793957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:39.794393 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:39.928342 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:40:39.936448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0ad6209c-d801-41d5-950f-d30296eda86e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1550 microversion: 2.1 time: 0.156940 Jun 25 21:40:39.937120 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3607/6751] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:40:39 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:40:39.953505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:40:39.954026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:40:39.956041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:39.956748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:40:39.964725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:39.965194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:39.965962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:39.966469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:40.061984 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e55a0d43-e4fa-4c18-b6e7-f90a31d4b5b2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112271 Jun 25 21:40:40.062630 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3145/6752] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:40:39 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:40:41.018951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2a1da712-93f3-4e0d-89c9-9552f6f42ed0 req-3149631c-368b-42d3-ab36-31dd63cdf874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:40:41.029352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2a1da712-93f3-4e0d-89c9-9552f6f42ed0 req-3149631c-368b-42d3-ab36-31dd63cdf874 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:40:41.029798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2a1da712-93f3-4e0d-89c9-9552f6f42ed0 req-3149631c-368b-42d3-ab36-31dd63cdf874 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:40:41.042329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-2a1da712-93f3-4e0d-89c9-9552f6f42ed0 req-3149631c-368b-42d3-ab36-31dd63cdf874 service nova] Creating event network-changed:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:40:41.047669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2a1da712-93f3-4e0d-89c9-9552f6f42ed0 req-3149631c-368b-42d3-ab36-31dd63cdf874 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032462 Jun 25 21:40:41.048557 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3608/6753] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:40:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:41:53.051135 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=11 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:53.052017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=42 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:53.057460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:41:53.058450 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:53.065778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:53.066250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:53.067031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:53.067520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:53.096477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:53.102439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Old instance type m1.heat2, new instance type m1.heat {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:41:53.109544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:41:53.109966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:41:53.110608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:41:53.111216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:41:53.111803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:41:53.180288 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-29a22ed2-494e-4fa4-b49b-11f9ccb3a3f9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/action" status: 202 len: 0 microversion: 2.1 time: 0.131729 Jun 25 21:41:53.180951 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3146/6754] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:41:53 2022] POST /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:41:53.188741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=11 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:53.189549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=68,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:41:53.195015 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:53.195536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:53.203913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:53.204584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:53.205570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:53.206155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:53.378975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:53.387333 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3fe1bc5a-87af-44b1-808b-d6b405346f77 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1677 microversion: 2.1 time: 0.201766 Jun 25 21:41:53.388236 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3609/6755] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:53 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:41:54.410347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:54.411011 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:54.419789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:54.420336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:54.421291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:54.421822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:54.567782 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:54.575714 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-858e3d97-26ec-420a-bbf5-07c83eed6683 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1677 microversion: 2.1 time: 0.172837 Jun 25 21:41:54.576350 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3147/6756] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:54 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:41:55.598046 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:55.598990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:55.611211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:55.611696 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:55.612453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:55.612936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:55.753371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:55.761323 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13d3defa-7524-4e93-a4b1-16c69d6c34ac tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.170030 Jun 25 21:41:55.761909 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3610/6757] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:55 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:41:56.781328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:56.782252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:56.790006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:56.790470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:56.791225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:56.791686 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:56.924794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:56.932588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc8a45b6-ee14-4f66-a1ec-b686aa782c51 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.156976 Jun 25 21:41:56.933162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3148/6758] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:56 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:41:57.949687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:57.950277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:57.957584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:57.958034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:57.958786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:57.959224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:58.091877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:58.099870 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-061b57ce-47ed-406f-96fd-5c92743d8f86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.154408 Jun 25 21:41:58.100453 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3611/6759] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:57 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:41:59.121327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:41:59.122303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:41:59.131554 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:59.132021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:59.132842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:41:59.133306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:41:59.272442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:41:59.285011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f2bafaa5-a652-42ec-b571-0685e5b6b1d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.170135 Jun 25 21:41:59.285866 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3149/6760] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:41:59 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:00.312007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:00.312921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:00.321686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:00.322146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:00.322912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:00.323349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:00.467612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:00.475482 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c669b951-fb40-451e-937c-dea03b30b7ba tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.170192 Jun 25 21:42:00.476070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3612/6761] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:00 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:01.499551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:01.500352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:01.509415 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:01.509995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:01.510951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:01.511507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:01.653259 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:01.664644 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0df9cf8-a5c8-40a4-9699-6fdf1b2c6f82 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.169718 Jun 25 21:42:01.665404 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3150/6762] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:01 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:02.689058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:02.689641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:02.697839 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:02.698295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:02.699077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:02.699516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:02.835419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:02.843909 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-92f9727a-2c16-4637-9497-e4276e9313c6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.161091 Jun 25 21:42:02.844509 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3613/6763] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:02 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:03.861726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:03.862346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:03.870078 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:03.870542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:03.871321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:03.871765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:04.010504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:04.018500 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c92fb8c-5b3e-4a4b-953e-0cca76da75d6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.160826 Jun 25 21:42:04.019080 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3151/6764] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:03 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:05.039317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:05.039945 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:05.048039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:05.048556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:05.049359 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:05.049823 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:05.184343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:05.192478 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6785f57e-276a-48f5-93f1-edf32968bd44 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.158905 Jun 25 21:42:05.193070 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3614/6765] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:05 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:06.211635 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:06.212274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:06.220179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:06.220676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:06.221456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:06.221909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:06.355003 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:06.363022 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-35f4f3f8-256f-48ad-97ca-13f9389ab974 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1682 microversion: 2.1 time: 0.156496 Jun 25 21:42:06.363600 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3152/6766] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:06 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:07.379572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:07.380200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:07.387732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:07.388182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:07.389031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:07.389475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:07.603450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:07.611593 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-36899ade-de84-4545-bf16-8b309fefaac3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1681 microversion: 2.1 time: 0.236007 Jun 25 21:42:07.612190 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3615/6767] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:07 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:07.673451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "name": "network-vif-unplugged", "status": "completed", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:07.683293 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:07.683871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:07.697246 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] Creating event network-vif-unplugged:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch1-master-1 Jun 25 21:42:07.703205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] Instance e2474501-4f93-43b7-8057-c12786f69b25 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:42:07.714852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f241ef16-e814-4c94-9dfc-2dd68142012c req-df510c8b-cc3a-4c5c-aae1-724e8af2544d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045291 Jun 25 21:42:07.715492 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3153/6768] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:08.630750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:08.633161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:08.638205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:08.638579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:08.639368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:08.639826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:08.775416 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:08.783110 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dee98f2-174a-48b9-ade3-764db217d23f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1681 microversion: 2.1 time: 0.157372 Jun 25 21:42:08.783670 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3616/6769] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:08 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:09.738044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:09.748341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:09.748820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:09.763479 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] Creating event network-changed:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch1-master-1 Jun 25 21:42:09.769019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] Instance e2474501-4f93-43b7-8057-c12786f69b25 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:42:09.779661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ecea46c8-a58c-4a98-a256-aa016e586da1 req-b9e5e760-e940-45d8-b860-c2985cc0d827 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048469 Jun 25 21:42:09.780262 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3154/6770] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:09.801136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:09.801764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:09.809731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:09.810183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:09.810966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:09.811426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:10.129786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:10.138329 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2e8ee65-16e6-4609-addb-70ee35a202d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1679 microversion: 2.1 time: 0.341228 Jun 25 21:42:10.148572 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3617/6771] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:09 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1679 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:11.161905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:11.162947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:11.173900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.174698 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.176001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.176818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.326395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:11.334970 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bde33805-90e4-4f62-8ca1-69b8aa791df3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1676 microversion: 2.1 time: 0.181895 Jun 25 21:42:11.335598 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3155/6772] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:11 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:11.352032 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:11.352692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:11.360109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.360598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.361377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.361821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.400125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.400631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.401431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.401871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.422900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:42:11.428683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:42:11.537058 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-95243c05-6f49-47f6-a4f7-addc274e4575 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/action" status: 202 len: 0 microversion: 2.1 time: 0.188753 Jun 25 21:42:11.537736 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3618/6773] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:42:11 2022] POST /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:42:11.546467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:11.547103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:11.553540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.554007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.554812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:11.555264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:11.699841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:11.708459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-94cdb201-b68b-4c23-8f29-44967fa3a7c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.166301 Jun 25 21:42:11.709082 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3156/6774] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:11 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:12.728500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:12.729202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:12.739985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:12.740390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:12.741362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:12.741780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:12.875269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:12.883052 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4eb97d32-1cd9-4dd1-8493-e455fa215727 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.160398 Jun 25 21:42:12.883649 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3619/6775] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:12 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:13.901157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:13.901719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:13.910023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:13.910488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:13.911273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:13.911743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:14.052346 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:14.060304 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7e7e686a-e2d7-4ff1-b0ec-3e7372a2d83e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.163323 Jun 25 21:42:14.060925 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3157/6776] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:13 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:15.077857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:15.078460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:15.085796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:15.086248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:15.087019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:15.087637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:15.283184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:15.291349 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-88fe7d00-083f-48a0-843f-b01942b147fe tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.217544 Jun 25 21:42:15.291946 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3620/6777] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:15 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:15.352202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:15.364245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:15.364810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:15.380962 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] Creating event network-changed:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:42:15.387251 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] Instance e2474501-4f93-43b7-8057-c12786f69b25 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:42:15.399554 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-65cf861a-763b-4191-92f8-0091f438aa1e req-a1aafa05-b405-43d1-a966-daf010771855 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051869 Jun 25 21:42:15.400583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3158/6778] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:16.314547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:16.315554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:16.323516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:16.323972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:16.324775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:16.325220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:16.458406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:16.467006 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-44005677-8686-44a5-a204-ea62ada72189 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.160599 Jun 25 21:42:16.467589 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3621/6779] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:16 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:17.490877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:17.491602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:17.498592 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:17.499063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:17.499840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:17.500298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:17.642273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:17.653704 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-44a619f5-9e36-4f3a-8053-f7ef0fd2490e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.171166 Jun 25 21:42:17.654465 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3159/6780] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:17 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:18.674395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:18.675613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:18.683328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:18.683781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:18.684576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:18.685007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:18.703872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:18.907425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:18.915472 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e0918417-f5ae-47ea-97f1-806b7cd49628 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1675 microversion: 2.1 time: 0.245014 Jun 25 21:42:18.915998 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3622/6781] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:18 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:19.932171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:19.932830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:19.939842 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:19.940303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:19.941097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:19.941544 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.076937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:20.084733 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-90a7f7b2-8492-4473-9276-17eed2c0ae25 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1668 microversion: 2.1 time: 0.156585 Jun 25 21:42:20.085322 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3160/6782] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:19 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:20.101702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:20.102266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:20.109874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.110318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.111061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.111504 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.253109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:20.263736 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-99524de4-16e6-4ce3-bb57-7c21aab8e884 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1668 microversion: 2.1 time: 0.165833 Jun 25 21:42:20.266350 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3623/6783] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:20 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1668 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:20.283562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:20.284111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:20.290507 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.290977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.291755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.292223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.441205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:20.449358 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45c07065-7369-4216-84da-42e8201ae90c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1668 microversion: 2.1 time: 0.170794 Jun 25 21:42:20.449941 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3161/6784] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:20 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1668 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:20.465958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:20.466464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:20.473520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.473973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.474735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.475170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.500750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:42:20.592728 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e54a8f79-a946-421b-a553-f15d9ee4f49c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 204 len: 0 microversion: 2.1 time: 0.130589 Jun 25 21:42:20.593333 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3624/6785] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:42:20 2022] DELETE /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:42:20.603245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:20.603896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:20.610335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.610805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.611562 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:20.612004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:20.616160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:20.746342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:20.754340 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e2707ef7-b18d-4598-9096-0b718747e920 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1674 microversion: 2.1 time: 0.155704 Jun 25 21:42:20.754917 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3162/6786] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:20 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:21.772920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:21.773598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:21.776044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:21.782017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:21.782457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:21.783236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:21.783682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:21.829956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e5700277-0db1-4734-ac93-9800b125f8ef req-daf977f5-aba3-465d-871e-df2b8a9dc2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "name": "network-vif-plugged", "status": "completed", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:21.840366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e5700277-0db1-4734-ac93-9800b125f8ef req-daf977f5-aba3-465d-871e-df2b8a9dc2ea service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:21.840931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e5700277-0db1-4734-ac93-9800b125f8ef req-daf977f5-aba3-465d-871e-df2b8a9dc2ea service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:21.853903 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e5700277-0db1-4734-ac93-9800b125f8ef req-daf977f5-aba3-465d-871e-df2b8a9dc2ea service nova] Creating event network-vif-plugged:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:42:21.859037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e5700277-0db1-4734-ac93-9800b125f8ef req-daf977f5-aba3-465d-871e-df2b8a9dc2ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032723 Jun 25 21:42:21.860032 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3163/6787] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:21.919856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:21.927944 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c051a85-ae69-4afd-91d1-8778de6152a3 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1674 microversion: 2.1 time: 0.159775 Jun 25 21:42:21.928573 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3625/6788] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:21 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:22.946985 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:22.948043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:22.956474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:22.956971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:22.958813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:22.959500 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:22.967216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-cbadece4-3568-4e5d-9b34-ee101a457822 req-8a98f075-7477-4ca1-b383-2ba9df541a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2474501-4f93-43b7-8057-c12786f69b25", "name": "network-vif-deleted", "tag": "35d7e583-ee07-40dc-bbc6-089b1dc5e005"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:22.977337 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cbadece4-3568-4e5d-9b34-ee101a457822 req-8a98f075-7477-4ca1-b383-2ba9df541a20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:22.978917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-cbadece4-3568-4e5d-9b34-ee101a457822 req-8a98f075-7477-4ca1-b383-2ba9df541a20 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:22.993649 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-cbadece4-3568-4e5d-9b34-ee101a457822 req-8a98f075-7477-4ca1-b383-2ba9df541a20 service nova] Creating event network-vif-deleted:35d7e583-ee07-40dc-bbc6-089b1dc5e005 for instance e2474501-4f93-43b7-8057-c12786f69b25 on nch2-master-1 Jun 25 21:42:22.999400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-cbadece4-3568-4e5d-9b34-ee101a457822 req-8a98f075-7477-4ca1-b383-2ba9df541a20 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039025 Jun 25 21:42:23.000072 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3626/6789] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:23.047583 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:23.056827 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4f7d42d2-2a02-45fb-9a0a-2d740c5ba3dd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 200 len: 1607 microversion: 2.1 time: 0.114176 Jun 25 21:42:23.060524 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3164/6790] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:22 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:24.076644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:24.077660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:24.083913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:24.085955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.086978 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.087934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.089188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.106514 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 HTTP/1.1 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e2474501-4f93-43b7-8057-c12786f69b25'} Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:42:24.108298 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-194f2c0f-6fa2-4c9b-934c-7a5fabd6c1d4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 404 len: 111 microversion: 2.1 time: 0.040057 Jun 25 21:42:24.113082 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3627/6791] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:24 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:42:24.132890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:24.134474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:24.137596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=43 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:24.143676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.144258 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.145138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.145650 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.160178 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 HTTP/1.1 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e2474501-4f93-43b7-8057-c12786f69b25'} Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:42:24.161815 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71f47ddf-0f1e-4434-b49c-79ff2cc1f5e4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 404 len: 111 microversion: 2.1 time: 0.034474 Jun 25 21:42:24.166390 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3165/6792] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:24 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:42:24.210459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-854358945", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "568f79cb-7fa4-475a-97f8-00e0980c23b6"}], "security_groups": [{"name": "tempest-securitygroup--699415506"}], "key_name": "tempest-keypair-1929333221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:24.315231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] validate_networks() for [('568f79cb-7fa4-475a-97f8-00e0980c23b6', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:42:24.733330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:42:24.733753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:42:24.734250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:42:24.734664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:42:24.735072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:42:24.744785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.745231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.746019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:24.746449 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:24.764452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:42:24.770165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:42:24.783680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:42:24.786072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:42:24.842320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-476b8514-6984-46b7-b996-2cc6d9536547 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.635817 Jun 25 21:42:24.844583 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3628/6793] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:42:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:42:24.855601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d13bfb49-2bd7-4ff4-9feb-997303ca7c41 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:24.856343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d13bfb49-2bd7-4ff4-9feb-997303ca7c41 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:24.913807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d13bfb49-2bd7-4ff4-9feb-997303ca7c41 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:24.920829 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d13bfb49-2bd7-4ff4-9feb-997303ca7c41 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1238 microversion: 2.1 time: 0.069188 Jun 25 21:42:24.921379 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3166/6794] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:24 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:42:25.938735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:25.939306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:25.947143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:25.947579 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:25.948364 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:25.948837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:26.020578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:26.028198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d185cd9c-94eb-4cbd-bf20-7d29ba5addc8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1296 microversion: 2.1 time: 0.094341 Jun 25 21:42:26.028844 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3629/6795] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:25 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:27.045843 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:27.046564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:27.056168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:27.057089 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:27.057901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:27.058329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:27.199777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:27.208147 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55e1f482-c563-4767-ad68-1b7f9da50d32 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.166472 Jun 25 21:42:27.208859 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3167/6796] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:27 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:27.365543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d7276ce7-fa3d-4541-bc7e-5ebb5d6017ec req-a72ae4e8-8452-4d9e-b7ed-8ba015d7e5db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "tag": "0e219651-0cd6-44e6-9050-550136871914"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:27.384885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d7276ce7-fa3d-4541-bc7e-5ebb5d6017ec req-a72ae4e8-8452-4d9e-b7ed-8ba015d7e5db service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:27.385556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d7276ce7-fa3d-4541-bc7e-5ebb5d6017ec req-a72ae4e8-8452-4d9e-b7ed-8ba015d7e5db service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:27.398256 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d7276ce7-fa3d-4541-bc7e-5ebb5d6017ec req-a72ae4e8-8452-4d9e-b7ed-8ba015d7e5db service nova] Creating event network-changed:0e219651-0cd6-44e6-9050-550136871914 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch1-master-1 Jun 25 21:42:27.403235 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d7276ce7-fa3d-4541-bc7e-5ebb5d6017ec req-a72ae4e8-8452-4d9e-b7ed-8ba015d7e5db service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041453 Jun 25 21:42:27.403799 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3630/6797] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:28.226229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:28.227506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:28.234914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:28.235629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:28.236611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:28.237217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:28.426723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:28.435577 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0343f272-7e52-4965-aecb-7e00d4f4c19c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1307 microversion: 2.1 time: 0.213252 Jun 25 21:42:28.436214 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3168/6798] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:28 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1307 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:28.605519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-2f51314b-6921-452a-a220-004115bfc7bb req-fb0544c1-976d-49b5-a4dc-b89b362da9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-deleted", "tag": "0e219651-0cd6-44e6-9050-550136871914"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:28.615301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2f51314b-6921-452a-a220-004115bfc7bb req-fb0544c1-976d-49b5-a4dc-b89b362da9a9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:28.615750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-2f51314b-6921-452a-a220-004115bfc7bb req-fb0544c1-976d-49b5-a4dc-b89b362da9a9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:28.631799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_external_events [req-2f51314b-6921-452a-a220-004115bfc7bb req-fb0544c1-976d-49b5-a4dc-b89b362da9a9 service nova] Unable to find a host for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0. Dropping event network-vif-deleted {{(pid=137461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 21:42:28.633157 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-2f51314b-6921-452a-a220-004115bfc7bb req-fb0544c1-976d-49b5-a4dc-b89b362da9a9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.106950 Jun 25 21:42:28.634239 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3631/6799] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 109 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 21:42:29.461696 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:29.462886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:29.471626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:29.472183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:29.472997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:29.473444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:29.537574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:29.546792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2df9f77d-87f6-41b5-af77-d9ed7ba57107 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1290 microversion: 2.1 time: 0.095968 Jun 25 21:42:29.547428 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3169/6800] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:29 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1290 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:30.566457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:30.568268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:30.577877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:30.578177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:30.578951 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:30.579577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:30.789709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:30.798095 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d04b094d-c9c6-4c3b-a3cc-c27786b503f2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.236943 Jun 25 21:42:30.798681 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3632/6801] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:30 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:31.103224 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-36807514-33b2-4f72-94db-29d3316eafab req-685dfe49-069b-4210-b217-6985d14b9599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:31.112277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-36807514-33b2-4f72-94db-29d3316eafab req-685dfe49-069b-4210-b217-6985d14b9599 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:31.118963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-36807514-33b2-4f72-94db-29d3316eafab req-685dfe49-069b-4210-b217-6985d14b9599 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:31.135495 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-36807514-33b2-4f72-94db-29d3316eafab req-685dfe49-069b-4210-b217-6985d14b9599 service nova] Creating event network-changed:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:42:31.140988 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-36807514-33b2-4f72-94db-29d3316eafab req-685dfe49-069b-4210-b217-6985d14b9599 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042948 Jun 25 21:42:31.141620 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3170/6802] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:31.820985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:31.821646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:31.829146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:31.829603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:31.830376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:31.830815 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:31.968145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:31.975979 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-37339e34-edd1-4677-a6e9-cad90478376a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.161932 Jun 25 21:42:31.976696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3633/6803] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:31 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:32.998606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:32.999568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:33.008396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:33.009087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:33.010100 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:33.010695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:33.160341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:33.168390 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93977b37-6d9e-42f5-ba89-bc3a2b8a6bd9 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.177549 Jun 25 21:42:33.169005 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3171/6804] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:32 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:34.186209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:34.186970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:34.194406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:34.194858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:34.195624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:34.196057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:34.329479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:34.340287 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd74b6d1-3ace-4588-a3ce-f4795537ffcf tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.158036 Jun 25 21:42:34.340890 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3634/6805] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:34 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:35.362253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:35.363289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:35.367908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:35.374490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:35.374961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:35.375747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:35.376184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:35.508375 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:35.516647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-488ba0e5-d69c-4707-81bd-c820a898315c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.161071 Jun 25 21:42:35.517150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3172/6806] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:35 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:35.996871 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3e5bad2c-f9da-4fb2-9987-2f1492b9ec9a req-b67b62d4-ec50-4c6d-814a-b9ea2f7e1a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-plugged", "status": "completed", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:36.000546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:36.001253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:42:36.008458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3e5bad2c-f9da-4fb2-9987-2f1492b9ec9a req-b67b62d4-ec50-4c6d-814a-b9ea2f7e1a1a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:36.008906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3e5bad2c-f9da-4fb2-9987-2f1492b9ec9a req-b67b62d4-ec50-4c6d-814a-b9ea2f7e1a1a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:36.020560 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3e5bad2c-f9da-4fb2-9987-2f1492b9ec9a req-b67b62d4-ec50-4c6d-814a-b9ea2f7e1a1a service nova] Creating event network-vif-plugged:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:42:36.025953 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3e5bad2c-f9da-4fb2-9987-2f1492b9ec9a req-b67b62d4-ec50-4c6d-814a-b9ea2f7e1a1a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Jun 25 21:42:36.026673 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3635/6807] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:36.535668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:36.536414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:36.545102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:36.545660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:36.546579 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:36.547109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:36.682539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:36.690647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ebc264d4-b57f-4a65-b316-fc54512e139c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1363 microversion: 2.1 time: 0.159694 Jun 25 21:42:36.691251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3173/6808] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:36 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:37.714266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:37.715424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:37.726446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:37.727187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:37.728464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:37.729203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:37.879806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:42:37.888127 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76e6064c-c3e2-456a-ac7a-bb83d95bb84e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1549 microversion: 2.1 time: 0.182795 Jun 25 21:42:37.888765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3636/6809] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:42:37 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1549 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:42:37.905494 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:42:37.906022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:42:37.913271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:37.913743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:37.914526 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:37.915239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:37.993501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a7407495-8e40-47bf-ba42-8f63b080b361 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092038 Jun 25 21:42:37.994124 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3174/6810] 10.222.0.39 () {58 vars in 1274 bytes} [Sat Jun 25 21:42:37 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:42:38.952854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-76961fba-79e0-4f20-a4fb-749523a8a61a req-6ea8a597-5b30-4b08-8304-53dde8546e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:42:38.962169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-76961fba-79e0-4f20-a4fb-749523a8a61a req-6ea8a597-5b30-4b08-8304-53dde8546e4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:42:38.962561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-76961fba-79e0-4f20-a4fb-749523a8a61a req-6ea8a597-5b30-4b08-8304-53dde8546e4f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:42:38.974062 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-76961fba-79e0-4f20-a4fb-749523a8a61a req-6ea8a597-5b30-4b08-8304-53dde8546e4f service nova] Creating event network-changed:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:42:38.979153 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-76961fba-79e0-4f20-a4fb-749523a8a61a req-6ea8a597-5b30-4b08-8304-53dde8546e4f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030122 Jun 25 21:42:38.979815 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3637/6811] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:43:28.999677 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:43:29.000856 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:43:52.536721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=21 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:52.538214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=56 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:52.542845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:43:52.543463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:52.550558 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:52.551024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:52.551790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:52.552244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:52.781899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:43:52.789658 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e804e35d-b463-4841-aeb4-af74300b3e75 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1667 microversion: 2.1 time: 0.256460 Jun 25 21:43:52.790341 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3175/6812] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:43:52 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1667 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:43:52.805458 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:52.806181 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:43:52.811341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f533e81c-9e79-499b-b6ce-b38f2384d888"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:43:52.812523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:52.821381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:52.821826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:52.822718 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:52.823056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:53.138180 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d4be520-c70b-42fa-a3cf-7c5cbab03224 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335331 Jun 25 21:43:53.138911 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3638/6813] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:43:52 2022] POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:43:56.439125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:43:56.440115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:56.447348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:56.447808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:56.448799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:56.449246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:56.477756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:43:56.484320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Old instance type m1.heat2, new instance type m1.heat {{(pid=137462) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:43:56.491315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:43:56.491739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:43:56.492226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:43:56.492674 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:43:56.493097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:43:56.563588 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5c4fb423-8705-4d9e-bd99-d9e455ffec8f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.128166 Jun 25 21:43:56.564229 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3176/6814] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:43:56 2022] POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:43:56.573162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:43:56.574455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:56.583172 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:56.583751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:56.584577 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:56.585348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:56.748612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:43:56.756803 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4b91949a-3959-4397-8b04-da8c74045d5c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1722 microversion: 2.1 time: 0.188130 Jun 25 21:43:56.757739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3639/6815] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:43:56 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:43:57.778865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:43:57.780062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:57.794184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:57.794990 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:57.796271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:57.797069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:57.901260 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:43:57.901714 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 (ip 10.222.0.39) !!! Jun 25 21:43:57.949665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:43:57.958022 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c32b41d2-ca95-480e-b3d8-202f365916d0 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1722 microversion: 2.1 time: 0.185964 Jun 25 21:43:57.958622 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3177/6816] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:43:57 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:43:58.980367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:43:58.981126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:43:58.988560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:58.989011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:58.989767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:43:58.990198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:43:59.133003 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:43:59.141564 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6d64df64-9f73-4d40-92bb-b8840a79fe2d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1722 microversion: 2.1 time: 0.167955 Jun 25 21:43:59.142180 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3640/6817] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:43:58 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:00.163452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:00.164482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:00.173397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:00.173862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:00.174629 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:00.175076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:00.312489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:00.320883 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4019b6e7-e370-4814-a648-bf51b4ff645a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1722 microversion: 2.1 time: 0.164136 Jun 25 21:44:00.321459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3178/6818] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:00 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:01.340170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:01.340896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:01.349034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:01.349486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:01.350253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:01.350708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:01.494531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:01.503702 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db381072-e019-4ab5-8260-b0c752323ccb tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1722 microversion: 2.1 time: 0.168806 Jun 25 21:44:01.504275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3641/6819] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:01 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:02.525216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:02.526324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:02.538501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:02.539283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:02.540624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:02.541412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:02.682654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:02.693960 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf17ec0d-e1e4-4b02-91eb-a47cd55c5dca tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.175115 Jun 25 21:44:02.694723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3179/6820] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:02 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:03.715124 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:03.715746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:03.723471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:03.723967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:03.724970 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:03.725410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:03.857706 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:03.866171 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9b31f278-f4d3-40f0-afb5-549c431f832b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.155489 Jun 25 21:44:03.866759 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3642/6821] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:03 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:04.886525 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:04.887537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:04.895633 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:04.896106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:04.896924 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:04.897376 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:05.027595 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:05.038245 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66146ec4-37b0-4fdc-82f7-3b783a6c13ef tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.157984 Jun 25 21:44:05.038837 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3180/6822] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:04 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:06.059448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:06.060492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:06.068341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:06.068835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:06.069600 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:06.070047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:06.209898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:06.219053 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e002c23c-75e6-4ce1-acf6-36beca9b74c2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.166229 Jun 25 21:44:06.219632 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3643/6823] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:06 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:07.240203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:07.241277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:07.251868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:07.252339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:07.253153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:07.253613 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:07.394453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:07.402813 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d2c2e75f-17fb-4d2c-80c5-3fbd8d1dccc4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.169393 Jun 25 21:44:07.403398 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3181/6824] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:07 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:08.423790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:08.424636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:08.434274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:08.434873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:08.435910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:08.436472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:08.593857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:08.606516 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e5426de-1e97-444a-9012-2b44fc57dc38 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.188633 Jun 25 21:44:08.607329 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3644/6825] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:08 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:09.626794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:09.627765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:09.638832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:09.639537 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:09.640778 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:09.641467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:09.786496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:09.794932 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-afaa0246-c1b9-4ec0-a72d-69e5408f4f35 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.174426 Jun 25 21:44:09.795449 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3182/6826] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:09 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:10.816687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:10.817674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:10.829433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:10.829876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:10.830645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:10.831079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:10.980955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:10.989283 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e44830c-3d37-477a-8d52-5c68371e262e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.179403 Jun 25 21:44:10.989877 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3645/6827] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:10 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:12.011295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:12.012170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:12.021742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:12.022209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:12.023026 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:12.023475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:12.165603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:12.174130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4da166eb-4894-46b1-ac09-576b29145380 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.169672 Jun 25 21:44:12.174676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3183/6828] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:12 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:13.194471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:13.195209 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:13.201776 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:13.202312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:13.203155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:13.203664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:13.336790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:13.348105 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-34b46939-c949-4820-9d26-814b99f18381 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.159189 Jun 25 21:44:13.348773 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3646/6829] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:13 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:14.367256 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:14.367877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:14.375678 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:14.376149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:14.376957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:14.377405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:14.512541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:14.521503 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2467a35f-66a2-4519-b1cf-5bdc0ed7cd86 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1727 microversion: 2.1 time: 0.158571 Jun 25 21:44:14.522212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3184/6830] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:14 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:15.540907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:15.541277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:15.548933 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:15.549385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:15.550169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:15.550637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:15.783867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:15.794347 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c0d0b1e-f062-47ec-9c51-e395eefe1fbc tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1726 microversion: 2.1 time: 0.259005 Jun 25 21:44:15.794901 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3647/6831] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:15 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1726 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:16.812720 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:16.813327 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:16.820896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:16.821399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:16.822170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:16.823121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:16.957218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:16.965802 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-40028209-8d70-4b25-a76e-ce982681f4a7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1724 microversion: 2.1 time: 0.157105 Jun 25 21:44:16.966424 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3185/6832] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:16 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:17.984384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:17.985062 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:17.992524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:17.992976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:17.993744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:17.994176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:18.134821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:18.143465 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89a1de60-c27e-4148-a226-577cae4a7499 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1724 microversion: 2.1 time: 0.163063 Jun 25 21:44:18.144075 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3648/6833] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:17 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:18.189276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-unplugged", "status": "completed", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:18.199303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:18.199729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:18.212131 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] Creating event network-vif-unplugged:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:44:18.217898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:44:18.224304 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-75cf4aad-0b70-431b-8317-4de78e352693 req-65614f66-cf3a-476c-bbd5-1b48c25a752a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039317 Jun 25 21:44:18.225156 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3186/6834] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:19.165238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:19.166083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:19.177201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:19.177891 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:19.179117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:19.179835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:19.321519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:19.330022 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5e87383f-3685-4472-af14-4e946ea441ec tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1724 microversion: 2.1 time: 0.171850 Jun 25 21:44:19.330604 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3649/6835] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:19 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:20.351261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:20.352140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:20.360789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:20.361371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:20.362379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:20.362836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:20.515142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:20.524858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5803e3cf-af89-439c-8db1-22accd3d2b01 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1724 microversion: 2.1 time: 0.180223 Jun 25 21:44:20.525419 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3187/6836] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:20 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:21.546692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:21.547898 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:21.559602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.560355 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.561671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.562405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.697235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:21.705479 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba2ff02f-78d6-4c70-9169-697e7a48989b tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1721 microversion: 2.1 time: 0.165550 Jun 25 21:44:21.706063 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3650/6837] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:21 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:21.722795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:21.723325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:21.730813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.731289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.732076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.732648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.770998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.771460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.772264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.772744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.793891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:44:21.799301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Getting quotas for user 39b0356717474e7fabff20aa3fa9e309 and project 252cb11a6c804df8840720793581d971. Resources: {'cores', 'ram'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:44:21.861973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:21.913543 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-48ce8346-4931-4d62-9e41-d1a55dce938d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.194748 Jun 25 21:44:21.914169 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3188/6838] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:44:21 2022] POST /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:44:21.922665 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:21.923370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:21.930186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.930683 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:21.931623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:21.932082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:22.132216 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:22.141769 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f6dbdee-f080-4e4a-bc7a-19f804ddddf1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.222980 Jun 25 21:44:22.142480 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3651/6839] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:21 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:23.165101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:23.165911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:23.168103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:23.176873 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:23.177336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:23.178283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:23.178872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:23.324596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:23.333184 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-59f6af72-73b3-44cc-8329-4e6fdf52c442 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.175529 Jun 25 21:44:23.333727 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3189/6840] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:23 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:24.317327 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-plugged", "status": "completed", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:24.322067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=29 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:24.328688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:24.329140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:24.333609 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:24.343012 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] Creating event network-vif-plugged:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:44:24.349655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:44:24.351991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:24.352768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:24.356500 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-35e71a53-449c-4c3d-a4e4-352dab0736e5 req-c57b3cbd-e810-48af-b6e4-621710f42225 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042928 Jun 25 21:44:24.357282 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3652/6841] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:24.359786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:24.360255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:24.361145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:24.361728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:24.496940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:24.509037 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e0768e52-3cd9-4ad0-a1bd-77beef1ce2d2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.160654 Jun 25 21:44:24.510505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3190/6842] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:24 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:25.527841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:25.528561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:25.537097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:25.537538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:25.538303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:25.538732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:25.747549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:25.756340 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b4b4c19-599a-460a-b5bc-06c3a1b6cce7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.232687 Jun 25 21:44:25.756961 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3653/6843] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:25 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:26.774474 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:26.775105 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:26.783292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:26.783872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:26.784718 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:26.785176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:26.921640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:26.930094 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9b0b032f-5b7d-40c8-b28e-a2a74bffc5e8 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.159830 Jun 25 21:44:26.930860 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3191/6844] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:26 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:27.947882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:27.948593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:27.955920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:27.956385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:27.957258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:27.957697 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:28.100857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:28.112933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d99fe1e3-d5a5-49ec-83be-8f8836639bd1 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.168682 Jun 25 21:44:28.113739 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3654/6845] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:27 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:28.298541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-unplugged", "status": "completed", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:28.307770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:28.308245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:28.320640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] Creating event network-vif-unplugged:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:44:28.326115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137462) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 21:44:28.332335 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1b4b0487-6cee-4155-864a-a19746fd215f req-933e4f72-ed9a-44c9-8470-68615c88e326 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037654 Jun 25 21:44:28.332976 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3192/6846] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:29.139541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:29.140401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:29.152257 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:29.153064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:29.154316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:29.154989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:29.302561 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:29.311507 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4fce0485-bfdf-42f7-8794-a54c78e18082 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.178652 Jun 25 21:44:29.312073 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3655/6847] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:29 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:30.333022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:30.333745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:30.341793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:30.342263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:30.343054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:30.343502 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:30.478497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:30.490897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-14db55e3-92b0-4745-9fea-24984c323dd6 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1720 microversion: 2.1 time: 0.163669 Jun 25 21:44:30.491659 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3193/6848] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:30 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:31.512971 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:31.513984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:31.526244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.526987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:31.528298 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.529108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:31.664537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:31.673374 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58d93f53-ac0f-446d-a7c7-931246201790 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1713 microversion: 2.1 time: 0.167007 Jun 25 21:44:31.674003 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3656/6849] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:31 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:31.690336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:31.690967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:31.698279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.698747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:31.699528 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.699976 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:31.786825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:31.839136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:31.847775 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-15862f91-7af0-4233-b5c4-39dca8dc4bdd tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1713 microversion: 2.1 time: 0.161800 Jun 25 21:44:31.848399 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3194/6850] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:31 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:31.864344 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:31.865420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:31.872676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.873125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:31.873882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:31.874315 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:32.007266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:32.016133 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6c0e2bdb-6af1-42fd-8021-e2984e60243e tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1713 microversion: 2.1 time: 0.156038 Jun 25 21:44:32.016803 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3657/6851] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:31 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1713 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:32.034980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:32.035402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:32.042325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:32.042801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:32.043591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:32.044038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:32.072102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:44:32.156248 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4b72400a-bd9a-4d96-ae59-207cfbdd7698 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 204 len: 0 microversion: 2.1 time: 0.125518 Jun 25 21:44:32.156890 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3195/6852] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:44:32 2022] DELETE /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:44:32.166457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:32.167070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:32.173371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:32.173837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:32.174602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:32.175033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:32.315781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:32.324677 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a596c4a3-4853-4d23-ae79-1ea94d5e9e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1719 microversion: 2.1 time: 0.162382 Jun 25 21:44:32.325268 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3658/6853] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:32 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:33.343328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:33.344037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:33.351786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:33.352236 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:33.353048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:33.353497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:33.489464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:33.498026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fbfe2fc7-c9dc-4cb6-972d-366cf35a3aaa tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1719 microversion: 2.1 time: 0.159460 Jun 25 21:44:33.498847 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3196/6854] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:33 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:34.384061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d0f0646e-7f4b-4fdc-a5bd-04c80f76d22b req-281464ca-9d91-495f-83c3-9c3e8d210410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-plugged", "status": "completed", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:34.396642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d0f0646e-7f4b-4fdc-a5bd-04c80f76d22b req-281464ca-9d91-495f-83c3-9c3e8d210410 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:34.398396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d0f0646e-7f4b-4fdc-a5bd-04c80f76d22b req-281464ca-9d91-495f-83c3-9c3e8d210410 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:34.411388 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d0f0646e-7f4b-4fdc-a5bd-04c80f76d22b req-281464ca-9d91-495f-83c3-9c3e8d210410 service nova] Creating event network-vif-plugged:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:44:34.417286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d0f0646e-7f4b-4fdc-a5bd-04c80f76d22b req-281464ca-9d91-495f-83c3-9c3e8d210410 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037884 Jun 25 21:44:34.418023 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3659/6855] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:34.518031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:34.519009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:34.532634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:34.533101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:34.533891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:34.534340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:34.613266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39b0356717474e7fabff20aa3fa9e309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252cb11a6c804df8840720793581d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:34.624620 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2a5e8ac1-9192-41c0-9336-6eb468b85e07 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 200 len: 1652 microversion: 2.1 time: 0.112075 Jun 25 21:44:34.626038 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3197/6856] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:34 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 1652 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:34.804825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ce7bf537-690a-4294-bf12-196df2a62fa0 req-1e697ecd-266b-459a-9548-fe7f2c70d32b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8906362d-59f1-4985-b427-0c4c7df2dbb0", "name": "network-vif-deleted", "tag": "feaf4b04-3b54-45ca-9e00-bd34a03ecf88"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:34.815135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ce7bf537-690a-4294-bf12-196df2a62fa0 req-1e697ecd-266b-459a-9548-fe7f2c70d32b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:34.816009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ce7bf537-690a-4294-bf12-196df2a62fa0 req-1e697ecd-266b-459a-9548-fe7f2c70d32b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:34.829316 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ce7bf537-690a-4294-bf12-196df2a62fa0 req-1e697ecd-266b-459a-9548-fe7f2c70d32b service nova] Creating event network-vif-deleted:feaf4b04-3b54-45ca-9e00-bd34a03ecf88 for instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 on nch2-master-1 Jun 25 21:44:34.837063 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ce7bf537-690a-4294-bf12-196df2a62fa0 req-1e697ecd-266b-459a-9548-fe7f2c70d32b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036224 Jun 25 21:44:34.838040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3660/6857] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:35.643631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:35.644391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:35.652247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:35.652741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:35.653566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:35.654049 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:35.668897 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 HTTP/1.1 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8906362d-59f1-4985-b427-0c4c7df2dbb0'} Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:35.670646 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2ee61d44-4619-4899-b80e-0f7418550ef4 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 404 len: 111 microversion: 2.1 time: 0.032494 Jun 25 21:44:35.675054 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3198/6858] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:35 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:35.731488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:35.732545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:35.740162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:35.740647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:35.741418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:35.741844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:35.755448 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-volume_attachments HTTP/1.1 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'server_id': '8906362d-59f1-4985-b427-0c4c7df2dbb0'} Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:35.757156 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-af4f7f77-0292-4227-a584-90790367d7a2 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031533 Jun 25 21:44:35.761471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3661/6859] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:44:35 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:36.982469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:36.983031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:36.993693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:36.994304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:36.995312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:36.995891 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.012821 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 HTTP/1.1 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '8906362d-59f1-4985-b427-0c4c7df2dbb0'} Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.014374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fce286bc-7a21-4fd8-87f7-c4b8b1931385 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 404 len: 111 microversion: 2.1 time: 0.039744 Jun 25 21:44:37.018253 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3199/6860] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:44:36 2022] DELETE /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.024646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.025258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 8906362d-59f1-4985-b427-0c4c7df2dbb0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.032566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.033018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.033781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.034215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.047957 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 HTTP/1.1 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '8906362d-59f1-4985-b427-0c4c7df2dbb0'} Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.049529 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 8906362d-59f1-4985-b427-0c4c7df2dbb0 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a8539706-cd91-4420-b7c4-a46b6423f011 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0" status: 404 len: 111 microversion: 2.1 time: 0.030298 Jun 25 21:44:37.054040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3662/6861] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:37 2022] GET /compute/v2.1/servers/8906362d-59f1-4985-b427-0c4c7df2dbb0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.060002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.060560 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.066895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.067369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.068154 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.068651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.082561 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 HTTP/1.1 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e2474501-4f93-43b7-8057-c12786f69b25'} Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.084153 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a387404c-bb97-4da5-a9eb-83a7119a581c tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 404 len: 111 microversion: 2.1 time: 0.029659 Jun 25 21:44:37.088202 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3200/6862] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:44:37 2022] DELETE /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.094459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.095084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: e2474501-4f93-43b7-8057-c12786f69b25] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.101433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.101889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.102655 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.103102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.117691 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 HTTP/1.1 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'e2474501-4f93-43b7-8057-c12786f69b25'} Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.119206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance e2474501-4f93-43b7-8057-c12786f69b25 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b8b6be2e-25c2-4678-b794-4024f27e2c90 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25" status: 404 len: 111 microversion: 2.1 time: 0.030054 Jun 25 21:44:37.123573 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3663/6863] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:37 2022] GET /compute/v2.1/servers/e2474501-4f93-43b7-8057-c12786f69b25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.129211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.129732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.136053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.136552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.137309 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.137789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.151878 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a HTTP/1.1 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '4f898ec4-18d7-4d49-999e-5b54f6ca9c9a'} Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.153478 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cfd2eb91-42f1-49da-bd0a-56c3ebfe7613 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 404 len: 111 microversion: 2.1 time: 0.029588 Jun 25 21:44:37.157852 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3201/6864] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:44:37 2022] DELETE /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.163816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.164483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.170882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.171303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.172073 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.172541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.186290 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a HTTP/1.1 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '4f898ec4-18d7-4d49-999e-5b54f6ca9c9a'} Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.187817 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance 4f898ec4-18d7-4d49-999e-5b54f6ca9c9a could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6f858fc7-2ee9-4225-8c32-58b4dd69b95d tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a" status: 404 len: 111 microversion: 2.1 time: 0.029384 Jun 25 21:44:37.192402 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3664/6865] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:37 2022] GET /compute/v2.1/servers/4f898ec4-18d7-4d49-999e-5b54f6ca9c9a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.197911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.198453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.205029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.205492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.206268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.207565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.222414 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 HTTP/1.1 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2'} Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.223974 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1d14ad09-9dc4-4f72-8723-75806a7e051f tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 404 len: 111 microversion: 2.1 time: 0.031811 Jun 25 21:44:37.230503 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3202/6866] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:44:37 2022] DELETE /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.235279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.235906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] [instance: dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:37.242636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.243099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.243865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:37.244308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:37.258488 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] HTTP exception thrown: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Request method failure captured: Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 HTTP/1.1 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4BAFHt7-zokaQjG5gxCevpfu3ao_JIRKDLjBVehSXy-Z4u1Qntpl_L6TrC7gzuAB1OdNLhrBVR7PGOgvFhW0kj_VXuriBF15QrTlrBkdZGcmvTLtbHCij2oCxrYptbMok46aLysfQtKADw5eWfz2nLtDopjSgxeDTbLpi7xV4-PzH8 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/252cb11a6c804df8840720793581d971"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_252cb11a6c804df8840720793581d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/252cb11a6c804df8840720793581d971"}]}] Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 252cb11a6c804df8840720793581d971 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServerActionsTestJSON-1210636320 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 39b0356717474e7fabff20aa3fa9e309 Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServerActionsTestJSON-1210636320-project Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2'} Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:44:37.260065 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Returning 404 to user: Instance dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a4f76222-eb3c-4195-934e-d2b8643f023a tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2" status: 404 len: 111 microversion: 2.1 time: 0.030129 Jun 25 21:44:37.264736 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3665/6867] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:37 2022] GET /compute/v2.1/servers/dea0e7a5-8b43-404c-9e39-fb1fbac8c2f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:44:37.270503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b9401cb-7dd5-41b6-97d2-bf7cfda9fba7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] Calling method '.version_select at 0x7f9861eb7af0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:37.296799 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b9401cb-7dd5-41b6-97d2-bf7cfda9fba7 tempest-ServerActionsTestJSON-1210636320 tempest-ServerActionsTestJSON-1210636320-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929333221" status: 202 len: 0 microversion: 2.1 time: 0.030135 Jun 25 21:44:37.297376 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3203/6868] 10.222.0.39 () {58 vars in 1220 bytes} [Sat Jun 25 21:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929333221 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:44:46.688688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-870008962", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "5196f1ad-9845-4b9e-91c7-88bfd35ac732"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:46.747295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] validate_networks() for [('5196f1ad-9845-4b9e-91c7-88bfd35ac732', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:44:47.150382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:44:47.150814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:44:47.152804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:44:47.153263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:44:47.154011 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:44:47.164269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:47.164996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:47.165797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:47.166287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:47.184058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Getting quotas for project 49b14b2b91e84382b20f46a788ecba70. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:44:47.189540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Getting quotas for user e368fa23f5ab4e6887af9a885e560164 and project 49b14b2b91e84382b20f46a788ecba70. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:44:47.202513 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:44:47.204854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:44:47.252416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d970b008-d80a-484c-93a5-1fb7af15a7ee tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756112 Jun 25 21:44:47.253315 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3666/6869] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:44:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:44:47.261811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:47.266273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9afc884d-b61f-4f25-a206-436a93614efa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:47.266914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9afc884d-b61f-4f25-a206-436a93614efa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:47.334109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9afc884d-b61f-4f25-a206-436a93614efa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:47.342721 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9afc884d-b61f-4f25-a206-436a93614efa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1216 microversion: 2.1 time: 0.082875 Jun 25 21:44:47.343505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3204/6870] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:47 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:48.360192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:48.360923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:48.367729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:48.368177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:48.368972 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:48.369405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:48.451781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:48.460272 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a3f53f6d-8a0d-4f85-92f1-e54dedfae689 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1274 microversion: 2.1 time: 0.104923 Jun 25 21:44:48.461200 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3667/6871] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:48 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:49.479795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:49.481268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:49.498137 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:49.501337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:49.504577 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:49.506408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:49.746455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:49.756099 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1fbde22d-e46a-4b76-b43a-b0b76827bfb5 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.281682 Jun 25 21:44:49.767150 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3205/6872] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:49 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:50.083912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-717fcef4-5f0e-454f-97a1-82569bda05c7 req-ef7fa7a9-a253-4281-ae50-f97ab4b3447a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da06add4-73dc-4862-9b25-e3c5e3516db6", "tag": "11234a3e-1962-4a6f-9687-9104ee2aad4d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:50.104672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-717fcef4-5f0e-454f-97a1-82569bda05c7 req-ef7fa7a9-a253-4281-ae50-f97ab4b3447a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:50.106461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-717fcef4-5f0e-454f-97a1-82569bda05c7 req-ef7fa7a9-a253-4281-ae50-f97ab4b3447a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:50.122451 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-717fcef4-5f0e-454f-97a1-82569bda05c7 req-ef7fa7a9-a253-4281-ae50-f97ab4b3447a service nova] Creating event network-changed:11234a3e-1962-4a6f-9687-9104ee2aad4d for instance da06add4-73dc-4862-9b25-e3c5e3516db6 on nch2-master-1 Jun 25 21:44:50.129103 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-717fcef4-5f0e-454f-97a1-82569bda05c7 req-ef7fa7a9-a253-4281-ae50-f97ab4b3447a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055385 Jun 25 21:44:50.130109 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3668/6873] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:44:50.774486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:50.775120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:50.782599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:50.782992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:50.783795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:50.784242 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:50.930996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:50.942303 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c2d559f-7577-4a81-baf9-3f89b6ccba17 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.172316 Jun 25 21:44:50.943142 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3206/6874] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:50 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:51.965280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:51.966436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:51.976735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:51.977186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:51.977940 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:51.978375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:52.122595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:52.130326 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6568d950-4540-4b9b-97bf-ba29db6a8023 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.172853 Jun 25 21:44:52.130930 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3669/6875] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:51 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:53.149658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:53.150289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:53.157801 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:53.158271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:53.159055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:53.159505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:53.297761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:53.305571 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0b297d4c-e215-4f53-b222-3628011add88 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.160707 Jun 25 21:44:53.306154 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3207/6876] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:53 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:54.324454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:54.325176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:54.334576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:54.335027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:54.335785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:54.336387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:54.478846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:54.486773 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e52901e5-fdec-43e2-9290-7ddf2c4f21cd tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.167264 Jun 25 21:44:54.487514 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3670/6877] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:54 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:55.503606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:55.504229 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:55.507070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:55.512688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:55.513157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:55.513942 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:55.514390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:55.651311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:55.659140 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fb8bdb73-3855-459d-9ba9-81ead5ef72e9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.159652 Jun 25 21:44:55.659712 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3208/6878] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:55 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:56.471723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f184a2e7-d20f-4ece-9b48-e0179a740c37 req-95d04807-f80c-425a-a4ce-c9282515206d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da06add4-73dc-4862-9b25-e3c5e3516db6", "name": "network-vif-plugged", "status": "completed", "tag": "11234a3e-1962-4a6f-9687-9104ee2aad4d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:56.477521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:56.483624 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f184a2e7-d20f-4ece-9b48-e0179a740c37 req-95d04807-f80c-425a-a4ce-c9282515206d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:56.484176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f184a2e7-d20f-4ece-9b48-e0179a740c37 req-95d04807-f80c-425a-a4ce-c9282515206d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:56.488894 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=76 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:56.497264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f184a2e7-d20f-4ece-9b48-e0179a740c37 req-95d04807-f80c-425a-a4ce-c9282515206d service nova] Creating event network-vif-plugged:11234a3e-1962-4a6f-9687-9104ee2aad4d for instance da06add4-73dc-4862-9b25-e3c5e3516db6 on nch2-master-1 Jun 25 21:44:56.502406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f184a2e7-d20f-4ece-9b48-e0179a740c37 req-95d04807-f80c-425a-a4ce-c9282515206d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034511 Jun 25 21:44:56.503005 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3671/6879] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:44:56.676742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:56.677475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:56.685303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:56.685766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:56.686639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:56.687270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:56.819729 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:56.827792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f501354e-c198-47f0-a5d9-1f863b5f7361 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.155075 Jun 25 21:44:56.828375 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3209/6880] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:56 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:57.842892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:57.843639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:57.848740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:57.849573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:57.856875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:57.857329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:57.858091 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:57.858529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:57.997729 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:58.005438 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6bc8535e-230e-4877-a5ef-db836c6517b3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1316 microversion: 2.1 time: 0.163659 Jun 25 21:44:58.006037 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3672/6881] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:57 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:59.027484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:59.028512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:59.031647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:44:59.043285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:59.044107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:59.045427 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:59.046233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:59.183538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:59.191611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ffe9e0e-906f-4d4c-8525-20d7f695dee9 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.170922 Jun 25 21:44:59.192192 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3210/6882] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:59 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:44:59.249995 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1172755857", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "5196f1ad-9845-4b9e-91c7-88bfd35ac732"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:44:59.303060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] validate_networks() for [('5196f1ad-9845-4b9e-91c7-88bfd35ac732', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:44:59.682039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:44:59.682664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:44:59.683379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:44:59.683965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:44:59.684414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:44:59.697435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:59.698061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:59.699203 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:44:59.699790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:44:59.720603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Getting quotas for project 49b14b2b91e84382b20f46a788ecba70. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:44:59.726365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Getting quotas for user e368fa23f5ab4e6887af9a885e560164 and project 49b14b2b91e84382b20f46a788ecba70. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:44:59.740348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:44:59.742717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:44:59.799907 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb54bd8a-0518-4f59-bea0-d7aa7a3fb319 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553689 Jun 25 21:44:59.800783 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3673/6883] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:44:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:44:59.811561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fcecc330-8d19-4478-a30a-f8fcdd79fa2c tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:44:59.812192 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fcecc330-8d19-4478-a30a-f8fcdd79fa2c tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:44:59.867152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fcecc330-8d19-4478-a30a-f8fcdd79fa2c tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:44:59.874579 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fcecc330-8d19-4478-a30a-f8fcdd79fa2c tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1217 microversion: 2.1 time: 0.067043 Jun 25 21:44:59.875224 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3211/6884] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:44:59 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:00.892262 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:00.892903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:00.899896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:00.900370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:00.901137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:00.901578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:00.973405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:00.981161 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d62818cb-3a2f-48ae-9956-947a12962524 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1275 microversion: 2.1 time: 0.093760 Jun 25 21:45:00.981759 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3674/6885] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:00 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:01.999285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:02.000029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:02.011573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:02.012074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:02.012933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:02.013765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:02.114758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6bd7b9a2-5bf9-4ec7-ac91-8aaa15bcff36 req-dbf3397f-c924-4a94-a3bb-5f4faf0d0ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2180c993-16cb-471b-a57b-ffb370868847", "tag": "5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:02.140373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6bd7b9a2-5bf9-4ec7-ac91-8aaa15bcff36 req-dbf3397f-c924-4a94-a3bb-5f4faf0d0ba5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:02.141075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6bd7b9a2-5bf9-4ec7-ac91-8aaa15bcff36 req-dbf3397f-c924-4a94-a3bb-5f4faf0d0ba5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:02.156231 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6bd7b9a2-5bf9-4ec7-ac91-8aaa15bcff36 req-dbf3397f-c924-4a94-a3bb-5f4faf0d0ba5 service nova] Creating event network-changed:5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2 for instance 2180c993-16cb-471b-a57b-ffb370868847 on nch2-master-1 Jun 25 21:45:02.160328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:02.169073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6bd7b9a2-5bf9-4ec7-ac91-8aaa15bcff36 req-dbf3397f-c924-4a94-a3bb-5f4faf0d0ba5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057889 Jun 25 21:45:02.170048 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-db59449a-3db0-4824-b9c7-734495220983 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.174891 Jun 25 21:45:02.170275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3675/6886] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:45:02.179970 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3212/6887] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:01 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:03.193607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:03.194939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:03.201540 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:03.202033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:03.202783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:03.203246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:03.334690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:03.343129 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-98016f0f-b028-4528-ba7d-db5a772f8abe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.157932 Jun 25 21:45:03.343714 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3676/6888] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:03 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:04.364487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:04.367471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:04.373858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:04.374374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:04.375234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:04.375725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:04.514616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:04.522906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b7ff123-3188-42f9-a7b1-49fa2043bd45 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.165030 Jun 25 21:45:04.523552 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3213/6889] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:04 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:05.543597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:05.544566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:05.555120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:05.555567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:05.556328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:05.556779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:05.701266 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:05.709187 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f7df5ce0-59cd-4d54-a9a3-6b58f2026595 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.172175 Jun 25 21:45:05.709778 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3677/6890] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:05 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:06.735024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:06.736023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:06.747978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:06.748820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:06.750106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:06.750820 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:06.887436 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:06.895197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-099f5058-2549-4587-bc5f-eaf16d432b47 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.166812 Jun 25 21:45:06.895776 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3214/6891] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:06 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:07.915957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:07.917196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:07.928576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:07.929030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:07.929792 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:07.930231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:08.064392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:08.075596 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de181d28-b592-4486-bf99-3cf373a497b7 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.165896 Jun 25 21:45:08.076360 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3678/6892] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:07 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:08.529243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-309462d2-13d5-4bed-a9cf-3734c2b8d718 req-4c488471-b552-414a-b434-86e03b62038a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2180c993-16cb-471b-a57b-ffb370868847", "name": "network-vif-plugged", "status": "completed", "tag": "5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:08.539027 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-309462d2-13d5-4bed-a9cf-3734c2b8d718 req-4c488471-b552-414a-b434-86e03b62038a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:08.539492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-309462d2-13d5-4bed-a9cf-3734c2b8d718 req-4c488471-b552-414a-b434-86e03b62038a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:08.551079 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-309462d2-13d5-4bed-a9cf-3734c2b8d718 req-4c488471-b552-414a-b434-86e03b62038a service nova] Creating event network-vif-plugged:5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2 for instance 2180c993-16cb-471b-a57b-ffb370868847 on nch2-master-1 Jun 25 21:45:08.556045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-309462d2-13d5-4bed-a9cf-3734c2b8d718 req-4c488471-b552-414a-b434-86e03b62038a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 Jun 25 21:45:08.556659 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3215/6893] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:45:09.098326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:09.099302 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:09.107131 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:09.107585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:09.108336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:09.108811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:09.248028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:09.256386 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1bd35356-2eac-414b-aad8-1ba7dbf8ceea tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1317 microversion: 2.1 time: 0.165497 Jun 25 21:45:09.257002 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3679/6894] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:09 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:10.271179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:10.275656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:10.276398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:10.282995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.283454 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.284221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.284733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.447786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:10.459294 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-582c46ab-a86f-4589-91cf-e826dea4f648 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1505 microversion: 2.1 time: 0.189885 Jun 25 21:45:10.459889 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3216/6895] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:10 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:10.481243 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:10.481764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:10.483764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:10.484462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:10.491425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.491882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.492682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.493143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.522596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:45:10.616871 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-191f75a4-2cc3-4d51-9cc2-5ff7685d5701 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 204 len: 0 microversion: 2.1 time: 0.139050 Jun 25 21:45:10.617826 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3680/6896] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:45:10 2022] DELETE /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:45:10.625980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:10.626608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:10.633098 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.633501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.634279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:10.634910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:10.780336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:10.788826 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13164bf1-d0ae-4cce-b566-ee5bba70a635 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1511 microversion: 2.1 time: 0.166828 Jun 25 21:45:10.789409 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3217/6897] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:10 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:11.808215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:11.808950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:11.816575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:11.817075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:11.817817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:11.818280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:11.953819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:11.965004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3c50d91b-baa8-423d-99b0-cc690295346d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1511 microversion: 2.1 time: 0.160874 Jun 25 21:45:11.965765 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3681/6898] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:11 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:12.569784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ace144df-b17d-4b22-b251-04372959e4f8 req-8b821dc2-3b1f-40cc-b80a-7037bedecf44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2180c993-16cb-471b-a57b-ffb370868847", "name": "network-vif-deleted", "tag": "5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:12.585041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ace144df-b17d-4b22-b251-04372959e4f8 req-8b821dc2-3b1f-40cc-b80a-7037bedecf44 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:12.585749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ace144df-b17d-4b22-b251-04372959e4f8 req-8b821dc2-3b1f-40cc-b80a-7037bedecf44 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:12.599875 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ace144df-b17d-4b22-b251-04372959e4f8 req-8b821dc2-3b1f-40cc-b80a-7037bedecf44 service nova] Creating event network-vif-deleted:5cebcd5a-fb4d-4bbd-aa7e-ea681ae077b2 for instance 2180c993-16cb-471b-a57b-ffb370868847 on nch2-master-1 Jun 25 21:45:12.607187 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ace144df-b17d-4b22-b251-04372959e4f8 req-8b821dc2-3b1f-40cc-b80a-7037bedecf44 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041406 Jun 25 21:45:12.607926 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3218/6899] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:45:12.985239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:12.986005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:12.993538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:12.994050 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:12.994920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:12.995382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:13.031332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:13.031774 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:13.032230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lazy-loading 'fault' on Instance uuid 2180c993-16cb-471b-a57b-ffb370868847 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:45:13.074366 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:13.081885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-23147ae9-99e3-4912-8c10-5fce9e9bdc4f tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 200 len: 1307 microversion: 2.1 time: 0.101288 Jun 25 21:45:13.082452 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3682/6900] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:12 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:14.105664 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.106838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.117596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.118359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.119621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.120366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.138167 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 HTTP/1.1 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '2180c993-16cb-471b-a57b-ffb370868847'} Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.139786 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 404 to user: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3eb09307-cce6-4b95-8b55-87aedfadc626 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 404 len: 111 microversion: 2.1 time: 0.044359 Jun 25 21:45:14.144743 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3219/6901] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:45:14.150511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.151122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.158351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.158802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.159555 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.159989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.295638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:14.303776 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b74521a9-53ac-484d-9014-2b8dbc00211e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.157273 Jun 25 21:45:14.304359 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3683/6902] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:14.320901 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:14.321880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 926fc0ec-cda0-4910-8f67-cb05da1128bb] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.327940 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/926fc0ec-cda0-4910-8f67-cb05da1128bb/action HTTP/1.1 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 32 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: {"resize": {"flavorRef": "452"}} Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '926fc0ec-cda0-4910-8f67-cb05da1128bb', 'body': {'resize': {'flavorRef': '452'}}} Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:45:14.329552 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 404 to user: Instance 926fc0ec-cda0-4910-8f67-cb05da1128bb could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3372b3c6-a05d-4e8a-8cb5-99d5f2ed38d4 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "POST /compute/v2.1/servers/926fc0ec-cda0-4910-8f67-cb05da1128bb/action" status: 404 len: 111 microversion: 2.1 time: 0.014168 Jun 25 21:45:14.333623 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3220/6903] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:45:14 2022] POST /compute/v2.1/servers/926fc0ec-cda0-4910-8f67-cb05da1128bb/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:45:14.339840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.340493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.346975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.347431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.348189 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.348681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.496150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:14.503959 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ecbaa89e-9954-45b6-8c01-4138dd8dc931 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.168330 Jun 25 21:45:14.504571 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3684/6904] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:14.521187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.523785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.533902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.534367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.535181 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.535631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.678996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:14.686906 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-36aae28e-c662-411b-819c-429cec20757d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.169622 Jun 25 21:45:14.687413 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3221/6905] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:14.703283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "c82e6f1c-94ae-4c20-8eab-9fa81304a024"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:14.704288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.710597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.711057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.711835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.712276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.752308 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:14.758189 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: request: POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action HTTP/1.1 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 65 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: {"resize": {"flavorRef": "c82e6f1c-94ae-4c20-8eab-9fa81304a024"}} Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: exception: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'da06add4-73dc-4862-9b25-e3c5e3516db6', 'body': {'resize': {'flavorRef': 'c82e6f1c-94ae-4c20-8eab-9fa81304a024'}}} Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 21:45:14.760127 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 400 to user: Flavor c82e6f1c-94ae-4c20-8eab-9fa81304a024 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72c2cbbe-5245-443c-9a2d-14aa67483bbb tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action" status: 400 len: 107 microversion: 2.1 time: 0.062417 Jun 25 21:45:14.764331 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3685/6906] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:45:14 2022] POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action => generated 107 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 21:45:14.771408 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.772107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.778733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.779201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.779968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.780417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.916975 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:14.925046 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4e38c8f5-49b5-4d4f-9dcd-60aeddcc7318 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.157725 Jun 25 21:45:14.925624 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3222/6907] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:45:14.942647 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:14.943200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:14.951475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.951942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:14.952780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:14.953224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.093927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:15.105497 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9bdb2860-bd6f-410b-beb1-fdc29b80756e tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.166589 Jun 25 21:45:15.106289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3686/6908] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:14 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:15.125511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ded5b05-ee22-4eb0-a453-aa232dbee3b6 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ded5b05-ee22-4eb0-a453-aa232dbee3b6 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: request: POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action HTTP/1.1 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 29 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: {"resize": {"flavorRef": ""}} Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'da06add4-73dc-4862-9b25-e3c5e3516db6', 'body': {'resize': {'flavorRef': ''}}} Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise error Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi On instance['resize']: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi '' Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.127811 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ded5b05-ee22-4eb0-a453-aa232dbee3b6 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ded5b05-ee22-4eb0-a453-aa232dbee3b6 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action" status: 400 len: 113 microversion: 2.1 time: 0.007839 Jun 25 21:45:15.133056 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3223/6909] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:45:15 2022] POST /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 25 21:45:15.137441 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:15.138063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:15.144221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.144722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.145487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.145926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.290838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:15.299244 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-64e8e8b2-6d3d-48c0-8fb2-867d3837338d tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1505 microversion: 2.1 time: 0.165448 Jun 25 21:45:15.300417 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3687/6910] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:15 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:15.327648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:15.328168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:15.335317 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.335786 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.336598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.337051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.350780 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 HTTP/1.1 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '2180c993-16cb-471b-a57b-ffb370868847'} Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:45:15.352374 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 404 to user: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a3578211-0403-4776-b6bb-2d5ecec20d6a tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 404 len: 111 microversion: 2.1 time: 0.031086 Jun 25 21:45:15.356830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3224/6911] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:45:15 2022] DELETE /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:45:15.362532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:15.363161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: 2180c993-16cb-471b-a57b-ffb370868847] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:15.369493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.369935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.370723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.371162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.375334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:15.386818 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 HTTP/1.1 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '2180c993-16cb-471b-a57b-ffb370868847'} Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:15.388478 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 404 to user: Instance 2180c993-16cb-471b-a57b-ffb370868847 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3fbf011a-e54e-4956-ad78-8fe2c3089de3 tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847" status: 404 len: 111 microversion: 2.1 time: 0.031327 Jun 25 21:45:15.392664 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3688/6912] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:15 2022] GET /compute/v2.1/servers/2180c993-16cb-471b-a57b-ffb370868847 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:45:15.398868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:15.399384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:15.405818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.406287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.407047 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.407492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.432702 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:45:15.483300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:45:15.528895 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-21f08825-3e8e-4b0b-ab7a-d2d254bea3bf tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "DELETE /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 204 len: 0 microversion: 2.1 time: 0.133678 Jun 25 21:45:15.529671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3225/6913] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:45:15 2022] DELETE /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 21:45:15.538977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:15.539565 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:15.546925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.547382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.548149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:15.548619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:15.682268 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:15.693926 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bb26518e-1a3b-40af-ad94-e941116697ce tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1511 microversion: 2.1 time: 0.159221 Jun 25 21:45:15.694683 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3689/6914] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:15 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:16.715013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:16.715694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:16.723623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:16.724087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:16.724918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:16.725504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:16.859656 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:16.867762 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3f911cb1-2690-463d-bfa9-8e94092e15ef tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1511 microversion: 2.1 time: 0.158603 Jun 25 21:45:16.868345 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3226/6915] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:16 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:17.649519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f2892e3f-63dc-473e-a7e7-300ea2502f38 req-ca13ca54-a3d4-4e18-8ce2-25895319904c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da06add4-73dc-4862-9b25-e3c5e3516db6", "name": "network-vif-deleted", "tag": "11234a3e-1962-4a6f-9687-9104ee2aad4d"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:45:17.659433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f2892e3f-63dc-473e-a7e7-300ea2502f38 req-ca13ca54-a3d4-4e18-8ce2-25895319904c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:17.660511 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f2892e3f-63dc-473e-a7e7-300ea2502f38 req-ca13ca54-a3d4-4e18-8ce2-25895319904c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:17.673486 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f2892e3f-63dc-473e-a7e7-300ea2502f38 req-ca13ca54-a3d4-4e18-8ce2-25895319904c service nova] Creating event network-vif-deleted:11234a3e-1962-4a6f-9687-9104ee2aad4d for instance da06add4-73dc-4862-9b25-e3c5e3516db6 on nch2-master-1 Jun 25 21:45:17.678845 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f2892e3f-63dc-473e-a7e7-300ea2502f38 req-ca13ca54-a3d4-4e18-8ce2-25895319904c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113140 Jun 25 21:45:17.679471 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3690/6916] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:45:17.884254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:17.885103 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:17.892602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:17.893069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:17.893849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:17.894287 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:17.930083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:17.930543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:17.931083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lazy-loading 'fault' on Instance uuid da06add4-73dc-4862-9b25-e3c5e3516db6 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:45:17.977042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e368fa23f5ab4e6887af9a885e560164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b14b2b91e84382b20f46a788ecba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:45:17.985219 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ba4c2c26-d82b-4493-9890-dede1d9445fe tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 200 len: 1306 microversion: 2.1 time: 0.105015 Jun 25 21:45:17.985723 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3227/6917] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:17 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:45:19.008615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:45:19.009573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] [instance: da06add4-73dc-4862-9b25-e3c5e3516db6] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:45:19.017202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:19.017716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:19.018566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:45:19.019048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:45:19.034152 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] HTTP exception thrown: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Request method failure captured: Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 HTTP/1.1 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4HOB-Pu9qintcZtC6hjN0mfAQdWFnRV49vaYKbpYMJiaYu6wGzJTbxcFEp-jHJkOIVzs_fwjTA_bFoUxh1QIh67TT7ME6EHkA9W8I9wqj9gY8tzbj7SzV2knCHk2FbnWHQsXFxluXaMmQgEhg1Uej3mHU_QL10ooCZ2nnGg9rpOiWA Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_49b14b2b91e84382b20f46a788ecba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/49b14b2b91e84382b20f46a788ecba70"}]}] Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 49b14b2b91e84382b20f46a788ecba70 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-ServersNegativeTestJSON-163355154 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: e368fa23f5ab4e6887af9a885e560164 Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-ServersNegativeTestJSON-163355154-project Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'da06add4-73dc-4862-9b25-e3c5e3516db6'} Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:45:19.035990 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] Returning 404 to user: Instance da06add4-73dc-4862-9b25-e3c5e3516db6 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-491f800f-800d-4db3-be3a-aecac2cd48fa tempest-ServersNegativeTestJSON-163355154 tempest-ServersNegativeTestJSON-163355154-project] 10.222.0.39 "GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6" status: 404 len: 111 microversion: 2.1 time: 0.037500 Jun 25 21:45:19.041547 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3691/6918] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:45:18 2022] GET /compute/v2.1/servers/da06add4-73dc-4862-9b25-e3c5e3516db6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:46:00.006588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-059cd7df-7a74-476e-84c2-9ca8357e0c53 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: .version_select at 0x7f984f65f9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-107759653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0vt4dRVvXk3HJnKlgoxJhFTudKciivJEFFUBKfpCRsAOX1ZHR6727eMKrbxkwHlncWfulyOnxHa0c+D1/XaFHjPksuwgTub8aQAKO/udp4JoUrRaTjfbeMtZk46MzRmg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:00.011176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:00.011862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:00.027203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-059cd7df-7a74-476e-84c2-9ca8357e0c53 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for project f1aca77315704d338f4f0f881e741a12. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:46:00.032991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-059cd7df-7a74-476e-84c2-9ca8357e0c53 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for user 53b9cc03262c41d682254f9cf61f34a0 and project f1aca77315704d338f4f0f881e741a12. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:46:00.062192 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-059cd7df-7a74-476e-84c2-9ca8357e0c53 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059981 Jun 25 21:46:00.063041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3228/6919] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:46:00 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:00.123660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-584473531", "imageRef": "6edfe58e-7144-4ba0-a755-9ed84abff442", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107759653", "networks": [{"uuid": "873ca98a-fc42-4464-851e-f847cc1ad4d6"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:00.131227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:00.131873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=11 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:00.179115 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] validate_networks() for [('873ca98a-fc42-4464-851e-f847cc1ad4d6', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:46:00.573874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:46:00.574554 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:46:00.575329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:46:00.575960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:46:00.576594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:46:00.589156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:00.589615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:00.590419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:00.590858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:00.610195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for project f1aca77315704d338f4f0f881e741a12. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:46:00.615506 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for user 53b9cc03262c41d682254f9cf61f34a0 and project f1aca77315704d338f4f0f881e741a12. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:46:00.628716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:46:00.630981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6edfe58e-7144-4ba0-a755-9ed84abff442',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:46:00.677646 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-12c7c06b-f0b3-45fa-81b5-daf6730f9329 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558391 Jun 25 21:46:00.678298 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3692/6920] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:46:00.688382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-79d3f335-1090-41cf-b73b-6181f71d1687 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:00.689068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-79d3f335-1090-41cf-b73b-6181f71d1687 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:00.748042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-79d3f335-1090-41cf-b73b-6181f71d1687 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:00.756026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-79d3f335-1090-41cf-b73b-6181f71d1687 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1257 microversion: 2.1 time: 0.071508 Jun 25 21:46:00.756650 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3229/6921] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:00 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1257 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:01.774905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:01.775685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:01.784708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:01.785290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:01.786173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:01.787961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:01.892688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:01.901141 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79929dcd-48af-4592-8e85-bfd005b54502 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1317 microversion: 2.1 time: 0.131510 Jun 25 21:46:01.902016 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3693/6922] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:01 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1317 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:02.919358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:02.920074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:02.928462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:02.928886 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:02.929681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:02.930130 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:03.090472 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:03.100069 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9e66b535-9894-4080-ab46-40954caaa2de tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.185138 Jun 25 21:46:03.110692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3230/6923] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:02 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:04.131517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:04.132279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:04.139585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:04.140038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:04.140838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:04.141303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:04.288848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:04.297580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4852a8c7-7330-48ac-8d4f-b168a5991213 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.179038 Jun 25 21:46:04.298430 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3694/6924] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:04 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:05.319033 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:05.319754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:05.327271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:05.327733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:05.328522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:05.328966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:05.473675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:05.482632 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c728adf1-9681-4a70-abca-7f7e61bff81a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.171380 Jun 25 21:46:05.483363 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3231/6925] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:05 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:06.499874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:06.500878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:06.508201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:06.508755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:06.509541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:06.509979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:06.653177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:06.660937 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e8a52e70-b126-4fce-8b43-7275437d698a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.164997 Jun 25 21:46:06.661730 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3695/6926] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:06 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:07.678738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:07.679369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:07.686512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:07.686983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:07.687773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:07.688225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:07.833503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:07.842012 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-09c4b9e6-0724-4dce-9558-8f520357e0c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.167285 Jun 25 21:46:07.846666 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3232/6927] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:07 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:08.861175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:08.861923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:08.869571 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:08.870020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:08.870790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:08.871226 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:09.008529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:09.016928 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-921a5df5-0a2c-430f-9ab4-0a16475d2619 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.161032 Jun 25 21:46:09.017907 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3696/6928] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:08 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:10.036893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:10.037935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:10.049493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:10.050222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:10.051403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:10.052085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:10.191661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:10.203268 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-71ab0421-0b3d-4583-9ba4-a6eaedae9d95 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.172270 Jun 25 21:46:10.204039 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3233/6929] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:10 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:11.225246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:11.225924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:11.228713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:11.229382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:11.235036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:11.235482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:11.236235 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:11.236703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:11.373578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:11.381975 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-805231ae-3115-43a0-830b-4e891ec2c697 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.160725 Jun 25 21:46:11.382536 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3697/6930] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:11 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:12.405932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:12.406515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:12.408413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:12.415178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:12.415649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:12.416455 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:12.416925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:12.559252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:12.570768 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c660cb53-3ea8-4b4e-9af8-91bd0595a1c3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.169698 Jun 25 21:46:12.571547 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3234/6931] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:12 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:13.591420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:13.592413 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:13.599847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:13.600534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:13.601291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:13.601837 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:13.648860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4ba4f211-17d3-48e3-b859-69c7a0f0cf34 req-6f1897f7-2f4e-4034-b7dd-ed1e19e3d1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:13.662228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ba4f211-17d3-48e3-b859-69c7a0f0cf34 req-6f1897f7-2f4e-4034-b7dd-ed1e19e3d1f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:13.662776 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4ba4f211-17d3-48e3-b859-69c7a0f0cf34 req-6f1897f7-2f4e-4034-b7dd-ed1e19e3d1f8 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:13.674853 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4ba4f211-17d3-48e3-b859-69c7a0f0cf34 req-6f1897f7-2f4e-4034-b7dd-ed1e19e3d1f8 service nova] Creating event network-changed:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:46:13.681574 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4ba4f211-17d3-48e3-b859-69c7a0f0cf34 req-6f1897f7-2f4e-4034-b7dd-ed1e19e3d1f8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036345 Jun 25 21:46:13.682191 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3235/6932] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:13.882986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:13.892054 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c8d1c7e-a346-4df6-bc0d-3b20e14b7c0a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.305945 Jun 25 21:46:13.892782 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3698/6933] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:13 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:46:14.915556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:14.916654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:14.924399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:14.924890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:14.925690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:14.926120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:15.066808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:15.074840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-12a254bb-4af1-4780-8d47-dc585276cacd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.167771 Jun 25 21:46:15.075328 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3236/6934] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:14 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:16.092813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:16.093492 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:16.101403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:16.101873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:16.102679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:16.103130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:16.328569 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:16.336408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-68407803-0158-45f9-81b5-986fe44004d9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.248229 Jun 25 21:46:16.337021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3699/6935] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:16 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:17.357520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:17.358594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:17.370536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:17.371310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:17.372659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:17.373497 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:17.509046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:17.518266 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-145d5dd4-d68f-4bb5-af74-414b1cf8d6e5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.167360 Jun 25 21:46:17.518857 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3237/6936] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:17 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:18.539692 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:18.540689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:18.552762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:18.553522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:18.554810 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:18.555526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:18.694056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:18.702278 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e58382cf-e444-45a8-90c2-acf3cdfa46e4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.169155 Jun 25 21:46:18.702870 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3700/6937] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:18 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:19.723972 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:19.724597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:19.731748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:19.732208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:19.733121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:19.733571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:19.868739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:19.876901 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89efa0c2-0cfa-457f-8afb-ed2e5ece3ad9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.157037 Jun 25 21:46:19.877506 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3238/6938] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:19 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:20.894283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:20.894905 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:20.902633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:20.903078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:20.903855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:20.904250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:21.045679 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:21.054965 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c7f3108-d99d-4a38-8637-ff7a1f8972d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.164633 Jun 25 21:46:21.055931 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3701/6939] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:20 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:21.234253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dec6ab57-8173-4d51-be71-7fd740d7dd6b req-509cc842-9276-44af-95f9-f5d7996db166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "name": "network-vif-plugged", "status": "completed", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:21.242443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dec6ab57-8173-4d51-be71-7fd740d7dd6b req-509cc842-9276-44af-95f9-f5d7996db166 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:21.242898 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dec6ab57-8173-4d51-be71-7fd740d7dd6b req-509cc842-9276-44af-95f9-f5d7996db166 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:21.253868 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dec6ab57-8173-4d51-be71-7fd740d7dd6b req-509cc842-9276-44af-95f9-f5d7996db166 service nova] Creating event network-vif-plugged:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:46:21.258903 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dec6ab57-8173-4d51-be71-7fd740d7dd6b req-509cc842-9276-44af-95f9-f5d7996db166 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155655 Jun 25 21:46:21.259469 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3239/6940] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:46:22.078751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:22.079407 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:22.087613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:22.088120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:22.089379 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:22.089868 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:22.231138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:22.239926 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-254ba0bf-9461-4052-8942-47722f403e61 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1357 microversion: 2.1 time: 0.167723 Jun 25 21:46:22.240577 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3702/6941] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:22 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:23.263337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:23.264483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:23.275048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.275772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.277199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.277906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.413313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:23.421492 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-45e9872a-51d1-4edf-8517-b88f323c1dd4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1546 microversion: 2.1 time: 0.166204 Jun 25 21:46:23.422080 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3240/6942] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:23 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:23.437889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:23.438406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:23.445779 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.446236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.447040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.447483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.582472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:23.591109 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cd8b7376-c610-432c-ae57-ee5ca713bad8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1546 microversion: 2.1 time: 0.157241 Jun 25 21:46:23.591698 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3703/6943] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:23 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1546 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:23.607136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:23.610617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:23.611395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Searching by: {'deleted': False, 'project_id': 'f1aca77315704d338f4f0f881e741a12'} {{(pid=137462) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:46:23.617409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.617867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.618670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.619114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.644518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.multi_cell_list [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137462) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:46:23.673128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f82ee8c4-2227-4494-9b9c-89fd51955d85 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069864 Jun 25 21:46:23.673710 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3241/6944] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:46:23 2022] GET /compute/v2.1/servers => generated 342 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:23.684330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:23.684996 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:23.691637 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.692059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.692957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:23.693386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:23.830068 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:23.838264 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7b3ad5a8-510b-49f5-9681-8c8ed7631397 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1546 microversion: 2.1 time: 0.157923 Jun 25 21:46:23.839202 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3704/6945] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:23 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:25.388008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71ea031-7686-4a9e-b248-7fbd51e5acf0"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:25.389325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:25.396821 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:25.397324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:25.398139 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:25.398622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:25.659749 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cc8f7173-786e-441f-9425-b9ef9851a456 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275762 Jun 25 21:46:25.660446 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3242/6946] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:46:25 2022] POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:30.266016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:30.266585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:30.269439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:30.275252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:30.275702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:30.276475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:30.276944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:30.280334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=75 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:30.418112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:30.427020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-614dc292-e047-4e7a-a7c5-afa2a66b98a7 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1592 microversion: 2.1 time: 0.165760 Jun 25 21:46:30.427605 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3705/6947] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:30 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1592 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:32.473914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d4912ed4-f026-402b-9dde-9e5c178b3135 req-a324a4d4-dc4e-47e4-9d34-5a3f535f100f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:32.482594 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:32.485636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d4912ed4-f026-402b-9dde-9e5c178b3135 req-a324a4d4-dc4e-47e4-9d34-5a3f535f100f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:32.486054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d4912ed4-f026-402b-9dde-9e5c178b3135 req-a324a4d4-dc4e-47e4-9d34-5a3f535f100f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:32.497388 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:32.500892 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d4912ed4-f026-402b-9dde-9e5c178b3135 req-a324a4d4-dc4e-47e4-9d34-5a3f535f100f service nova] Creating event network-changed:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:46:32.506431 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d4912ed4-f026-402b-9dde-9e5c178b3135 req-a324a4d4-dc4e-47e4-9d34-5a3f535f100f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036506 Jun 25 21:46:32.507502 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3243/6948] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:33.470883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1481129939"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:33.471429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:33.478991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:33.479443 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:33.480222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:33.480677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:33.610876 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Adding security group b703aae4-e97f-4acc-88d8-16b8c10c160d to port b969c1c5-d8b8-4274-9bab-398a76dc879a Jun 25 21:46:33.969333 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-056165ac-1a28-46d4-9f7d-1e74eb5c5346 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action" status: 202 len: 0 microversion: 2.1 time: 0.502307 Jun 25 21:46:33.970327 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3706/6949] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:46:33 2022] POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:46:33.978039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:46:33.991466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:46:33.993006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:46:34.012082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:34.012591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:34.013535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:34.014201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:34.178328 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:46:34.187979 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-323f8607-c9d6-4ff9-aba5-dd499ba3d296 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1758 microversion: 2.1 time: 0.212170 Jun 25 21:46:34.188474 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3244/6950] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:46:33 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:46:34.522957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-5ffbf8c6-51aa-43c2-b84d-8321f2cb0f6a req-099d8cfc-ad01-4407-9b4b-f9f6084cd24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:46:34.531408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5ffbf8c6-51aa-43c2-b84d-8321f2cb0f6a req-099d8cfc-ad01-4407-9b4b-f9f6084cd24d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:46:34.531929 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-5ffbf8c6-51aa-43c2-b84d-8321f2cb0f6a req-099d8cfc-ad01-4407-9b4b-f9f6084cd24d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:46:34.544083 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-5ffbf8c6-51aa-43c2-b84d-8321f2cb0f6a req-099d8cfc-ad01-4407-9b4b-f9f6084cd24d service nova] Creating event network-changed:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:46:34.549591 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-5ffbf8c6-51aa-43c2-b84d-8321f2cb0f6a req-099d8cfc-ad01-4407-9b4b-f9f6084cd24d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031941 Jun 25 21:46:34.550728 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3707/6951] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:46:49.012993 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:46:49.014230 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:46:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:48:29.097539 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:48:29.098406 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:48:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:48:57.915693 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:48:57.916697 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:48:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:49:27.715125 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 21:49:27.716060 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 21:49:27.716813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:27.717631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=7 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:27.721690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:49:27.722672 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:49:27.729584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:27.730046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:27.730812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:27.731260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:27.806964 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1c5c45b9-eeae-4a11-a07b-ae8b445572cd tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action" status: 202 len: 0 microversion: 2.1 time: 0.093755 Jun 25 21:49:27.810619 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3245/6952] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:49:27 2022] POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:49:27.814983 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 21:49:27.815911 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 21:49:27.824249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:49:27.824249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:49:27.824249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=5 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:27.824249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=11 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:49:27.831553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:27.832004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:27.833496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:27.834034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:28.158385 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:49:28.167299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-024c375f-1807-4e54-9cc9-c0534baa338a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1760 microversion: 2.1 time: 0.354335 Jun 25 21:49:28.167881 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3708/6953] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:49:27 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1760 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:49:29.190153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:49:29.190947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:49:29.200660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:29.201245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:29.202209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:49:29.202771 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:49:29.211973 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 40116. Jun 25 21:49:29.212756 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 40114. Jun 25 21:49:29.415903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:49:29.424619 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-50f755e1-009c-45ef-922e-6ec2c0347997 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1758 microversion: 2.1 time: 0.241989 Jun 25 21:49:29.425210 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3246/6954] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:49:29 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:50:09.024828 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:50:09.025560 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:50:09.283921 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:50:09.284863 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:50:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:51:05.785500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:05.786715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:05.807841 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 40200. Jun 25 21:51:05.808777 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 40198. Jun 25 21:51:05.910357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1481129939"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:05.910899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:05.918146 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:05.918567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:05.919350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:05.919782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:06.151371 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Removing security group b703aae4-e97f-4acc-88d8-16b8c10c160d from port b969c1c5-d8b8-4274-9bab-398a76dc879a Jun 25 21:51:06.498982 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-14dd0d7f-fdb3-432a-863f-1eed2ebc42a4 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action" status: 202 len: 0 microversion: 2.1 time: 0.719332 Jun 25 21:51:06.499790 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3709/6955] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:51:05 2022] POST /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/action => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:51:06.561895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:06.563072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:06.694941 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-8c514068-f314-48c1-a066-5fde3e243bbb req-067ae2e1-5bf6-49d5-8d9d-16876915e4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:06.703912 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8c514068-f314-48c1-a066-5fde3e243bbb req-067ae2e1-5bf6-49d5-8d9d-16876915e4de service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:06.704601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-8c514068-f314-48c1-a066-5fde3e243bbb req-067ae2e1-5bf6-49d5-8d9d-16876915e4de service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:06.723220 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-8c514068-f314-48c1-a066-5fde3e243bbb req-067ae2e1-5bf6-49d5-8d9d-16876915e4de service nova] Creating event network-changed:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:51:06.729499 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-8c514068-f314-48c1-a066-5fde3e243bbb req-067ae2e1-5bf6-49d5-8d9d-16876915e4de service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168938 Jun 25 21:51:06.730550 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3247/6956] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:08.339130 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:08.339635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:08.348317 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:08.348804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:08.349736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:08.350174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:08.432136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lazy-loading 'services' on Instance uuid 7832afb1-70af-42e9-8b68-faff12a80fef {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:51:08.509614 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [eeb2a81e-a7ee-4a42-ac86-5020969e7ba4] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 21:51:08.794018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-abeb39e5-f76f-4cec-9dde-84892c04a331 req-67878d8c-21a7-4706-b951-53fd67aa5992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:08.807634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-abeb39e5-f76f-4cec-9dde-84892c04a331 req-67878d8c-21a7-4706-b951-53fd67aa5992 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:08.808225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-abeb39e5-f76f-4cec-9dde-84892c04a331 req-67878d8c-21a7-4706-b951-53fd67aa5992 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:08.820436 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-abeb39e5-f76f-4cec-9dde-84892c04a331 req-67878d8c-21a7-4706-b951-53fd67aa5992 service nova] Creating event network-changed:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:51:08.825646 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-abeb39e5-f76f-4cec-9dde-84892c04a331 req-67878d8c-21a7-4706-b951-53fd67aa5992 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039447 Jun 25 21:51:08.826226 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3248/6957] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:09.522357 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [eeb2a81e-a7ee-4a42-ac86-5020969e7ba4] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 40252. Jun 25 21:51:09.526198 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-35fe86b7-b532-4e35-a502-39bc20294d92 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments/d71ea031-7686-4a9e-b248-7fbd51e5acf0" status: 202 len: 0 microversion: 2.1 time: 1.192426 Jun 25 21:51:09.526806 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3710/6958] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:51:08 2022] DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments/d71ea031-7686-4a9e-b248-7fbd51e5acf0 => generated 0 bytes in 1194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:51:09.536461 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:09.537496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:09.544681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:09.545149 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:09.545940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:09.546396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:09.577828 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70861f50-1a0b-49d9-ad42-a37d7ebb6492 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045788 Jun 25 21:51:09.578398 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3249/6959] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:51:09 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:10.597253 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:10.598880 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:10.606429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:10.606883 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:10.607640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:10.608079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:10.638107 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee0702a3-3fa3-4b5a-858d-3feadec503a1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050213 Jun 25 21:51:10.638667 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3711/6960] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:51:10 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:51:10.649134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:10.649667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:10.657007 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:10.657465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:10.658239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:10.658680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:10.921865 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] HTTP exception thrown: Instance 7832afb1-70af-42e9-8b68-faff12a80fef is not attached to volume d71ea031-7686-4a9e-b248-7fbd51e5acf0 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Request method failure captured: Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments/d71ea031-7686-4a9e-b248-7fbd51e5acf0 HTTP/1.1 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4IJ5Mf4GSgrRbrBnln5dZq_oLFSwzaR-mwKoej_7ChchmJW-RorT9hZK5PauU780wDlQjVQpg2GHb9C9okV64HmEMc56WGbDk6iEooM94Z_CctRUP367QMHFbfE8kA3-vliSVjena2ASOMcyhT4Kk9GoNfTwUjLaw7SzhXM3VyOcdQ Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1aca77315704d338f4f0f881e741a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}] Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 53b9cc03262c41d682254f9cf61f34a0 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 7832afb1-70af-42e9-8b68-faff12a80fef is not attached to volume d71ea031-7686-4a9e-b248-7fbd51e5acf0 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '7832afb1-70af-42e9-8b68-faff12a80fef', 'id': 'd71ea031-7686-4a9e-b248-7fbd51e5acf0'} Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d71ea031-7686-4a9e-b248-7fbd51e5acf0. Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7832afb1-70af-42e9-8b68-faff12a80fef is not attached to volume d71ea031-7686-4a9e-b248-7fbd51e5acf0 Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:51:10.942802 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7832afb1-70af-42e9-8b68-faff12a80fef is not attached to volume d71ea031-7686-4a9e-b248-7fbd51e5acf0 Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Returning 404 to user: Instance 7832afb1-70af-42e9-8b68-faff12a80fef is not attached to volume d71ea031-7686-4a9e-b248-7fbd51e5acf0 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:51:10.947734 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3b9f9a86-fd7b-4544-83ca-502cf236b053 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments/d71ea031-7686-4a9e-b248-7fbd51e5acf0" status: 404 len: 154 microversion: 2.1 time: 0.299456 Jun 25 21:51:10.948639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3250/6961] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:51:10 2022] DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef/os-volume_attachments/d71ea031-7686-4a9e-b248-7fbd51e5acf0 => generated 154 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:51:12.101082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:12.101771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:12.109284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:12.109739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:12.110586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:12.111025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:12.140303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:51:12.217669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-94e8611c-89a0-4c9a-a242-8fd983d34f11 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 204 len: 0 microversion: 2.1 time: 0.121772 Jun 25 21:51:12.218245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3712/6962] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:51:12 2022] DELETE /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:51:12.226740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:12.227367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:12.234414 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:12.234871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:12.235670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:12.236112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:12.386879 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:12.398712 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-281d30ce-4e62-4fee-95e1-482cfd13b0f1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1552 microversion: 2.1 time: 0.175593 Jun 25 21:51:12.399293 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3251/6963] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:12 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1552 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:13.422246 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:13.423447 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:13.436238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:13.437040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:13.438289 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:13.439022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:13.571939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:13.579760 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f63094c1-7579-4cbe-b5a8-830285b902a5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1552 microversion: 2.1 time: 0.164841 Jun 25 21:51:13.580343 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3713/6964] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:13 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:14.598068 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:14.598689 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:14.606321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:14.606793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:14.607582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:14.608029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:14.637451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-bf29f93a-8ef3-480a-9e61-7be3c675a7d3 req-1ff24ff1-4e62-4152-96dc-97560239cce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7832afb1-70af-42e9-8b68-faff12a80fef", "name": "network-vif-deleted", "tag": "b969c1c5-d8b8-4274-9bab-398a76dc879a"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:14.649258 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf29f93a-8ef3-480a-9e61-7be3c675a7d3 req-1ff24ff1-4e62-4152-96dc-97560239cce1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:14.649710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-bf29f93a-8ef3-480a-9e61-7be3c675a7d3 req-1ff24ff1-4e62-4152-96dc-97560239cce1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:14.664519 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-bf29f93a-8ef3-480a-9e61-7be3c675a7d3 req-1ff24ff1-4e62-4152-96dc-97560239cce1 service nova] Creating event network-vif-deleted:b969c1c5-d8b8-4274-9bab-398a76dc879a for instance 7832afb1-70af-42e9-8b68-faff12a80fef on nch2-master-1 Jun 25 21:51:14.670035 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-bf29f93a-8ef3-480a-9e61-7be3c675a7d3 req-1ff24ff1-4e62-4152-96dc-97560239cce1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036535 Jun 25 21:51:14.670641 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3714/6965] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:14.677283 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:14.687014 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4ba54f12-4ac9-4048-a994-d3be44368cda tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 200 len: 1510 microversion: 2.1 time: 0.092179 Jun 25 21:51:14.687014 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3252/6966] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:14 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:15.708498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:15.709670 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 7832afb1-70af-42e9-8b68-faff12a80fef] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:15.722245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:15.722975 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:15.724280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:15.725014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:15.739535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] HTTP exception thrown: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Request method failure captured: Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef HTTP/1.1 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4IJ5Mf4GSgrRbrBnln5dZq_oLFSwzaR-mwKoej_7ChchmJW-RorT9hZK5PauU780wDlQjVQpg2GHb9C9okV64HmEMc56WGbDk6iEooM94Z_CctRUP367QMHFbfE8kA3-vliSVjena2ASOMcyhT4Kk9GoNfTwUjLaw7SzhXM3VyOcdQ Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1aca77315704d338f4f0f881e741a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}] Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 53b9cc03262c41d682254f9cf61f34a0 Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '7832afb1-70af-42e9-8b68-faff12a80fef'} Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:51:15.741193 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Returning 404 to user: Instance 7832afb1-70af-42e9-8b68-faff12a80fef could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5f551fd2-c802-4d95-8205-0ef619e40c12 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef" status: 404 len: 111 microversion: 2.1 time: 0.041495 Jun 25 21:51:15.745846 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3715/6967] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:15 2022] GET /compute/v2.1/servers/7832afb1-70af-42e9-8b68-faff12a80fef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:51:15.751864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-eff2e097-23ea-4dab-888d-53322834b3ab tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '.version_select at 0x7f9862032b80>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:15.777427 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-eff2e097-23ea-4dab-888d-53322834b3ab tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107759653" status: 202 len: 0 microversion: 2.1 time: 0.029446 Jun 25 21:51:15.778008 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3253/6968] 10.222.0.39 () {58 vars in 1268 bytes} [Sat Jun 25 21:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107759653 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:51:24.682375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9ef01d28-d21a-48e3-804e-8b983603166c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: .version_select at 0x7f984e7779d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2034148806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCdlwxVuNsy732s2pLWvxp0bJhA2U502LtZTudSAFLpDEDxW5ZnaxRkhoPG3V4Klib3ZgTPpHf8oUraNQNwkEAa/mV3e83MBzPAOzDj4/Zd/IznPGVzPiNAJnUjH4glEUA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:24.701681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-9ef01d28-d21a-48e3-804e-8b983603166c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for project f1aca77315704d338f4f0f881e741a12. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:51:24.708234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-9ef01d28-d21a-48e3-804e-8b983603166c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for user 53b9cc03262c41d682254f9cf61f34a0 and project f1aca77315704d338f4f0f881e741a12. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:51:24.737038 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9ef01d28-d21a-48e3-804e-8b983603166c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058933 Jun 25 21:51:24.737655 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3716/6969] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:51:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:24.785738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=28 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:24.790064 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1865638211", "imageRef": "c277afa7-802c-4501-a8e6-7ef2031fe65b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2034148806", "networks": [{"uuid": "873ca98a-fc42-4464-851e-f847cc1ad4d6"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:24.842310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] validate_networks() for [('873ca98a-fc42-4464-851e-f847cc1ad4d6', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:51:25.342481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:51:25.342963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:51:25.343468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:51:25.343894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:51:25.344324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:51:25.357072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:25.357536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:25.358420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:25.358861 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:25.378947 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for project f1aca77315704d338f4f0f881e741a12. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:51:25.384503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Getting quotas for user 53b9cc03262c41d682254f9cf61f34a0 and project f1aca77315704d338f4f0f881e741a12. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:51:25.396880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:51:25.399144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c277afa7-802c-4501-a8e6-7ef2031fe65b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:51:25.452332 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a65262af-57b7-4d7a-83a7-25096ad8227d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668464 Jun 25 21:51:25.453041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3254/6970] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:51:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 21:51:25.463860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d1bba493-bd47-42a7-b782-ae10ef46e1e1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:25.464592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d1bba493-bd47-42a7-b782-ae10ef46e1e1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:25.519713 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d1bba493-bd47-42a7-b782-ae10ef46e1e1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:25.527157 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d1bba493-bd47-42a7-b782-ae10ef46e1e1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1259 microversion: 2.1 time: 0.067695 Jun 25 21:51:25.536437 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3717/6971] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:25 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:26.545456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:26.546938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:26.554058 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:26.555097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:26.558302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:26.559117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:26.627441 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:26.635197 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4c959569-aff9-4ba2-83a0-22cdabd5a9a3 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1329 microversion: 2.1 time: 0.095184 Jun 25 21:51:26.635782 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3255/6972] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:26 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1329 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:27.653085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:27.654446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:27.657685 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:27.664532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:27.665222 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:27.666082 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:27.666595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:27.813684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:27.826627 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d4619a01-3e2b-4e5c-9ef7-6f95516d7432 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.177515 Jun 25 21:51:27.827581 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3718/6973] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:27 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:28.843731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:28.844370 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:28.851874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:28.852368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:28.853212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:28.853663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:28.995029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:29.004493 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a675255b-a227-4be6-86a0-13ddca1568d0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.164679 Jun 25 21:51:29.005497 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3256/6974] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:28 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:30.021983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:30.022766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:30.030876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:30.031329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:30.032238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:30.032825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:30.172394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:30.181541 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7d42a746-09ac-43c0-8808-50b363a256b9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.163331 Jun 25 21:51:30.182133 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3719/6975] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:30 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:31.199734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:31.200416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:31.207115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:31.207586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:31.208407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:31.208934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:31.357849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:31.367254 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2bee1bc1-c981-4e27-89f1-f42064ae0bbe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.171633 Jun 25 21:51:31.368064 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3257/6976] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:31 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:32.385775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:32.386405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:32.393851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:32.394307 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:32.395097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:32.395509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:32.540006 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:32.548493 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6937b1c9-3f72-44ba-be4d-53efefc44622 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.166684 Jun 25 21:51:32.549098 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3720/6977] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:32 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:33.566111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:33.566706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:33.574513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:33.574977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:33.575773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:33.576221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:33.721108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:33.729472 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70533b23-3ea5-4b42-9266-1265a324f1d1 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.167561 Jun 25 21:51:33.730766 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3258/6978] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:33 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:34.750363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:34.751256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:34.761981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:34.762558 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:34.763627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:34.764157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:34.903852 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:34.915304 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-08ee8fa5-92c1-431f-9e04-958f5245f875 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.170926 Jun 25 21:51:34.916125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3721/6979] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:34 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:35.935281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:35.935987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:35.939160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:35.939913 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:35.947062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:35.947527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:35.948340 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:35.948816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:36.084997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:36.094923 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3e1292b4-efda-4019-aa97-7e73e6fef2a8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.164882 Jun 25 21:51:36.095516 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3259/6980] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:35 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:37.113174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:37.113928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:37.115985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:37.117141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:37.124725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:37.125282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:37.126350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:37.126907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:37.330629 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:37.339933 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c8bcf1f0-6370-4d1f-990b-49ca6774f185 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.231579 Jun 25 21:51:37.340564 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3722/6981] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:37 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:37.415749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-21c3e5c5-2318-4c58-8b85-c3d3920d66fa req-fb4e01b2-3349-4389-905e-69b77756f736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:37.426300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:37.429083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-21c3e5c5-2318-4c58-8b85-c3d3920d66fa req-fb4e01b2-3349-4389-905e-69b77756f736 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:37.429565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-21c3e5c5-2318-4c58-8b85-c3d3920d66fa req-fb4e01b2-3349-4389-905e-69b77756f736 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:37.444981 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-21c3e5c5-2318-4c58-8b85-c3d3920d66fa req-fb4e01b2-3349-4389-905e-69b77756f736 service nova] Creating event network-changed:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:51:37.451347 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-21c3e5c5-2318-4c58-8b85-c3d3920d66fa req-fb4e01b2-3349-4389-905e-69b77756f736 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039184 Jun 25 21:51:37.452784 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3260/6982] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:38.361320 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:38.362282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:38.372576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:38.373045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:38.373805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:38.374234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:38.525245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:38.533664 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2aed70e9-246c-4e83-bf4d-8ccd9182895a tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.178991 Jun 25 21:51:38.534249 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3723/6983] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:38 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:39.558357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:39.559640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:39.571954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:39.572799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:39.573765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:39.574214 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:39.718586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:39.726372 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8c10072d-53f6-44e3-8b33-4d9dac3750df tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.176882 Jun 25 21:51:39.726957 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3261/6984] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:39 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:40.747301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:40.748043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:40.757205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:40.757781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:40.758825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:40.759403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:40.906338 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:40.919663 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd89cabc-22b1-47d2-9e14-2ac15f23d4d5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.178480 Jun 25 21:51:40.920245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3724/6985] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:40 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:41.944060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:41.945106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:41.953760 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:41.954234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:41.955020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:41.955475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:42.094032 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:42.102355 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-faab272a-cf13-4a48-a659-71e539007608 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.165019 Jun 25 21:51:42.102912 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3262/6986] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:41 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:43.124223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:43.124862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:43.132134 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:43.132644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:43.133446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:43.133867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:43.286231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:43.294685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81d4e9f5-7ad3-4de0-bddb-04797475685c tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.174488 Jun 25 21:51:43.295332 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3725/6987] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:43 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:44.312168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:44.312827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:44.320306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:44.320839 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:44.321601 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:44.322081 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:44.466582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:44.474746 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1855fc82-06bc-42fe-8f96-dbe876f98b89 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.166735 Jun 25 21:51:44.475346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3263/6988] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:44 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:44.658199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-b263c88b-77da-41aa-8aa9-cb4391df2711 req-687a1d16-f290-495d-8b9f-da2c84e8dccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "name": "network-vif-plugged", "status": "completed", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:44.669925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b263c88b-77da-41aa-8aa9-cb4391df2711 req-687a1d16-f290-495d-8b9f-da2c84e8dccb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:44.670529 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-b263c88b-77da-41aa-8aa9-cb4391df2711 req-687a1d16-f290-495d-8b9f-da2c84e8dccb service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:44.681771 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-b263c88b-77da-41aa-8aa9-cb4391df2711 req-687a1d16-f290-495d-8b9f-da2c84e8dccb service nova] Creating event network-vif-plugged:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:51:44.687045 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-b263c88b-77da-41aa-8aa9-cb4391df2711 req-687a1d16-f290-495d-8b9f-da2c84e8dccb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094911 Jun 25 21:51:44.687827 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3726/6989] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:45.495553 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:45.496746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:45.508584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:45.509361 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:45.510648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:45.511402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:45.659651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:45.667647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f5c608ea-1ee4-42a7-bc46-7bda6032224b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1359 microversion: 2.1 time: 0.178906 Jun 25 21:51:45.668244 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3264/6990] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:45 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:46.693963 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:46.695119 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:46.702477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:46.702925 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:46.703688 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:46.704122 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:46.842910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:46.850697 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83bc494d-fb2a-4028-820c-eac43824f696 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1548 microversion: 2.1 time: 0.163722 Jun 25 21:51:46.851275 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3727/6991] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:46 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:46.867184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:46.867894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:46.875386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:46.875854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:46.876665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:46.877107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:47.017421 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:47.028760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1f48ecf4-48d0-4348-badf-331ea69b717b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1548 microversion: 2.1 time: 0.165543 Jun 25 21:51:47.029459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3265/6992] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:46 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:47.045217 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:47.048465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:47.049244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Searching by: {'deleted': False, 'project_id': 'f1aca77315704d338f4f0f881e741a12'} {{(pid=137461) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 21:51:47.055034 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:47.055485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:47.056267 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:47.056762 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:47.083877 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.multi_cell_list [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137461) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 21:51:47.110772 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-158b181c-177e-45a3-b33b-28a18fe924fe tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069547 Jun 25 21:51:47.111357 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3728/6993] 10.222.0.39 () {58 vars in 1124 bytes} [Sat Jun 25 21:51:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:47.122142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:47.122770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:47.129304 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:47.129803 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:47.130581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:47.131029 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:47.264082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:47.272174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5f9f7812-3ea6-487e-992b-30c806e14a24 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1548 microversion: 2.1 time: 0.154073 Jun 25 21:51:47.272996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3266/6994] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:47 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:48.789939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1048aa47-e900-4c3e-8db7-58c5919f6ae3"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:48.791399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:48.804446 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:48.804914 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:48.805694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:48.806175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:49.053826 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-dbc4ada3-ab18-4170-8e96-2342bd39ab42 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270280 Jun 25 21:51:49.054561 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3729/6995] 10.222.0.39 () {60 vars in 1322 bytes} [Sat Jun 25 21:51:48 2022] POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:49.108136 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:51:49.108295 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:51:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:51:52.416045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:52.416711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:52.426643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:52.427111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:52.427923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:52.428373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:52.561270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:52.569733 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ab82950-89a1-4c45-8f7b-715f103fd9f9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1594 microversion: 2.1 time: 0.157669 Jun 25 21:51:52.570326 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3267/6996] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:52 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:54.427699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-676719d9-650a-4bf7-a34f-9c40d224d846 req-9f90e2c0-3ce2-4314-a4b7-ba7566b4b9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:54.440512 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-676719d9-650a-4bf7-a34f-9c40d224d846 req-9f90e2c0-3ce2-4314-a4b7-ba7566b4b9bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:54.441001 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-676719d9-650a-4bf7-a34f-9c40d224d846 req-9f90e2c0-3ce2-4314-a4b7-ba7566b4b9bf service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:54.452895 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-676719d9-650a-4bf7-a34f-9c40d224d846 req-9f90e2c0-3ce2-4314-a4b7-ba7566b4b9bf service nova] Creating event network-changed:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:51:54.458269 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-676719d9-650a-4bf7-a34f-9c40d224d846 req-9f90e2c0-3ce2-4314-a4b7-ba7566b4b9bf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104501 Jun 25 21:51:54.458879 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3730/6997] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:51:55.306679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1595856412"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:55.307253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:55.316655 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:55.317131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:55.317963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:55.318416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:55.321330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=77 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:51:55.454208 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.network.security_group_api [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Adding security group 6aee2e19-08fe-4548-8d25-43875f6173db to port d5d2c211-b937-4178-8907-0a5fb5ff12ef Jun 25 21:51:55.827239 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-31a0bc35-10ac-4014-a84c-ca143d042d28 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action" status: 202 len: 0 microversion: 2.1 time: 0.525440 Jun 25 21:51:55.827372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3268/6998] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:51:55 2022] POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:51:55.837092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:51:55.838771 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:51:55.847581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:55.847581 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:55.848137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:55.848840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:56.031112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:51:56.041037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-985ca64a-ab3d-4d49-a66f-9f8b392aeca5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1759 microversion: 2.1 time: 0.209033 Jun 25 21:51:56.042397 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3731/6999] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:51:55 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:51:56.477999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-99fc9849-35c1-4176-abd0-ccffca3c4af8 req-5058ed05-c05b-4aea-a2dc-cb4af47549a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:51:56.486391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-99fc9849-35c1-4176-abd0-ccffca3c4af8 req-5058ed05-c05b-4aea-a2dc-cb4af47549a4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:51:56.486853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-99fc9849-35c1-4176-abd0-ccffca3c4af8 req-5058ed05-c05b-4aea-a2dc-cb4af47549a4 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:51:56.498760 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-99fc9849-35c1-4176-abd0-ccffca3c4af8 req-5058ed05-c05b-4aea-a2dc-cb4af47549a4 service nova] Creating event network-changed:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:51:56.504098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-99fc9849-35c1-4176-abd0-ccffca3c4af8 req-5058ed05-c05b-4aea-a2dc-cb4af47549a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 Jun 25 21:51:56.504864 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3269/7000] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:52:56.577956 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:56.579136 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=19 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:56.580085 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:56.585736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:52:56.586760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:52:56.595575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:56.596013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:56.596795 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:56.597229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:56.685510 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91e12d72-5c94-44a0-8ca5-829b3d456a44 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action" status: 202 len: 0 microversion: 2.1 time: 0.109622 Jun 25 21:52:56.686176 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3732/7001] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:52:56 2022] POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:52:56.693617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=19 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:56.694853 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=5 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:52:56.699791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:52:56.700721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:52:56.708838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:56.709310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:56.710153 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:56.710632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:56.862847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:52:56.873271 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-affe8869-a2a9-4132-9d34-79c4178af4d8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1751 microversion: 2.1 time: 0.182204 Jun 25 21:52:56.874385 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3270/7002] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:52:56 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:52:57.895191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:52:57.896051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:52:57.904415 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:57.905025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:57.905980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:57.906487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:58.053345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:52:58.066410 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-166affd9-0b87-4c1a-ac45-c1085cae8a84 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.177597 Jun 25 21:52:58.067231 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3733/7003] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:52:57 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:52:59.096932 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:52:59.098017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:52:59.109783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:59.110552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:59.111852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:52:59.112647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:52:59.600501 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:52:59.612858 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-036c0706-2bc2-4c6f-bdc5-08fc6586854f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.522741 Jun 25 21:52:59.613434 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3271/7004] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:52:59 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:00.639797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:00.640848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:00.649453 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:00.649917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:00.650680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:00.651120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:00.800143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:00.808531 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2f5b5255-4bc5-4788-83cf-805b87bb8a5d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.175344 Jun 25 21:53:00.809130 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3734/7005] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:00 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:01.832321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:01.832991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:01.841020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:01.841493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:01.842296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:01.842755 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:02.003944 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:02.015486 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4758a18b-9df4-4db9-884e-f5fc67d3f6f5 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.190053 Jun 25 21:53:02.016320 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3272/7006] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:01 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:03.037345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:03.038110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:03.047913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:03.048562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:03.049591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:03.050178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:03.199550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:03.212720 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2af6bebd-c755-43f6-b7ac-d056a14e6f0b tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.180742 Jun 25 21:53:03.213548 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3735/7007] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:03 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:04.237751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:04.238922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:04.247222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:04.247746 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:04.248765 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:04.249277 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:04.397727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:04.410804 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1b56bf68-08d4-493b-a97e-ec67791a6fb9 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.179546 Jun 25 21:53:04.411404 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3273/7008] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:04 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:05.428332 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:05.428965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:05.436392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:05.436881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:05.437635 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:05.438072 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:05.586915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:05.597266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65a8f450-0050-44ae-8db3-f9012cd80a54 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.172968 Jun 25 21:53:05.597843 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3736/7009] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:05 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:06.618956 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:06.619994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:06.631627 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:06.632090 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:06.632911 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:06.633360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:06.788680 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:06.797448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-043dae0f-8950-4605-a630-a1493057edff tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.185067 Jun 25 21:53:06.798042 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3274/7010] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:06 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:07.820488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:07.821535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:07.832589 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:07.833303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:07.834568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:07.835013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:07.980190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:07.992047 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7235344f-7b0c-45b8-8fa5-e12c511083bc tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1756 microversion: 2.1 time: 0.179627 Jun 25 21:53:07.992699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3737/7011] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:07 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:09.013896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:53:09.014920 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:53:09.026679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:09.027637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:09.029319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:53:09.029993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:53:09.187406 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:53:09.197144 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9b396a6-5651-47cd-8bc8-2f5e47a3d351 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1759 microversion: 2.1 time: 0.190008 Jun 25 21:53:09.197738 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3275/7012] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:53:09 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1759 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:53:57.932376 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:53:57.934183 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:53:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:54:04.622358 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1595856412"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:04.623368 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:04.626867 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:04.627802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:04.634426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:04.634879 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:04.635645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:04.636079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:04.777496 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.network.security_group_api [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Removing security group 6aee2e19-08fe-4548-8d25-43875f6173db from port d5d2c211-b937-4178-8907-0a5fb5ff12ef Jun 25 21:54:05.126275 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4466262f-1ed1-44cd-8a6e-fd2773fbdea8 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action" status: 202 len: 0 microversion: 2.1 time: 0.511133 Jun 25 21:54:05.126966 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3738/7013] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:54:04 2022] POST /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:54:05.150767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-95da8613-8a9a-4d22-a9e3-4d3c9ad8b282 req-3ef62bbc-60c1-4a68-b395-f25519ea9623 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:05.165395 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:05.167006 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=36 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:05.170024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-95da8613-8a9a-4d22-a9e3-4d3c9ad8b282 req-3ef62bbc-60c1-4a68-b395-f25519ea9623 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:05.171050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-95da8613-8a9a-4d22-a9e3-4d3c9ad8b282 req-3ef62bbc-60c1-4a68-b395-f25519ea9623 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:05.193199 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-95da8613-8a9a-4d22-a9e3-4d3c9ad8b282 req-3ef62bbc-60c1-4a68-b395-f25519ea9623 service nova] Creating event network-changed:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:54:05.209281 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-95da8613-8a9a-4d22-a9e3-4d3c9ad8b282 req-3ef62bbc-60c1-4a68-b395-f25519ea9623 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075924 Jun 25 21:54:05.210504 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3276/7014] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:06.247042 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:06.247615 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-ca0efc59-f206-400d-bd69-8c5f521ab43a req-34685e6e-2fb9-4715-bbd1-c469fa72a588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:06.247997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:06.254396 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:06.254844 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:06.255631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:06.256084 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:06.258869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ca0efc59-f206-400d-bd69-8c5f521ab43a req-34685e6e-2fb9-4715-bbd1-c469fa72a588 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:06.259431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-ca0efc59-f206-400d-bd69-8c5f521ab43a req-34685e6e-2fb9-4715-bbd1-c469fa72a588 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:06.271230 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-ca0efc59-f206-400d-bd69-8c5f521ab43a req-34685e6e-2fb9-4715-bbd1-c469fa72a588 service nova] Creating event network-changed:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:54:06.276714 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-ca0efc59-f206-400d-bd69-8c5f521ab43a req-34685e6e-2fb9-4715-bbd1-c469fa72a588 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033515 Jun 25 21:54:06.277510 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3277/7015] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:06.347704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lazy-loading 'services' on Instance uuid 85745d57-3270-4d05-ab44-76573bda23f2 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:54:06.425004 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd8592ef-88a6-415f-ba9f-9dce4d84b422 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments/1048aa47-e900-4c3e-8db7-58c5919f6ae3" status: 202 len: 0 microversion: 2.1 time: 0.184000 Jun 25 21:54:06.426390 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3739/7016] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:54:06 2022] DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments/1048aa47-e900-4c3e-8db7-58c5919f6ae3 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:54:06.435907 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:06.437541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:06.444991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:06.445715 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:06.447109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:06.448008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:06.483421 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-15d068fe-4c4e-486e-bee1-725fefadd64f tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052244 Jun 25 21:54:06.484078 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3278/7017] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:54:06 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:07.502277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:07.503378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:07.510549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:07.511004 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:07.511761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:07.512195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:07.541752 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9dff76d9-6b89-4770-aac2-b757041cf6a0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048408 Jun 25 21:54:07.542309 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3740/7018] 10.222.0.39 () {58 vars in 1301 bytes} [Sat Jun 25 21:54:07 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 21:54:07.555206 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:07.555770 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:07.565896 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:07.566377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:07.567205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:07.567647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:07.646552 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] HTTP exception thrown: Instance 85745d57-3270-4d05-ab44-76573bda23f2 is not attached to volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Request method failure captured: Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: request: DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments/1048aa47-e900-4c3e-8db7-58c5919f6ae3 HTTP/1.1 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4IJ5Mf4GSgrRbrBnln5dZq_oLFSwzaR-mwKoej_7ChchmJW-RorT9hZK5PauU780wDlQjVQpg2GHb9C9okV64HmEMc56WGbDk6iEooM94Z_CctRUP367QMHFbfE8kA3-vliSVjena2ASOMcyhT4Kk9GoNfTwUjLaw7SzhXM3VyOcdQ Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1aca77315704d338f4f0f881e741a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}] Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 53b9cc03262c41d682254f9cf61f34a0 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 85745d57-3270-4d05-ab44-76573bda23f2 is not attached to volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'server_id': '85745d57-3270-4d05-ab44-76573bda23f2', 'id': '1048aa47-e900-4c3e-8db7-58c5919f6ae3'} Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1048aa47-e900-4c3e-8db7-58c5919f6ae3. Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85745d57-3270-4d05-ab44-76573bda23f2 is not attached to volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3 Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:54:07.648239 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85745d57-3270-4d05-ab44-76573bda23f2 is not attached to volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3 Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Returning 404 to user: Instance 85745d57-3270-4d05-ab44-76573bda23f2 is not attached to volume 1048aa47-e900-4c3e-8db7-58c5919f6ae3 {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fcc73a79-d15a-4354-9a0e-33465f3ca6ae tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments/1048aa47-e900-4c3e-8db7-58c5919f6ae3" status: 404 len: 154 microversion: 2.1 time: 0.101095 Jun 25 21:54:07.652883 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3279/7019] 10.222.0.39 () {58 vars in 1415 bytes} [Sat Jun 25 21:54:07 2022] DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2/os-volume_attachments/1048aa47-e900-4c3e-8db7-58c5919f6ae3 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:54:08.802251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:08.802845 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:08.810260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:08.810724 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:08.811496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:08.811935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:08.838126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:54:08.918412 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-91df29b0-a7b7-4842-9362-19d97060ba20 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 204 len: 0 microversion: 2.1 time: 0.120399 Jun 25 21:54:08.919015 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3741/7020] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:54:08 2022] DELETE /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:54:08.927851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:08.928532 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:08.935724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:08.936201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:08.937010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:08.937469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:09.075030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:09.083267 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c696aa4c-c76d-488b-9381-adf075a5f25d tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1554 microversion: 2.1 time: 0.159470 Jun 25 21:54:09.083845 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3280/7021] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:08 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:10.101550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:10.102108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:10.110221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:10.110674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:10.111437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:10.111920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:10.253280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:10.261477 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2283473d-1bba-4b59-a6d5-94cf43adf092 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1554 microversion: 2.1 time: 0.164505 Jun 25 21:54:10.262063 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3742/7022] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:10 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:11.278995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:11.279609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:11.286804 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:11.287273 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:11.288048 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:11.288515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:11.369482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53b9cc03262c41d682254f9cf61f34a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1aca77315704d338f4f0f881e741a12', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:11.373420 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-21d28fdf-2162-4f97-9ca3-d2a8a432de22 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 200 len: 1512 microversion: 2.1 time: 0.098387 Jun 25 21:54:11.373996 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3281/7023] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:11 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 1512 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:11.397462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d54e39b7-6c6e-4967-a314-95e4674ecc1d req-f1952063-4917-4553-be8b-0f48a026adfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85745d57-3270-4d05-ab44-76573bda23f2", "name": "network-vif-deleted", "tag": "d5d2c211-b937-4178-8907-0a5fb5ff12ef"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:11.406283 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d54e39b7-6c6e-4967-a314-95e4674ecc1d req-f1952063-4917-4553-be8b-0f48a026adfa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:11.406750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d54e39b7-6c6e-4967-a314-95e4674ecc1d req-f1952063-4917-4553-be8b-0f48a026adfa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:11.418619 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d54e39b7-6c6e-4967-a314-95e4674ecc1d req-f1952063-4917-4553-be8b-0f48a026adfa service nova] Creating event network-vif-deleted:d5d2c211-b937-4178-8907-0a5fb5ff12ef for instance 85745d57-3270-4d05-ab44-76573bda23f2 on nch2-master-1 Jun 25 21:54:11.425005 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d54e39b7-6c6e-4967-a314-95e4674ecc1d req-f1952063-4917-4553-be8b-0f48a026adfa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031106 Jun 25 21:54:11.425682 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3743/7024] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:12.394903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:12.395510 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] [instance: 85745d57-3270-4d05-ab44-76573bda23f2] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:12.403015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:12.403478 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:12.404257 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:12.404734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:12.418584 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] HTTP exception thrown: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Request method failure captured: Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 HTTP/1.1 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4IJ5Mf4GSgrRbrBnln5dZq_oLFSwzaR-mwKoej_7ChchmJW-RorT9hZK5PauU780wDlQjVQpg2GHb9C9okV64HmEMc56WGbDk6iEooM94Z_CctRUP367QMHFbfE8kA3-vliSVjena2ASOMcyhT4Kk9GoNfTwUjLaw7SzhXM3VyOcdQ Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_f1aca77315704d338f4f0f881e741a12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/f1aca77315704d338f4f0f881e741a12"}]}] Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: f1aca77315704d338f4f0f881e741a12 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestMinimumBasicScenario-700856057 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 53b9cc03262c41d682254f9cf61f34a0 Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestMinimumBasicScenario-700856057-project Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '85745d57-3270-4d05-ab44-76573bda23f2'} Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:54:12.420133 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Returning 404 to user: Instance 85745d57-3270-4d05-ab44-76573bda23f2 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f951fc75-b156-4371-bc3d-7f4a0fc39de0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2" status: 404 len: 111 microversion: 2.1 time: 0.034000 Jun 25 21:54:12.429425 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3282/7025] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:12 2022] GET /compute/v2.1/servers/85745d57-3270-4d05-ab44-76573bda23f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:54:12.434584 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-42409d4a-4348-46ec-8c03-1274e81c3ea0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] Calling method '.version_select at 0x7f984ef89e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:12.465059 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-42409d4a-4348-46ec-8c03-1274e81c3ea0 tempest-TestMinimumBasicScenario-700856057 tempest-TestMinimumBasicScenario-700856057-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034148806" status: 202 len: 0 microversion: 2.1 time: 0.036457 Jun 25 21:54:12.465976 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3744/7026] 10.222.0.39 () {58 vars in 1271 bytes} [Sat Jun 25 21:54:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2034148806 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:54:21.750225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-23209bd8-c76a-477e-8ed4-e3fa1022d471 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: .version_select at 0x7f984f3fadc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1289138760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDxWxoPJFT4ly/bIzW6aM/9uoJO6hsWve4WbaC/sRP/JesT32XqL5NTF8PpBrAR+eMZlzTz6+YCbtIV42IRcYPRIFgjZLIgsQLldh8uZwbHm/T3pfMDRJ86PHb0aRj4Yg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:21.764881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-23209bd8-c76a-477e-8ed4-e3fa1022d471 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:54:21.771063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-23209bd8-c76a-477e-8ed4-e3fa1022d471 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:54:21.804375 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-23209bd8-c76a-477e-8ed4-e3fa1022d471 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.229108 Jun 25 21:54:21.805069 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3283/7027] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:54:21 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:27.570373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:27.571503 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:27.577735 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-133829374", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "49b8e6a2-5604-4e91-a059-022314cb3e44"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1289138760", "security_groups": [{"name": "tempest-secgroup-smoke-1747293705"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:27.712410 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] validate_networks() for [('49b8e6a2-5604-4e91-a059-022314cb3e44', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:54:28.263089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:54:28.263588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:54:28.264397 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:54:28.265076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:54:28.265596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:54:28.281681 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:28.282284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:28.283198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:28.283741 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:28.303790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:54:28.309508 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:54:28.323301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:54:28.325758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:54:28.379036 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-155f7633-7cf0-4e17-a9af-d831411843bf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.810418 Jun 25 21:54:28.384847 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3745/7028] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:54:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:54:28.390546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0735cee0-e81b-4e87-bd31-4f951b515342 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:28.391318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0735cee0-e81b-4e87-bd31-4f951b515342 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:28.394866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=30 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:28.456337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0735cee0-e81b-4e87-bd31-4f951b515342 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:28.465425 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0735cee0-e81b-4e87-bd31-4f951b515342 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1266 microversion: 2.1 time: 0.078972 Jun 25 21:54:28.466040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3284/7029] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:28 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:29.484012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:29.484488 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:29.493534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:29.494421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:29.495769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:29.496373 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:30.023659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:30.031685 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e35846d3-4522-47c7-896b-545663240379 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1326 microversion: 2.1 time: 0.552412 Jun 25 21:54:30.044982 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3746/7030] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:29 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1326 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:31.049496 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:31.050125 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:31.061423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:31.062168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:31.063299 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:31.064111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:31.206425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:31.215140 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1ac1381d-3b59-482f-b308-b139d22b9a26 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.169691 Jun 25 21:54:31.216251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3285/7031] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:31 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:31.454514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4039e72c-186f-4b97-b0b2-8209feeb04fa req-b807453f-86f4-4273-aec0-73162ffd4a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a62ff94-7171-4c62-a3f3-a320c244063c", "tag": "ec2023a0-b2f1-4c01-8a72-69599127e2f1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:31.464322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4039e72c-186f-4b97-b0b2-8209feeb04fa req-b807453f-86f4-4273-aec0-73162ffd4a05 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:31.467874 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4039e72c-186f-4b97-b0b2-8209feeb04fa req-b807453f-86f4-4273-aec0-73162ffd4a05 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:31.483209 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4039e72c-186f-4b97-b0b2-8209feeb04fa req-b807453f-86f4-4273-aec0-73162ffd4a05 service nova] Creating event network-changed:ec2023a0-b2f1-4c01-8a72-69599127e2f1 for instance 0a62ff94-7171-4c62-a3f3-a320c244063c on nch2-master-1 Jun 25 21:54:31.488391 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4039e72c-186f-4b97-b0b2-8209feeb04fa req-b807453f-86f4-4273-aec0-73162ffd4a05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037458 Jun 25 21:54:31.489041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3747/7032] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:32.232752 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:32.233391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:32.240734 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:32.241208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:32.241998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:32.242458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:32.378683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:32.386343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fa353432-d68d-4426-b152-abd2a83e16da tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.157609 Jun 25 21:54:32.386934 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3286/7033] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:32 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:33.409828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:33.410863 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:33.421759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:33.422518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:33.423892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:33.424674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:33.578098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:33.591211 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ccb8bf82-e3a0-4fb0-b740-8f3165907514 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.189976 Jun 25 21:54:33.592094 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3748/7034] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:33 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:34.614195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:34.614871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:34.625623 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:34.626288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:34.627403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:34.628031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:34.766585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:34.774884 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fe480aa9-a634-405e-91c9-89a7d9bebc4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.167041 Jun 25 21:54:34.775486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3287/7035] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:34 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:35.793326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:35.793974 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:35.802121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:35.802702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:35.803469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:35.803904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:35.942426 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:35.950830 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8d805cdf-f58d-4127-9694-b0b1d050e4ad tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.161835 Jun 25 21:54:35.951524 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3749/7036] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:35 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:36.972308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:36.973417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:36.977766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:36.987456 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:36.988250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:36.989619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:36.990331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:37.130069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:37.138120 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a1390cc7-b67c-49df-9aca-a3ccf02cd140 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.172438 Jun 25 21:54:37.138697 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3288/7037] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:36 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:37.662926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-df05c962-c55a-4a7d-85e4-355d7cfe1cf8 req-ee00f6b4-e861-4da6-b44b-ae833d5888bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a62ff94-7171-4c62-a3f3-a320c244063c", "name": "network-vif-plugged", "status": "completed", "tag": "ec2023a0-b2f1-4c01-8a72-69599127e2f1"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:37.673176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-df05c962-c55a-4a7d-85e4-355d7cfe1cf8 req-ee00f6b4-e861-4da6-b44b-ae833d5888bc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:37.673625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-df05c962-c55a-4a7d-85e4-355d7cfe1cf8 req-ee00f6b4-e861-4da6-b44b-ae833d5888bc service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:37.685020 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-df05c962-c55a-4a7d-85e4-355d7cfe1cf8 req-ee00f6b4-e861-4da6-b44b-ae833d5888bc service nova] Creating event network-vif-plugged:ec2023a0-b2f1-4c01-8a72-69599127e2f1 for instance 0a62ff94-7171-4c62-a3f3-a320c244063c on nch2-master-1 Jun 25 21:54:37.690558 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-df05c962-c55a-4a7d-85e4-355d7cfe1cf8 req-ee00f6b4-e861-4da6-b44b-ae833d5888bc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Jun 25 21:54:37.691189 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3750/7038] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:38.156638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:38.157407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:38.165681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:38.166147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:38.166918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:38.167363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:38.314508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:38.322755 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-807483a6-4af2-4334-8c2f-e2e1dbb97e04 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1392 microversion: 2.1 time: 0.171124 Jun 25 21:54:38.323671 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3289/7039] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:38 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:39.340284 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:39.341754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:39.349997 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:39.351252 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:39.358524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:39.358986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:39.359748 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:39.360190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:39.505067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:39.517069 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-18a54f55-1988-49ab-bd8f-e03b0b5f0201 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1563 microversion: 2.1 time: 0.178426 Jun 25 21:54:39.517917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3751/7040] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:39 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1563 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:54:39.535902 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:39.536531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:39.538517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:54:39.544799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:39.545250 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:39.546016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:39.546458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:39.689798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:39.697961 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-16b3b082-f291-4eed-9c19-2b76ab1ab152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1563 microversion: 2.1 time: 0.166042 Jun 25 21:54:39.698538 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3290/7041] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:39 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:54:41.646352 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:54:41.647067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:54:41.647905 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-dd12de2c-4cb3-4cb9-84e7-14891a086191 req-5ec82a9d-3b61-404c-a632-250b5b26721d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a62ff94-7171-4c62-a3f3-a320c244063c", "tag": "ec2023a0-b2f1-4c01-8a72-69599127e2f1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:54:41.654306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:41.654820 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:41.655538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:41.656054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:41.658386 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dd12de2c-4cb3-4cb9-84e7-14891a086191 req-5ec82a9d-3b61-404c-a632-250b5b26721d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:54:41.659050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-dd12de2c-4cb3-4cb9-84e7-14891a086191 req-5ec82a9d-3b61-404c-a632-250b5b26721d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:54:41.671530 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-dd12de2c-4cb3-4cb9-84e7-14891a086191 req-5ec82a9d-3b61-404c-a632-250b5b26721d service nova] Creating event network-changed:ec2023a0-b2f1-4c01-8a72-69599127e2f1 for instance 0a62ff94-7171-4c62-a3f3-a320c244063c on nch2-master-1 Jun 25 21:54:41.677417 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-dd12de2c-4cb3-4cb9-84e7-14891a086191 req-5ec82a9d-3b61-404c-a632-250b5b26721d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033153 Jun 25 21:54:41.678388 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3291/7042] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:54:41.892118 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:54:41.900959 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-722eb474-ee7a-4799-b422-a820c05a52eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1563 microversion: 2.1 time: 0.258964 Jun 25 21:54:41.902250 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3752/7043] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:54:41 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1563 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:15.274145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:15.275520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:15.278777 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=7 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:15.279810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=38 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:15.291409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:15.291957 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:15.292794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:15.293269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:15.352319 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a2eecb3-3fd2-4cdf-a4da-1111240d69cf tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action" status: 200 len: 24574 microversion: 2.1 time: 0.083980 Jun 25 21:55:15.352982 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3292/7044] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:55:15 2022] POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action => generated 24574 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:55:45.789489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:45.790689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=36 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:45.797301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:45.797833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:45.805881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:45.806326 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:45.807094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:45.807528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:45.880183 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-db84aafa-0da9-4b82-a9a5-a73653cfb770 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action" status: 202 len: 0 microversion: 2.1 time: 0.093833 Jun 25 21:55:45.880983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3753/7045] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:55:45 2022] POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:55:45.890191 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:45.890970 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:45.893783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:45.894491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:55:45.901101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:45.901571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:45.902363 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:45.902814 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:46.038338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:46.048697 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cf1ce069-238b-49ed-8720-9546ff7be9c5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1687 microversion: 2.1 time: 0.162752 Jun 25 21:55:46.049212 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3293/7046] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:45 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:47.067649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:47.068528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:47.076586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:47.076973 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:47.077789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:47.078234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:47.224187 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:47.232417 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8f12946b-669d-45a0-b5e3-768bb36740d5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1667 microversion: 2.1 time: 0.169879 Jun 25 21:55:47.233134 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3754/7047] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:47 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:48.327053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:48.328665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:48.342382 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.343204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.344459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.344904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.397188 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d826e8a2-c4da-4c63-be4c-3eca6224db23 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action" status: 200 len: 32647 microversion: 2.1 time: 0.076820 Jun 25 21:55:48.397862 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3294/7048] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:55:48 2022] POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action => generated 32647 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:55:48.409386 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:48.409935 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:48.417450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.417902 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.418675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.419099 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.495082 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3f04e80-49ce-46fb-8d5b-2b284e13bf1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action" status: 202 len: 0 microversion: 2.1 time: 0.089229 Jun 25 21:55:48.496060 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3755/7049] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:55:48 2022] POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:55:48.506252 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:48.507094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:48.514925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.515444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.516335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:48.516824 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:48.658337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:48.667098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-73c8df50-d2ac-49cc-8811-1d4df9d69805 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1674 microversion: 2.1 time: 0.165205 Jun 25 21:55:48.667938 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3295/7050] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:48 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:49.692255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:49.693455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:49.704149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:49.704636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:49.705399 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:49.705838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:49.852989 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:49.861108 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-55efe5b7-468c-4947-9751-2fb78aea610a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1682 microversion: 2.1 time: 0.177633 Jun 25 21:55:49.861658 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3756/7051] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:49 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:49.954872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:49.955794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:49.964170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:49.964682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:49.965462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:49.966559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:50.016835 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5d41302c-5d46-401a-beb7-481159366611 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action" status: 200 len: 36719 microversion: 2.1 time: 0.065987 Jun 25 21:55:50.017481 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3296/7052] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:55:49 2022] POST /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c/action => generated 36719 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:55:51.069935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f4eb4644-7fe8-420d-bfb7-931f421f0b00 req-4019abae-1a23-457f-9931-08a2138a4e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a62ff94-7171-4c62-a3f3-a320c244063c", "tag": "ec2023a0-b2f1-4c01-8a72-69599127e2f1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:51.071149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:51.072121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:51.079481 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:51.079915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:51.080117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f4eb4644-7fe8-420d-bfb7-931f421f0b00 req-4019abae-1a23-457f-9931-08a2138a4e39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:51.080634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f4eb4644-7fe8-420d-bfb7-931f421f0b00 req-4019abae-1a23-457f-9931-08a2138a4e39 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:51.080790 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:51.081142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:51.092599 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f4eb4644-7fe8-420d-bfb7-931f421f0b00 req-4019abae-1a23-457f-9931-08a2138a4e39 service nova] Creating event network-changed:ec2023a0-b2f1-4c01-8a72-69599127e2f1 for instance 0a62ff94-7171-4c62-a3f3-a320c244063c on nch2-master-1 Jun 25 21:55:51.097603 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f4eb4644-7fe8-420d-bfb7-931f421f0b00 req-4019abae-1a23-457f-9931-08a2138a4e39 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031852 Jun 25 21:55:51.098301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3297/7053] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:55:51.108058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:55:51.202657 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-72900da7-b626-4d78-93a8-1e966c111105 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 204 len: 0 microversion: 2.1 time: 0.136923 Jun 25 21:55:51.203203 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3757/7054] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:55:51 2022] DELETE /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:55:51.213989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:51.214727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:51.221371 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:51.221849 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:51.222800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:51.223261 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:51.363916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:51.371926 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-82450dcb-6aea-44d8-a015-2b160ff22521 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1688 microversion: 2.1 time: 0.163469 Jun 25 21:55:51.372531 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3298/7055] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:51 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:52.394919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:52.395604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:52.402926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:52.403377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:52.404166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:52.404645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:52.630056 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:52.638262 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-260cdefe-f3e2-45c2-bc1d-01b9bd783f98 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1688 microversion: 2.1 time: 0.248533 Jun 25 21:55:52.638829 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3758/7056] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:52 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:53.428194 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-1de5eec6-54c1-4b60-bc11-41e33ad932fa req-47b0a550-60ea-46d0-a13c-5348efa1da75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a62ff94-7171-4c62-a3f3-a320c244063c", "name": "network-vif-deleted", "tag": "ec2023a0-b2f1-4c01-8a72-69599127e2f1"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:53.437790 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1de5eec6-54c1-4b60-bc11-41e33ad932fa req-47b0a550-60ea-46d0-a13c-5348efa1da75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:53.438249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-1de5eec6-54c1-4b60-bc11-41e33ad932fa req-47b0a550-60ea-46d0-a13c-5348efa1da75 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:53.450038 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-1de5eec6-54c1-4b60-bc11-41e33ad932fa req-47b0a550-60ea-46d0-a13c-5348efa1da75 service nova] Creating event network-vif-deleted:ec2023a0-b2f1-4c01-8a72-69599127e2f1 for instance 0a62ff94-7171-4c62-a3f3-a320c244063c on nch2-master-1 Jun 25 21:55:53.455434 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-1de5eec6-54c1-4b60-bc11-41e33ad932fa req-47b0a550-60ea-46d0-a13c-5348efa1da75 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031071 Jun 25 21:55:53.456299 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3299/7057] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:55:53.655737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:53.656343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:53.663780 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:53.664238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:53.665051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:53.665485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:53.700878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:53.701304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:53.701927 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lazy-loading 'fault' on Instance uuid 0a62ff94-7171-4c62-a3f3-a320c244063c {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:55:53.744695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:55:53.753769 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30ae2065-733f-4840-87bf-9fd57ab80878 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 200 len: 1356 microversion: 2.1 time: 0.102046 Jun 25 21:55:53.754641 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3759/7058] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:53 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:55:54.778514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:54.779690 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 0a62ff94-7171-4c62-a3f3-a320c244063c] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:55:54.790922 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:54.791695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:54.793041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:55:54.793797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:55:54.809690 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] HTTP exception thrown: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Request method failure captured: Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c HTTP/1.1 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4QMYUYeio3FZyMcn97N9XjzllnBawFJ_8kR8mRSjIg3OcbmrP53pmI7j8VQ8sR-tyPmIMxtRojnkXh7pMcUeQX1LGXwQmxhFleyNWLP9tB8StwnJJm_mfK05iK9Ey4dP6cKG-OxmFpM20QDMFNB8baSAud-MBjidrJOyyIO37Eoltc Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}] Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3f346fe40c774c4cb8f0f93413823b1f Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '0a62ff94-7171-4c62-a3f3-a320c244063c'} Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:55:54.811404 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Returning 404 to user: Instance 0a62ff94-7171-4c62-a3f3-a320c244063c could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cd169249-71a2-47ee-8d53-94aa947362e8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c" status: 404 len: 111 microversion: 2.1 time: 0.043093 Jun 25 21:55:54.815817 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3300/7059] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:55:54 2022] GET /compute/v2.1/servers/0a62ff94-7171-4c62-a3f3-a320c244063c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:55:58.135215 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-57f054ba-0774-4ffa-a142-a71d67c462ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '.version_select at 0x7f984e726940>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:55:58.160552 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-57f054ba-0774-4ffa-a142-a71d67c462ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289138760" status: 202 len: 0 microversion: 2.1 time: 0.029150 Jun 25 21:55:58.161215 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3760/7060] 10.222.0.39 () {58 vars in 1283 bytes} [Sat Jun 25 21:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1289138760 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:55:58.188643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0c293864-00e9-492e-bd7c-6f4b46860538 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: .version_select at 0x7f984f64bb80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-925798002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZQ6bBw4Afg5P323/3v4hnpJh+bVnaZLJh29gQ/xuYHazt1MOaaRRD7h8b1cGAeSjg1emG7M+SfowchAimI9BhhmPoxbz3XSnc+f42hw7iiMVIyuLCEFShLGovlVTIOQA=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:55:58.205551 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0c293864-00e9-492e-bd7c-6f4b46860538 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:55:58.210832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-0c293864-00e9-492e-bd7c-6f4b46860538 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:55:58.252508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0c293864-00e9-492e-bd7c-6f4b46860538 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067595 Jun 25 21:55:58.253737 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3301/7061] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:55:58 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:56:03.955667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:03.959958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-73625223", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "05af9963-71cb-483b-8cca-9663d53be486"}], "key_name": "tempest-TestNetworkAdvancedServerOps-925798002", "security_groups": [{"name": "tempest-secgroup-smoke-2122915347"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:56:04.101340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] validate_networks() for [('05af9963-71cb-483b-8cca-9663d53be486', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:56:04.542958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:56:04.547917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:56:04.549113 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:56:04.549731 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:56:04.550329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:56:04.564383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:04.564903 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:04.565915 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:04.566371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:04.589719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:56:04.596178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:56:04.611605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:56:04.614059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:56:04.666743 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ddbde249-2929-4344-9baa-d932c401b5f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.712755 Jun 25 21:56:04.674045 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3761/7062] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:56:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:56:04.678351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8256d2a6-0000-48ec-ae94-b69d4654ab9e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:04.679101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8256d2a6-0000-48ec-ae94-b69d4654ab9e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:04.775622 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8256d2a6-0000-48ec-ae94-b69d4654ab9e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:04.786407 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8256d2a6-0000-48ec-ae94-b69d4654ab9e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1264 microversion: 2.1 time: 0.112297 Jun 25 21:56:04.787087 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3302/7063] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:04 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1264 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:05.804316 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:05.805597 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:05.817640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:05.820686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:05.821826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:05.823423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:06.117436 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:06.127691 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-033ac675-b665-46b9-af14-39631f0a1174 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1334 microversion: 2.1 time: 0.328122 Jun 25 21:56:06.129395 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3762/7064] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:05 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:07.146332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:07.147031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:07.149238 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:07.157877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:07.158359 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:07.159170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:07.159632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:07.321453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:07.331810 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6567cab8-5198-48af-862c-ed55e8ee0d2a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.189472 Jun 25 21:56:07.333609 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3303/7065] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:07 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:07.524890 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-00e21fd4-45af-4abd-8bc9-7ecf7d2a0615 req-fcfeb1bb-b6c1-4986-aeef-c4cea2dc24ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673f5db5-5c30-443d-bdcf-297a5de37ae0", "tag": "dbfaaa1b-bc06-455d-aa8b-58385de03104"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:56:07.534582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-00e21fd4-45af-4abd-8bc9-7ecf7d2a0615 req-fcfeb1bb-b6c1-4986-aeef-c4cea2dc24ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:07.535467 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-00e21fd4-45af-4abd-8bc9-7ecf7d2a0615 req-fcfeb1bb-b6c1-4986-aeef-c4cea2dc24ac service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:07.552862 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-00e21fd4-45af-4abd-8bc9-7ecf7d2a0615 req-fcfeb1bb-b6c1-4986-aeef-c4cea2dc24ac service nova] Creating event network-changed:dbfaaa1b-bc06-455d-aa8b-58385de03104 for instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 on nch2-master-1 Jun 25 21:56:07.558703 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-00e21fd4-45af-4abd-8bc9-7ecf7d2a0615 req-fcfeb1bb-b6c1-4986-aeef-c4cea2dc24ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124305 Jun 25 21:56:07.559618 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3763/7066] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 21:56:08.354102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:08.355102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:08.364838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:08.365311 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:08.366086 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:08.366538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:08.512762 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:08.521216 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-205da35d-906c-49ce-ab0f-22188925fdd5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.173293 Jun 25 21:56:08.521777 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3304/7067] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:08 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:09.544983 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:09.546170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:09.557047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:09.557797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:09.559059 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:09.559782 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:09.698854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:09.706715 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-46de0d6d-dd22-436b-a283-15b26c2da912 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.170316 Jun 25 21:56:09.707308 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3764/7068] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:09 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:10.728539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:10.729607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:10.740457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:10.740953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:10.741745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:10.742202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:10.931329 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:10.943108 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cb4fef3f-caf2-4d26-9585-a99734cba1de tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.221056 Jun 25 21:56:10.943879 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3305/7069] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:10 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:11.965247 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:11.965833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:11.973400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:11.973855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:11.974619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:11.975060 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:12.113045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:12.122027 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9430b04-db0d-4930-b4a4-470fdfdee9fc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.161171 Jun 25 21:56:12.122717 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3765/7070] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:11 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:13.144008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:13.144619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:13.151940 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:13.152389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:13.153200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:13.153652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:13.291639 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:13.299461 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-56f5a448-6a07-4b4c-9d5b-8a438e060176 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.162509 Jun 25 21:56:13.300330 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3306/7071] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:13 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:14.087403 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f4a6f90f-66a6-4d26-9852-b19974b12179 req-230c1564-2f97-431b-b3ec-932673a9d27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673f5db5-5c30-443d-bdcf-297a5de37ae0", "name": "network-vif-plugged", "status": "completed", "tag": "dbfaaa1b-bc06-455d-aa8b-58385de03104"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:56:14.097018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f4a6f90f-66a6-4d26-9852-b19974b12179 req-230c1564-2f97-431b-b3ec-932673a9d27e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:14.097631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f4a6f90f-66a6-4d26-9852-b19974b12179 req-230c1564-2f97-431b-b3ec-932673a9d27e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:14.109253 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f4a6f90f-66a6-4d26-9852-b19974b12179 req-230c1564-2f97-431b-b3ec-932673a9d27e service nova] Creating event network-vif-plugged:dbfaaa1b-bc06-455d-aa8b-58385de03104 for instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 on nch2-master-1 Jun 25 21:56:14.114383 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f4a6f90f-66a6-4d26-9852-b19974b12179 req-230c1564-2f97-431b-b3ec-932673a9d27e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031184 Jun 25 21:56:14.115289 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3766/7072] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:56:14.317045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:14.317751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:14.327424 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:14.327916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:14.329077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:14.329535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:14.467773 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:14.478860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e72f71ca-54ed-4cd1-9770-c3e0337856ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.166567 Jun 25 21:56:14.479414 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3307/7073] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:14 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:15.498841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:15.499991 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:15.507335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:15.508030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:15.515717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:15.516154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:15.516941 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:15.517387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:15.660630 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:15.670631 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a2b5feaa-b244-4452-9eb1-884ad878c29e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1390 microversion: 2.1 time: 0.173375 Jun 25 21:56:15.671220 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3767/7074] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:15 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:16.690517 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:16.691333 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:16.693716 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:16.695697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:16.702950 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:16.703543 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:16.704561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:16.705134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:16.844150 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:16.852107 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8b9b903f-90e2-42e4-8e0a-db609cfb63eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1562 microversion: 2.1 time: 0.166693 Jun 25 21:56:16.852692 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3308/7075] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:16 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:16.868592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:16.869218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:16.872000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:16.877567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:16.878020 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:16.878789 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:16.879233 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:17.030179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:17.038502 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9aff6c2f-9fc8-4144-b064-ebee82191149 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1562 microversion: 2.1 time: 0.173846 Jun 25 21:56:17.039040 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3768/7076] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:16 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:19.024996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:56:19.025768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:19.026125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c8d0dcf7-e2b7-4c34-a78a-8a90155b9fbe req-c324068a-c4db-4bde-9a6b-e0a85b7a1c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673f5db5-5c30-443d-bdcf-297a5de37ae0", "tag": "dbfaaa1b-bc06-455d-aa8b-58385de03104"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:56:19.033925 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:19.034651 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:19.035506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:19.036022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c8d0dcf7-e2b7-4c34-a78a-8a90155b9fbe req-c324068a-c4db-4bde-9a6b-e0a85b7a1c1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:19.036165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:19.036500 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c8d0dcf7-e2b7-4c34-a78a-8a90155b9fbe req-c324068a-c4db-4bde-9a6b-e0a85b7a1c1b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:19.048241 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c8d0dcf7-e2b7-4c34-a78a-8a90155b9fbe req-c324068a-c4db-4bde-9a6b-e0a85b7a1c1b service nova] Creating event network-changed:dbfaaa1b-bc06-455d-aa8b-58385de03104 for instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 on nch2-master-1 Jun 25 21:56:19.053408 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c8d0dcf7-e2b7-4c34-a78a-8a90155b9fbe req-c324068a-c4db-4bde-9a6b-e0a85b7a1c1b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031532 Jun 25 21:56:19.054465 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3769/7077] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:56:19.188969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:56:19.199730 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-13ccb4a4-80ef-41db-8ac6-124b87fe3aa8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1562 microversion: 2.1 time: 0.179569 Jun 25 21:56:19.200667 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3309/7078] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:56:19 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1562 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:56:49.301575 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:56:49.302699 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 21:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:56:50.518806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:50.519904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=38 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:56:50.525104 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:56:50.526125 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:56:50.533376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:50.533832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:50.534585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:56:50.535014 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:56:50.586348 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d156d7db-aaeb-4ba3-8444-f0fe13aa5a50 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action" status: 200 len: 24552 microversion: 2.1 time: 0.070004 Jun 25 21:56:50.586994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3770/7079] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:56:50 2022] POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action => generated 24552 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:57:21.042215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:21.043073 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=42 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:21.047576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:57:21.048691 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:21.056394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:21.056955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:21.057813 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:21.058335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:21.136027 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7cf9d7a0-2923-4d19-aadc-d27733380d77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.097060 Jun 25 21:57:21.136596 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3310/7080] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:57:21 2022] POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:57:21.145719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:21.146427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:21.149026 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:21.149807 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:57:21.155486 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:21.155961 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:21.156754 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:21.157190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:21.374475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:21.382472 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2dfb73e5-91b5-4372-8423-847166300c66 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1673 microversion: 2.1 time: 0.241192 Jun 25 21:57:21.383058 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3771/7081] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:21 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:22.405260 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:22.405868 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:22.413157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:22.413654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:22.414487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:22.414962 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:22.550885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:22.558764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ce213f55-84c9-47db-8be1-486713b3f858 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.160620 Jun 25 21:57:22.559346 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3311/7082] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:22 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:23.579968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:23.580875 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:23.594376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:23.595138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:23.596404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:23.597179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:23.748519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:23.756357 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-83a56c01-4ef7-45ae-9824-770ea949aa4a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.183188 Jun 25 21:57:23.756965 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3772/7083] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:23 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:24.774520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:24.775140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:24.782607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:24.783072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:24.783845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:24.784290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:24.924492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:24.932382 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66954c3d-42fa-42f0-80cd-677b945b9dca tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.162147 Jun 25 21:57:24.932968 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3312/7084] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:24 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:25.953982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:25.955007 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:25.966328 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:25.966786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:25.967548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:25.967980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:26.098550 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:26.110450 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6a10c12f-2195-4d67-a5ff-1b3c566eb506 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.162985 Jun 25 21:57:26.111304 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3773/7085] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:25 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:27.135243 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:27.135807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:27.143520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:27.143982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:27.144810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:27.145272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:27.276095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:27.283998 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a8b86caa-0c20-44ab-9fd9-f65606f79b69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.154997 Jun 25 21:57:27.284583 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3313/7086] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:27 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:28.305853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:28.306733 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:28.314912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:28.315418 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:28.316390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:28.316606 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:28.458533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:28.471130 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bd9c84d4-1412-4cd4-b7b3-19747531041d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.171767 Jun 25 21:57:28.471983 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3774/7087] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:28 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:29.497189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:29.498219 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:29.508899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:29.509687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:29.510991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:29.511877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:29.645053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:29.653229 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0023b3af-b61c-48ad-8baf-7866bec5f09f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.163327 Jun 25 21:57:29.653829 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3314/7088] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:29 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:30.674804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:30.675800 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:30.686520 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:30.686980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:30.687750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:30.688224 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:30.824784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:30.832676 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7c853c83-27d3-498f-898e-d0f3e9293aa5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.164534 Jun 25 21:57:30.833252 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3775/7089] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:30 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:31.853465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:31.854338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:31.865832 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:31.866488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:31.867586 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:31.868225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:32.009811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:32.018090 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-665465ca-9626-4566-af42-4ad2613fe9e5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1678 microversion: 2.1 time: 0.170481 Jun 25 21:57:32.018676 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3315/7090] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:31 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:57:33.039521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:57:33.040518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:57:33.049263 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:33.049727 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:33.050493 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:57:33.050936 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:57:33.184542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:57:33.195506 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cfcbf2b5-24fe-4ed5-8a10-a54f314ead77 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1681 microversion: 2.1 time: 0.162402 Jun 25 21:57:33.196263 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3776/7091] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:57:33 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:05.476700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:05.477694 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:05.480185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:05.481002 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:05.487576 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:05.488077 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:05.488917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:05.489364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:05.546348 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5bb45818-c877-47ba-9f2d-e93145abc7c8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action" status: 200 len: 68952 microversion: 2.1 time: 0.073720 Jun 25 21:58:05.547022 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3316/7092] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:58:05 2022] POST /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0/action => generated 68952 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:58:22.909849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:22.910434 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:22.912596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:22.913263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:22.915664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:22.917198 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=36 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:22.919051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:22.919507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:22.920345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:22.920740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:22.947148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 21:58:22.969076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-106b82b0-711e-4bc0-b852-02903a9d927e req-4c224569-54d8-482e-981a-52e6e1c72cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "673f5db5-5c30-443d-bdcf-297a5de37ae0", "tag": "dbfaaa1b-bc06-455d-aa8b-58385de03104"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:22.978969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-106b82b0-711e-4bc0-b852-02903a9d927e req-4c224569-54d8-482e-981a-52e6e1c72cd9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:22.979434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-106b82b0-711e-4bc0-b852-02903a9d927e req-4c224569-54d8-482e-981a-52e6e1c72cd9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:22.990552 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-106b82b0-711e-4bc0-b852-02903a9d927e req-4c224569-54d8-482e-981a-52e6e1c72cd9 service nova] Creating event network-changed:dbfaaa1b-bc06-455d-aa8b-58385de03104 for instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 on nch2-master-1 Jun 25 21:58:22.996077 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-106b82b0-711e-4bc0-b852-02903a9d927e req-4c224569-54d8-482e-981a-52e6e1c72cd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089580 Jun 25 21:58:22.997099 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3317/7093] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:23.040857 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b1ebd597-71cf-43e8-b90d-76edc8dafddc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 204 len: 0 microversion: 2.1 time: 0.136710 Jun 25 21:58:23.041878 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3777/7094] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 21:58:22 2022] DELETE /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 21:58:23.051488 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:23.052669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:23.060596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:23.061949 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:23.063176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:23.063637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:23.207647 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:23.215825 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-356730b4-2785-475a-844b-5656e71bf20a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1687 microversion: 2.1 time: 0.168890 Jun 25 21:58:23.216508 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3318/7095] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:23 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:24.234653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:24.235365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:24.243109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:24.243560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:24.244341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:24.244811 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:24.458881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:24.467126 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0c7ff330-a17d-49b3-ae89-20e9b63aacce tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1687 microversion: 2.1 time: 0.237000 Jun 25 21:58:24.467744 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3778/7096] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:24 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:25.223095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-f6db6f8d-0310-4e28-b7b4-5b7369a45265 req-e9d58890-6bfd-4ee3-9566-ab522caea296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "673f5db5-5c30-443d-bdcf-297a5de37ae0", "name": "network-vif-deleted", "tag": "dbfaaa1b-bc06-455d-aa8b-58385de03104"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:25.232358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f6db6f8d-0310-4e28-b7b4-5b7369a45265 req-e9d58890-6bfd-4ee3-9566-ab522caea296 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:25.232894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-f6db6f8d-0310-4e28-b7b4-5b7369a45265 req-e9d58890-6bfd-4ee3-9566-ab522caea296 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:25.244654 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-f6db6f8d-0310-4e28-b7b4-5b7369a45265 req-e9d58890-6bfd-4ee3-9566-ab522caea296 service nova] Creating event network-vif-deleted:dbfaaa1b-bc06-455d-aa8b-58385de03104 for instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 on nch2-master-1 Jun 25 21:58:25.249520 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-f6db6f8d-0310-4e28-b7b4-5b7369a45265 req-e9d58890-6bfd-4ee3-9566-ab522caea296 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030283 Jun 25 21:58:25.250122 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3319/7097] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:25.484838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:25.485404 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:25.492686 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:25.493143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:25.493926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:25.494365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:25.528906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:25.529498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:25.530078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lazy-loading 'fault' on Instance uuid 673f5db5-5c30-443d-bdcf-297a5de37ae0 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 21:58:25.575501 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:25.586065 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-24e3513d-34f1-4390-a29c-9f810b849910 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 200 len: 1354 microversion: 2.1 time: 0.105305 Jun 25 21:58:25.587177 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3779/7098] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:25 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:26.605057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:26.605732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 673f5db5-5c30-443d-bdcf-297a5de37ae0] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:26.612565 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:26.613037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:26.613914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:26.614364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:26.628123 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] HTTP exception thrown: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Request method failure captured: Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 HTTP/1.1 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4QMYUYeio3FZyMcn97N9XjzllnBawFJ_8kR8mRSjIg3OcbmrP53pmI7j8VQ8sR-tyPmIMxtRojnkXh7pMcUeQX1LGXwQmxhFleyNWLP9tB8StwnJJm_mfK05iK9Ey4dP6cKG-OxmFpM20QDMFNB8baSAud-MBjidrJOyyIO37Eoltc Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}] Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 3f346fe40c774c4cb8f0f93413823b1f Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': '673f5db5-5c30-443d-bdcf-297a5de37ae0'} Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:58:26.629810 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Returning 404 to user: Instance 673f5db5-5c30-443d-bdcf-297a5de37ae0 could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0074e0a2-0628-4917-a4ed-da37482c187b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0" status: 404 len: 111 microversion: 2.1 time: 0.031527 Jun 25 21:58:26.634437 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3320/7099] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:26 2022] GET /compute/v2.1/servers/673f5db5-5c30-443d-bdcf-297a5de37ae0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 21:58:29.042599 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 21:58:29.043113 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 21:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 21:58:29.961525 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e97f758-343c-4234-aaad-209751e23664 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '.version_select at 0x7f984e618e50>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:29.990088 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e97f758-343c-4234-aaad-209751e23664 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-925798002" status: 202 len: 0 microversion: 2.1 time: 0.032773 Jun 25 21:58:29.990991 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3780/7100] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 21:58:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-925798002 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:58:30.017624 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-894b14e4-e7d9-47de-a62b-9b35fecc22ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: .version_select at 0x7f9861fd45e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-275542418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4xvVBIqPF405Q9/t6q4Yv1qoVInxSbuR85pCH5aO9wk8xtBdpjkN7oxxDtBXiQUv6ybzYKyrhnULAhE7vxPHMqnJR6aBMASVti+UvBvvHzJKlooLmzg7gRqOO9YkEIQg=="}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:30.032846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-894b14e4-e7d9-47de-a62b-9b35fecc22ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:58:30.039142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-894b14e4-e7d9-47de-a62b-9b35fecc22ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:58:30.065616 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-894b14e4-e7d9-47de-a62b-9b35fecc22ef tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052073 Jun 25 21:58:30.066240 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3321/7101] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 21:58:30 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:36.040819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1783500760", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "9ce72aba-8ee8-43ee-ac39-67feae2e7a5a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-275542418", "security_groups": [{"name": "tempest-secgroup-smoke-117340529"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:36.054107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:36.177541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] validate_networks() for [('9ce72aba-8ee8-43ee-ac39-67feae2e7a5a', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 21:58:36.568677 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:58:36.569249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:58:36.569742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:58:36.570148 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:58:36.570595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:58:36.580464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:36.581176 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:36.582018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:36.582840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:36.605917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 21:58:36.611851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 21:58:36.625604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 21:58:36.627979 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 21:58:36.677116 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-60fe0ef2-575e-413b-838f-5e48b4c9fc38 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640749 Jun 25 21:58:36.678012 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3781/7102] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 21:58:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 21:58:36.687983 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-52ae365f-37d4-4f55-b7d1-5fd5412450f3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:36.689235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-52ae365f-37d4-4f55-b7d1-5fd5412450f3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:36.693212 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=12 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:36.758469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-52ae365f-37d4-4f55-b7d1-5fd5412450f3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:36.767823 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-52ae365f-37d4-4f55-b7d1-5fd5412450f3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1266 microversion: 2.1 time: 0.083665 Jun 25 21:58:36.768762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3322/7103] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:36 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:37.789112 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:37.789881 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:37.798912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:37.799750 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:37.801690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:37.802627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:37.887178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:37.895683 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-de8a05f0-9738-45a8-9bd1-c104bc62af54 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1336 microversion: 2.1 time: 0.114652 Jun 25 21:58:37.896533 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3782/7104] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:37 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1336 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:38.914041 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:38.914904 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:38.923931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:38.924400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:38.925399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:38.926005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:39.168745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:39.176896 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6dbc3501-a945-433d-a631-03f461853bc9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.268196 Jun 25 21:58:39.177592 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3323/7105] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:38 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 21:58:39.299548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-004232b7-8dcc-473b-9020-c9c4e4ea28ba req-11c74588-467a-4932-9a2b-17041c516a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:39.320819 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-004232b7-8dcc-473b-9020-c9c4e4ea28ba req-11c74588-467a-4932-9a2b-17041c516a21 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:39.321547 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-004232b7-8dcc-473b-9020-c9c4e4ea28ba req-11c74588-467a-4932-9a2b-17041c516a21 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:39.344849 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-004232b7-8dcc-473b-9020-c9c4e4ea28ba req-11c74588-467a-4932-9a2b-17041c516a21 service nova] Creating event network-changed:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 21:58:39.351317 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-004232b7-8dcc-473b-9020-c9c4e4ea28ba req-11c74588-467a-4932-9a2b-17041c516a21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055777 Jun 25 21:58:39.352451 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3783/7106] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:40.196582 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:40.197170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:40.204700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:40.205179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:40.205973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:40.206431 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:40.339433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:40.349806 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-510e1142-2471-4ea8-a9ad-200b06bd4cbd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.157408 Jun 25 21:58:40.350424 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3324/7107] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:40 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:41.371631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:41.372475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:41.380538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:41.381058 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:41.381982 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:41.382517 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:41.533602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:41.541416 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-153caa38-d808-4eea-9529-91818f4d34a9 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.176561 Jun 25 21:58:41.541994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3784/7108] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:41 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:42.563571 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:42.564300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:42.571935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:42.572413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:42.573246 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:42.573706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:42.716138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:42.724017 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3d67ed1c-f2e8-4122-ac56-f77daba5aa2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.164471 Jun 25 21:58:42.724710 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3325/7109] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:42 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:43.742494 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:43.743087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:43.750621 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:43.751081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:43.751853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:43.752299 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:43.886324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:43.894087 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eb19dd0d-8e50-41f7-8d4d-e45021fc5997 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.155745 Jun 25 21:58:43.894671 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3785/7110] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:43 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:44.777797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-36677df0-54fd-4f13-b1ba-01e8369f47e5 req-018a48cf-8dd7-4309-bac2-85a4d62d2a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "name": "network-vif-plugged", "status": "completed", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:44.786120 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-36677df0-54fd-4f13-b1ba-01e8369f47e5 req-018a48cf-8dd7-4309-bac2-85a4d62d2a62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:44.786584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-36677df0-54fd-4f13-b1ba-01e8369f47e5 req-018a48cf-8dd7-4309-bac2-85a4d62d2a62 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:44.797824 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-36677df0-54fd-4f13-b1ba-01e8369f47e5 req-018a48cf-8dd7-4309-bac2-85a4d62d2a62 service nova] Creating event network-vif-plugged:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 21:58:44.802745 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-36677df0-54fd-4f13-b1ba-01e8369f47e5 req-018a48cf-8dd7-4309-bac2-85a4d62d2a62 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089605 Jun 25 21:58:44.803341 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3326/7111] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:44.913322 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:44.914063 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:44.921153 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:44.921644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:44.922411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:44.922846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:45.057725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:45.065543 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-45c22cfb-81c0-459f-8cc7-39e97235aa70 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.156395 Jun 25 21:58:45.066128 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3786/7112] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:44 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:46.084626 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:46.085888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:46.092816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:46.093620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:46.094046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:46.094495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:46.247315 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:46.258834 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f41d07bd-d9a9-448f-bb41-a25b97ffea3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1391 microversion: 2.1 time: 0.178480 Jun 25 21:58:46.268929 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3327/7113] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:46 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:47.277035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:47.277673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:47.280548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:47.281231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:47.287562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:47.288035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:47.288947 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:47.289406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:47.429244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:47.437373 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-65df184d-20fd-43d1-8843-9378d9e02128 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1563 microversion: 2.1 time: 0.164546 Jun 25 21:58:47.437958 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3787/7114] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:47 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:47.462401 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:47.463018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:47.465121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:58:47.471676 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:47.472145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:47.472960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:47.473411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:47.615833 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:47.624411 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4c16f778-0aba-4dd8-a9f0-59d30bd533ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1563 microversion: 2.1 time: 0.167697 Jun 25 21:58:47.625018 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3328/7115] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:47 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:58:49.230592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:58:49.236459 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-53148921-88ff-4363-9806-4ba2d55e1be1 req-33783639-10b3-4d90-8067-01d20567c2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:58:49.242341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:58:49.245845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-53148921-88ff-4363-9806-4ba2d55e1be1 req-33783639-10b3-4d90-8067-01d20567c2f9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:49.246344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-53148921-88ff-4363-9806-4ba2d55e1be1 req-33783639-10b3-4d90-8067-01d20567c2f9 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:49.249592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:49.250035 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:49.250814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:58:49.251240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:58:49.258226 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-53148921-88ff-4363-9806-4ba2d55e1be1 req-33783639-10b3-4d90-8067-01d20567c2f9 service nova] Creating event network-changed:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 21:58:49.263377 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-53148921-88ff-4363-9806-4ba2d55e1be1 req-33783639-10b3-4d90-8067-01d20567c2f9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031251 Jun 25 21:58:49.264162 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3329/7116] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 21:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 21:58:49.391170 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:58:49.400201 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-87f60662-9fb0-49a6-a7e0-70ce581a17ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1563 microversion: 2.1 time: 0.173447 Jun 25 21:58:49.401492 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3788/7117] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:58:49 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:20.726255 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:20.727745 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=34 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:20.735377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:59:20.736344 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:20.744374 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:20.744869 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:20.745642 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:20.746084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:20.796011 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-336f9b55-0f45-4237-a47b-36160135eae3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action" status: 200 len: 24575 microversion: 2.1 time: 0.073288 Jun 25 21:59:20.796656 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3330/7118] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:59:20 2022] POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action => generated 24575 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 21:59:51.226615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:51.227812 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=40 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:51.283037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 21:59:51.284018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:51.290463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:51.290911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:51.291673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:51.292105 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:51.378088 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:51.385027 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Old instance type m1.heat2, new instance type m1.heat {{(pid=137461) resize /opt/stack/nova/nova/compute/api.py:4166}} Jun 25 21:59:51.392023 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 21:59:51.392464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 21:59:51.392964 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 21:59:51.393377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 21:59:51.393799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 21:59:51.470454 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e172d449-c020-4258-9eea-a998e77689f8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action" status: 202 len: 0 microversion: 2.1 time: 0.246939 Jun 25 21:59:51.471076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3789/7119] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 21:59:51 2022] POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 21:59:51.484352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:51.485022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:51.487754 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:51.488759 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:59:51.494508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:51.495017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:51.495772 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:51.496220 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:51.635817 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:51.643681 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-302ad281-e87b-46bc-bd15-8da021310301 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1691 microversion: 2.1 time: 0.166006 Jun 25 21:59:51.644249 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3331/7120] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:51 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:52.662395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:52.663196 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:52.669582 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:52.670033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:52.670793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:52.671227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:52.809740 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:52.817739 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f269a2ed-a59b-4e3f-93ae-49fbe9a7b841 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1691 microversion: 2.1 time: 0.160378 Jun 25 21:59:52.818383 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3790/7121] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:52 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:53.836112 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:53.836809 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:53.844900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:53.845373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:53.846155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:53.846608 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:53.995506 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:54.005987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f67299cc-6141-4fa1-a735-92c0c34fa04c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.174324 Jun 25 21:59:54.006587 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3332/7122] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:53 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:55.027826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:55.028708 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:55.039797 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:55.040595 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:55.042053 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:55.042675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:55.187234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:55.195535 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-53c358f4-256c-41ce-b492-9db1bd29ca3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.174015 Jun 25 21:59:55.196122 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3791/7123] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:55 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:56.219881 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:56.221211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:56.229166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:56.229668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:56.230557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:56.231009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:56.375071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:56.383747 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a68e77e5-0c19-4c39-8a06-f4c8d57421ff tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.170474 Jun 25 21:59:56.384291 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3333/7124] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:56 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:57.405482 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:57.406490 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:57.418313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:57.419067 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:57.420323 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:57.421087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:57.566619 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:57.574861 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f25b3673-252a-4f4b-9bb6-94505494237b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.175967 Jun 25 21:59:57.575441 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3792/7125] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:57 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:58.596230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:58.597347 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:58.609193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:58.609960 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:58.611205 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:58.611951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:58.752728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:58.768266 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0544411b-a072-4c10-b007-72f56a762152 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.178346 Jun 25 21:59:58.769101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3334/7126] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:58 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 21:59:59.789349 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 21:59:59.790421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 21:59:59.802106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:59.802865 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:59.804109 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 21:59:59.804939 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 21:59:59.959703 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 21:59:59.968078 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebc290b3-9a60-4951-bcec-3eacb7cd6139 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.185585 Jun 25 21:59:59.968677 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3793/7127] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 21:59:59 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:00.990331 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:00.990968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:00.997725 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:00.998208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:00.999189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:00.999671 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:01.151620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:01.162921 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63db32d6-2c44-4fc1-8568-b43e44fdec6a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.178081 Jun 25 22:00:01.163640 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3335/7128] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:00 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:02.184857 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:02.185422 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:02.193766 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:02.194392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:02.195161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:02.195599 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:02.344045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:02.352237 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9840de4d-a80e-428c-9f2c-4b67e7551609 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.171346 Jun 25 22:00:02.352869 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3794/7129] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:02 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:03.373412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:03.374420 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:03.386530 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:03.387324 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:03.388668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:03.389433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:03.534072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:03.542660 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5270a717-a619-4812-a1b1-f216b29619ed tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.176106 Jun 25 22:00:03.543251 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3336/7130] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:03 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:04.567566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:04.568725 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:04.580460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:04.581225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:04.582485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:04.582918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:04.723245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:04.735227 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c00452fd-30b6-4de1-b40c-1384a596e7fd tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1696 microversion: 2.1 time: 0.174191 Jun 25 22:00:04.735978 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3795/7131] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:04 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:05.754223 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:05.754910 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:05.762457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:05.762931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:05.763753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:05.764183 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:05.993914 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:06.002343 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a9940535-671f-41d4-97a6-9dea9fb402f6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1695 microversion: 2.1 time: 0.252334 Jun 25 22:00:06.003309 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3337/7132] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:05 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1695 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:07.024957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:07.026016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:07.036849 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:07.037640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:07.038896 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:07.039625 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:07.190613 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:07.198962 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c87c9564-5072-41f3-bbe9-9dc3f5330865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1693 microversion: 2.1 time: 0.181025 Jun 25 22:00:07.199551 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3796/7133] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:07 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1693 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:08.225303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:08.226313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:08.237399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:08.238123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:08.239318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:08.240020 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:08.393084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:08.401444 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bf50a914-3d8f-4862-8aca-debb79995689 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1693 microversion: 2.1 time: 0.182281 Jun 25 22:00:08.402064 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3338/7134] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:08 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:09.314562 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:00:09.315198 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:00:09.332310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "name": "network-vif-unplugged", "status": "completed", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:00:09.342287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.342739 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.356652 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] Creating event network-vif-unplugged:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 22:00:09.362694 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] Instance 95827bfb-878b-435f-90a4-3e6b3f209baa is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=137461) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jun 25 22:00:09.369397 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-c14d9e63-27f1-4aa6-9909-f4b3ff4a69f5 req-ffb891d1-3b9b-4648-a6d8-ecefdeb6a718 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040955 Jun 25 22:00:09.370179 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3797/7135] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:00:09.418980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:09.419609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:09.427619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.428087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.428909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.429364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.565742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:09.574164 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b48003c0-d8cf-48b3-9ccc-f55d19590e0b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1690 microversion: 2.1 time: 0.159139 Jun 25 22:00:09.574742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3339/7136] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:09 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:09.591530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:00:09.592150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:09.598605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.599061 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.599816 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.600250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.664864 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-eefc67aa-4b9a-409f-87ff-25b0adb7786b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action" status: 204 len: 0 microversion: 2.1 time: 0.077394 Jun 25 22:00:09.665509 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3798/7137] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:00:09 2022] POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:00:09.673871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:09.674495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:09.681042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.681503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.682278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.682761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.873111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:09.881007 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a206275e-8e04-4e56-85b4-26169116a435 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1690 microversion: 2.1 time: 0.211012 Jun 25 22:00:09.881591 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3340/7138] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:09 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:09.898100 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:09.898827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:09.905334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.905784 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:09.906549 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:09.906984 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:10.045464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:10.053536 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2c0e7f8a-df6e-41c4-a697-783207cd0673 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1690 microversion: 2.1 time: 0.159876 Jun 25 22:00:10.054830 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3799/7139] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:09 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:00:11.073121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:00:11.073660 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:11.081063 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:11.081542 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:11.082323 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:11.082769 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:11.215974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:00:11.223972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f0f60210-fbe5-4855-aeed-e741eaf300a3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1682 microversion: 2.1 time: 0.155567 Jun 25 22:00:11.224573 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3341/7140] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:00:11 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:00:11.390588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-82544d93-287c-4541-a61e-07b927d4cdf5 req-3bfe9e9a-2a42-4fb2-8491-4189d707054b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "name": "network-vif-plugged", "status": "completed", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:00:11.400343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82544d93-287c-4541-a61e-07b927d4cdf5 req-3bfe9e9a-2a42-4fb2-8491-4189d707054b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:11.400825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-82544d93-287c-4541-a61e-07b927d4cdf5 req-3bfe9e9a-2a42-4fb2-8491-4189d707054b service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:11.412954 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-82544d93-287c-4541-a61e-07b927d4cdf5 req-3bfe9e9a-2a42-4fb2-8491-4189d707054b service nova] Creating event network-vif-plugged:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 22:00:11.420337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-82544d93-287c-4541-a61e-07b927d4cdf5 req-3bfe9e9a-2a42-4fb2-8491-4189d707054b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Jun 25 22:00:11.421108 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3800/7141] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:00:43.488180 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:00:43.489208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:00:43.492498 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=22 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:43.493226 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=66 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:00:43.501384 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:43.501989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:43.503190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:00:43.503808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:00:43.557748 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-284abc66-1649-4cb7-bc7f-03d08202880d tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action" status: 200 len: 24538 microversion: 2.1 time: 0.075760 Jun 25 22:00:43.558725 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3342/7142] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:00:43 2022] POST /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa/action => generated 24538 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:01:00.840192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=28 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:00.841277 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:00.845115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e16dfe47-ebdb-4267-8038-bbc5bcaf3440 req-4c14f076-9458-44b8-8528-cf0881586c8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:00.845576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:00.846306 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:00.853482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:00.853980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:00.854195 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:00.855057 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:00.855932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:00.856372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:00.856967 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e16dfe47-ebdb-4267-8038-bbc5bcaf3440 req-4c14f076-9458-44b8-8528-cf0881586c8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:00.857630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e16dfe47-ebdb-4267-8038-bbc5bcaf3440 req-4c14f076-9458-44b8-8528-cf0881586c8c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:00.872227 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e16dfe47-ebdb-4267-8038-bbc5bcaf3440 req-4c14f076-9458-44b8-8528-cf0881586c8c service nova] Creating event network-changed:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 22:01:00.877766 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e16dfe47-ebdb-4267-8038-bbc5bcaf3440 req-4c14f076-9458-44b8-8528-cf0881586c8c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037597 Jun 25 22:01:00.878513 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3343/7143] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:01:00.886955 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:01:00.976994 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e76a9f51-ddd1-4956-a634-04b6b01d6a36 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 204 len: 0 microversion: 2.1 time: 0.137087 Jun 25 22:01:00.977638 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3801/7144] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:01:00 2022] DELETE /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:01:00.987356 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:00.988085 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:00.994991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:00.995468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:00.996253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:00.996732 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:01.139320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:01.147374 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-be21a9a1-eb7e-46d8-a4b1-3d1b61728cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1688 microversion: 2.1 time: 0.164869 Jun 25 22:01:01.147958 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3344/7145] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:00 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:02.167411 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:02.168180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:02.175786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:02.176408 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:02.177236 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:02.177746 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:02.315889 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:02.323908 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bdcdf630-7428-40fa-b151-6840e121a647 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 200 len: 1688 microversion: 2.1 time: 0.160862 Jun 25 22:01:02.324474 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3802/7146] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:02 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:02.893683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d8734ccb-bbb8-4121-9118-79b04ba6ce29 req-37b27d01-92c2-4834-88a6-c040b622ad29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95827bfb-878b-435f-90a4-3e6b3f209baa", "name": "network-vif-deleted", "tag": "f52bc09e-e151-40a7-b4a1-3ee862ae9156"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:02.902888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d8734ccb-bbb8-4121-9118-79b04ba6ce29 req-37b27d01-92c2-4834-88a6-c040b622ad29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:02.903353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d8734ccb-bbb8-4121-9118-79b04ba6ce29 req-37b27d01-92c2-4834-88a6-c040b622ad29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:02.915064 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d8734ccb-bbb8-4121-9118-79b04ba6ce29 req-37b27d01-92c2-4834-88a6-c040b622ad29 service nova] Creating event network-vif-deleted:f52bc09e-e151-40a7-b4a1-3ee862ae9156 for instance 95827bfb-878b-435f-90a4-3e6b3f209baa on nch2-master-1 Jun 25 22:01:02.920009 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d8734ccb-bbb8-4121-9118-79b04ba6ce29 req-37b27d01-92c2-4834-88a6-c040b622ad29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030129 Jun 25 22:01:02.920695 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3345/7147] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:01:03.341610 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:03.342334 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 95827bfb-878b-435f-90a4-3e6b3f209baa] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:03.350305 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:03.350753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:03.351530 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:03.351960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:03.365548 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] HTTP exception thrown: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Request method failure captured: Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa HTTP/1.1 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4QMYUYeio3FZyMcn97N9XjzllnBawFJ_8kR8mRSjIg3OcbmrP53pmI7j8VQ8sR-tyPmIMxtRojnkXh7pMcUeQX1LGXwQmxhFleyNWLP9tB8StwnJJm_mfK05iK9Ey4dP6cKG-OxmFpM20QDMFNB8baSAud-MBjidrJOyyIO37Eoltc Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}] Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3f346fe40c774c4cb8f0f93413823b1f Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '95827bfb-878b-435f-90a4-3e6b3f209baa'} Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:01:03.367206 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Returning 404 to user: Instance 95827bfb-878b-435f-90a4-3e6b3f209baa could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f88b87fd-e824-43bd-9695-bfeec148e532 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa" status: 404 len: 111 microversion: 2.1 time: 0.031045 Jun 25 22:01:03.372150 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3803/7148] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:03 2022] GET /compute/v2.1/servers/95827bfb-878b-435f-90a4-3e6b3f209baa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:01:06.731336 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fea932c6-83c0-4d8c-8198-28fea6082663 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '.version_select at 0x7f984c1a30d0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:06.759351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fea932c6-83c0-4d8c-8198-28fea6082663 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-275542418" status: 202 len: 0 microversion: 2.1 time: 0.032703 Jun 25 22:01:06.759884 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3346/7149] 10.222.0.39 () {58 vars in 1280 bytes} [Sat Jun 25 22:01:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-275542418 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:01:06.785325 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-772e97ff-b9fe-4e93-a626-f5d0738eb0ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: .version_select at 0x7f984e61edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1035993593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYpsFj/MSx+ipXY76Qju59AuMVY/QPl0GqL3CZZsBncjFNkFhOpUuq6ijWdAUwDCVNiZ/wf3fLranCAWhy4YvfUUsx7dMZEJvRq3cMRv7QkLN6AJaie6700iNYQXfYnPg=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:06.799545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-772e97ff-b9fe-4e93-a626-f5d0738eb0ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:01:06.804966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-772e97ff-b9fe-4e93-a626-f5d0738eb0ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:01:06.831822 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-772e97ff-b9fe-4e93-a626-f5d0738eb0ab tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050643 Jun 25 22:01:06.832463 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3804/7150] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 22:01:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 22:01:12.646216 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-466497499", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "a87045d8-e799-4099-8c4e-9b03bd6d2d4a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1035993593", "security_groups": [{"name": "tempest-secgroup-smoke-1681731299"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:12.904465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] validate_networks() for [('a87045d8-e799-4099-8c4e-9b03bd6d2d4a', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:01:12.909860 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:13.411876 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:01:13.412564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:01:13.413067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:01:13.413490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:01:13.413929 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:01:13.423890 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:13.424766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:13.425966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:13.426616 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:13.446477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:01:13.454458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:01:13.472221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:01:13.475189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:01:13.533881 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-720ddd90-d209-4108-9848-0beb05906a2c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891332 Jun 25 22:01:13.536486 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3347/7151] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:01:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:01:13.542761 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:13.547519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b4a0bb02-fea4-45a5-9fe5-b5a97c84af17 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:13.548348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b4a0bb02-fea4-45a5-9fe5-b5a97c84af17 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:13.662840 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b4a0bb02-fea4-45a5-9fe5-b5a97c84af17 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:13.669573 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b4a0bb02-fea4-45a5-9fe5-b5a97c84af17 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1266 microversion: 2.1 time: 0.128627 Jun 25 22:01:13.670416 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3805/7152] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:13 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:14.687121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7d34d1e1-0e3f-40aa-8194-b70ad2fcbadb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:14.687723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7d34d1e1-0e3f-40aa-8194-b70ad2fcbadb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:14.770935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7d34d1e1-0e3f-40aa-8194-b70ad2fcbadb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:14.780533 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7d34d1e1-0e3f-40aa-8194-b70ad2fcbadb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1266 microversion: 2.1 time: 0.097204 Jun 25 22:01:14.781414 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3348/7153] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:14 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:15.798010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-390b0bfb-7895-46c5-a120-c405e40154eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:15.798860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-390b0bfb-7895-46c5-a120-c405e40154eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:15.854377 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-390b0bfb-7895-46c5-a120-c405e40154eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:15.861428 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-390b0bfb-7895-46c5-a120-c405e40154eb tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1266 microversion: 2.1 time: 0.067465 Jun 25 22:01:15.861994 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3806/7154] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:15 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1266 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:16.878829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22bf69c6-69bc-481a-865a-02d0d36776d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:16.879464 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22bf69c6-69bc-481a-865a-02d0d36776d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:16.942402 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22bf69c6-69bc-481a-865a-02d0d36776d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:16.949547 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22bf69c6-69bc-481a-865a-02d0d36776d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1266 microversion: 2.1 time: 0.075075 Jun 25 22:01:16.950283 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3349/7155] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:16 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:17.967760 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:17.968351 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:17.976744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:17.977206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:17.977985 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:17.978435 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:18.042127 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:18.052857 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ebe5a775-c760-47cc-b702-22fd4b4573e3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1270 microversion: 2.1 time: 0.089207 Jun 25 22:01:18.053618 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3807/7156] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:17 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:19.070555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:19.071136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:19.079023 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:19.079483 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:19.080313 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:19.080798 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:19.507202 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:19.515643 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ca21a948-a72d-4f98-8085-72b1b465469a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1324 microversion: 2.1 time: 0.449100 Jun 25 22:01:19.516244 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3350/7157] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:19 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:20.134341 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-d7e0b9cf-7b80-4b58-9d13-e10bc69ceb3c req-8b2bf955-11ff-44b6-a775-bb6fde16d24c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce265ff-e4ba-459a-b8a2-66942807e900", "tag": "0eb1c38b-7c96-460d-8ef0-100183cb4534"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:20.145335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d7e0b9cf-7b80-4b58-9d13-e10bc69ceb3c req-8b2bf955-11ff-44b6-a775-bb6fde16d24c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:20.146145 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-d7e0b9cf-7b80-4b58-9d13-e10bc69ceb3c req-8b2bf955-11ff-44b6-a775-bb6fde16d24c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:20.167330 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-d7e0b9cf-7b80-4b58-9d13-e10bc69ceb3c req-8b2bf955-11ff-44b6-a775-bb6fde16d24c service nova] Creating event network-changed:0eb1c38b-7c96-460d-8ef0-100183cb4534 for instance 1ce265ff-e4ba-459a-b8a2-66942807e900 on nch2-master-1 Jun 25 22:01:20.172344 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-d7e0b9cf-7b80-4b58-9d13-e10bc69ceb3c req-8b2bf955-11ff-44b6-a775-bb6fde16d24c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111087 Jun 25 22:01:20.173021 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3808/7158] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:01:20.534974 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:20.535574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:20.543157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:20.543614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:20.544390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:20.544874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:20.683511 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:20.691375 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-93c7d69d-4eff-4e2c-90f5-81e78c75a707 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.162012 Jun 25 22:01:20.691943 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3351/7159] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:20 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:21.715523 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:21.716737 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:21.727804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:21.728617 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:21.729918 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:21.730687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:21.876592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:21.884788 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5ebdf867-0b89-4618-b31b-b4545c80e85b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.178164 Jun 25 22:01:21.885382 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3809/7160] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:21 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:22.901432 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:22.902221 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:22.909602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:22.910197 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:22.911050 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:22.911573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:23.045266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:23.053121 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6426a8c7-3262-4957-8c35-183e26157612 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.155667 Jun 25 22:01:23.053705 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3352/7161] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:22 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:24.069736 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:24.070350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:24.077768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:24.078498 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:24.079025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:24.079465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:24.219087 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:24.227367 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-02ccafb7-eb9b-4c7a-9e79-14339576ee1f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.161566 Jun 25 22:01:24.227974 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3810/7162] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:24 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:25.248108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:25.249104 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:25.252188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:25.262838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:25.263588 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:25.265230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:25.266031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:25.406337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:25.418985 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-584ed969-10a0-43eb-94af-02491f681448 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.177140 Jun 25 22:01:25.419765 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3353/7163] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:25 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:25.736395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-07166ff9-673b-437b-ba75-b8a235474a6a req-4a4562d1-8088-4b77-8760-b184fd8f7ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce265ff-e4ba-459a-b8a2-66942807e900", "name": "network-vif-plugged", "status": "completed", "tag": "0eb1c38b-7c96-460d-8ef0-100183cb4534"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:25.746086 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-07166ff9-673b-437b-ba75-b8a235474a6a req-4a4562d1-8088-4b77-8760-b184fd8f7ea5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:25.746538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-07166ff9-673b-437b-ba75-b8a235474a6a req-4a4562d1-8088-4b77-8760-b184fd8f7ea5 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:25.758393 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-07166ff9-673b-437b-ba75-b8a235474a6a req-4a4562d1-8088-4b77-8760-b184fd8f7ea5 service nova] Creating event network-vif-plugged:0eb1c38b-7c96-460d-8ef0-100183cb4534 for instance 1ce265ff-e4ba-459a-b8a2-66942807e900 on nch2-master-1 Jun 25 22:01:25.763387 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-07166ff9-673b-437b-ba75-b8a235474a6a req-4a4562d1-8088-4b77-8760-b184fd8f7ea5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030748 Jun 25 22:01:25.763985 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3811/7164] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:01:26.439628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:26.440417 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:26.448244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:26.448743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:26.449521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:26.449973 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:26.584916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:26.592778 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c0f7a48b-1082-4222-94d3-9bced7847f1b tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1392 microversion: 2.1 time: 0.159924 Jun 25 22:01:26.593334 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3354/7165] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:26 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:27.609838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:27.616365 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:27.617220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:27.625331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:27.625859 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:27.626747 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:27.627255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:27.769110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:27.777089 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2b4835ca-8493-4551-818c-4337b7223811 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1564 microversion: 2.1 time: 0.169233 Jun 25 22:01:27.777665 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3812/7166] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:27 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:27.793452 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:27.794054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:27.795981 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=10 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:01:27.802546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:27.803001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:27.803775 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:27.804222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:27.948031 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:27.956067 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7409a266-0c38-4e09-be53-45f9020d8599 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1564 microversion: 2.1 time: 0.166469 Jun 25 22:01:27.956691 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3355/7167] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:27 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:01:29.666444 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:01:29.672185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6beccf39-c428-4cac-8801-ab04e0502369 req-981d7f2d-38e4-4acc-be74-26ce2d1e9972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce265ff-e4ba-459a-b8a2-66942807e900", "tag": "0eb1c38b-7c96-460d-8ef0-100183cb4534"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:01:29.676674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:01:29.684051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:29.684548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:29.685382 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:29.685826 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:29.687115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6beccf39-c428-4cac-8801-ab04e0502369 req-981d7f2d-38e4-4acc-be74-26ce2d1e9972 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:01:29.687578 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6beccf39-c428-4cac-8801-ab04e0502369 req-981d7f2d-38e4-4acc-be74-26ce2d1e9972 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:01:29.699129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6beccf39-c428-4cac-8801-ab04e0502369 req-981d7f2d-38e4-4acc-be74-26ce2d1e9972 service nova] Creating event network-changed:0eb1c38b-7c96-460d-8ef0-100183cb4534 for instance 1ce265ff-e4ba-459a-b8a2-66942807e900 on nch2-master-1 Jun 25 22:01:29.704326 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6beccf39-c428-4cac-8801-ab04e0502369 req-981d7f2d-38e4-4acc-be74-26ce2d1e9972 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036048 Jun 25 22:01:29.705200 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3356/7168] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:01:29.912578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:01:29.920491 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1d8e2f22-757a-4a47-9308-4e9b29a9853c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1564 microversion: 2.1 time: 0.258062 Jun 25 22:01:29.921280 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3813/7169] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:01:29 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1564 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:02:03.294661 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:03.295573 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=40 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:03.301982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:02:03.303373 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:03.313326 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:03.313966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:03.314826 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:03.315276 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:03.365660 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-21d02385-1e72-4780-891d-f24a19203960 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action" status: 200 len: 24571 microversion: 2.1 time: 0.073507 Jun 25 22:02:03.366333 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3357/7170] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:02:03 2022] POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:02:33.717977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:33.719168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=34 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:33.724835 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-47b8be4f-1ac2-40b4-809d-c86b9a3ead3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:02:33.732560 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b8be4f-1ac2-40b4-809d-c86b9a3ead3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:33.733005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-47b8be4f-1ac2-40b4-809d-c86b9a3ead3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:33.758142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-47b8be4f-1ac2-40b4-809d-c86b9a3ead3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Going to try to stop instance {{(pid=137461) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 22:02:33.812037 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-47b8be4f-1ac2-40b4-809d-c86b9a3ead3e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action" status: 202 len: 0 microversion: 2.1 time: 0.097072 Jun 25 22:02:33.812745 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3814/7171] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:02:33 2022] POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:02:33.821756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:33.822477 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:33.825264 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:33.825934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:02:33.838434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:33.838856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:33.839643 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:33.840101 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:33.985122 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:33.993045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2cff43ab-d023-4726-ba1d-020f06af0104 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.175623 Jun 25 22:02:33.993627 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3358/7172] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:33 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:35.017827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:35.019901 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:35.027331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:35.027916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:35.029043 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:35.029491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:35.176524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:35.184604 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8cea2c76-5115-4f2b-9eec-58c8722c61d4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.175721 Jun 25 22:02:35.185182 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3815/7173] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:35 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:36.205353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:36.206091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:36.216230 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:36.216741 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:36.217519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:36.217966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:36.354102 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:36.362082 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-0685d153-ef2f-4daa-92fd-a36ce34e96ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.162996 Jun 25 22:02:36.362662 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3359/7174] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:36 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:37.379521 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:37.380137 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:37.386999 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:37.387465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:37.388200 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:37.388798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:37.595827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:37.604071 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d947da4b-ff79-4320-82a0-a85d33439526 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.228639 Jun 25 22:02:37.604696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3816/7175] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:37 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:38.621043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:38.621640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:38.629301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:38.629774 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:38.630568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:38.631016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:38.778129 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:38.789647 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a891b060-5942-4043-ab1f-8c4acc24c48c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.172525 Jun 25 22:02:38.790459 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3360/7176] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:38 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:39.815572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:39.816960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:39.824173 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:39.824663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:39.825442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:39.825878 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:39.963860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:39.972266 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6b920635-dcf6-480f-84f5-15ac5cb3e6b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.163424 Jun 25 22:02:39.973125 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3817/7177] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:39 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:40.994253 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:40.995200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:41.007280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:41.008054 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:41.009389 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:41.010132 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:41.156268 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:41.168863 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ec4c11fb-77b0-4db2-b713-6a8c533e34ec tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.181097 Jun 25 22:02:41.169705 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3361/7178] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:40 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:42.191656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:42.192255 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:42.199667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:42.200117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:42.200913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:42.201348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:42.337167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:42.348331 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5a081ed7-3dfe-4cf0-931e-6e26e7700d27 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.163148 Jun 25 22:02:42.349152 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3818/7179] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:42 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:43.366051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:43.366649 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:43.373948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:43.374416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:43.375184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:43.375628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:43.517207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:43.529139 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d0c58b80-725d-4c5c-8fcf-bf6422f448a1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.166869 Jun 25 22:02:43.529947 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3362/7180] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:43 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:44.553049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:44.553950 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:44.565796 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:44.566664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:44.567433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:44.567864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:44.704542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:44.712851 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b295ad53-fe6e-4c75-a61a-fa81ed727645 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.166682 Jun 25 22:02:44.713431 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3819/7181] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:44 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:45.739369 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:45.740335 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:45.752600 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:45.753274 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:45.754465 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:45.754908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:45.896038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:45.907958 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-66177978-c542-4891-9a6d-7e68fe30cabc tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.174984 Jun 25 22:02:45.908886 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3363/7182] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:45 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:46.930350 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:46.931389 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:46.943179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:46.943923 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:46.945231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:46.945957 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:47.084828 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:47.092580 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fe8f7cb6-b032-498b-a199-4e3598ce991a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.168887 Jun 25 22:02:47.093163 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3820/7183] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:46 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:48.110793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:48.111367 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:48.119092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:48.119567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:48.120350 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:48.120835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:48.275157 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:48.282985 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fc12cc2b-efd5-4d57-ac76-2871465240e2 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1692 microversion: 2.1 time: 0.176344 Jun 25 22:02:48.283757 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3364/7184] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:48 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:49.303376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:49.304089 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:49.312656 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:49.313183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:49.314045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:49.314537 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:49.457231 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:49.469623 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-333c1ed2-94f8-462f-994d-88d72638f3c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1669 microversion: 2.1 time: 0.170568 Jun 25 22:02:49.470441 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3821/7185] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:49 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:50.568703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:02:50.570218 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:50.581928 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:50.583082 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:50.584134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:50.584625 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:50.637814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6493f3c7-2d07-4c17-aa39-74f0e62114c6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action" status: 200 len: 35557 microversion: 2.1 time: 0.075255 Jun 25 22:02:50.638637 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3365/7186] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:02:50 2022] POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action => generated 35557 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:02:50.652658 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-89cb85a6-f1d5-4a54-b1e7-8a730d6c83c0 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:02:50.660077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89cb85a6-f1d5-4a54-b1e7-8a730d6c83c0 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:50.660568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-89cb85a6-f1d5-4a54-b1e7-8a730d6c83c0 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:50.685928 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-89cb85a6-f1d5-4a54-b1e7-8a730d6c83c0 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Going to try to start instance {{(pid=137461) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 22:02:50.741372 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-89cb85a6-f1d5-4a54-b1e7-8a730d6c83c0 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action" status: 202 len: 0 microversion: 2.1 time: 0.092501 Jun 25 22:02:50.741973 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3822/7187] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:02:50 2022] POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:02:50.751568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:50.752390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:50.760024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:50.760567 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:50.761319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:50.761779 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:50.897434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:50.905179 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e237016f-c411-4497-8fba-4019f1a17f00 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1678 microversion: 2.1 time: 0.157955 Jun 25 22:02:50.905805 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3366/7188] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:50 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:51.929175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:51.930356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:51.943516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:51.944045 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:51.944846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:51.945280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:52.083497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:52.091968 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a2b0191-e6e3-4eb1-91ab-6127ba0ab955 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1678 microversion: 2.1 time: 0.170256 Jun 25 22:02:52.092575 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3823/7189] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:51 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:02:53.109768 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:02:53.110352 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:02:53.117830 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:53.118295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:53.119067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:02:53.119514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:02:53.257872 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:02:53.265851 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9310df8f-0174-48c5-b307-40871293f387 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1682 microversion: 2.1 time: 0.160164 Jun 25 22:02:53.266438 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3367/7190] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:02:53 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:25.531335 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:25.532287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:25.534543 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=20 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:25.535311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:25.541594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:25.542054 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:25.542825 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:25.543264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:25.600147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-40494c2d-a5bf-4058-9bee-83e26e6fc845 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action" status: 200 len: 60116 microversion: 2.1 time: 0.072608 Jun 25 22:03:25.600851 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3824/7191] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:03:25 2022] POST /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900/action => generated 60116 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:03:29.056066 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:03:29.057458 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:03:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:03:42.883008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:42.884284 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:42.885767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-ab10c6bd-c933-4626-b755-ed0ba9381468 req-87c001ca-679c-45e8-a033-fddbb664658c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ce265ff-e4ba-459a-b8a2-66942807e900", "tag": "0eb1c38b-7c96-460d-8ef0-100183cb4534"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:42.890177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:42.890453 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=20 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:42.891185 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=58 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:42.891631 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=4 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:42.893630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:42.894426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:42.895237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:42.895695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:42.901432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ab10c6bd-c933-4626-b755-ed0ba9381468 req-87c001ca-679c-45e8-a033-fddbb664658c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:42.902024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-ab10c6bd-c933-4626-b755-ed0ba9381468 req-87c001ca-679c-45e8-a033-fddbb664658c service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:42.913694 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-ab10c6bd-c933-4626-b755-ed0ba9381468 req-87c001ca-679c-45e8-a033-fddbb664658c service nova] Creating event network-changed:0eb1c38b-7c96-460d-8ef0-100183cb4534 for instance 1ce265ff-e4ba-459a-b8a2-66942807e900 on nch2-master-1 Jun 25 22:03:42.919601 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-ab10c6bd-c933-4626-b755-ed0ba9381468 req-87c001ca-679c-45e8-a033-fddbb664658c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038059 Jun 25 22:03:42.920216 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3825/7192] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:03:42.926504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:03:43.017564 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53f099ef-fdfe-4a74-aad9-a613e58b439a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 204 len: 0 microversion: 2.1 time: 0.138550 Jun 25 22:03:43.018394 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3368/7193] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:03:42 2022] DELETE /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:03:43.028564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:43.029367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:43.037230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:43.037764 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:43.038759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:43.039367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:43.194333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:43.203644 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f999f411-f6d0-4a08-a7be-b57f8bdfb797 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1688 microversion: 2.1 time: 0.180333 Jun 25 22:03:43.204267 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3826/7194] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:43 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:44.221795 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:44.222513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:44.230245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:44.230711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:44.231493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:44.231938 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:44.373123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:44.381216 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cdbde80f-01ec-4276-8b35-338cb397b488 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1688 microversion: 2.1 time: 0.163743 Jun 25 22:03:44.381808 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3369/7195] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:44 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:45.087280 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f5aa5be8-ee5a-4f6c-9f75-c5db19db9605 req-d3f866c1-35b0-4b8e-9cc3-af449d83ae42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ce265ff-e4ba-459a-b8a2-66942807e900", "name": "network-vif-deleted", "tag": "0eb1c38b-7c96-460d-8ef0-100183cb4534"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:45.103846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f5aa5be8-ee5a-4f6c-9f75-c5db19db9605 req-d3f866c1-35b0-4b8e-9cc3-af449d83ae42 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:45.104294 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f5aa5be8-ee5a-4f6c-9f75-c5db19db9605 req-d3f866c1-35b0-4b8e-9cc3-af449d83ae42 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:45.119155 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f5aa5be8-ee5a-4f6c-9f75-c5db19db9605 req-d3f866c1-35b0-4b8e-9cc3-af449d83ae42 service nova] Creating event network-vif-deleted:0eb1c38b-7c96-460d-8ef0-100183cb4534 for instance 1ce265ff-e4ba-459a-b8a2-66942807e900 on nch2-master-1 Jun 25 22:03:45.126073 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f5aa5be8-ee5a-4f6c-9f75-c5db19db9605 req-d3f866c1-35b0-4b8e-9cc3-af449d83ae42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042944 Jun 25 22:03:45.126696 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3827/7196] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:03:45.399022 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:45.399784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:45.407733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:45.408249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:45.409099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:45.409606 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:45.447522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:45.448599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:45.449295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lazy-loading 'fault' on Instance uuid 1ce265ff-e4ba-459a-b8a2-66942807e900 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:03:45.495211 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:45.507285 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-22ca21b6-4cde-4c62-bfff-e5db9c1f4f09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 200 len: 1356 microversion: 2.1 time: 0.112156 Jun 25 22:03:45.508269 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3370/7197] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:45 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:46.526651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:46.527218 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 1ce265ff-e4ba-459a-b8a2-66942807e900] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:46.533949 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:46.534383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:46.535177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:46.535620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:46.549438 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] HTTP exception thrown: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Request method failure captured: Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 HTTP/1.1 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4QMYUYeio3FZyMcn97N9XjzllnBawFJ_8kR8mRSjIg3OcbmrP53pmI7j8VQ8sR-tyPmIMxtRojnkXh7pMcUeQX1LGXwQmxhFleyNWLP9tB8StwnJJm_mfK05iK9Ey4dP6cKG-OxmFpM20QDMFNB8baSAud-MBjidrJOyyIO37Eoltc Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}] Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3f346fe40c774c4cb8f0f93413823b1f Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '1ce265ff-e4ba-459a-b8a2-66942807e900'} Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:03:46.551094 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Returning 404 to user: Instance 1ce265ff-e4ba-459a-b8a2-66942807e900 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fb232b86-de43-4d01-881d-bcf9ed431cc6 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900" status: 404 len: 111 microversion: 2.1 time: 0.031344 Jun 25 22:03:46.555899 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3828/7198] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:46 2022] GET /compute/v2.1/servers/1ce265ff-e4ba-459a-b8a2-66942807e900 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:03:49.963547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9c574eec-05be-4265-a301-ed72ed37c2c3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '.version_select at 0x7f984c12ed30>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:49.984100 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9c574eec-05be-4265-a301-ed72ed37c2c3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035993593" status: 202 len: 0 microversion: 2.1 time: 0.024637 Jun 25 22:03:49.984762 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3371/7199] 10.222.0.39 () {58 vars in 1283 bytes} [Sat Jun 25 22:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1035993593 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:03:50.018314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-389c74a9-0f78-4c75-bffb-8d0b32910df5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: .version_select at 0x7f984e618670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1910811556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd6BZu3HwuQCoAYs4mtYwilRmW0U6VvUGjwx2iO6nIdbO29hZdwdhlJdn7IWpfi+0d5oyzVXGwgsQ/DZifXY5TLxKIE4fP7irC3A37GMga57yDS2Q/33let+rLmWjlEzw=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:50.034031 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-389c74a9-0f78-4c75-bffb-8d0b32910df5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:03:50.039149 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-389c74a9-0f78-4c75-bffb-8d0b32910df5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:03:50.070910 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-389c74a9-0f78-4c75-bffb-8d0b32910df5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.056263 Jun 25 22:03:50.071633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3829/7200] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 22:03:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:03:55.616546 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:55.621467 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-151888174", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "networks": [{"uuid": "f4437e99-cf4a-4321-834f-eaaef1c05c70"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1910811556", "security_groups": [{"name": "tempest-secgroup-smoke-1697477795"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:55.749523 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] validate_networks() for [('f4437e99-cf4a-4321-834f-eaaef1c05c70', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:03:56.177208 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:03:56.177908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:03:56.178670 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:03:56.179316 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:03:56.179875 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:03:56.197008 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:56.197475 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:56.198338 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:56.198791 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:56.217484 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:03:56.223091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Getting quotas for user 3f346fe40c774c4cb8f0f93413823b1f and project d8abcaad562b4e00a9bae557c0f21e6e. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:03:56.237265 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:03:56.239628 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:03:56.295832 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a84475f5-1acb-4fa4-9671-335cac391b09 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.681358 Jun 25 22:03:56.301992 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3372/7201] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:03:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:03:56.308680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1551ae45-d557-4c9f-b977-918161147fba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:56.309461 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1551ae45-d557-4c9f-b977-918161147fba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:56.398671 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1551ae45-d557-4c9f-b977-918161147fba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:56.416350 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1551ae45-d557-4c9f-b977-918161147fba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1266 microversion: 2.1 time: 0.112760 Jun 25 22:03:56.417038 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3830/7202] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:56 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:57.434893 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:57.435513 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:57.443739 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:57.444204 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:57.445300 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:57.445785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:57.526614 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:57.535217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d91a108b-15a2-4384-9eee-dd006a666ed4 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1324 microversion: 2.1 time: 0.105307 Jun 25 22:03:57.536048 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3373/7203] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:57 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1324 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:58.554264 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:58.555019 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:58.557295 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:03:58.565260 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:58.565804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:58.566594 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:58.567038 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:58.792008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:58.812739 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e92c922c-b354-46ab-940d-7448b56628d7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.262984 Jun 25 22:03:58.813666 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3831/7204] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:58 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:03:58.925057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-4f75553f-07a9-48bd-a28e-7830a1bac0c0 req-1d3d7020-3d4c-40b4-8a99-51762e4382ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f53623-ddf6-48d6-95b4-2a1d4e00ed45", "tag": "60fcfbce-5307-40b9-a465-e17047947278"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:03:58.935591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4f75553f-07a9-48bd-a28e-7830a1bac0c0 req-1d3d7020-3d4c-40b4-8a99-51762e4382ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:58.936111 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-4f75553f-07a9-48bd-a28e-7830a1bac0c0 req-1d3d7020-3d4c-40b4-8a99-51762e4382ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:58.954152 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-4f75553f-07a9-48bd-a28e-7830a1bac0c0 req-1d3d7020-3d4c-40b4-8a99-51762e4382ec service nova] Creating event network-changed:60fcfbce-5307-40b9-a465-e17047947278 for instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 on nch2-master-1 Jun 25 22:03:58.960661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-4f75553f-07a9-48bd-a28e-7830a1bac0c0 req-1d3d7020-3d4c-40b4-8a99-51762e4382ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040182 Jun 25 22:03:58.964627 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3374/7205] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:03:59.830133 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:03:59.830734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:03:59.838383 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:59.838834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:59.839592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:03:59.840028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:03:59.974185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:03:59.985532 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e03431e3-b9ca-43c4-a772-b260c9204e69 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.159017 Jun 25 22:03:59.986345 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3832/7206] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:03:59 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:01.009731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:01.010909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:01.021980 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:01.022763 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:01.024057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:01.025001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:01.159038 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:01.169987 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f48cde08-ff95-44f3-a0a4-27f403a8f17c tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.169162 Jun 25 22:04:01.171052 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3375/7207] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:00 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:02.187719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:02.188381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:02.195575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:02.196037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:02.196834 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:02.197274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:02.371139 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:02.379320 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f5c9d877-7b96-4a1e-b3f4-13c65927fb72 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.195609 Jun 25 22:04:02.379886 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3833/7208] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:02 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:03.401479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:03.402061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:03.409540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:03.410010 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:03.410789 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:03.411237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:03.545717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:03.554145 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-55b7b428-c785-43ef-81a8-48a3134f3002 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.156713 Jun 25 22:04:03.554748 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3376/7209] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:03 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:04.572651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:04.574369 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:04.583075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:04.583702 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:04.584717 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:04.585414 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:04.642318 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-025b7ee4-f614-497f-a4a2-a239534b0687 req-8a9c135f-4676-45d2-849f-c7b1a775c18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f53623-ddf6-48d6-95b4-2a1d4e00ed45", "name": "network-vif-plugged", "status": "completed", "tag": "60fcfbce-5307-40b9-a465-e17047947278"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:04:04.653659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-025b7ee4-f614-497f-a4a2-a239534b0687 req-8a9c135f-4676-45d2-849f-c7b1a775c18e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:04.654114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-025b7ee4-f614-497f-a4a2-a239534b0687 req-8a9c135f-4676-45d2-849f-c7b1a775c18e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:04.665283 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-025b7ee4-f614-497f-a4a2-a239534b0687 req-8a9c135f-4676-45d2-849f-c7b1a775c18e service nova] Creating event network-vif-plugged:60fcfbce-5307-40b9-a465-e17047947278 for instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 on nch2-master-1 Jun 25 22:04:04.670410 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-025b7ee4-f614-497f-a4a2-a239534b0687 req-8a9c135f-4676-45d2-849f-c7b1a775c18e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098985 Jun 25 22:04:04.671020 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3377/7210] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 22:04:04.721652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:04.729520 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-967bd9ec-0c65-483d-bf34-a3ab89863296 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.160988 Jun 25 22:04:04.730321 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3834/7211] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:04 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:05.752519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:05.753272 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:05.760954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:05.761479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:05.762351 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:05.762854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:05.915943 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:05.928078 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6b4ab7be-f60b-43aa-9511-ee475d2f4865 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1392 microversion: 2.1 time: 0.183018 Jun 25 22:04:05.929101 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3378/7212] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:05 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:06.950210 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:06.950804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:06.952848 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:06.959753 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:06.960191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:06.961012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:06.961455 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:07.098798 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:07.107277 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b28858ef-14ed-4c09-bdd6-ab7ec57b42ee tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1563 microversion: 2.1 time: 0.161448 Jun 25 22:04:07.107865 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3835/7213] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:06 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:07.124298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:07.124931 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:07.127092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:07.127815 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:07.134704 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:07.135166 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:07.135948 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:07.136391 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:07.282411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:07.290553 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-031c3373-49c6-4c25-97e0-bb38143dfd1e tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1563 microversion: 2.1 time: 0.170211 Jun 25 22:04:07.291261 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3379/7214] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:07 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:08.923487 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-16ac82cc-e206-40a5-811a-0d7cc9e4eddc req-3f5b1aa2-489d-43d9-a818-c5c0a16b9425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f53623-ddf6-48d6-95b4-2a1d4e00ed45", "tag": "60fcfbce-5307-40b9-a465-e17047947278"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:04:08.927673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:04:08.928290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:08.940314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:08.940897 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:08.941145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-16ac82cc-e206-40a5-811a-0d7cc9e4eddc req-3f5b1aa2-489d-43d9-a818-c5c0a16b9425 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:08.941598 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-16ac82cc-e206-40a5-811a-0d7cc9e4eddc req-3f5b1aa2-489d-43d9-a818-c5c0a16b9425 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:08.941714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:08.942106 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:08.953477 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-16ac82cc-e206-40a5-811a-0d7cc9e4eddc req-3f5b1aa2-489d-43d9-a818-c5c0a16b9425 service nova] Creating event network-changed:60fcfbce-5307-40b9-a465-e17047947278 for instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 on nch2-master-1 Jun 25 22:04:08.959249 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-16ac82cc-e206-40a5-811a-0d7cc9e4eddc req-3f5b1aa2-489d-43d9-a818-c5c0a16b9425 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039495 Jun 25 22:04:08.960149 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3380/7215] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:04:09.176282 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:04:09.184539 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ba9ff8ad-b908-4b9d-91a9-9ad0b0218c22 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1563 microversion: 2.1 time: 0.266859 Jun 25 22:04:09.185448 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3836/7216] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:04:08 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:04:42.558864 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:42.560019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=38 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:04:42.567321 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:04:42.569053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:04:42.578951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:42.579426 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:42.580201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:04:42.580688 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:04:42.631546 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f41bfd7e-3a22-4fe6-a5a7-5b141d6cbde7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action" status: 200 len: 24569 microversion: 2.1 time: 0.076169 Jun 25 22:04:42.632175 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3381/7217] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:04:42 2022] POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action => generated 24569 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:05:09.130017 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:05:09.130801 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:05:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:05:13.143074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:13.144121 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=36 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:13.392976 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:13.393567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:13.399716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:13.400184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:13.400953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:13.401392 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:13.424241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lazy-loading 'flavor' on Instance uuid 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:05:13.499452 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a1fcec8e-c9c4-4221-b952-56e6729e6603 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action" status: 202 len: 0 microversion: 2.1 time: 0.359527 Jun 25 22:05:13.500069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3837/7218] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:05:13 2022] POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:05:13.509298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:13.510015 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:13.512673 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=4 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:13.513310 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:13.519245 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:13.519697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:13.520514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:13.520969 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:13.656280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:13.667123 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1da38823-cf7b-411a-9fb7-79f5236c4c80 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1690 microversion: 2.1 time: 0.162081 Jun 25 22:05:13.668013 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3382/7219] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:13 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:14.697207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:14.698234 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:14.706363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:14.706833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:14.707570 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:14.708029 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:15.149205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:15.157419 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-30186b0c-3c88-4366-b3c0-7edcfad257ba tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1690 microversion: 2.1 time: 0.469698 Jun 25 22:05:15.158007 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3838/7220] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:14 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1690 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:16.175740 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:16.176298 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:16.187349 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:16.187829 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:16.188659 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:16.189115 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:16.329681 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:16.341788 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d777635a-933c-46f4-861c-1d12cc3e065f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1673 microversion: 2.1 time: 0.169966 Jun 25 22:05:16.342530 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3383/7221] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:16 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:17.437483 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:17.438472 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:17.445660 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.446117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.446885 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.447324 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.499658 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-76890009-8ecb-451d-90cc-f45fba6225c7 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action" status: 200 len: 36262 microversion: 2.1 time: 0.067187 Jun 25 22:05:17.500278 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3839/7222] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:05:17 2022] POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action => generated 36262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:05:17.514364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:17.514934 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:17.522568 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.523069 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.523836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.524278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.591792 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f3449a62-a00b-4ede-9a87-186b45c905b3 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action" status: 202 len: 0 microversion: 2.1 time: 0.083248 Jun 25 22:05:17.592742 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3384/7223] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:05:17 2022] POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:05:17.601182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:17.601886 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:17.609238 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.609689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.610460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:17.610892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:17.830864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:17.839377 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a4318328-0dd0-4874-af5b-faeb4218af29 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1679 microversion: 2.1 time: 0.242327 Jun 25 22:05:17.840006 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3840/7224] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:17 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1679 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:18.858365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:18.859087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:18.867092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:18.867564 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:18.868339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:18.868827 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:19.004653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:19.013107 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f187c783-ed0a-4ee3-954c-8a0a65da9f59 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1679 microversion: 2.1 time: 0.159022 Jun 25 22:05:19.013687 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3385/7225] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:18 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:20.034910 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:20.035920 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:20.047290 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:20.047751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:20.048572 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:20.049013 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:20.196553 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:20.204358 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d28f3baf-5ea4-4e6f-baa2-1d34f62cb5f5 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1682 microversion: 2.1 time: 0.176192 Jun 25 22:05:20.204961 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3841/7226] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:20 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:20.299995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:20.300984 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:20.308404 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:20.308894 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:20.309665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:20.310168 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:20.353752 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60787342-c9a0-4877-8e0f-d03bd0029ac8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action" status: 200 len: 36262 microversion: 2.1 time: 0.057525 Jun 25 22:05:20.354399 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3386/7227] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:05:20 2022] POST /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45/action => generated 36262 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 22:05:21.441008 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:21.441538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:21.449154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:21.449968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:21.451022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:21.451639 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:21.482384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:05:21.569810 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-69753e15-a549-4e29-b353-07c253fa2d3a tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 204 len: 0 microversion: 2.1 time: 0.132870 Jun 25 22:05:21.570456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3842/7228] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:05:21 2022] DELETE /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:05:21.579541 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:21.580248 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:21.587220 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:21.587674 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:21.589165 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:21.589614 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:21.612584 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-51412437-3c57-4670-aace-1aca0088cd9e req-12097afd-fb4d-49fe-bbaa-92b3d7645c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64f53623-ddf6-48d6-95b4-2a1d4e00ed45", "tag": "60fcfbce-5307-40b9-a465-e17047947278"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:21.621094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-51412437-3c57-4670-aace-1aca0088cd9e req-12097afd-fb4d-49fe-bbaa-92b3d7645c29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:21.621636 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-51412437-3c57-4670-aace-1aca0088cd9e req-12097afd-fb4d-49fe-bbaa-92b3d7645c29 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:21.633165 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-51412437-3c57-4670-aace-1aca0088cd9e req-12097afd-fb4d-49fe-bbaa-92b3d7645c29 service nova] Creating event network-changed:60fcfbce-5307-40b9-a465-e17047947278 for instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 on nch2-master-1 Jun 25 22:05:21.638286 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-51412437-3c57-4670-aace-1aca0088cd9e req-12097afd-fb4d-49fe-bbaa-92b3d7645c29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191611 Jun 25 22:05:21.639111 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3387/7229] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:05:21.723821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:21.731827 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-3a75f2cf-6d68-4627-b664-af5f30ccea32 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1688 microversion: 2.1 time: 0.156611 Jun 25 22:05:21.732435 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3843/7230] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:21 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:22.752867 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:22.753612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:22.760596 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:22.761062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:22.761844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:22.762290 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:22.904658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:22.912670 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-73cde60e-bcae-4d13-8ca1-98851c626cd1 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1688 microversion: 2.1 time: 0.165348 Jun 25 22:05:22.913252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3388/7231] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:22 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:23.718070 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-f031a539-b56a-43ba-afb4-b884ca172a2e req-dd46accb-6ab4-40a4-aeac-1b6d20de6a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64f53623-ddf6-48d6-95b4-2a1d4e00ed45", "name": "network-vif-deleted", "tag": "60fcfbce-5307-40b9-a465-e17047947278"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:23.729466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f031a539-b56a-43ba-afb4-b884ca172a2e req-dd46accb-6ab4-40a4-aeac-1b6d20de6a8d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:23.729919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-f031a539-b56a-43ba-afb4-b884ca172a2e req-dd46accb-6ab4-40a4-aeac-1b6d20de6a8d service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:23.743993 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-f031a539-b56a-43ba-afb4-b884ca172a2e req-dd46accb-6ab4-40a4-aeac-1b6d20de6a8d service nova] Creating event network-vif-deleted:60fcfbce-5307-40b9-a465-e17047947278 for instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 on nch2-master-1 Jun 25 22:05:23.749632 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-f031a539-b56a-43ba-afb4-b884ca172a2e req-dd46accb-6ab4-40a4-aeac-1b6d20de6a8d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036366 Jun 25 22:05:23.750270 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3844/7232] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:05:23.935612 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:23.936233 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:23.944024 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:23.944555 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:23.945380 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:23.945852 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:23.981559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:23.982055 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:23.982522 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lazy-loading 'fault' on Instance uuid 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:05:24.024692 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f346fe40c774c4cb8f0f93413823b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8abcaad562b4e00a9bae557c0f21e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:24.032708 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ae416d7f-d973-484e-b3a0-1f54e16b351f tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 200 len: 1506 microversion: 2.1 time: 0.103859 Jun 25 22:05:24.033345 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3389/7233] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:23 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 1506 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:25.057155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:25.059474 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] [instance: 64f53623-ddf6-48d6-95b4-2a1d4e00ed45] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:25.070567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:25.071301 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:25.073405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:25.073405 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:25.088669 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] HTTP exception thrown: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Request method failure captured: Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 HTTP/1.1 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4QMYUYeio3FZyMcn97N9XjzllnBawFJ_8kR8mRSjIg3OcbmrP53pmI7j8VQ8sR-tyPmIMxtRojnkXh7pMcUeQX1LGXwQmxhFleyNWLP9tB8StwnJJm_mfK05iK9Ey4dP6cKG-OxmFpM20QDMFNB8baSAud-MBjidrJOyyIO37Eoltc Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_d8abcaad562b4e00a9bae557c0f21e6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/d8abcaad562b4e00a9bae557c0f21e6e"}]}] Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: d8abcaad562b4e00a9bae557c0f21e6e Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1994412494 Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 3f346fe40c774c4cb8f0f93413823b1f Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1994412494-project Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '64f53623-ddf6-48d6-95b4-2a1d4e00ed45'} Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:05:25.090360 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Returning 404 to user: Instance 64f53623-ddf6-48d6-95b4-2a1d4e00ed45 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e29be8c-bd11-48f5-93c3-ffb4bb842dc8 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45" status: 404 len: 111 microversion: 2.1 time: 0.043286 Jun 25 22:05:25.095147 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3845/7234] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:25 2022] GET /compute/v2.1/servers/64f53623-ddf6-48d6-95b4-2a1d4e00ed45 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:05:28.481355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7818e96d-57dc-4c32-a0fd-75bba9a4f651 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] Calling method '.version_select at 0x7f984f443f70>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:28.504565 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7818e96d-57dc-4c32-a0fd-75bba9a4f651 tempest-TestNetworkAdvancedServerOps-1994412494 tempest-TestNetworkAdvancedServerOps-1994412494-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1910811556" status: 202 len: 0 microversion: 2.1 time: 0.026917 Jun 25 22:05:28.505145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3390/7235] 10.222.0.39 () {58 vars in 1283 bytes} [Sat Jun 25 22:05:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1910811556 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 22:05:39.495917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:39.496805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:39.668615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-80c895cc-2918-44b3-a3fd-099dfd51099f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'create', calling method: .version_select at 0x7f984e5e6e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1853742998", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAykm14ia4D4LiQJ+PeIxFLnigbsFwS5rTbkmFDjZXYy2wHmQdNnt+74NH44kkxFI4WGq3BDGenMT9/cWyC8iVLhnQHIFr5D1c3QSi15r7lebpTjFGUIVt3uq4gQqm4FMA=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:39.685195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-80c895cc-2918-44b3-a3fd-099dfd51099f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:05:39.693916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-80c895cc-2918-44b3-a3fd-099dfd51099f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for user bd5bd999a2b74f6b820b67f376486e7e and project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:05:39.725716 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-80c895cc-2918-44b3-a3fd-099dfd51099f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235443 Jun 25 22:05:39.726767 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3846/7236] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 22:05:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:05:40.824042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:40.824906 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:40.828989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-89077086", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1853742998", "security_groups": [{"name": "tempest-secgroup-smoke-487903601"}], "networks": [{"uuid": "c6b642a8-0928-409f-bf2c-1f324ca487ac"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:40.938291 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] validate_networks() for [('c6b642a8-0928-409f-bf2c-1f324ca487ac', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:05:41.333145 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:05:41.333679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:05:41.334249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:05:41.335249 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:05:41.335742 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:05:41.345289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:41.345748 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:41.346557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:41.346996 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:41.369083 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:05:41.375091 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for user bd5bd999a2b74f6b820b67f376486e7e and project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:05:41.388992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:05:41.391342 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:05:41.444983 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c1742815-80c0-418c-bec1-41a2f3758c94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.622712 Jun 25 22:05:41.445788 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3391/7237] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:05:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:05:41.456016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c96dd7f4-7a9d-4831-8baf-f8ff3472283d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:41.456772 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c96dd7f4-7a9d-4831-8baf-f8ff3472283d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:41.524169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-c96dd7f4-7a9d-4831-8baf-f8ff3472283d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:41.531772 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c96dd7f4-7a9d-4831-8baf-f8ff3472283d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1245 microversion: 2.1 time: 0.079715 Jun 25 22:05:41.532408 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3847/7238] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:41 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:42.550215 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:42.550979 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:42.569237 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:42.569731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:42.575144 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:42.575961 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:42.678997 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:42.689510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c220540b-0945-43f7-bf6a-85557124d80e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1303 microversion: 2.1 time: 0.144033 Jun 25 22:05:42.690872 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3392/7239] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:42 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:43.707206 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:43.708090 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:43.715806 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:43.716769 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:43.717864 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:43.718751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:43.940142 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:43.966921 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81895764-001f-430e-bd96-6f7a18698e79 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.263626 Jun 25 22:05:43.968511 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3848/7240] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:43 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:44.191470 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-62f2c393-9459-44b9-89eb-2883f1269a5b req-edc706a3-07a4-433f-b6be-79e3f5c01fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:44.221838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62f2c393-9459-44b9-89eb-2883f1269a5b req-edc706a3-07a4-433f-b6be-79e3f5c01fff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:44.222306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-62f2c393-9459-44b9-89eb-2883f1269a5b req-edc706a3-07a4-433f-b6be-79e3f5c01fff service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:44.249012 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-62f2c393-9459-44b9-89eb-2883f1269a5b req-edc706a3-07a4-433f-b6be-79e3f5c01fff service nova] Creating event network-changed:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:05:44.255031 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-62f2c393-9459-44b9-89eb-2883f1269a5b req-edc706a3-07a4-433f-b6be-79e3f5c01fff service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069891 Jun 25 22:05:44.257036 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3393/7241] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:05:44.984005 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:44.984732 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:44.992157 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:44.992646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:44.993423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:44.993870 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:45.133507 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:45.142337 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-51caa159-bc2a-468a-91e4-8a357232294d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.162297 Jun 25 22:05:45.142990 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3849/7242] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:44 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:46.164994 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:46.165840 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:46.175390 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:46.175866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:46.176721 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:46.177176 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:46.316097 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:46.324589 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-797adba1-44eb-4815-9c5f-8c3cf4c85298 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.164794 Jun 25 22:05:46.325171 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3394/7243] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:46 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:47.346522 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:47.347585 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:47.359028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:47.359804 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:47.361114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:47.361842 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:47.504024 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:47.511767 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7bb0f11e-1eb7-426f-bca9-208d7fae8e40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.172154 Jun 25 22:05:47.512355 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3850/7244] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:47 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:48.528888 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:48.529505 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:48.537039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:48.537541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:48.538332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:48.538784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:48.687603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:48.695598 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-fee90dc4-b48c-42b8-8a14-c9807a8ac217 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.170793 Jun 25 22:05:48.696198 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3395/7245] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:48 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:49.125548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-dc3f9e63-fabb-4ac6-a0f1-1048a9e1474b req-af7c1dfc-ff77-4ffa-84b4-e03eaf490c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "name": "network-vif-plugged", "status": "completed", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:49.136598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc3f9e63-fabb-4ac6-a0f1-1048a9e1474b req-af7c1dfc-ff77-4ffa-84b4-e03eaf490c30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:49.137205 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-dc3f9e63-fabb-4ac6-a0f1-1048a9e1474b req-af7c1dfc-ff77-4ffa-84b4-e03eaf490c30 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:49.151263 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-dc3f9e63-fabb-4ac6-a0f1-1048a9e1474b req-af7c1dfc-ff77-4ffa-84b4-e03eaf490c30 service nova] Creating event network-vif-plugged:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:05:49.156588 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-dc3f9e63-fabb-4ac6-a0f1-1048a9e1474b req-af7c1dfc-ff77-4ffa-84b4-e03eaf490c30 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034881 Jun 25 22:05:49.157422 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3851/7246] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:05:49.717392 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:49.718035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:49.725857 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:49.726353 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:49.727207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:49.727662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:49.867574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:49.878771 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-89947617-c09b-40d1-b353-9a0fbfb5d5f4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1370 microversion: 2.1 time: 0.167695 Jun 25 22:05:49.879560 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3396/7247] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:49 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:50.897465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:50.898207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:50.905079 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:50.905539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:50.906304 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:50.906742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:51.047518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:51.055980 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2d35ecc-d6aa-4137-9a1c-72709efc7873 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1553 microversion: 2.1 time: 0.163737 Jun 25 22:05:51.056587 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3852/7248] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:50 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:05:51.072460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:05:51.073119 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:05:51.080281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:51.080785 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:51.081552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:51.082016 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:51.224971 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:05:51.232938 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7537d6aa-a468-45ad-9016-a581f8f78018 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1553 microversion: 2.1 time: 0.164287 Jun 25 22:05:51.233533 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3397/7249] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:05:51 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:05:53.346548 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-14c6dec5-eee9-4a2c-a119-7b6787022940 req-9bd20e97-bbf1-4cb3-8e0d-d96f315cb723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:05:53.351251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:05:53.356672 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-14c6dec5-eee9-4a2c-a119-7b6787022940 req-9bd20e97-bbf1-4cb3-8e0d-d96f315cb723 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:05:53.357126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-14c6dec5-eee9-4a2c-a119-7b6787022940 req-9bd20e97-bbf1-4cb3-8e0d-d96f315cb723 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:05:53.368475 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-14c6dec5-eee9-4a2c-a119-7b6787022940 req-9bd20e97-bbf1-4cb3-8e0d-d96f315cb723 service nova] Creating event network-changed:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:05:53.373663 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-14c6dec5-eee9-4a2c-a119-7b6787022940 req-9bd20e97-bbf1-4cb3-8e0d-d96f315cb723 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030947 Jun 25 22:05:53.374320 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3853/7250] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 22:08:19.455706 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:08:19.457301 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:08:19.457987 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:19.459169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:19.460385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:19.461701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=34 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:19.469067 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:08:19.470025 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:19.478539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:19.479066 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:19.479835 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:19.480279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:19.503863 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.objects.instance [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lazy-loading 'flavor' on Instance uuid d7a79897-2d64-4fa4-9583-3041c7ce5bf3 {{(pid=137462) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:08:19.914620 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [cd87511b-21c2-4e66-8e64-03881b86cbb8] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:08:20.473402 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42504. Jun 25 22:08:20.474645 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42502. Jun 25 22:08:20.926956 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [cd87511b-21c2-4e66-8e64-03881b86cbb8] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42506. Jun 25 22:08:20.932930 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-8ff28879-3c0d-4710-abc5-92947ab663b5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3/action" status: 202 len: 0 microversion: 2.1 time: 1.480554 Jun 25 22:08:20.935217 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3398/7251] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:08:19 2022] POST /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3/action => generated 0 bytes in 1483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:08:20.943048 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:08:20.943889 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:08:20.944456 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:20.945345 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=28 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:20.949917 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:20.950627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:20.958207 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:20.958664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:20.959433 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:20.959873 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:21.149909 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:21.157813 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d14ccae-c4a4-48c2-a396-4b30f91cb550 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.216647 Jun 25 22:08:21.158368 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3854/7252] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:20 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:22.182514 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:22.183281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:22.194899 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:22.195572 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:22.196828 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:22.197490 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:22.342574 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:22.350453 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-498d789b-de67-41de-9723-84f15d9e862e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.176938 Jun 25 22:08:22.351041 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3399/7253] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:22 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:23.368037 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:23.368664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:23.378195 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:23.378649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:23.379448 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:23.379862 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:23.386928 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42520. Jun 25 22:08:23.397217 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 42522. Jun 25 22:08:23.520475 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:23.528467 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-805414f1-9931-4eb6-a795-7f62c513c39c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.164547 Jun 25 22:08:23.529081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3855/7254] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:23 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:24.549968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:24.551059 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:24.562955 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:24.563632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:24.564977 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:24.565731 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:24.708163 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:24.716534 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ee7851f9-7992-4d81-9114-ae850450c9ff tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.173168 Jun 25 22:08:24.717137 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3400/7255] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:24 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:25.738546 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:25.739627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:25.747223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:25.747682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:25.748485 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:25.748980 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:25.886767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:25.894530 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13df7e57-d3ce-4bd1-b981-92046f26ae70 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.163081 Jun 25 22:08:25.895082 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3856/7256] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:25 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:26.916413 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:26.917479 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:26.929463 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:26.930240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:26.931521 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:26.932270 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:27.080001 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:27.088767 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b0ae6dda-1fec-4c9a-b1dc-c510f652045e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.179096 Jun 25 22:08:27.089339 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3401/7257] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:26 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:28.110519 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:28.111427 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:28.120452 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:28.120922 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:28.121690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:28.122126 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:28.263846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:28.276371 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9133114d-420c-453c-9565-91ac26adce92 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.172443 Jun 25 22:08:28.277226 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3857/7258] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:28 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:29.072542 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:08:29.072987 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:08:29.142576 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:08:29.142576 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:08:29.298201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:29.299193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:29.311184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:29.311953 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:29.313296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:29.314044 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:29.331440 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:08:29.331610 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:08:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 (ip 10.222.0.39) !!! Jun 25 22:08:29.459043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:29.471448 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-bfc2f25a-8481-4a6f-bc38-0bfb44ee44ea tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.179859 Jun 25 22:08:29.472029 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3402/7259] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:29 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:30.497887 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:30.498937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:30.512454 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:30.512906 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:30.513704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:30.514140 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:30.651016 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:30.662104 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-41af850c-892d-4660-80a7-46756a8f7e8f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.170831 Jun 25 22:08:30.662845 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3858/7260] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:30 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:31.683437 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:31.684482 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:31.694607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:31.695222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:31.696254 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:31.696889 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:31.859201 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:31.867576 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aa0be30a-859c-4060-8084-d0e9d1fa7880 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.190849 Jun 25 22:08:31.868139 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3403/7261] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:31 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:32.887654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:32.888715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:32.900900 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:32.901667 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:32.902958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:32.903710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:33.043514 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:33.054951 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-48c988e0-551d-4d2f-a082-a653e1b2c12f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1699 microversion: 2.1 time: 0.173461 Jun 25 22:08:33.055699 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3859/7262] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:32 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1699 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:34.078585 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:34.079397 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:34.088540 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:34.088854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:34.089637 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:34.090094 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:34.234541 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:34.242751 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-474b3ca2-13ea-4c3a-ba0d-5ef61b832c42 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1699 microversion: 2.1 time: 0.169048 Jun 25 22:08:34.243342 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3404/7263] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:34 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:08:35.264556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:35.265755 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:35.277684 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:35.278451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:35.279742 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:35.280497 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:35.423186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:35.431453 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-823e5ead-d657-4ed4-8bcd-55fa2508cef6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1699 microversion: 2.1 time: 0.173566 Jun 25 22:08:35.432041 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3860/7264] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:35 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1699 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:36.037620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-db9ff993-2e39-4c68-b199-7f8519208900 req-c95545a1-1efd-40c8-a15f-da5432ed584a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "name": "network-vif-plugged", "status": "completed", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:08:36.047084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-db9ff993-2e39-4c68-b199-7f8519208900 req-c95545a1-1efd-40c8-a15f-da5432ed584a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:36.047512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-db9ff993-2e39-4c68-b199-7f8519208900 req-c95545a1-1efd-40c8-a15f-da5432ed584a service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:36.059129 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-db9ff993-2e39-4c68-b199-7f8519208900 req-c95545a1-1efd-40c8-a15f-da5432ed584a service nova] Creating event network-vif-plugged:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:08:36.064222 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-db9ff993-2e39-4c68-b199-7f8519208900 req-c95545a1-1efd-40c8-a15f-da5432ed584a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030492 Jun 25 22:08:36.065024 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3405/7265] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:08:36.450531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:36.451110 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:36.459954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:36.460412 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:36.461228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:36.461673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:36.609384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:36.621178 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-73a5dcf6-5530-41e3-91ec-ddc4fedb9f9b tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1699 microversion: 2.1 time: 0.175169 Jun 25 22:08:36.621977 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3861/7266] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:36 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1699 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:37.642053 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:37.644159 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:37.651013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:37.651480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:37.652262 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:37.652738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:37.794756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:37.803311 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-842aeb26-9869-407b-9957-178756ef6cb2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.167104 Jun 25 22:08:37.804340 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3406/7267] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:37 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:38.821576 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:38.822431 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:38.831179 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:38.831912 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:38.832836 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:38.833592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:38.978542 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:38.989786 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-cf649391-ecc6-49c8-80a0-b15ef1711622 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.172940 Jun 25 22:08:38.990633 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3862/7268] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:38 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:38.994164 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:08:38.994556 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:08:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:08:40.006668 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:40.007288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:40.014712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:40.015447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:40.016244 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:40.016728 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:40.168859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:40.177503 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4433ce7b-18b0-4e64-8310-0c1fe3b3a1c6 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.174762 Jun 25 22:08:40.178191 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3407/7269] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:40 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:41.195551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:41.196116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:41.203391 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:41.204129 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:41.205371 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:41.205966 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:41.370161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:41.381732 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ca863deb-93dc-4fe6-a354-4b0822e3e7b4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.190337 Jun 25 22:08:41.391245 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3863/7270] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:41 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:42.401783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:42.402416 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:42.411538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:42.412136 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:42.412986 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:42.413440 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:42.586042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:42.594459 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4120f173-7a99-4c59-bee4-47c430c68ec9 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.196550 Jun 25 22:08:42.602662 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3408/7271] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:42 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:08:43.611827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:43.612395 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:43.624000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:43.624596 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:43.625578 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:43.626272 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:43.799678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:43.808714 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-79662dd5-245e-4792-b48e-1694984ee14a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.201235 Jun 25 22:08:43.819796 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3864/7272] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:43 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:44.827412 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:44.828004 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:44.836240 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:44.836738 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:44.837531 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:44.837978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:45.005705 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:45.013556 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c4033299-41b0-40ae-8027-f1705eea2fe8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.190700 Jun 25 22:08:45.014145 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3409/7273] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:44 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:46.035276 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:46.036296 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:46.048221 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:46.049033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:46.050287 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:46.051018 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:46.575363 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:46.583656 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1291de91-e910-44b1-8fc3-2d5c452f9206 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1694 microversion: 2.1 time: 0.555034 Jun 25 22:08:46.584465 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3865/7274] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:46 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1694 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:47.604155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:47.605009 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:47.614744 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:47.615365 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:47.616481 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:47.617046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:47.763269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:47.773150 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2b25d5f5-6afd-436b-b456-c52bfb0cdffa tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1676 microversion: 2.1 time: 0.174429 Jun 25 22:08:47.773780 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3410/7275] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:47 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:48.803208 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:48.805297 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:48.813340 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:48.813814 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:48.814601 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:48.815051 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:48.964723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:48.972764 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-8bfef512-0dbc-4c3c-8aa1-7258d0e26a14 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1676 microversion: 2.1 time: 0.176199 Jun 25 22:08:48.973456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3866/7276] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:48 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:49.991210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:49.991836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:49.995147 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=27 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:50.000978 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.001442 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.002228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.002679 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.007012 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:50.040649 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-9d0811ff-caa8-4f94-a99b-3645eb268b29 req-3acf2d1d-9275-43d8-8122-ea23d3f00e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "name": "network-vif-unplugged", "status": "completed", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:08:50.050279 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9d0811ff-caa8-4f94-a99b-3645eb268b29 req-3acf2d1d-9275-43d8-8122-ea23d3f00e97 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.051612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-9d0811ff-caa8-4f94-a99b-3645eb268b29 req-3acf2d1d-9275-43d8-8122-ea23d3f00e97 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.066567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.compute.server_external_events [req-9d0811ff-caa8-4f94-a99b-3645eb268b29 req-3acf2d1d-9275-43d8-8122-ea23d3f00e97 service nova] Unable to find a host for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3. Dropping event network-vif-unplugged {{(pid=137461) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 22:08:50.067563 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-9d0811ff-caa8-4f94-a99b-3645eb268b29 req-3acf2d1d-9275-43d8-8122-ea23d3f00e97 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031097 Jun 25 22:08:50.068250 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3867/7277] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 22:08:50.143862 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:50.155123 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d2397f8d-afcb-4691-aef7-2dadc06edf9a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1619 microversion: 2.1 time: 0.167736 Jun 25 22:08:50.156040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3411/7278] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:49 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1619 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:50.176075 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:08:50.176775 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:50.183152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.183612 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.184381 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.184847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.334838 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-16c739fd-1025-431e-ac0b-4aeafe1d5b08 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3/action" status: 202 len: 0 microversion: 2.1 time: 0.162749 Jun 25 22:08:50.335441 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3868/7279] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:08:50 2022] POST /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:08:50.344271 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:50.344930 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:50.351368 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.352046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.352897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:50.353444 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:50.493684 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:50.501895 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-388ace6f-2634-4bd6-b16f-55391f2a4d6e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1627 microversion: 2.1 time: 0.161618 Jun 25 22:08:50.502470 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3412/7280] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:50 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:51.520270 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:51.520946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:51.522783 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=33 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:51.528473 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:51.528953 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:51.529714 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:51.530143 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:51.532882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:08:51.700463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:51.709775 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6787e07-9868-4196-8667-bb24d6a83390 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.194441 Jun 25 22:08:51.710430 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3869/7281] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:51 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:52.736460 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:52.738951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:52.749609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:52.750173 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:52.753343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:52.756190 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:52.904781 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:52.912537 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-1a97b1b1-18dc-4ec3-8c5f-123e0932f3f1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.186564 Jun 25 22:08:52.913124 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3413/7282] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:52 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:53.931943 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:53.933509 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:53.940071 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:53.940663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:53.941518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:53.942028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:54.093343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:54.101942 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-58021a77-9d44-4bf3-819c-db5804d36c96 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.174801 Jun 25 22:08:54.102846 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3870/7283] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:53 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:55.119717 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:55.120491 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:55.135883 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:55.136806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:55.138146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:55.138951 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:55.302937 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:55.307989 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c6160bec-0b37-434d-9f56-e99551b0d1c3 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.192418 Jun 25 22:08:55.308659 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3414/7284] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:55 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:56.326169 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:56.327077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:56.334354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:56.334791 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:56.335664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:56.336069 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:56.484336 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:56.492456 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bc927dc1-b9a0-4b5f-881a-13f011a0b5ed tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.170150 Jun 25 22:08:56.493241 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3871/7285] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:56 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:57.509519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:57.510172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:57.517516 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:57.517988 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:57.518784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:57.519234 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:57.680597 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:57.688788 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c43b721b-e5e0-4bce-9762-1ff636f09495 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.183261 Jun 25 22:08:57.689376 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3415/7286] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:57 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:58.709370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:58.710818 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:58.719406 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:58.719861 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:58.720676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:58.721120 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:58.870330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:08:58.878594 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ed514e7e-b8c7-4e1e-94ff-bdc9a4226da1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.174840 Jun 25 22:08:58.879187 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3872/7287] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:58 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:08:59.900993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:08:59.901806 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:08:59.911377 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:59.911989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:08:59.913056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:08:59.913648 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:00.348364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:00.360173 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-cdcfc76b-0a23-4035-b9c9-40aa7ccfc41a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.464332 Jun 25 22:09:00.360995 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3416/7288] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:08:59 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:01.382096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:01.383251 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:01.391822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:01.392278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:01.393081 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:01.393516 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:01.532869 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:01.540570 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-bfdabba0-879f-4940-ab09-544cf3fb367d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.165158 Jun 25 22:09:01.541466 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3873/7289] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:01 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:02.565403 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:02.566443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:02.575877 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:02.576341 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:02.577170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:02.577652 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:02.747797 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:02.755765 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2d30177d-9788-4f81-ae61-cbde5d0eb6f5 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.196301 Jun 25 22:09:02.756349 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3417/7290] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:02 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:03.774640 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:03.775274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:03.782998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:03.783464 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:03.784245 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:03.784728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:03.918199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:03.925945 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0818482d-c6f3-419b-9f57-831766bc88e1 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.155333 Jun 25 22:09:03.926530 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3874/7291] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:03 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:04.947697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:04.948808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:04.956148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:04.956658 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:04.957443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:04.957895 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:05.098466 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:05.106347 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2f21401f-90ed-4d28-8071-0af859c2a059 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.165359 Jun 25 22:09:05.106956 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3418/7292] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:04 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:06.124778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:06.125372 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:06.132856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:06.133310 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:06.134077 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:06.134518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:06.273107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:06.281345 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ee64a634-3494-496e-961a-8f86f57f499d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.160826 Jun 25 22:09:06.281952 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3875/7293] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:06 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:07.303222 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:07.304295 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:07.316065 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:07.316885 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:07.318160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:07.318900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:07.466794 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:07.474819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d88f966e-3a56-4811-9803-0db7f6b25dc2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.178356 Jun 25 22:09:07.475429 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3419/7294] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:07 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:08.491934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:08.492607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:08.500166 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:08.500664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:08.501462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:08.501911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:08.642291 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:08.650159 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9d9a8c03-37bd-4973-a87b-10e943d9ba91 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.162409 Jun 25 22:09:08.650917 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3876/7295] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:08 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:09.671663 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:09.672724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:09.684179 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:09.684697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:09.685493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:09.685954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:09.823850 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:09.831814 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-38f88106-9937-4971-a4c3-2f987e3e4079 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.167019 Jun 25 22:09:09.832398 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3420/7296] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:09 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:10.227734 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-4dbbfaa4-1386-4193-9f14-7a0c4a620896 req-d9c99cd6-fad5-4159-839e-14d917bbac80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "name": "network-vif-plugged", "status": "completed", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:09:10.236108 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4dbbfaa4-1386-4193-9f14-7a0c4a620896 req-d9c99cd6-fad5-4159-839e-14d917bbac80 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:10.236588 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-4dbbfaa4-1386-4193-9f14-7a0c4a620896 req-d9c99cd6-fad5-4159-839e-14d917bbac80 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:10.247711 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-4dbbfaa4-1386-4193-9f14-7a0c4a620896 req-d9c99cd6-fad5-4159-839e-14d917bbac80 service nova] Creating event network-vif-plugged:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:09:10.253726 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-4dbbfaa4-1386-4193-9f14-7a0c4a620896 req-d9c99cd6-fad5-4159-839e-14d917bbac80 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090788 Jun 25 22:09:10.254315 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3877/7297] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:09:10.850954 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:10.851620 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:10.859241 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:10.859719 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:10.860545 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:10.861005 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:11.008280 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:11.016128 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-70407806-67e1-4e6b-8500-e3126258cc98 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.169274 Jun 25 22:09:11.016754 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3421/7298] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:10 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:12.044152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:12.044965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:12.051662 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:12.052114 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:12.052911 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:12.053348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:12.193872 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:12.202182 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0a46ebd6-1dec-4568-b59c-5f4d79686e3e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1685 microversion: 2.1 time: 0.167638 Jun 25 22:09:12.202750 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3878/7299] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:12 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:09:13.220808 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:09:13.221486 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:09:13.228871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:13.229343 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:13.230113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:09:13.230556 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:09:13.362409 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:09:13.370130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-055e071c-0818-43b6-b166-e917a80d6db8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1672 microversion: 2.1 time: 0.153327 Jun 25 22:09:13.370709 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3422/7300] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:09:13 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:10:37.960735 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:10:37.961523 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:10:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:10:58.593895 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=19 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:58.595278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=55 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:58.599813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:10:58.600051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=23 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:58.600909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=71 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:10:58.601704 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:10:58.617526 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:58.617987 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:58.618785 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:58.619223 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:58.646465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:10:58.674193 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-cf0c26de-cc74-4da4-a947-fb6466d7ce8c req-a96577cd-bd3f-46ba-942d-c70468b1d230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:10:58.682783 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cf0c26de-cc74-4da4-a947-fb6466d7ce8c req-a96577cd-bd3f-46ba-942d-c70468b1d230 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:58.683499 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-cf0c26de-cc74-4da4-a947-fb6466d7ce8c req-a96577cd-bd3f-46ba-942d-c70468b1d230 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:58.696284 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-cf0c26de-cc74-4da4-a947-fb6466d7ce8c req-a96577cd-bd3f-46ba-942d-c70468b1d230 service nova] Creating event network-changed:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:10:58.701471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-cf0c26de-cc74-4da4-a947-fb6466d7ce8c req-a96577cd-bd3f-46ba-942d-c70468b1d230 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107483 Jun 25 22:10:58.702385 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3423/7301] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:10:58.744590 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f2af5944-61b7-4182-9c43-b24d55d68818 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 204 len: 0 microversion: 2.1 time: 0.152308 Jun 25 22:10:58.745606 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3879/7302] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:10:58 2022] DELETE /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:10:58.757566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:10:58.758733 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:10:58.775503 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:58.776080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:58.777225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:58.777712 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:58.918581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:10:58.926399 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c5e1a1a7-883b-4664-bdd8-ed4b1264a426 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.176369 Jun 25 22:10:58.926959 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3424/7303] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:10:58 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:10:59.945424 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:10:59.946269 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:10:59.954227 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:59.954687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:10:59.955462 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:10:59.955904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:00.154098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:00.162400 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5456ce36-4515-400c-afe4-ed44e51dbe7a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 200 len: 1678 microversion: 2.1 time: 0.221449 Jun 25 22:11:00.163006 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3880/7304] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:10:59 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:00.717142 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-40b99a0f-7212-4ed5-ade4-e48bb814b5ca req-b52940db-6916-4e70-bb84-b496025ba4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a79897-2d64-4fa4-9583-3041c7ce5bf3", "name": "network-vif-deleted", "tag": "30a78de2-34ea-4385-b35e-2bfad34a8dde"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:00.727548 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-40b99a0f-7212-4ed5-ade4-e48bb814b5ca req-b52940db-6916-4e70-bb84-b496025ba4a6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:00.728013 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-40b99a0f-7212-4ed5-ade4-e48bb814b5ca req-b52940db-6916-4e70-bb84-b496025ba4a6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:00.739661 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-40b99a0f-7212-4ed5-ade4-e48bb814b5ca req-b52940db-6916-4e70-bb84-b496025ba4a6 service nova] Creating event network-vif-deleted:30a78de2-34ea-4385-b35e-2bfad34a8dde for instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 on nch2-master-1 Jun 25 22:11:00.744581 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-40b99a0f-7212-4ed5-ade4-e48bb814b5ca req-b52940db-6916-4e70-bb84-b496025ba4a6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031778 Jun 25 22:11:00.745183 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3425/7305] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 22:11:01.186135 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:01.186958 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: d7a79897-2d64-4fa4-9583-3041c7ce5bf3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:01.197303 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:01.197759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:01.198524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:01.198968 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:01.213335 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] HTTP exception thrown: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Request method failure captured: Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 HTTP/1.1 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4auAZwLGPuMUcMz04ijnS0IV-HhjTJHzagluRNcCHaF3dzt7XoY1sl4lVCiyd3eAwi8ewixKejhofhwPWWuApLlXvSwOwVt6YxkbCqP16fopt-wYtNDPNAaLNohdNb1-0LtynWff2uDmBU0PeRU2hjmFIWF9nTXOHC89oV7k9bajTo Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7659c265b2b14bdb9ac0b22dfbb8d2ed Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestShelveInstance-1899059185 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}] Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestShelveInstance-1899059185 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7659c265b2b14bdb9ac0b22dfbb8d2ed Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestShelveInstance-1899059185 Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestShelveInstance-1899059185-project Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: bd5bd999a2b74f6b820b67f376486e7e Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestShelveInstance-1899059185-project Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'd7a79897-2d64-4fa4-9583-3041c7ce5bf3'} Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:11:01.215420 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Returning 404 to user: Instance d7a79897-2d64-4fa4-9583-3041c7ce5bf3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4571ab7f-96bd-44fe-b4df-8729d38b6d76 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3" status: 404 len: 111 microversion: 2.1 time: 0.037365 Jun 25 22:11:01.220856 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3881/7306] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:01 2022] GET /compute/v2.1/servers/d7a79897-2d64-4fa4-9583-3041c7ce5bf3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:11:01.386800 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9bea794c-55d6-47e4-a5d4-413c89dd2e18 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '.version_select at 0x7f984f3eca60>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:01.413508 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9bea794c-55d6-47e4-a5d4-413c89dd2e18 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853742998" status: 202 len: 0 microversion: 2.1 time: 0.031053 Jun 25 22:11:01.414115 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3426/7307] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 22:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1853742998 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:11:01.433117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-62cec343-4da0-4109-9b8f-55ac21a37a4a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'create', calling method: .version_select at 0x7f984e5e8310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1029991385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLVypTj1n7cDdvctFftEZAuxOPNrKaVMgkZl0EiJgwCqaWaPuldiY4SbU2QFOOJ0nwrvgkeWeobhLwzPbZYE+WLBLpRzEmaDumf+rA8lKzBhgMj/f5FO+DYYOClOwe8A=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:01.447831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-62cec343-4da0-4109-9b8f-55ac21a37a4a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:11:01.453036 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-62cec343-4da0-4109-9b8f-55ac21a37a4a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for user bd5bd999a2b74f6b820b67f376486e7e and project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:11:01.485346 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-62cec343-4da0-4109-9b8f-55ac21a37a4a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.056353 Jun 25 22:11:01.486081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3882/7308] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 22:11:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:11:05.031844 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1642388252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1029991385", "security_groups": [{"name": "tempest-secgroup-smoke-1896508468"}], "networks": [{"uuid": "c6b642a8-0928-409f-bf2c-1f324ca487ac"}], "block_device_mapping_v2": [{"uuid": "51685089-e2ae-4572-8638-311f0ca7d2b7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:05.154281 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] validate_networks() for [('c6b642a8-0928-409f-bf2c-1f324ca487ac', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:11:05.899992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:11:05.900471 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:11:05.900968 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:11:05.901430 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:11:05.901854 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:11:05.911727 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:05.912188 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:05.913039 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:05.913480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:05.930662 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:11:05.936355 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Getting quotas for user bd5bd999a2b74f6b820b67f376486e7e and project 7659c265b2b14bdb9ac0b22dfbb8d2ed. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:11:05.997117 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:11:05.999358 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51685089-e2ae-4572-8638-311f0ca7d2b7',volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:11:06.135994 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-2939a275-b335-44b9-88d1-f1cd89289cf0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.110047 Jun 25 22:11:06.136726 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3427/7309] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:11:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:11:06.148017 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7226abc9-4a7b-46a3-bc37-290544860048 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:06.148636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7226abc9-4a7b-46a3-bc37-290544860048 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:06.206832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-7226abc9-4a7b-46a3-bc37-290544860048 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:06.213745 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7226abc9-4a7b-46a3-bc37-290544860048 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1089 microversion: 2.1 time: 0.070711 Jun 25 22:11:06.214318 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3883/7310] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:06 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:07.232793 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:07.233419 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:07.242093 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:07.242566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:07.243394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:07.243836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:07.327527 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:07.335764 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-3124b357-d5ec-42c2-b86b-911371aa5aa0 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1195 microversion: 2.1 time: 0.108104 Jun 25 22:11:07.336360 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3428/7311] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:07 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1195 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:08.353967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:08.354354 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:08.363096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:08.363568 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:08.364347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:08.364805 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:08.519641 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:08.527839 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-19d49543-9cef-4a9a-97ab-c06dbdaa7260 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1273 microversion: 2.1 time: 0.178493 Jun 25 22:11:08.537461 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3884/7312] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:08 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:08.678231 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-28113242-0a84-421f-a30a-db91d53bd947 req-0b8ce870-ccf4-4397-8012-d9bf71eb41ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:08.688908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-28113242-0a84-421f-a30a-db91d53bd947 req-0b8ce870-ccf4-4397-8012-d9bf71eb41ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:08.689381 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-28113242-0a84-421f-a30a-db91d53bd947 req-0b8ce870-ccf4-4397-8012-d9bf71eb41ec service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:08.707198 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-28113242-0a84-421f-a30a-db91d53bd947 req-0b8ce870-ccf4-4397-8012-d9bf71eb41ec service nova] Creating event network-changed:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:11:08.712169 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-28113242-0a84-421f-a30a-db91d53bd947 req-0b8ce870-ccf4-4397-8012-d9bf71eb41ec service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037649 Jun 25 22:11:08.713374 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3429/7313] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:11:09.545850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:09.546477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:09.554076 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:09.554539 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:09.555318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:09.555768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:09.705362 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:09.717299 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b386636e-854c-4fa9-8fd2-dd69242148ab tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.175409 Jun 25 22:11:09.718096 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3885/7314] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:09 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:10.739982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:10.740724 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:10.750158 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:10.750675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:10.751458 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:10.751916 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:10.894764 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:10.903217 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-53236ae9-fb1b-4eaf-a0a1-6d59ee3ad103 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.168470 Jun 25 22:11:10.904505 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3430/7315] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:10 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:11.924096 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:11.924916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:11.933343 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:11.933850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:11.934682 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:11.935786 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:12.073074 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:12.081184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-163fa8d6-a82d-4330-9a54-2196156c4628 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.161428 Jun 25 22:11:12.081725 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3886/7316] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:11 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:13.103169 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:13.104247 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:13.116019 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:13.116859 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:13.118165 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:13.118917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:13.259209 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:13.267174 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a11d23b2-6aef-446a-af89-14e8df64e434 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.170865 Jun 25 22:11:13.267714 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3431/7317] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:13 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:14.288723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:14.289728 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:14.301574 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:14.302347 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:14.303642 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:14.304388 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:14.452853 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:14.464106 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dd0f9d8-6d45-4d8d-b64c-6f52e4436946 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.182060 Jun 25 22:11:14.464743 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3887/7318] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:14 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:14.820538 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-5fa5f020-a97b-4197-bc24-70245698559d req-01e037b7-b0be-48e8-9151-c72fcb7e30e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "name": "network-vif-plugged", "status": "completed", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:14.831167 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5fa5f020-a97b-4197-bc24-70245698559d req-01e037b7-b0be-48e8-9151-c72fcb7e30e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:14.831631 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-5fa5f020-a97b-4197-bc24-70245698559d req-01e037b7-b0be-48e8-9151-c72fcb7e30e6 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:14.843413 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-5fa5f020-a97b-4197-bc24-70245698559d req-01e037b7-b0be-48e8-9151-c72fcb7e30e6 service nova] Creating event network-vif-plugged:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:11:14.848410 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-5fa5f020-a97b-4197-bc24-70245698559d req-01e037b7-b0be-48e8-9151-c72fcb7e30e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Jun 25 22:11:14.849336 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3432/7319] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:11:15.485168 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:15.486182 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:15.497944 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:15.498751 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:15.500028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:15.500793 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:15.646986 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:15.656537 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f98b65c8-178e-48c9-8030-4f576e5c8947 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1261 microversion: 2.1 time: 0.178091 Jun 25 22:11:15.657124 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3888/7320] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:15 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:16.672146 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:16.673294 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:16.677493 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:16.678210 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:16.685750 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:16.686217 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:16.686982 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:16.687451 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:16.826312 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:16.834342 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-aee48dee-c0bb-45af-9c31-f68fc862bc40 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1445 microversion: 2.1 time: 0.164072 Jun 25 22:11:16.834948 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3433/7321] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:16 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1445 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:16.851854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:11:16.852450 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:11:16.854505 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:11:16.861244 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:16.861695 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:16.862457 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:16.862893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:17.007496 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:11:17.016473 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-4f5dad4a-3348-4a2f-b3e7-d365fed7919c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1445 microversion: 2.1 time: 0.168577 Jun 25 22:11:17.017097 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3889/7322] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:11:16 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:11:19.126057 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-e473f521-7bd8-4619-91a8-fa9a114a84b4 req-741880cf-135a-40e8-b264-65420385f0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:11:19.134590 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e473f521-7bd8-4619-91a8-fa9a114a84b4 req-741880cf-135a-40e8-b264-65420385f0d3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:11:19.135121 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-e473f521-7bd8-4619-91a8-fa9a114a84b4 req-741880cf-135a-40e8-b264-65420385f0d3 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:11:19.146840 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-e473f521-7bd8-4619-91a8-fa9a114a84b4 req-741880cf-135a-40e8-b264-65420385f0d3 service nova] Creating event network-changed:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:11:19.151860 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-e473f521-7bd8-4619-91a8-fa9a114a84b4 req-741880cf-135a-40e8-b264-65420385f0d3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094079 Jun 25 22:11:19.152655 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3434/7323] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:11:49.151066 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:11:49.151844 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:11:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:13:24.209908 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:13:24.210848 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:13:24.211384 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:24.212193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:24.216623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:13:24.217162 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:24.224924 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:24.225375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:24.226132 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:24.226573 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:24.251214 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lazy-loading 'flavor' on Instance uuid b2762d32-82f0-44ec-8389-81e7a5da2e29 {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:13:24.327952 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-0f8de16f-3a86-445e-9278-fc0d7b8d9ad4 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29/action" status: 202 len: 0 microversion: 2.1 time: 0.121423 Jun 25 22:13:24.328580 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3890/7324] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:13:24 2022] POST /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:13:24.336559 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:13:24.337428 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:13:24.338062 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:24.338812 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=42 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:13:24.343784 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:24.344524 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:24.353297 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:24.353758 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:24.354533 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:24.354991 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:24.550858 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:24.559367 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b2f76576-bd2a-4773-92db-2f621d1bdf75 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.224851 Jun 25 22:13:24.559945 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3435/7325] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:24 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:13:25.580676 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:25.581465 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:25.592831 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:25.593390 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:25.594161 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:25.594598 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:25.602401 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43138. Jun 25 22:13:25.605442 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43136. Jun 25 22:13:25.796499 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:25.806606 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-909489ff-3ba9-479c-b045-d4119cc5d544 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.232767 Jun 25 22:13:25.807185 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3891/7326] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:25 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:26.827675 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:26.828266 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:26.837051 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:26.837518 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:26.838306 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:26.838767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:26.847049 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43148. Jun 25 22:13:26.860864 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43146. Jun 25 22:13:26.982566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:26.990910 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-72b8091a-34f4-4df3-a633-77b293045021 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.167410 Jun 25 22:13:26.991601 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3436/7327] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:26 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:28.017932 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:28.018960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:28.030719 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:28.031451 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:28.032802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:28.033538 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:28.179078 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:28.191396 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-417755b3-63c2-4152-8aee-b8b86d5cbdb7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.179989 Jun 25 22:13:28.192188 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3892/7328] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:28 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:29.086563 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:13:29.087944 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:13:29.211172 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:29.211799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:29.219749 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:29.220227 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:29.221080 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:29.221539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:29.352471 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:13:29.352693 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 (ip 10.222.0.39) !!! Jun 25 22:13:29.364700 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:29.373325 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-d87bfe48-1183-45bd-8972-eee8662b254f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.167686 Jun 25 22:13:29.373741 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3437/7329] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:29 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:30.390847 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:30.391459 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:30.399039 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:30.399518 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:30.400333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:30.400827 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:30.549969 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:30.560203 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f8058555-7771-4b96-80fe-64b9775dd0f8 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.173355 Jun 25 22:13:30.560805 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3893/7330] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:30 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:31.582207 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:31.583302 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:31.592845 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:31.593319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:31.594143 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:31.594599 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:31.742480 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:31.750687 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9cd1b16d-06db-4486-a236-2ecbf91462b7 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.175447 Jun 25 22:13:31.751301 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3438/7331] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:31 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:32.768575 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:32.769177 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:32.776882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:32.777330 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:32.778092 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:32.778527 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:32.914048 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:32.925769 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-6dc6e3ec-962d-4e73-a40f-ad6f43e91f5a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.160964 Jun 25 22:13:32.926440 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3894/7332] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:32 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:33.948535 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:33.949155 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:33.956446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:33.956918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:33.958056 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:33.958200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:34.112189 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:34.123780 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f1679772-67aa-43ba-aa60-df75c3bfec06 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.180878 Jun 25 22:13:34.124607 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3439/7333] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:33 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:35.145370 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:35.145988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:35.155202 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:35.155653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:35.156394 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:35.156882 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:35.298314 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:35.306431 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5b7e7e28-9880-438d-826b-b0072e6423ee tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.167513 Jun 25 22:13:35.307123 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3895/7334] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:35 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:36.328263 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:36.329325 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:36.341903 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:36.342683 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:36.343966 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:36.344811 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:36.485611 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:36.493471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c9926570-f90f-41c0-a062-57c576081a62 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.172051 Jun 25 22:13:36.494063 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3440/7335] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:36 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:37.513033 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:37.513846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:37.523331 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.523937 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:37.525010 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.525591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:37.659701 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:37.669872 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d6e42dff-69f3-41fe-9083-a2f1407c3c8a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1511 microversion: 2.1 time: 0.162185 Jun 25 22:13:37.670449 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3896/7336] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:37 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:37.686512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:13:37.687071 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:37.694603 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.695074 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:37.695856 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.696308 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:37.791423 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-b41f9bda-6ae7-4d33-8799-fede027f0a9c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "POST /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29/action" status: 202 len: 0 microversion: 2.1 time: 0.108468 Jun 25 22:13:37.792015 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3441/7337] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:13:37 2022] POST /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:13:37.800907 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:37.801562 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:37.810756 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.811219 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:37.811988 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:37.812489 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:38.005191 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:38.013616 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b588374d-5921-4454-bf63-03505f1eaa94 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1519 microversion: 2.1 time: 0.216784 Jun 25 22:13:38.014235 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3897/7338] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:37 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:39.031557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:39.032178 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:39.039866 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:39.040319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:39.041160 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:39.041654 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:39.175723 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:39.184110 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-564f0780-5af5-40b2-ae74-1fdfa619fcdd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1521 microversion: 2.1 time: 0.156716 Jun 25 22:13:39.184715 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3442/7339] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:39 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:39.598321 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-6c8050a3-f9bd-47c8-8b12-b7aa3c7baa9e req-e6c8a261-7d73-40d6-8b1e-f7d402425f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "name": "network-vif-unplugged", "status": "completed", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:13:39.608469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c8050a3-f9bd-47c8-8b12-b7aa3c7baa9e req-e6c8a261-7d73-40d6-8b1e-f7d402425f55 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:39.608921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-6c8050a3-f9bd-47c8-8b12-b7aa3c7baa9e req-e6c8a261-7d73-40d6-8b1e-f7d402425f55 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:39.620869 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-6c8050a3-f9bd-47c8-8b12-b7aa3c7baa9e req-e6c8a261-7d73-40d6-8b1e-f7d402425f55 service nova] Creating event network-vif-unplugged:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:13:39.625885 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-6c8050a3-f9bd-47c8-8b12-b7aa3c7baa9e req-e6c8a261-7d73-40d6-8b1e-f7d402425f55 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031821 Jun 25 22:13:39.626484 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3898/7340] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:13:40.203203 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:40.203917 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:40.211701 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:40.212275 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:40.213177 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:40.213638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:40.442423 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:40.451026 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-e60ac280-3e25-490c-81a2-18db3b7a70ae tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.252250 Jun 25 22:13:40.451643 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3443/7341] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:40 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:41.472278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:41.473174 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:41.481201 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:41.481652 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:41.482419 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:41.482860 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:41.624663 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:41.632769 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5d6f5a33-688c-4292-a25e-c1f73e32d6df tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.166951 Jun 25 22:13:41.633321 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3899/7342] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:41 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:42.651945 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:42.652831 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:42.660703 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:42.661182 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:42.661993 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:42.662439 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:42.795561 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:42.803469 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-039c286f-a25a-47ee-89d4-b888d1a9f52e tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.156895 Jun 25 22:13:42.804089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3444/7343] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:42 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:43.820998 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:43.821620 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:43.829152 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:43.829607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:43.830400 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:43.830833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:43.971654 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:43.981591 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9e883e47-3073-4ffb-9158-90a465e0f118 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.164445 Jun 25 22:13:43.986069 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3900/7344] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:43 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:45.000330 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:45.000999 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:45.008348 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:45.008847 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:45.009618 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:45.010095 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:45.144838 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:45.153351 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60b80be7-e003-49b5-b489-741202fb7d2d tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.157099 Jun 25 22:13:45.153974 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3445/7345] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:44 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:45.658586 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-1574a6f2-a7fa-4153-b0ee-8b80f768bd9c req-7f9d270c-d675-4e57-abe9-efffbc02e991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "name": "network-vif-plugged", "status": "completed", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:13:45.668030 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1574a6f2-a7fa-4153-b0ee-8b80f768bd9c req-7f9d270c-d675-4e57-abe9-efffbc02e991 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:45.668580 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-1574a6f2-a7fa-4153-b0ee-8b80f768bd9c req-7f9d270c-d675-4e57-abe9-efffbc02e991 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:45.679960 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-1574a6f2-a7fa-4153-b0ee-8b80f768bd9c req-7f9d270c-d675-4e57-abe9-efffbc02e991 service nova] Creating event network-vif-plugged:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:13:45.685199 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-1574a6f2-a7fa-4153-b0ee-8b80f768bd9c req-7f9d270c-d675-4e57-abe9-efffbc02e991 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 Jun 25 22:13:45.685800 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3901/7346] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:13:46.173429 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:46.174037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:46.181435 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:46.181900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:46.182677 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:46.183123 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:46.322303 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:46.334665 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-a81d2b86-fb89-4587-8205-ee46f7825252 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1577 microversion: 2.1 time: 0.165122 Jun 25 22:13:46.335461 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3446/7347] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:46 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:47.359524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:13:47.360188 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:13:47.367138 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:47.367593 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:47.368356 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:13:47.368822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:13:47.509044 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:13:47.517126 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f35d2478-e84c-488c-8048-84ea31f0ff80 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1564 microversion: 2.1 time: 0.164654 Jun 25 22:13:47.517670 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3902/7348] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:13:47 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:13:57.971110 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:13:57.971699 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:13:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:13:57.994438 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:13:57.994642 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:13:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:15:09.161047 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:15:09.161958 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:15:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:15:14.552697 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=28 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:14.554107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:14.558495 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:14.559288 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:14.560744 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-8ff3e0d2-9242-4a7c-b4ce-ce90dbf676f1 req-639e8c56-cbfd-4dcb-8bb1-17004b320c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:14.565524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=26 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:14.566778 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:14.567114 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:14.567591 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:14.568447 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:14.568909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:14.574487 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8ff3e0d2-9242-4a7c-b4ce-ce90dbf676f1 req-639e8c56-cbfd-4dcb-8bb1-17004b320c67 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:14.575239 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-8ff3e0d2-9242-4a7c-b4ce-ce90dbf676f1 req-639e8c56-cbfd-4dcb-8bb1-17004b320c67 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:14.589103 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-8ff3e0d2-9242-4a7c-b4ce-ce90dbf676f1 req-639e8c56-cbfd-4dcb-8bb1-17004b320c67 service nova] Creating event network-changed:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:15:14.595101 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-8ff3e0d2-9242-4a7c-b4ce-ce90dbf676f1 req-639e8c56-cbfd-4dcb-8bb1-17004b320c67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041345 Jun 25 22:15:14.596081 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3903/7349] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:15:14.596269 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Going to try to terminate instance {{(pid=137462) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:15:14.687390 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-5a48ad75-6d28-4b88-8ff0-c18cd00b96e2 tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "DELETE /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 204 len: 0 microversion: 2.1 time: 0.136501 Jun 25 22:15:14.691483 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3447/7350] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:15:14 2022] DELETE /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:15:14.699977 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:14.702178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:14.711229 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:14.711768 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:14.712607 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:14.713567 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:14.856117 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:14.864740 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-5891a02f-beec-4b78-8329-0e5e54aca81c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.171719 Jun 25 22:15:14.875507 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3904/7351] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:14 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:15.884489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:15.885106 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:15.893747 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:15.894213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:15.895017 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:15.895469 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:16.064248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:16.072695 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c79f32cf-c4ec-4b61-a0be-cd4083406a1a tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1570 microversion: 2.1 time: 0.192768 Jun 25 22:15:16.073299 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3448/7352] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:15 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:16.879175 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-43890e9b-a679-4bf2-ba7d-2b33ebad38b1 req-1501ac0a-6184-4cb4-bb48-a18c51677fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2762d32-82f0-44ec-8389-81e7a5da2e29", "name": "network-vif-deleted", "tag": "da418f8b-9044-4ba0-a2c7-202c69d1c265"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:16.889817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43890e9b-a679-4bf2-ba7d-2b33ebad38b1 req-1501ac0a-6184-4cb4-bb48-a18c51677fb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:16.890664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-43890e9b-a679-4bf2-ba7d-2b33ebad38b1 req-1501ac0a-6184-4cb4-bb48-a18c51677fb7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:16.906168 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-43890e9b-a679-4bf2-ba7d-2b33ebad38b1 req-1501ac0a-6184-4cb4-bb48-a18c51677fb7 service nova] Creating event network-vif-deleted:da418f8b-9044-4ba0-a2c7-202c69d1c265 for instance b2762d32-82f0-44ec-8389-81e7a5da2e29 on nch2-master-1 Jun 25 22:15:16.911201 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-43890e9b-a679-4bf2-ba7d-2b33ebad38b1 req-1501ac0a-6184-4cb4-bb48-a18c51677fb7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035881 Jun 25 22:15:16.911835 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3905/7353] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:15:17.090366 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:17.091109 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:17.098816 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:17.099292 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:17.101213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:17.101213 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:17.170989 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd5bd999a2b74f6b820b67f376486e7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7659c265b2b14bdb9ac0b22dfbb8d2ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:17.185028 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-63e7312a-4c62-4d59-996b-6a5a6cb9c09c tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 200 len: 1220 microversion: 2.1 time: 0.098526 Jun 25 22:15:17.185683 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3449/7354] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:17 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:18.210799 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:18.211854 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] [instance: b2762d32-82f0-44ec-8389-81e7a5da2e29] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:18.220387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:18.221275 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:18.222495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:18.223111 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:18.237834 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] HTTP exception thrown: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Request method failure captured: Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 HTTP/1.1 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4auAZwLGPuMUcMz04ijnS0IV-HhjTJHzagluRNcCHaF3dzt7XoY1sl4lVCiyd3eAwi8ewixKejhofhwPWWuApLlXvSwOwVt6YxkbCqP16fopt-wYtNDPNAaLNohdNb1-0LtynWff2uDmBU0PeRU2hjmFIWF9nTXOHC89oV7k9bajTo Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 7659c265b2b14bdb9ac0b22dfbb8d2ed Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestShelveInstance-1899059185 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7659c265b2b14bdb9ac0b22dfbb8d2ed"}]}] Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestShelveInstance-1899059185 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 7659c265b2b14bdb9ac0b22dfbb8d2ed Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestShelveInstance-1899059185 Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestShelveInstance-1899059185-project Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: bd5bd999a2b74f6b820b67f376486e7e Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestShelveInstance-1899059185-project Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': 'b2762d32-82f0-44ec-8389-81e7a5da2e29'} Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:15:18.239556 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Returning 404 to user: Instance b2762d32-82f0-44ec-8389-81e7a5da2e29 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-7e38b821-2f2f-4966-bc58-9f0fd252b1fd tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29" status: 404 len: 111 microversion: 2.1 time: 0.040954 Jun 25 22:15:18.245675 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3906/7355] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:18 2022] GET /compute/v2.1/servers/b2762d32-82f0-44ec-8389-81e7a5da2e29 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:15:18.415394 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-60af8d52-1805-448d-ad27-50a3f324db6f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] Calling method '.version_select at 0x7f984f696310>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:18.446045 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-60af8d52-1805-448d-ad27-50a3f324db6f tempest-TestShelveInstance-1899059185 tempest-TestShelveInstance-1899059185-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1029991385" status: 202 len: 0 microversion: 2.1 time: 0.034590 Jun 25 22:15:18.446651 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3450/7356] 10.222.0.39 () {58 vars in 1253 bytes} [Sat Jun 25 22:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1029991385 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:15:35.953049 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=8 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:35.953892 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=12 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:36.131439 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-09ce2d7b-ae0a-431e-bcd2-d2a50ba25393 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Action: 'create', calling method: .version_select at 0x7f984e7449d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1677713102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxbc9I2bWt5hzAYleKeJTDHFSKyxMvnnJB1hTuXBEoSXYIlPDpdbwOTw/CrheXnD9rNq0WEpZk8IhhjtoAaKBjJoM9gznaqlXLBoVe4iZqcmQx57P042pTv8TKLOnPAJg=="}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:36.146495 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-09ce2d7b-ae0a-431e-bcd2-d2a50ba25393 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for project 2f2229a0064b42d88f84448115ff450a. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:15:36.151858 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-09ce2d7b-ae0a-431e-bcd2-d2a50ba25393 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for user 6d3934c5660947f28734aefe3cb1c9b9 and project 2f2229a0064b42d88f84448115ff450a. Resources: {'key_pairs'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:15:36.184280 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-09ce2d7b-ae0a-431e-bcd2-d2a50ba25393 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.236459 Jun 25 22:15:36.189916 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3907/7357] 10.222.0.39 () {60 vars in 1158 bytes} [Sat Jun 25 22:15:35 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:15:37.283398 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:37.285248 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:37.293399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1475855648", "imageRef": "c5741eca-b932-4865-b29a-bd2a12a73795", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1677713102", "security_groups": [{"name": "tempest-secgroup-smoke-764709400"}], "networks": [{"uuid": "643f47b9-ba48-40c8-8f57-24ef47de0731"}]}} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:37.412640 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.network.neutron [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] validate_networks() for [('643f47b9-ba48-40c8-8f57-24ef47de0731', None, None, None, None, None)] {{(pid=137462) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:15:37.810519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Flavor limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:15:37.810963 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Image limits 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:15:37.811706 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Flavor pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:15:37.812140 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Image pref 0:0:0 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:15:37.812609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.virt.hardware [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137462) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:15:37.822753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:37.823076 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:37.823900 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:37.824492 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:37.847072 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for project 2f2229a0064b42d88f84448115ff450a. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:15:37.853045 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.quota [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for user 6d3934c5660947f28734aefe3cb1c9b9 and project 2f2229a0064b42d88f84448115ff450a. Resources: {'cores', 'ram', 'instances'} {{(pid=137462) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:15:37.866607 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Going to run 1 instances... {{(pid=137462) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:15:37.868995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c5741eca-b932-4865-b29a-bd2a12a73795',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137462) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:15:37.927201 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86565fb3-0fee-4720-a5e2-cc63a0666b14 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645581 Jun 25 22:15:37.928318 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3451/7358] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:15:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:15:37.939651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-81fbbea4-ce21-4551-aa50-a41ebce770e0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:37.940353 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-81fbbea4-ce21-4551-aa50-a41ebce770e0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:38.006536 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-81fbbea4-ce21-4551-aa50-a41ebce770e0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:38.013900 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-81fbbea4-ce21-4551-aa50-a41ebce770e0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1249 microversion: 2.1 time: 0.079234 Jun 25 22:15:38.014456 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3908/7359] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:37 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:39.040547 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:39.041799 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:39.052713 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:39.054126 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:39.054998 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:39.055638 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:39.157539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:39.168020 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-069b6216-24b5-407e-8073-f5015f704982 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1319 microversion: 2.1 time: 0.138925 Jun 25 22:15:39.169006 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3452/7360] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:39 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:40.187123 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:40.188532 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:40.198151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:40.198833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:40.200083 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:40.200960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:40.374288 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:40.388184 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f01d2352-11e1-44f0-9b47-5a1330835602 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.206245 Jun 25 22:15:40.389053 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3909/7361] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:40 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 22:15:40.595908 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-147697a1-ff67-4cc2-9c73-46a42ff98561 req-c451d2e9-bb0d-4214-a87d-9cfc994a71e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:40.630108 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-147697a1-ff67-4cc2-9c73-46a42ff98561 req-c451d2e9-bb0d-4214-a87d-9cfc994a71e1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:40.630711 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-147697a1-ff67-4cc2-9c73-46a42ff98561 req-c451d2e9-bb0d-4214-a87d-9cfc994a71e1 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:40.645496 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-147697a1-ff67-4cc2-9c73-46a42ff98561 req-c451d2e9-bb0d-4214-a87d-9cfc994a71e1 service nova] Creating event network-changed:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:15:40.652793 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-147697a1-ff67-4cc2-9c73-46a42ff98561 req-c451d2e9-bb0d-4214-a87d-9cfc994a71e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063113 Jun 25 22:15:40.653830 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3453/7362] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:15:41.406040 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:41.406633 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:41.414278 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:41.414709 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:41.415528 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:41.415967 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:41.548300 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:41.556187 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-a9e865c6-4ed6-427e-a12f-2dfa252abbba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.154246 Jun 25 22:15:41.556804 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3910/7363] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:41 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:42.580175 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:42.581393 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:42.592871 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:42.593644 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:42.594923 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:42.595665 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:42.737952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:42.746203 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c44e2b03-73a9-4ed6-a5c2-c04daa9084ce tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.174721 Jun 25 22:15:42.746778 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3454/7364] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:42 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:43.765604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:43.766423 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:43.776225 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:43.776919 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:43.777946 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:43.778534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:43.920028 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:43.932286 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1121f038-2b63-498a-8a47-a6c5ff53987f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.171824 Jun 25 22:15:43.933168 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3911/7365] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:43 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:44.953138 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:44.953751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:44.961669 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:44.962148 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:44.962939 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:44.963399 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:45.107043 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:45.119485 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-f4c1cfbb-29e9-4e26-bb8e-667d1d1a5f28 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.171872 Jun 25 22:15:45.120320 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3455/7366] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:44 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:46.137781 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:46.138429 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:46.145689 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:46.146151 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:46.146942 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:46.147401 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:46.287185 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:46.295852 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-984a86aa-7f23-4348-a4a3-f0c6e7a7ea9b tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.161912 Jun 25 22:15:46.296467 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3912/7367] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:46 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:46.309743 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-57ec0416-73fd-40fd-a875-105b6749b3ab req-5cc67502-bfbd-40ee-aebe-2adee778e07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "name": "network-vif-plugged", "status": "completed", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:46.318092 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-57ec0416-73fd-40fd-a875-105b6749b3ab req-5cc67502-bfbd-40ee-aebe-2adee778e07e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:46.318552 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-57ec0416-73fd-40fd-a875-105b6749b3ab req-5cc67502-bfbd-40ee-aebe-2adee778e07e service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:46.332857 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-57ec0416-73fd-40fd-a875-105b6749b3ab req-5cc67502-bfbd-40ee-aebe-2adee778e07e service nova] Creating event network-vif-plugged:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:15:46.338034 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-57ec0416-73fd-40fd-a875-105b6749b3ab req-5cc67502-bfbd-40ee-aebe-2adee778e07e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107619 Jun 25 22:15:46.338672 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3456/7368] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 22:15:47.314990 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:47.315604 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:47.323193 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:47.323632 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:47.324442 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:47.324948 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:47.471460 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:47.482314 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-467057ca-2648-4608-a547-389c170a01b5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1374 microversion: 2.1 time: 0.172034 Jun 25 22:15:47.482913 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3913/7369] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:47 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:48.498319 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:48.499362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=6 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:48.505634 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:48.506575 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:48.516000 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:48.516512 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:48.517285 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:48.517756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:48.669337 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:48.677549 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-30283011-5ce3-4c08-8bc2-d90f2dea9e5e tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1560 microversion: 2.1 time: 0.181957 Jun 25 22:15:48.678124 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3457/7370] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:48 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:48.693931 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:15:48.694551 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:15:48.696468 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:15:48.703012 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:48.703463 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:48.704228 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:48.704699 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:48.855534 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:15:48.863465 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-75fa6c0f-6ad1-403f-8714-b2d1d48a887d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1560 microversion: 2.1 time: 0.173403 Jun 25 22:15:48.863968 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3914/7371] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:15:48 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:15:50.623846 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-988614fd-80b1-414d-8aba-7831e9d01935 req-b0d918b1-9352-404b-b497-49e10eade415 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:15:50.634171 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-988614fd-80b1-414d-8aba-7831e9d01935 req-b0d918b1-9352-404b-b497-49e10eade415 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:15:50.634619 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-988614fd-80b1-414d-8aba-7831e9d01935 req-b0d918b1-9352-404b-b497-49e10eade415 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:15:50.646270 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-988614fd-80b1-414d-8aba-7831e9d01935 req-b0d918b1-9352-404b-b497-49e10eade415 service nova] Creating event network-changed:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:15:50.651471 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-988614fd-80b1-414d-8aba-7831e9d01935 req-b0d918b1-9352-404b-b497-49e10eade415 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031760 Jun 25 22:15:50.652252 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3458/7372] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:18:16.628667 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:18:16.630164 ncdv-master-1 devstack@n-api.service[137461]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 25 22:18:16.631022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:16.632375 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=36 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:16.639899 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1643827057"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:16.641329 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:16.649274 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:16.649722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:16.650479 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:16.650913 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:16.932519 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f19423c2-34c8-4c2e-a058-ce7ec48accc6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "POST /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3/action" status: 202 len: 0 microversion: 2.1 time: 0.307410 Jun 25 22:18:16.933076 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3915/7373] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:18:16 2022] POST /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 22:18:25.140146 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:18:25.141143 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:18:25.141751 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:25.142519 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=32 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:25.148187 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "name": "network-vif-plugged", "status": "completed", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:25.161405 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:25.161874 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:25.174035 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] Creating event network-vif-plugged:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:18:25.177648 ncdv-master-1 devstack@n-api.service[137462]: ERROR oslo.messaging._drivers.impl_rabbit [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] [cd87511b-21c2-4e66-8e64-03881b86cbb8] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 25 22:18:26.154553 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [e251df03-14c6-47f1-bb7c-6e1bacd9c3de] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43696. Jun 25 22:18:26.155600 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] [44511a07-5581-4a01-b5ce-eb0f6345dc1f] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43698. Jun 25 22:18:26.185728 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] [cd87511b-21c2-4e66-8e64-03881b86cbb8] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43700. Jun 25 22:18:26.189474 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-d4592bf9-ecd1-487a-b37c-d12f16c68a3a req-f1fec140-cade-4a78-9d74-f1a9229cb4d7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.051204 Jun 25 22:18:26.190115 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3459/7374] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:18:29.101438 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:18:29.102487 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:18:29.172027 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:18:29.172268 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:18:29.364191 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:18:29.364957 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:18:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:18:34.629025 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:34.629846 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:34.634432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1847218450", "imageRef": "d05868b9-e524-4ec6-a4b9-cb128f1a300c", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1677713102", "security_groups": [{"name": "tempest-secgroup-smoke-764709400"}], "networks": [{"uuid": "643f47b9-ba48-40c8-8f57-24ef47de0731"}]}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:34.659119 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [4f5a8c46-d10a-4789-96e4-c431d59ab5ed] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43788. Jun 25 22:18:34.660351 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] [146cbf85-bace-457d-bcf9-5a837c1bd80a] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 43786. Jun 25 22:18:34.898605 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.network.neutron [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] validate_networks() for [('643f47b9-ba48-40c8-8f57-24ef47de0731', None, None, None, None, None)] {{(pid=137461) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 22:18:35.342524 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Flavor limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 22:18:35.343333 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Image limits 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 22:18:35.343841 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Flavor pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 22:18:35.344256 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Image pref 0:0:0 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 22:18:35.344698 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.virt.hardware [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137461) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 22:18:35.354318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:35.354767 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:35.355552 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:35.355981 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:35.373759 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for project 2f2229a0064b42d88f84448115ff450a. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 22:18:35.379232 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.quota [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Getting quotas for user 6d3934c5660947f28734aefe3cb1c9b9 and project 2f2229a0064b42d88f84448115ff450a. Resources: {'cores', 'ram', 'instances'} {{(pid=137461) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 22:18:35.392183 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Going to run 1 instances... {{(pid=137461) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 22:18:35.394664 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d05868b9-e524-4ec6-a4b9-cb128f1a300c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137461) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 22:18:35.442808 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f3848947-14dd-4f81-9b7b-031b46159b23 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.815506 Jun 25 22:18:35.443689 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3916/7375] 10.222.0.39 () {60 vars in 1146 bytes} [Sat Jun 25 22:18:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 22:18:35.452520 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:35.453682 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:35.458037 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-86fe6347-39e6-4a40-8941-fba63a49b529 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:35.458767 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-86fe6347-39e6-4a40-8941-fba63a49b529 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:35.580396 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-86fe6347-39e6-4a40-8941-fba63a49b529 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:35.587842 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-86fe6347-39e6-4a40-8941-fba63a49b529 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1249 microversion: 2.1 time: 0.137326 Jun 25 22:18:35.588569 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3460/7376] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:35 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1249 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:36.607147 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:36.607821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:36.615155 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:36.615636 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:36.616432 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:36.616904 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:36.687765 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:36.696455 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1e807053-eda4-49ad-aa2d-e9734a822fe4 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1309 microversion: 2.1 time: 0.094130 Jun 25 22:18:36.702249 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3917/7377] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:36 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:37.274818 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-18946680-450c-4983-973f-97dab50cfef5 req-3f5bc9f9-a357-4d64-870b-e56cb08dc244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "name": "network-vif-unplugged", "status": "completed", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:37.296687 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-18946680-450c-4983-973f-97dab50cfef5 req-3f5bc9f9-a357-4d64-870b-e56cb08dc244 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:37.299566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-18946680-450c-4983-973f-97dab50cfef5 req-3f5bc9f9-a357-4d64-870b-e56cb08dc244 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:37.315867 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-18946680-450c-4983-973f-97dab50cfef5 req-3f5bc9f9-a357-4d64-870b-e56cb08dc244 service nova] Creating event network-vif-unplugged:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:18:37.322157 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-18946680-450c-4983-973f-97dab50cfef5 req-3f5bc9f9-a357-4d64-870b-e56cb08dc244 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051404 Jun 25 22:18:37.323186 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3461/7378] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:18:37.714348 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:37.715098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:37.724533 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:37.725491 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:37.726502 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:37.727312 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:37.899678 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:37.915499 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-39e6ab64-cd45-4f59-8a24-3d1a97c90198 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.205303 Jun 25 22:18:37.925597 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3918/7379] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:37 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:38.934726 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:38.935539 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:38.944566 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:38.945087 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:38.946042 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:38.946645 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:39.102836 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:39.112074 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-4a714189-1f88-4795-8a19-df0a90b29afe tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.182427 Jun 25 22:18:39.113617 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3462/7380] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:38 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:40.173098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:40.173817 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:40.181022 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:40.181469 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:40.182285 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:40.182722 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:40.328199 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:40.336704 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d86287b4-c8e4-4956-b271-104e4069643a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.167551 Jun 25 22:18:40.338350 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3919/7381] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:40 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:41.356693 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:41.357433 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:41.364946 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:41.365422 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:41.366320 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:41.366807 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:41.526407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:41.534449 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-7ffee665-f989-40b7-8b1b-50454664ffd6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.181943 Jun 25 22:18:41.535040 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3463/7382] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:41 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:42.553047 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:42.553850 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:42.560926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:42.561378 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:42.562154 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:42.562591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:42.713638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:42.722019 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-1640ce9c-df41-4630-9e35-e99d0f38e588 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.173270 Jun 25 22:18:42.722609 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3920/7383] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:42 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:43.747761 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:43.748468 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:43.755819 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:43.756364 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:43.757199 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:43.757653 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:43.922457 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:43.930950 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-183ee01b-f4c8-486d-99ab-74ef42fcfde2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.190581 Jun 25 22:18:43.940899 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3464/7384] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:43 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:44.952603 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:44.953615 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:44.963960 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:44.964437 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:44.965230 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:44.965675 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:45.100190 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:45.109418 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f719cf4f-0d2b-4722-a588-0c1cef08d71c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.163762 Jun 25 22:18:45.110000 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3921/7385] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:44 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:46.133184 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:46.133822 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:46.136805 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell0:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:46.142756 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:46.143228 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:46.144018 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:46.144508 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:46.281504 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:46.289640 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ad22d39b-c608-49af-b8b7-225be736ffe7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.163141 Jun 25 22:18:46.290479 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3465/7386] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:46 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:47.166838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:47.167758 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell0:SELECT=6 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:18:47.237916 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-3533bd12-5414-4ddd-9b6e-e38c88e58cd0 req-a1643f12-6a2c-43ee-acd5-3aa0a3bd4530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:47.249743 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3533bd12-5414-4ddd-9b6e-e38c88e58cd0 req-a1643f12-6a2c-43ee-acd5-3aa0a3bd4530 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:47.250241 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-3533bd12-5414-4ddd-9b6e-e38c88e58cd0 req-a1643f12-6a2c-43ee-acd5-3aa0a3bd4530 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:47.262701 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-3533bd12-5414-4ddd-9b6e-e38c88e58cd0 req-a1643f12-6a2c-43ee-acd5-3aa0a3bd4530 service nova] Creating event network-changed:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:18:47.268306 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-3533bd12-5414-4ddd-9b6e-e38c88e58cd0 req-a1643f12-6a2c-43ee-acd5-3aa0a3bd4530 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110280 Jun 25 22:18:47.269469 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3922/7387] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:18:47.306617 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:47.307425 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:47.315753 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:47.316339 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:47.317301 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:47.317851 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:47.544362 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:47.552408 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9d7fcb0c-da91-4cd4-97ea-bb9d90eb2136 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.250144 Jun 25 22:18:47.553035 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3466/7388] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:47 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:48.575777 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:48.577009 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:48.587545 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:48.588000 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:48.588803 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:48.589240 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:48.723564 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:48.731804 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-ae1dfb55-65e2-4681-bad2-21ec7ffeaec6 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.163386 Jun 25 22:18:48.732468 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3923/7389] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:48 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:49.749279 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:49.749887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:49.757865 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:49.758609 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:49.759909 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:49.760360 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:49.965035 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:49.973678 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9a905cba-3698-49be-b13e-00c774877786 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.228420 Jun 25 22:18:49.974257 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3467/7390] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:49 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:50.994653 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:50.995357 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:51.004107 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:51.004687 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:51.005644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:51.006167 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:51.152097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:51.162891 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-e6e15cf3-e93c-4300-a78c-8d9988150de0 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.174539 Jun 25 22:18:51.163668 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3924/7391] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:50 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:52.188918 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:52.190897 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:52.201557 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:52.202061 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:52.202880 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:52.203332 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:52.348936 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:52.356819 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-c8193931-7d86-4934-9c3d-01949e24944a tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.175846 Jun 25 22:18:52.357393 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3468/7392] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:52 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:53.317954 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [req-093fcaa3-a58a-44db-a714-bce946df4e62 req-c8279494-c8b3-49db-8c60-f527a3ed4021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "name": "network-vif-plugged", "status": "completed", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:53.327802 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-093fcaa3-a58a-44db-a714-bce946df4e62 req-c8279494-c8b3-49db-8c60-f527a3ed4021 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:53.328250 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [req-093fcaa3-a58a-44db-a714-bce946df4e62 req-c8279494-c8b3-49db-8c60-f527a3ed4021 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:53.343195 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.compute.server_external_events [req-093fcaa3-a58a-44db-a714-bce946df4e62 req-c8279494-c8b3-49db-8c60-f527a3ed4021 service nova] Creating event network-vif-plugged:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:18:53.348466 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [req-093fcaa3-a58a-44db-a714-bce946df4e62 req-c8279494-c8b3-49db-8c60-f527a3ed4021 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034360 Jun 25 22:18:53.349093 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3925/7393] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:18:53.375060 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:53.375515 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:53.383695 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:53.384385 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:53.385400 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:53.386345 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:53.580021 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:53.591739 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-baefc331-02da-47cf-bef7-6c09a9bb4b3f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.220840 Jun 25 22:18:53.592483 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3469/7394] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:53 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:54.612249 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:54.613101 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:54.620752 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:54.621211 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:54.622064 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:54.622690 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:54.763715 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:54.771773 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b527b5d9-ffbd-4a57-96b4-d6ab5238960f tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1374 microversion: 2.1 time: 0.165167 Jun 25 22:18:54.772374 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3926/7395] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:54 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:55.794200 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:55.795134 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:55.804766 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:55.805438 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:55.806411 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:55.806952 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:55.998443 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:56.006778 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-583c5ed0-b090-4c0c-a7c2-50caaa1c88f7 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1559 microversion: 2.1 time: 0.219359 Jun 25 22:18:56.007372 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3470/7396] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:55 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:56.023178 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:18:56.023808 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:18:56.031425 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:56.031888 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:56.032710 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:56.033156 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:56.172644 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:18:56.184545 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-b2c6cd4b-7835-46a0-a3a2-67cbe6bdd42c tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1559 microversion: 2.1 time: 0.165366 Jun 25 22:18:56.185288 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3927/7397] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:18:56 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:18:58.248788 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-3f9aa209-ffdd-4e72-a7bd-a8c14fa5c238 req-ae499b72-95b0-44b2-a25f-715efb340d3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:18:58.257099 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f9aa209-ffdd-4e72-a7bd-a8c14fa5c238 req-ae499b72-95b0-44b2-a25f-715efb340d3f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:18:58.257559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-3f9aa209-ffdd-4e72-a7bd-a8c14fa5c238 req-ae499b72-95b0-44b2-a25f-715efb340d3f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:18:58.269346 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-3f9aa209-ffdd-4e72-a7bd-a8c14fa5c238 req-ae499b72-95b0-44b2-a25f-715efb340d3f service nova] Creating event network-changed:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:18:58.274501 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-3f9aa209-ffdd-4e72-a7bd-a8c14fa5c238 req-ae499b72-95b0-44b2-a25f-715efb340d3f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086414 Jun 25 22:18:58.275089 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3471/7398] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:20:37.984290 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:20:37.984980 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:21:11.695833 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:11.697097 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=60 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:11.759592 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1519060018"}} {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:11.760723 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:11.767367 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:11.767838 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:11.768659 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:11.769102 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:12.059778 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-f05dd24f-47ac-4745-b0ae-535612dcd697 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "POST /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d/action" status: 202 len: 0 microversion: 2.1 time: 0.367739 Jun 25 22:21:12.060473 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3928/7399] 10.222.0.39 () {60 vars in 1277 bytes} [Sat Jun 25 22:21:11 2022] POST /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jun 25 22:21:19.948379 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=26 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:19.949995 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=58 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:20.009170 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-edd4d785-bf5d-4c33-861a-d5ab833314c4 req-bd2ea765-a30e-43f8-b0b4-f99456b3a2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "name": "network-vif-plugged", "status": "completed", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:20.018084 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-edd4d785-bf5d-4c33-861a-d5ab833314c4 req-bd2ea765-a30e-43f8-b0b4-f99456b3a2ea service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:20.018559 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-edd4d785-bf5d-4c33-861a-d5ab833314c4 req-bd2ea765-a30e-43f8-b0b4-f99456b3a2ea service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:20.030098 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-edd4d785-bf5d-4c33-861a-d5ab833314c4 req-bd2ea765-a30e-43f8-b0b4-f99456b3a2ea service nova] Creating event network-vif-plugged:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:21:20.035510 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-edd4d785-bf5d-4c33-861a-d5ab833314c4 req-bd2ea765-a30e-43f8-b0b4-f99456b3a2ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089785 Jun 25 22:21:20.036034 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3472/7400] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:21:30.891822 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_api:SELECT=2 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:30.892638 ncdv-master-1 devstack@n-api.service[137461]: DEBUG dbcounter [-] [137461] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=137461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:30.897002 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:30.897673 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:30.898887 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-47edf590-fa90-425a-bc98-9345b50a7d51 req-414e2458-983b-4ab6-a003-06b9719b558f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:30.905566 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:30.906171 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:30.907192 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:30.907813 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:30.908630 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_api:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:30.909602 ncdv-master-1 devstack@n-api.service[137462]: DEBUG dbcounter [-] [137462] Writing DB stats nova_cell1:SELECT=2 {{(pid=137462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 22:21:30.912667 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-47edf590-fa90-425a-bc98-9345b50a7d51 req-414e2458-983b-4ab6-a003-06b9719b558f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:30.913289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-47edf590-fa90-425a-bc98-9345b50a7d51 req-414e2458-983b-4ab6-a003-06b9719b558f service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:30.926736 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-47edf590-fa90-425a-bc98-9345b50a7d51 req-414e2458-983b-4ab6-a003-06b9719b558f service nova] Creating event network-changed:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:21:30.932451 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-47edf590-fa90-425a-bc98-9345b50a7d51 req-414e2458-983b-4ab6-a003-06b9719b558f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039907 Jun 25 22:21:30.933533 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3473/7401] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:21:30.935531 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:21:31.025992 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-13ed3462-d1dc-4f0a-acf6-dd32e053acc5 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 204 len: 0 microversion: 2.1 time: 0.136137 Jun 25 22:21:31.030050 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3929/7402] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:21:30 2022] DELETE /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:21:31.038107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:31.038935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:31.046632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:31.046632 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:31.047462 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:31.048235 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:31.214933 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:21:31.223276 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-19f8e04e-6924-4106-9dab-b02b395c499d tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1683 microversion: 2.1 time: 0.191633 Jun 25 22:21:31.223916 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3474/7403] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:31 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:21:32.246128 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:32.247180 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:32.258204 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:32.258651 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:32.259421 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:32.259851 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:32.401098 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:21:32.409403 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-2750c521-d7bb-4bc6-b55c-b92e079e6520 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1683 microversion: 2.1 time: 0.170625 Jun 25 22:21:32.409955 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3930/7404] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:32 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:21:33.313152 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-640be0c6-f91b-4075-8c87-c6cea0a339ce req-7431c5d2-d802-4840-a4fb-f83f6ffa3048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ad0fcb-600b-4cbb-864c-96fe4b94964d", "name": "network-vif-deleted", "tag": "09a9de39-5fc9-4a24-9aab-f07818c87967"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:33.325070 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-640be0c6-f91b-4075-8c87-c6cea0a339ce req-7431c5d2-d802-4840-a4fb-f83f6ffa3048 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:33.325536 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-640be0c6-f91b-4075-8c87-c6cea0a339ce req-7431c5d2-d802-4840-a4fb-f83f6ffa3048 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:33.338130 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-640be0c6-f91b-4075-8c87-c6cea0a339ce req-7431c5d2-d802-4840-a4fb-f83f6ffa3048 service nova] Creating event network-vif-deleted:09a9de39-5fc9-4a24-9aab-f07818c87967 for instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d on nch2-master-1 Jun 25 22:21:33.344838 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-640be0c6-f91b-4075-8c87-c6cea0a339ce req-7431c5d2-d802-4840-a4fb-f83f6ffa3048 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035543 Jun 25 22:21:33.345476 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3475/7405] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:21:33.427832 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:33.428680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:33.436380 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:33.436893 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:33.437646 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:33.438116 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:33.472311 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:33.472855 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:33.473313 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.objects.instance [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lazy-loading 'fault' on Instance uuid e6ad0fcb-600b-4cbb-864c-96fe4b94964d {{(pid=137461) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 22:21:33.514535 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:21:33.523863 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-d3545a75-1267-43b0-9b3d-8b5bf6f435a2 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 200 len: 1339 microversion: 2.1 time: 0.100259 Jun 25 22:21:33.524380 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3931/7406] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:33 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:21:34.544296 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:34.545446 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: e6ad0fcb-600b-4cbb-864c-96fe4b94964d] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:34.556489 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:34.557225 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:34.558407 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:34.559131 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:34.576701 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.wsgi [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] HTTP exception thrown: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Request method failure captured: Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: request: GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d HTTP/1.1 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Accept: application/json Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Accept-Encoding: identity Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Connection: close Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Content-Length: 0 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Content-Type: application/json Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Host: 10.222.0.39 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: Openstack-System-Scope: None Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: User-Agent: python-urllib3/1.26.9 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Auth-Token: gAAAAABit4kCvx_Ji_eRaFxEHFfkMof0LxJf_OcbA_CA_JTGTS5msX6ttDioF4j-Yxo8CbyyeHoBu2gbvR4B8y7UMOFI_8J-y5cNvyGw2XxXyQMSxLkUBvT-6IGc-GcZ2Glg_PlEBIpvhfT7uWzXCFIl2SZC7qS6W8c3v38BEXw4Xtsc3_-GAlk Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Id: None Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Domain-Name: None Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Identity-Status: Confirmed Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Is-Admin-Project: True Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Id: default Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Domain-Name: Default Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Id: 2f2229a0064b42d88f84448115ff450a Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Project-Name: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Role: member,reader Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Roles: member,reader Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f2229a0064b42d88f84448115ff450a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f2229a0064b42d88f84448115ff450a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f2229a0064b42d88f84448115ff450a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f2229a0064b42d88f84448115ff450a"}]}] Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Id: 2f2229a0064b42d88f84448115ff450a Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-Tenant-Name: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-User: tempest-TestSnapshotPattern-1009245234-project Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Id: default Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-User-Domain-Name: Default Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-User-Id: 6d3934c5660947f28734aefe3cb1c9b9 Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: X-User-Name: tempest-TestSnapshotPattern-1009245234-project Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: method: > Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: exception: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: action_args: {'id': 'e6ad0fcb-600b-4cbb-864c-96fe4b94964d'} Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:21:34.578357 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: ERROR nova.api.openstack.wsgi Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Returning 404 to user: Instance e6ad0fcb-600b-4cbb-864c-96fe4b94964d could not be found. {{(pid=137462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-9ab51097-38a6-482b-bedc-6763b251e9c8 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d" status: 404 len: 111 microversion: 2.1 time: 0.042043 Jun 25 22:21:34.584113 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3476/7407] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:34 2022] GET /compute/v2.1/servers/e6ad0fcb-600b-4cbb-864c-96fe4b94964d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:21:35.933926 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:35.934602 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:35.935935 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-6c07eafc-c510-49c3-b237-0517c62440f6 req-1fbcb8dc-2f82-4b43-9eb0-9f0b8672c733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:35.941184 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:35.941876 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:35.942645 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:35.943318 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:35.946030 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6c07eafc-c510-49c3-b237-0517c62440f6 req-1fbcb8dc-2f82-4b43-9eb0-9f0b8672c733 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:35.946549 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-6c07eafc-c510-49c3-b237-0517c62440f6 req-1fbcb8dc-2f82-4b43-9eb0-9f0b8672c733 service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:35.957637 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-6c07eafc-c510-49c3-b237-0517c62440f6 req-1fbcb8dc-2f82-4b43-9eb0-9f0b8672c733 service nova] Creating event network-changed:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:21:35.964972 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-6c07eafc-c510-49c3-b237-0517c62440f6 req-1fbcb8dc-2f82-4b43-9eb0-9f0b8672c733 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032574 Jun 25 22:21:35.965639 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3477/7408] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:21:35.972466 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Going to try to terminate instance {{(pid=137461) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 22:21:36.060406 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-fcd9070c-f5c7-4167-87d1-9dec33154fd3 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "DELETE /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 204 len: 0 microversion: 2.1 time: 0.130174 Jun 25 22:21:36.061349 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3932/7409] 10.222.0.39 () {58 vars in 1238 bytes} [Sat Jun 25 22:21:35 2022] DELETE /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 22:21:36.069992 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:36.070825 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.compute.api [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137462) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:36.077581 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:36.078046 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:36.078841 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:36.079278 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:36.242289 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.policy [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137462) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:21:36.250659 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-6694a5dd-4de9-4f63-a7b7-874a982d2e11 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1684 microversion: 2.1 time: 0.184819 Jun 25 22:21:36.251241 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3478/7410] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:36 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:21:37.269716 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:37.270470 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:37.278141 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:37.278591 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:37.279376 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:37.279821 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:37.419934 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.policy [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d3934c5660947f28734aefe3cb1c9b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f2229a0064b42d88f84448115ff450a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137461) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 22:21:37.427911 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-9c2b660b-9dd4-4924-9e33-b8254255bcba tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 200 len: 1566 microversion: 2.1 time: 0.162723 Jun 25 22:21:37.436483 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3933/7411] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:37 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 22:21:37.981434 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [req-0905ec2b-7fb6-404b-8881-7c7e457bff88 req-d12bb054-09dc-4228-b112-2ad7fb4568fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267e0907-7f3e-4f71-afc0-66f31843d5f3", "name": "network-vif-deleted", "tag": "5a7befd1-ed67-4a76-81ae-3cdd70577e7a"}]} {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 22:21:37.993186 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0905ec2b-7fb6-404b-8881-7c7e457bff88 req-d12bb054-09dc-4228-b112-2ad7fb4568fa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:37.993621 ncdv-master-1 devstack@n-api.service[137462]: DEBUG oslo_concurrency.lockutils [req-0905ec2b-7fb6-404b-8881-7c7e457bff88 req-d12bb054-09dc-4228-b112-2ad7fb4568fa service nova] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:38.005785 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.compute.server_external_events [req-0905ec2b-7fb6-404b-8881-7c7e457bff88 req-d12bb054-09dc-4228-b112-2ad7fb4568fa service nova] Creating event network-vif-deleted:5a7befd1-ed67-4a76-81ae-3cdd70577e7a for instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 on nch2-master-1 Jun 25 22:21:38.011247 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [req-0905ec2b-7fb6-404b-8881-7c7e457bff88 req-d12bb054-09dc-4228-b112-2ad7fb4568fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033689 Jun 25 22:21:38.011862 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3479/7412] 10.222.0.39 () {64 vars in 1317 bytes} [Sat Jun 25 22:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 22:21:38.449680 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '>' {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:38.450623 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.compute.api [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] [instance: 267e0907-7f3e-4f71-afc0-66f31843d5f3] Fetching instance by UUID {{(pid=137461) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 22:21:38.461921 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:38.462387 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:38.463186 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 22:21:38.463627 ncdv-master-1 devstack@n-api.service[137461]: DEBUG oslo_concurrency.lockutils [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Lock "db7644c9-31fa-4cfc-be56-1224ee9c28fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137461) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 22:21:38.477810 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.wsgi [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] HTTP exception thrown: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Request method failure captured: Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: request: GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 HTTP/1.1 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Accept: application/json Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Accept-Encoding: identity Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Connection: close Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Content-Length: 0 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Content-Type: application/json Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Host: 10.222.0.39 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: Openstack-System-Scope: None Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: User-Agent: python-urllib3/1.26.9 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Auth-Token: gAAAAABit4kCvx_Ji_eRaFxEHFfkMof0LxJf_OcbA_CA_JTGTS5msX6ttDioF4j-Yxo8CbyyeHoBu2gbvR4B8y7UMOFI_8J-y5cNvyGw2XxXyQMSxLkUBvT-6IGc-GcZ2Glg_PlEBIpvhfT7uWzXCFIl2SZC7qS6W8c3v38BEXw4Xtsc3_-GAlk Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Id: None Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Domain-Name: None Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Identity-Status: Confirmed Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Is-Admin-Project: True Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Id: default Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Domain-Name: Default Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Id: 2f2229a0064b42d88f84448115ff450a Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Project-Name: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Role: member,reader Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Roles: member,reader Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2f2229a0064b42d88f84448115ff450a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f2229a0064b42d88f84448115ff450a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2f2229a0064b42d88f84448115ff450a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2f2229a0064b42d88f84448115ff450a"}]}] Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Id: 2f2229a0064b42d88f84448115ff450a Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-Tenant-Name: tempest-TestSnapshotPattern-1009245234 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-User: tempest-TestSnapshotPattern-1009245234-project Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Id: default Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Domain-Name: Default Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Id: 6d3934c5660947f28734aefe3cb1c9b9 Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: X-User-Name: tempest-TestSnapshotPattern-1009245234-project Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: method: > Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: exception: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: action_args: {'id': '267e0907-7f3e-4f71-afc0-66f31843d5f3'} Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: {{(pid=137461) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 22:21:38.479477 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: ERROR nova.api.openstack.wsgi Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: DEBUG nova.api.openstack.wsgi [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Returning 404 to user: Instance 267e0907-7f3e-4f71-afc0-66f31843d5f3 could not be found. {{(pid=137461) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: INFO nova.api.openstack.requestlog [None req-c0e36dd0-f170-4774-9c4c-02b9daae2922 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3" status: 404 len: 111 microversion: 2.1 time: 0.038118 Jun 25 22:21:38.484965 ncdv-master-1 devstack@n-api.service[137461]: [pid: 137461|app: 0|req: 3934/7413] 10.222.0.39 () {58 vars in 1235 bytes} [Sat Jun 25 22:21:38 2022] GET /compute/v2.1/servers/267e0907-7f3e-4f71-afc0-66f31843d5f3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 22:21:38.655107 ncdv-master-1 devstack@n-api.service[137462]: DEBUG nova.api.openstack.wsgi [None req-ef609dea-18a3-46c1-a20b-0626e50b2e35 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] Calling method '.version_select at 0x7f984c0c14c0>' {{(pid=137462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 22:21:38.680611 ncdv-master-1 devstack@n-api.service[137462]: INFO nova.api.openstack.requestlog [None req-ef609dea-18a3-46c1-a20b-0626e50b2e35 tempest-TestSnapshotPattern-1009245234 tempest-TestSnapshotPattern-1009245234-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1677713102" status: 202 len: 0 microversion: 2.1 time: 0.029709 Jun 25 22:21:38.681204 ncdv-master-1 devstack@n-api.service[137462]: [pid: 137462|app: 0|req: 3480/7414] 10.222.0.39 () {58 vars in 1256 bytes} [Sat Jun 25 22:21:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1677713102 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 22:21:49.112884 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:21:49.113451 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:21:49.181095 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:21:49.181296 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:21:49.374159 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:21:49.374970 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:21:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:23:39.018577 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:23:39.019332 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:25:09.122817 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:25:09.123442 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:25:09.190583 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:25:09.190895 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:25:09.384487 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:25:09.385302 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:25:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:26:59.031854 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:26:59.032889 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:27:17.998392 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:27:17.999228 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:27:18.013875 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:27:18.014124 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:27:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:28:29.133312 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:28:29.134260 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:28:29.201634 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:28:29.201899 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:28:29.397999 ncdv-master-1 devstack@n-api.service[137462]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:28:29.398584 ncdv-master-1 devstack@n-api.service[137462]: Sat Jun 25 22:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 22:30:19.045339 ncdv-master-1 devstack@n-api.service[137461]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 22:30:19.046202 ncdv-master-1 devstack@n-api.service[137461]: Sat Jun 25 22:30:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!